-- Logs begin at Fri 2022-10-28 17:20:30 UTC, end at Fri 2022-10-28 19:52:32 UTC. -- Oct 28 17:52:01.864835 n-d-862404-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 17:52:01.874271 n-d-862404-2 devstack@n-api.service[104616]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 17:52:01 2022] *** Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: nodename: n-d-862404-2 Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: machine: x86_64 Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: clock source: unix Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: pcre jit disabled Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: detected number of CPU cores: 4 Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: current working directory: / Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: detected binary path: /usr/bin/uwsgi-core Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: your processes number limit is 47680 Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: your memory page size is 4096 bytes Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: detected max file descriptor number: 2048 Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: lock engine: pthread robust mutexes Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: thunder lock: enabled Oct 28 17:52:01.876685 n-d-862404-2 devstack@n-api.service[104616]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 17:52:01.877860 n-d-862404-2 devstack@n-api.service[104616]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 17:52:01.915941 n-d-862404-2 devstack@n-api.service[104616]: Python main interpreter initialized at 0x5618a05979c0 Oct 28 17:52:01.915941 n-d-862404-2 devstack@n-api.service[104616]: python threads support enabled Oct 28 17:52:01.915941 n-d-862404-2 devstack@n-api.service[104616]: your server socket listen backlog is limited to 100 connections Oct 28 17:52:01.915941 n-d-862404-2 devstack@n-api.service[104616]: your mercy for graceful operations on workers is 90 seconds Oct 28 17:52:01.916287 n-d-862404-2 devstack@n-api.service[104616]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 17:52:01.916362 n-d-862404-2 devstack@n-api.service[104616]: *** Operational MODE: preforking *** Oct 28 17:52:01.916608 n-d-862404-2 devstack@n-api.service[104616]: *** uWSGI is running in multiple interpreter mode *** Oct 28 17:52:01.916608 n-d-862404-2 devstack@n-api.service[104616]: spawned uWSGI master process (pid: 104616) Oct 28 17:52:01.916798 n-d-862404-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 17:52:01.924010 n-d-862404-2 devstack@n-api.service[104616]: spawned uWSGI worker 1 (pid: 104617, cores: 1) Oct 28 17:52:01.924010 n-d-862404-2 devstack@n-api.service[104616]: spawned uWSGI worker 2 (pid: 104618, cores: 1) Oct 28 17:52:01.924010 n-d-862404-2 devstack@n-api.service[104616]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 17:52:02.577819 n-d-862404-2 devstack@n-api.service[104618]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 17:52:02.592391 n-d-862404-2 devstack@n-api.service[104617]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 17:52:03.659363 n-d-862404-2 devstack@n-api.service[104618]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:52:03.659363 n-d-862404-2 devstack@n-api.service[104618]: from cryptography.utils import int_from_bytes Oct 28 17:52:03.659980 n-d-862404-2 devstack@n-api.service[104618]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:52:03.659980 n-d-862404-2 devstack@n-api.service[104618]: from cryptography.utils import int_from_bytes Oct 28 17:52:03.663567 n-d-862404-2 devstack@n-api.service[104617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:52:03.663567 n-d-862404-2 devstack@n-api.service[104617]: from cryptography.utils import int_from_bytes Oct 28 17:52:03.664042 n-d-862404-2 devstack@n-api.service[104617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:52:03.664042 n-d-862404-2 devstack@n-api.service[104617]: from cryptography.utils import int_from_bytes Oct 28 17:52:06.153362 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 17:52:06.153880 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 17:52:06.154141 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 17:52:06.154503 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 17:52:06.154757 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 17:52:06.155139 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.155365 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 17:52:06.155725 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.155838 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 17:52:06.155935 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.156085 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.156177 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 17:52:06.156412 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.156506 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 17:52:06.156719 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.156805 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 17:52:06.157038 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.157123 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.157352 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.157452 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.157681 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.157817 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.157939 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.158039 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.158251 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.158350 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.158568 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862404-2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.158656 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.158884 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.158977 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.159187 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.159273 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.159492 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.159577 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.159805 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.159917 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.160130 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.160230 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.160448 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.160534 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862404-2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.160749 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.160836 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.161063 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.161264 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.161371 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.161684 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.161781 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.161986 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.162077 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.162295 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.162385 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.162595 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.162795 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.162946 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.163107 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.163251 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.163420 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.163561 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.163725 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.163899 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.164067 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.164221 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.164404 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.165072 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.165413 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.165570 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862404-2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.165730 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.165874 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.166034 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.166170 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.166364 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.166475 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.166675 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.166781 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.166986 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.167077 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.167336 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.167433 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862404-2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.167653 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.167778 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.168000 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.168103 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.168310 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.168407 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.168633 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.168723 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.168950 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.169049 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.169267 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.169357 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.169582 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.169672 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.169881 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.169986 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.170182 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.170278 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.170488 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.170585 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.170805 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.170910 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.171106 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.171202 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.171407 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.171497 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.171657 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.171763 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.171987 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.172076 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.172310 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.172395 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.172629 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.172729 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.172942 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.173036 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.173190 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.173286 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.173440 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.173545 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.173755 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.173841 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.174424 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.174542 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.174612 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.174676 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.174744 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.174808 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.174939 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.175096 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.175188 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.175317 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.175494 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.175582 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.175826 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.175916 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.176142 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.176230 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.176445 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.176551 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.176752 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.176850 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.177060 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.177148 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.177367 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.177464 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.177670 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.177765 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.177972 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.178057 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.178278 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.178378 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.178595 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.178682 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.178896 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.178983 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.179217 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.179315 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.179531 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.179617 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.179854 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.179961 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.180811 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.180990 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.181140 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.181283 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.181383 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.181472 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.181713 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.181809 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.182017 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.182105 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.182324 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.182423 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.182646 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.182734 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.182946 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.183032 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.183196 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.183290 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.183495 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.183583 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.183798 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.183943 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.184142 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.184227 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.184453 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.184542 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.184757 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.184843 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.185016 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.185102 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.185318 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.185460 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.185624 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.185710 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.185922 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.186023 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.186225 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.186321 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.186529 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.186637 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.186832 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.186936 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.187130 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.187226 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.187429 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.187520 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.187731 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.187853 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.188056 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.188148 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.188358 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.188448 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.188660 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.188758 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.188965 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.189055 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.189264 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.189360 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.189564 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.189664 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.189865 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.189954 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.190163 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.190261 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.190478 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.190576 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.190778 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.190868 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.191079 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.191182 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.191380 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.191470 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.191681 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.191778 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.192006 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.192101 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.192322 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.192421 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.192627 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.192716 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.192925 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.193021 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.193238 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.193332 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.193536 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.193626 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.193838 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.193926 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.194164 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.194262 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.194449 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.194538 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.194746 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.194842 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.195296 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.195388 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.195600 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.195698 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.195944 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.196038 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.196277 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.196411 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.196583 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.196746 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.196888 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.197005 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.197192 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.197307 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.197496 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.197622 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.197798 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.197942 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.198106 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.198253 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.198409 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.198556 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.198711 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.198859 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.199010 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.199173 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.199328 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.199504 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.199652 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.199847 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.199984 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.200191 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.200286 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.200501 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.200593 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.200827 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.200915 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:52:06.201158 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.201250 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.201473 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.201568 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.201784 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.201870 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.202095 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.202189 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.202417 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.202512 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.202726 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.202814 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.203034 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.203121 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.203340 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.203438 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.203654 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.203741 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.204001 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.204099 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.204320 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.204408 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.204637 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.204733 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.204947 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.205032 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.205261 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.205360 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.205571 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.205669 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.205888 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.205980 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.206201 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.206290 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.206518 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.206608 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.206824 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.206914 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.207129 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.207220 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.207447 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.207539 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.207773 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.207898 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.208118 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.208208 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.208429 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.208518 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.208734 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.208823 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.209042 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.209133 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.209348 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.209447 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.209682 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.209782 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.209992 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.210090 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.210302 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.210399 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.210614 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.210712 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.210922 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.211011 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.211242 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.211336 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.211698 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.211796 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.212041 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.212132 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.212364 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.212512 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.212676 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.212832 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.213002 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.213146 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.213316 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.213492 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.213636 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.213778 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.213914 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.214047 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.214223 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.214397 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.214547 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.214693 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.214859 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.215000 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.215170 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.215313 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.215473 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.215609 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.215774 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.215951 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.216088 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.216222 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.216372 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.216509 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.216679 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.216821 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.216987 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.217129 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.217272 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.217419 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.217591 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.217732 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.217878 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.218021 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.218186 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.218335 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.218496 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.218647 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.218804 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.218955 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.219098 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.219242 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.219399 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.219548 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.219707 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.219882 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.220046 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.220188 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.220354 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.220497 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.220661 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.220812 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.220956 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.221091 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.221269 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.221417 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.221565 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.221701 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.221861 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.222011 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.222173 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.222315 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.222458 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.222599 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.222760 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.222909 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.223072 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.223232 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.223428 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.223575 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.223717 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.223884 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.224042 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.224185 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.224340 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.224483 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.224624 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.224772 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.224916 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.225064 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.225217 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.225365 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.225512 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.225652 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.225793 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.225945 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.226087 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.226235 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.226376 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.226516 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.226691 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.226919 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.227564 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.227706 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.227922 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.228079 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.228232 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.228383 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.228526 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.228667 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.228854 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.229005 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.229155 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.229296 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.229437 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.229588 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.229729 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.229870 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.230025 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.230180 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.230322 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.230462 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.230603 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.230743 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.230892 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.231043 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.231187 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.231327 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.231485 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.231635 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.231792 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.231968 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.232165 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.232314 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.232456 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.232604 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.232753 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.232894 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.233048 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.233189 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.233330 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.233489 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.233631 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.233778 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.233919 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.234059 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.234199 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.234384 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.234531 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.234672 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.234813 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.234953 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.235124 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.235290 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.235436 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.235576 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.235716 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.235923 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.236082 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.236223 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.236371 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.236512 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.236654 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.236794 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.236943 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.237085 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.237251 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.237393 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.237543 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.237722 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.237879 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.238029 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.238174 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.238315 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.238456 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.238597 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.238755 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.238897 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.239052 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.239205 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.239345 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.239493 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.239648 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.239790 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.239969 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.240145 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.240295 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.240445 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.240589 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.240730 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.240871 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.241012 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.241164 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.241318 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.241461 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.241601 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.241749 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.241890 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.242031 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.242180 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.242323 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.242463 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.243312 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.243471 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.243614 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.243777 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.243970 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.244115 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.244256 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.244397 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.244554 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.244704 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.244846 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.245011 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.245169 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.245339 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.245491 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.245634 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.245785 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.245960 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.246110 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.246274 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.246432 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.246575 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.246716 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.246889 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.247038 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.247180 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.247330 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.247472 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.247632 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.247783 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.247960 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.248116 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.248265 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.248431 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.248579 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.248721 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.248873 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.249024 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.249166 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.249308 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.249449 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.249604 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.249745 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.249894 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.250038 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.250187 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.250329 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.250477 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.250618 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.250766 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.250908 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.251050 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.251191 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.251332 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.251491 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.251634 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.251775 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.251953 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.252097 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.252239 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.252388 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.252531 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.252679 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.252820 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.252961 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.253101 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.253251 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.253404 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.253545 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.253685 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.253853 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.254003 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.254154 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.254303 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.254445 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.254587 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.254756 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.254915 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.255066 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.255219 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.255361 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.255508 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.255650 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.255933 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.256085 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.256227 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.256375 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.256525 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.256674 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.256829 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.256971 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.257111 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.257271 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.257414 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.257563 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.257713 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.257855 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.257997 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.258144 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.258322 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.258477 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.258629 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.258780 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.258973 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.259123 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.259274 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.259423 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.259566 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.259707 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.259902 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.260062 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.260205 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.260359 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.260512 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.260660 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.260809 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.260951 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.261092 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.261258 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.261400 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.261541 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.261682 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.261823 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.262003 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.262220 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.262371 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.262556 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.262715 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.262858 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.263007 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.263161 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.263454 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.263656 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.263852 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.264011 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.264155 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.264304 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.264446 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.264588 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.264743 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.264895 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.265045 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.265188 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.265338 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.265487 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.265637 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.265779 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.265919 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.266059 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.266231 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.266382 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.266523 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.266673 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.266823 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.266972 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.267122 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.267274 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.267416 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.267568 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.267711 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.267902 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.268067 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.268211 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.268351 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.268492 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.268641 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.268792 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.268953 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.269100 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.269253 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.269394 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.269534 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.269683 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.269826 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.269967 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.270109 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.270256 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.270398 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.270551 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.270694 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.270835 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.270987 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.271128 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.271275 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.271425 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.271568 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.271708 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.271870 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.272019 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.272161 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.272314 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.272457 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.272598 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.272782 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.272944 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.273097 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.273246 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.273388 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.273529 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.273671 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.273811 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.274072 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.274232 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.274375 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.274525 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.274675 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.274818 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.274983 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.275128 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.275269 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.275410 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.275558 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.275708 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.275888 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.276037 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.276180 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.276322 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.276462 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.276614 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.276767 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.276916 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.277057 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.277199 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.277340 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.277512 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.277663 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.277811 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.277953 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.278102 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.278244 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.278398 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.278540 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.278692 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.278832 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.278979 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.279126 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.279345 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.279497 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.279639 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.279788 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.279993 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.280147 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.280288 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.280432 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.280572 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.280724 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.280865 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.281014 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.281155 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.281295 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.281436 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.281577 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.281717 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.281866 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.282007 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.282148 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.282288 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.282428 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.282580 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.282729 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.282871 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.283018 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.283159 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.283299 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.283447 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.283590 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.283730 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.283917 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.284066 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.284208 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.284361 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.284513 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.284655 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.284804 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.284945 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.285093 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.285248 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.285390 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.285531 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.285673 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.285814 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.285954 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.286102 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.286257 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.286399 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.286540 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.286687 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.286842 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.286985 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.287126 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.287266 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.287415 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.287564 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.287715 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.287889 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.288039 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.288196 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.288338 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.288478 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.288628 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.288779 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.288927 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.289076 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.289218 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.289364 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.290026 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.290287 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.290506 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.290704 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.290869 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.291022 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.291166 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.291308 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.291449 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.291590 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.291731 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.291938 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.292089 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.292238 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.292380 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.292521 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.292669 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.292828 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.292977 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.293120 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.293260 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.293400 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.293540 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.293688 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.293829 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.293976 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.294118 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.294259 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.294408 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.294551 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.294702 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.294843 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.294983 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.295124 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.295283 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.295426 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.295567 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.295707 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.295868 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.296016 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.296170 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.296319 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.296472 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.296613 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.296753 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.296893 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.297041 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.297183 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.297323 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.297470 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.297612 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.297760 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.297902 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.298042 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.298181 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.298332 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.298473 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.298622 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.298763 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.298910 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.299058 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.299200 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.299341 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.299505 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.299649 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.299790 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.299959 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.300102 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.300263 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.300420 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.300569 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.300712 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.300851 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.300998 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.301147 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.301296 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.301439 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.301579 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.301720 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.301861 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.302009 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.302167 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.302309 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.302458 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.302605 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.302748 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.302897 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.303040 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.303181 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.303321 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.303461 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.303602 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.303750 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.303941 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.304085 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.304237 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.304386 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.304541 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.304682 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.304823 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.304963 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.305159 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.305860 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.306090 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.306241 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.306383 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.306536 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.306679 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.306820 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.306970 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.307119 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.307268 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.307410 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.307552 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.307694 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.307938 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.308089 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.308232 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.308373 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.308525 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.308665 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.308821 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.308964 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.309105 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.309245 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.309393 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.309546 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.309691 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.309832 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.309981 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.310132 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.310309 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.310479 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.310630 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.310773 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.310914 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.311061 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.311257 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.311415 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.311565 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.311713 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.311898 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.312057 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.312213 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.312375 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.312561 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.312712 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.312853 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.312994 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.313168 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.313320 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.313485 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.313632 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.313793 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.313943 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.314088 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.314237 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.314398 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.314548 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.314690 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.314838 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.314979 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.315122 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.315272 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.315414 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.315582 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.315731 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.315913 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.316068 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.316220 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.316381 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.316523 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.316665 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.316806 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.316946 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.317122 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.317274 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.317441 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.317590 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.317845 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.318074 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.318234 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.318393 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.318538 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.318678 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.318819 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.318967 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.319109 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.319251 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.319392 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.319540 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.319686 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.319900 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.320300 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.320444 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.320605 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.320770 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.320929 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.321127 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.321277 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.321428 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.321570 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.321710 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.321867 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.322011 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.322152 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.322291 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.322460 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.322621 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.322772 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.322915 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.323080 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.323231 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.323372 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.323562 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.323714 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.323889 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.324050 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.324202 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.324344 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.324495 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.324655 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.324797 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.324938 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.325086 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.325234 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.325387 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.325531 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.325672 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.325812 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.325952 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.326093 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.326242 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.326397 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.326539 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.326689 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.326831 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.326995 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.327154 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.327321 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.327470 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.327613 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.327754 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.327962 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.328108 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.328250 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.328402 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.328543 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.328685 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.328835 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.328978 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.329144 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.329294 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.329466 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.329623 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.329799 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.329956 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.330121 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.330276 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.330442 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.330586 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.330735 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.330877 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.331018 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.331158 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.331298 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.331450 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.331594 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.331734 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.331906 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.332062 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.332256 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.332412 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.332555 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.332696 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.332839 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.332980 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.333121 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.333273 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.333416 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.333557 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.333698 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.333839 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.333982 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.334141 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.334291 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.334467 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.334614 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.334755 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.334904 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.335055 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.335197 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.335345 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.335487 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.335627 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.335783 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.335943 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.336058 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.336146 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.336307 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.337027 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.337240 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.337395 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.337560 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.337717 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.337861 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.338002 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.338158 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.338302 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.338474 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.338642 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.338786 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.338940 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.339082 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.339224 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.339372 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.339514 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.339678 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.339872 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.340023 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.340174 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.340356 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.340508 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.340650 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.340800 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.341002 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.341150 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.341318 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.341469 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.341633 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.341792 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.341942 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.342085 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.342234 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.342385 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.342545 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.342695 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.342837 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.342985 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.343198 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.343348 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.343498 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.343665 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.343929 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.344083 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.344225 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.344379 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.344543 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.344686 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.344827 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.344968 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.345109 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.345258 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.345401 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.345543 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.345710 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.345861 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.346033 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.346192 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.346344 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.346499 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.346641 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.346782 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.346983 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.347213 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.347368 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.347511 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.347654 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.347801 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.347985 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.348128 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.348282 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.348432 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.348576 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.348716 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.348867 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.349009 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.349150 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.349291 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.349436 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.349585 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.349729 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.349870 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.350069 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.350219 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.350374 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.350530 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.350675 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.350816 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.350957 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.351105 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.351248 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.351398 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.351540 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.351682 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.351870 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.352596 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.352782 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.352956 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.353145 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.353295 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.353469 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.353619 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.353775 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.353989 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.354139 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.354306 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.354456 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.354637 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.354795 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.354962 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.355112 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.355285 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.355435 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.355586 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.355728 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.355927 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.356168 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.356318 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.356493 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.356654 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.356833 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.356985 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.357126 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.357266 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.357437 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.357594 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.357738 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.357879 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.358049 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.358198 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.358360 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.358519 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.358680 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.358822 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.358964 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.359105 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.359254 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.359403 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.359581 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.359771 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.359965 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.360123 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.360274 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.360435 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.360579 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.360731 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.360882 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.361053 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.361218 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.361361 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.361502 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.361643 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.361927 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.362077 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.362254 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.362403 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.362545 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.362687 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.362842 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.362992 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.363135 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.363276 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.363419 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.363560 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.363755 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.363956 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.364103 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.364245 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.364387 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.364529 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.364681 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.364841 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.364985 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.365126 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.365267 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.365415 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.365557 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.365707 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.365850 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.365991 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.366132 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.366281 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.366433 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.366588 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.366731 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.366872 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.367020 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.367169 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.367320 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.367463 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.367627 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.367784 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.367939 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.368164 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.368273 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.368518 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.368607 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.368830 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.368919 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.369147 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.369250 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.369454 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.369543 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.369756 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.369845 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.370069 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.370180 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.370374 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.370462 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.370688 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.370781 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.370991 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.371078 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.371293 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.371379 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.371597 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.371682 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.371925 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.372015 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.372248 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.372347 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.372559 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.372645 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.372869 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.372955 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.373192 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.373277 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.373498 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.373592 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.373805 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.374025 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.374112 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.374358 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.374443 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.374677 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.374772 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.375007 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.375094 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.375318 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.375402 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.375624 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.375709 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.376018 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.376119 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.376325 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.376592 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.376771 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.376933 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.377093 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.377245 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.377388 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.377542 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.377686 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.377829 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.377972 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.378114 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.378255 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.378409 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.378552 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.378693 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.378853 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.378997 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.379168 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.379321 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.379471 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.379615 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.379756 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.379961 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.380119 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.380263 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.380411 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.380554 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.380707 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.380849 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.381001 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.381145 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.381287 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.381429 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.381571 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.381712 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.381863 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.382006 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.382148 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.382290 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.382441 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.382591 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.382735 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.382877 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.383019 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.383161 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.383332 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.383490 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.383634 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.383899 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.384058 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.384203 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.384347 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.384514 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.384661 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.384804 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.384946 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.385088 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.385239 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.385490 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.385639 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.385782 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.385932 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.386076 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.386254 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.386418 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.386583 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.386741 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.386885 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.387027 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.387179 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.387322 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.387500 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.387651 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.387794 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.388139 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.388290 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.388446 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.388589 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.388762 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.388914 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.389097 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.389249 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.389423 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.389572 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.389743 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.389894 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.390045 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.390188 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.390330 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.390482 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.390626 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.390766 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.390916 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.391064 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.391206 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.391347 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.391498 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.391649 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.391791 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.391974 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.392118 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.392300 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.392453 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.392606 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.392749 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.392891 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.393033 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.393173 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.393320 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.393476 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.393619 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.393768 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.393911 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.394076 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.394245 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.394389 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.394529 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.394671 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.394812 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.394952 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.395102 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.395244 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.395392 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.395534 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.395674 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.395847 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.396011 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.396166 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.396308 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.396449 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.396590 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.396731 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.396893 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.397047 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.397198 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.397352 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.397495 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.397645 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.397788 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.397930 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.398081 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.398223 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.398364 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.398513 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.398654 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.398795 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.399467 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.399621 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.399765 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.399953 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.400100 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.400249 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.400403 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.400545 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.400686 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.400836 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.400979 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.401121 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.401263 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.401430 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.401589 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.401761 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.401918 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.402063 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.402204 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.402382 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.402541 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.402684 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.402833 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.402983 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.403126 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.403267 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.403416 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.403594 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.403745 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.403952 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.404105 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.404250 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.404418 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.404569 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.404712 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.404860 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.405013 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.405232 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.405379 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.405520 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.405661 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.405802 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.405950 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.406101 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.406264 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.406414 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.406556 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.406698 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.406839 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.406989 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.407132 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.407273 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.407416 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.407569 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.407720 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.407898 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.408058 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.408207 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.408351 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.408491 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.408641 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.408783 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.408924 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.409072 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.409214 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.409355 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.409506 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.409649 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.409790 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.409939 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.410081 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.410230 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.410373 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.410515 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.410663 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.410841 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.410990 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.411141 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.411283 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.411452 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.411601 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.411774 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.411963 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.412117 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.412259 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.412401 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.412544 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.412693 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.412843 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.412986 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 17:52:06.413127 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.413354 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.413699 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.414012 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.414353 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.415266 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.415584 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.415921 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.416233 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:52:06.416478 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 17:52:06.566409 n-d-862404-2 devstack@n-api.service[104618]: INFO dbcounter [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Registered counter for database nova_api Oct 28 17:52:06.568704 n-d-862404-2 devstack@n-api.service[104617]: INFO dbcounter [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Registered counter for database nova_api Oct 28 17:52:06.589664 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_db.sqlalchemy.engines [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:52:06.591390 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_db.sqlalchemy.engines [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:52:06.596395 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writer thread running {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:52:06.597903 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writer thread running {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:52:06.652856 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.context [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43f74929-bc21-41df-9120-e6be09c18015(cell1) {{(pid=104618) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 17:52:06.655194 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.context [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43f74929-bc21-41df-9120-e6be09c18015(cell1) {{(pid=104617) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 17:52:06.656730 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_concurrency.lockutils [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:06.657206 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_concurrency.lockutils [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:06.658795 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_concurrency.lockutils [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:06.659045 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:06.659503 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_concurrency.lockutils [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:06.659595 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:06.659972 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_concurrency.lockutils [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:06.661164 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:06.661883 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:06.661971 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_concurrency.lockutils [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:06.662333 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:06.663955 n-d-862404-2 devstack@n-api.service[104618]: INFO dbcounter [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Registered counter for database nova_cell0 Oct 28 17:52:06.664376 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:06.667087 n-d-862404-2 devstack@n-api.service[104617]: INFO dbcounter [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Registered counter for database nova_cell0 Oct 28 17:52:06.668823 n-d-862404-2 devstack@n-api.service[104618]: INFO dbcounter [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Registered counter for database nova_cell1 Oct 28 17:52:06.671150 n-d-862404-2 devstack@n-api.service[104617]: INFO dbcounter [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Registered counter for database nova_cell1 Oct 28 17:52:06.676738 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_db.sqlalchemy.engines [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:52:06.680017 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_db.sqlalchemy.engines [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:52:06.680183 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_db.sqlalchemy.engines [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:52:06.681960 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_db.sqlalchemy.engines [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:52:06.686615 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writer thread running {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:52:06.687774 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writer thread running {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:52:06.690032 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writer thread running {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:52:06.691786 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writer thread running {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:52:06.833058 n-d-862404-2 devstack@n-api.service[104617]: INFO dbcounter [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Registered counter for database nova_cell0 Oct 28 17:52:06.833414 n-d-862404-2 devstack@n-api.service[104618]: INFO dbcounter [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Registered counter for database nova_cell0 Oct 28 17:52:06.842524 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_db.sqlalchemy.engines [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:52:06.846073 n-d-862404-2 devstack@n-api.service[104618]: DEBUG oslo_db.sqlalchemy.engines [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:52:06.847324 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writer thread running {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:52:06.850939 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writer thread running {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:52:07.189076 n-d-862404-2 devstack@n-api.service[104617]: WARNING keystonemiddleware.auth_token [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:52:07.189589 n-d-862404-2 devstack@n-api.service[104618]: WARNING keystonemiddleware.auth_token [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:52:07.197240 n-d-862404-2 devstack@n-api.service[104618]: WARNING keystonemiddleware.auth_token [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:52:07.197447 n-d-862404-2 devstack@n-api.service[104617]: WARNING keystonemiddleware.auth_token [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:52:07.542866 n-d-862404-2 devstack@n-api.service[104617]: WARNING keystonemiddleware.auth_token [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:52:07.549390 n-d-862404-2 devstack@n-api.service[104617]: WARNING keystonemiddleware.auth_token [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:52:07.553505 n-d-862404-2 devstack@n-api.service[104618]: WARNING keystonemiddleware.auth_token [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:52:07.554720 n-d-862404-2 devstack@n-api.service[104617]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618a05979c0 pid: 104617 (default app) Oct 28 17:52:07.557405 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:07.558594 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Oct 28 17:52:07.559010 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Fri Oct 28 17:52:07 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:07.560199 n-d-862404-2 devstack@n-api.service[104618]: WARNING keystonemiddleware.auth_token [None req-39614b6c-1410-4d6d-a658-dafd0e754eb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:52:07.565519 n-d-862404-2 devstack@n-api.service[104618]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618a05979c0 pid: 104618 (default app) Oct 28 17:53:29.098610 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:29.099730 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 28 17:53:29.100174 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:29.113096 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writing DB stats nova_api:SELECT=3 {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:29.114022 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writing DB stats nova_cell1:SELECT=3 {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:29.115490 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writing DB stats nova_cell0:SELECT=3 {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:29.117895 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:29.984725 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-fea9b598-2393-4229-a660-50667ca7e45c admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:30.022542 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-fea9b598-2393-4229-a660-50667ca7e45c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914286 Oct 28 17:53:30.023853 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 17:53:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:32.678970 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:32.680015 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-7e3464dc-64ed-47cb-9f59-9b7e84e5141f None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 28 17:53:32.685355 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:32 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:33.137756 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-ce5cb0fb-e031-4c28-ad3f-d5ef275e1f67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:33.185345 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-ce5cb0fb-e031-4c28-ad3f-d5ef275e1f67 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498631 Oct 28 17:53:33.186155 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:53:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:53:33.199992 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writing DB stats nova_api:SELECT=3 {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:33.200784 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writing DB stats nova_cell0:SELECT=3 {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:33.201730 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writing DB stats nova_cell1:SELECT=3 {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:33.203194 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:33.415084 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-f63d3837-5eea-4c31-ba08-3e8f5641ef1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:33.485652 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-f63d3837-5eea-4c31-ba08-3e8f5641ef1b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291078 Oct 28 17:53:33.486722 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 17:53:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:36.148172 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-ce5cb0fb-e031-4c28-ad3f-d5ef275e1f67 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:36.149362 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-ce5cb0fb-e031-4c28-ad3f-d5ef275e1f67 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001684 Oct 28 17:53:36.149895 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:36.994658 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-804cb0cc-39cb-45ea-8ea2-131d4941aa5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:37.052744 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-804cb0cc-39cb-45ea-8ea2-131d4941aa5d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.895174 Oct 28 17:53:37.053703 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:53:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:53:37.068714 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-f33c212c-c1d5-4a89-87a0-4b9c59c42d7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:37.129373 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-f33c212c-c1d5-4a89-87a0-4b9c59c42d7f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065709 Oct 28 17:53:37.130001 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 17:53:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:39.967848 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-804cb0cc-39cb-45ea-8ea2-131d4941aa5d admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:39.968886 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-804cb0cc-39cb-45ea-8ea2-131d4941aa5d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 28 17:53:39.969300 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:40.564638 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-8ae2a7fe-c5ae-4081-921f-2bdd5962385e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G"}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:40.585102 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-8ae2a7fe-c5ae-4081-921f-2bdd5962385e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.609542 Oct 28 17:53:40.585889 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:53:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:53:40.597659 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-b8d7c2d4-9361-42bd-abcc-f43e5d6bdbde admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:40.625857 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-b8d7c2d4-9361-42bd-abcc-f43e5d6bdbde admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031705 Oct 28 17:53:40.626550 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 17:53:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:43.295998 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-8ae2a7fe-c5ae-4081-921f-2bdd5962385e admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:43.297011 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-8ae2a7fe-c5ae-4081-921f-2bdd5962385e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 28 17:53:43.297695 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:43.762407 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-ef26339c-1ff0-4e23-8304-2f04247a922a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:43.796968 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-ef26339c-1ff0-4e23-8304-2f04247a922a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491842 Oct 28 17:53:43.797615 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:53:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:53:43.811759 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-e0b6b331-96e0-4141-bdf3-c3bc33806164 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:43.845373 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-e0b6b331-96e0-4141-bdf3-c3bc33806164 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037502 Oct 28 17:53:43.845962 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 17:53:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:46.563378 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-ef26339c-1ff0-4e23-8304-2f04247a922a admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:46.564430 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-ef26339c-1ff0-4e23-8304-2f04247a922a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 28 17:53:46.565012 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:47.018921 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-65a1e315-dc5f-471d-9be9-8d2e6ed8eac3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "swap": 0}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:47.042921 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-65a1e315-dc5f-471d-9be9-8d2e6ed8eac3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471347 Oct 28 17:53:47.057435 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-fe384671-2190-4481-8506-49c587192e6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:47.063021 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:53:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:53:47.090011 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-fe384671-2190-4481-8506-49c587192e6a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036372 Oct 28 17:53:47.120960 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 17:53:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:49.736278 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-65a1e315-dc5f-471d-9be9-8d2e6ed8eac3 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:49.738084 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-65a1e315-dc5f-471d-9be9-8d2e6ed8eac3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 28 17:53:49.741853 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:50.250708 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-7069a371-1415-4f85-a9ce-8e4cddc4efeb admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:50.276411 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-7069a371-1415-4f85-a9ce-8e4cddc4efeb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.531993 Oct 28 17:53:50.276954 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 17:53:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:52.991402 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-65a1e315-dc5f-471d-9be9-8d2e6ed8eac3 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:52.992453 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-65a1e315-dc5f-471d-9be9-8d2e6ed8eac3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 28 17:53:52.992864 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:53.448711 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-618b22af-1c2b-4dab-8811-e30005c4d245 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:53.468339 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-618b22af-1c2b-4dab-8811-e30005c4d245 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467194 Oct 28 17:53:53.469203 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:53:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:53:53.486983 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-7ad0438e-98c1-4ffe-a828-b654c0f42383 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:53.521558 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-7ad0438e-98c1-4ffe-a828-b654c0f42383 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039449 Oct 28 17:53:53.522140 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 17:53:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:56.210858 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-618b22af-1c2b-4dab-8811-e30005c4d245 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:56.211909 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-618b22af-1c2b-4dab-8811-e30005c4d245 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 28 17:53:56.212315 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:56.622395 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-781958b9-c548-4742-8886-b325c495d895 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:56.641024 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-781958b9-c548-4742-8886-b325c495d895 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422701 Oct 28 17:53:56.641520 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:53:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:53:56.654109 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-94eb1cdf-f02f-44a3-b942-4ea4d7e8f6ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:56.678636 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-94eb1cdf-f02f-44a3-b942-4ea4d7e8f6ef admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028219 Oct 28 17:53:56.679213 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 17:53:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:59.284241 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-781958b9-c548-4742-8886-b325c495d895 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:59.285364 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-781958b9-c548-4742-8886-b325c495d895 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Oct 28 17:53:59.286011 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:59.659807 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-4c48d785-823d-4ae5-8e2c-00cf6d8b6f32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "vcpus": 2, "ram": 4096, "name": "m1.medium"}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:59.681631 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-4c48d785-823d-4ae5-8e2c-00cf6d8b6f32 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.388865 Oct 28 17:53:59.682698 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:53:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:53:59.694671 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-3c0c8895-2d34-4fec-ae88-fdf32a52ddb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:59.699865 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:59.723485 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-3c0c8895-2d34-4fec-ae88-fdf32a52ddb9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032699 Oct 28 17:53:59.725127 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 17:53:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:54:02.390779 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-4c48d785-823d-4ae5-8e2c-00cf6d8b6f32 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:02.391828 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-4c48d785-823d-4ae5-8e2c-00cf6d8b6f32 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 28 17:54:02.392246 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:02.834459 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-34bbf3a6-05b0-4cec-b249-3035fc0996b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "ram": 8192, "id": "4", "name": "m1.large"}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:02.854893 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-34bbf3a6-05b0-4cec-b249-3035fc0996b7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455812 Oct 28 17:54:02.855540 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:54:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:02.867747 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-a9a0ec0c-7ac6-4b13-ae4c-1b4416c4cd94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:02.893608 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-a9a0ec0c-7ac6-4b13-ae4c-1b4416c4cd94 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029536 Oct 28 17:54:02.894442 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 17:54:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:54:05.568718 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-34bbf3a6-05b0-4cec-b249-3035fc0996b7 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.570679 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-34bbf3a6-05b0-4cec-b249-3035fc0996b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002337 Oct 28 17:54:05.571322 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:06.013850 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-07b41ebf-f80a-4ac5-9c83-567b358b2fbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:06.021943 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:06.038906 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-07b41ebf-f80a-4ac5-9c83-567b358b2fbb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461480 Oct 28 17:54:06.039781 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 17:54:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:06.051430 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-cf701edf-9df8-4bbe-b3ba-265b83f16112 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:06.079729 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-cf701edf-9df8-4bbe-b3ba-265b83f16112 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031980 Oct 28 17:54:06.095845 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 17:54:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:26.924328 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-07b41ebf-f80a-4ac5-9c83-567b358b2fbb admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:26.925348 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-07b41ebf-f80a-4ac5-9c83-567b358b2fbb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 28 17:54:26.925755 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:54:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:26.936213 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:27.314473 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-d539ea9a-7631-4901-a72c-4c1dbf88c7e3 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:27.333199 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-d539ea9a-7631-4901-a72c-4c1dbf88c7e3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401418 Oct 28 17:54:27.333742 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 17:54:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:28.644993 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-07b41ebf-f80a-4ac5-9c83-567b358b2fbb admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:28.646025 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-07b41ebf-f80a-4ac5-9c83-567b358b2fbb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 28 17:54:28.646423 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 17:54:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:29.199176 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-ee237d02-f8ca-430e-b10d-cfd65c92b6c1 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:29.204493 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.wsgi [None req-ee237d02-f8ca-430e-b10d-cfd65c92b6c1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-ee237d02-f8ca-430e-b10d-cfd65c92b6c1 admin admin] Request method failure captured: Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: Accept: application/json Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: Accept-Encoding: gzip, deflate Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: Connection: keep-alive Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: Content-Length: 0 Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: Host: 10.222.0.16 Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: Openstack-Api-Version: compute 2.92 Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: Openstack-System-Scope: None Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: User-Agent: python-novaclient Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Auth-Token: gAAAAABjXBdUaPn_ZgBp3kU5eTVjaIFPcSz7DzY-CBj_2DWFLPJHnuF-HgjdNlFLWdrqtnn84cC97q1chCm6_V5HW_VvcJhHo9utpcn_uIaQSH_wHJOC7C6qWdRBSHq9cVu3f-528cFFQ3V4KB3awScKTNb4fHx1wtW1btBkkCpOIwbuYrEVwEo Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Domain-Id: None Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Domain-Name: None Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Identity-Status: Confirmed Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Is-Admin-Project: True Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Domain-Id: default Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Domain-Name: Default Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Name: admin Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Role: member,reader,admin Oct 28 17:54:29.207745 n-d-862404-2 devstack@n-api.service[104618]: X-Roles: member,reader,admin Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d283249e65f4780a0e2d3d9295b8fc8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant: admin Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant-Name: admin Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-User: admin Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-User-Domain-Id: default Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-User-Domain-Name: Default Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-User-Id: 39d74e0f698544f8a0905ee11faac3ad Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: X-User-Name: admin Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: method: > Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: exception: Flavor 42 could not be found. Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: action_args: {'id': '42'} Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:29.209424 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:29.210948 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.212219 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-ee237d02-f8ca-430e-b10d-cfd65c92b6c1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:29.213506 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-ee237d02-f8ca-430e-b10d-cfd65c92b6c1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398505 Oct 28 17:54:29.213506 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 17:54:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:54:29.220120 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-67f3d247-b171-4146-9f1a-ad3338112425 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:29.242205 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-67f3d247-b171-4146-9f1a-ad3338112425 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026296 Oct 28 17:54:29.242742 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 17:54:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:29.257664 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-e5b71413-b110-4a3f-a1d4-e5af7620a5af admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:29.280707 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-e5b71413-b110-4a3f-a1d4-e5af7620a5af admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027829 Oct 28 17:54:29.281381 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 17:54:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:29.293592 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-399fa0fb-a3f3-49e3-be3a-ab09185d46be admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:29.298977 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.wsgi [None req-399fa0fb-a3f3-49e3-be3a-ab09185d46be admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-399fa0fb-a3f3-49e3-be3a-ab09185d46be admin admin] Request method failure captured: Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: Accept: application/json Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: Accept-Encoding: gzip, deflate Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: Connection: keep-alive Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: Content-Length: 0 Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: Host: 10.222.0.16 Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: Openstack-Api-Version: compute 2.92 Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: Openstack-System-Scope: None Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: User-Agent: python-novaclient Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Auth-Token: gAAAAABjXBdUaPn_ZgBp3kU5eTVjaIFPcSz7DzY-CBj_2DWFLPJHnuF-HgjdNlFLWdrqtnn84cC97q1chCm6_V5HW_VvcJhHo9utpcn_uIaQSH_wHJOC7C6qWdRBSHq9cVu3f-528cFFQ3V4KB3awScKTNb4fHx1wtW1btBkkCpOIwbuYrEVwEo Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Domain-Id: None Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Domain-Name: None Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Identity-Status: Confirmed Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Is-Admin-Project: True Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Domain-Id: default Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Domain-Name: Default Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Name: admin Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Role: member,reader,admin Oct 28 17:54:29.302286 n-d-862404-2 devstack@n-api.service[104617]: X-Roles: member,reader,admin Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d283249e65f4780a0e2d3d9295b8fc8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant: admin Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant-Name: admin Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-User: admin Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-User-Domain-Id: default Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-User-Domain-Name: Default Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-User-Id: 39d74e0f698544f8a0905ee11faac3ad Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: X-User-Name: admin Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: method: > Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: exception: Flavor 42 could not be found. Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: action_args: {'id': '42'} Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:29.303915 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:29.304971 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:29.306256 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-399fa0fb-a3f3-49e3-be3a-ab09185d46be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:29.307516 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-399fa0fb-a3f3-49e3-be3a-ab09185d46be admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013773 Oct 28 17:54:29.307516 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 17:54:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 17:54:30.506236 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-e5b71413-b110-4a3f-a1d4-e5af7620a5af admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:30.507488 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-e5b71413-b110-4a3f-a1d4-e5af7620a5af admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Oct 28 17:54:30.508092 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 17:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:31.027283 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-0566a4c1-7426-4a9c-9ac3-b9e950dc9835 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:31.032382 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.wsgi [None req-0566a4c1-7426-4a9c-9ac3-b9e950dc9835 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-0566a4c1-7426-4a9c-9ac3-b9e950dc9835 admin admin] Request method failure captured: Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: Accept: application/json Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: Accept-Encoding: gzip, deflate Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: Connection: keep-alive Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: Content-Length: 0 Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: Host: 10.222.0.16 Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: Openstack-Api-Version: compute 2.92 Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: Openstack-System-Scope: None Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: User-Agent: python-novaclient Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Auth-Token: gAAAAABjXBdW7fegoIH8MNz3FRBmSk2_ggZPlZWGTs_4VkzcO3aAF8NzMQraNIe0DuqLcYv6PpyAU5_yP2MIfHEcCAcj_WzPUvghLj5n4K7jte0HiXGQ5EYFGRGzh1s1d70sh5rSeONZMp2BaAABx9O9SYp0s0sRLBqv2ikxdvn-rzSTe69B4e8 Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Domain-Id: None Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Domain-Name: None Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Identity-Status: Confirmed Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Is-Admin-Project: True Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Domain-Id: default Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Domain-Name: Default Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Name: admin Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Role: member,reader,admin Oct 28 17:54:31.033873 n-d-862404-2 devstack@n-api.service[104617]: X-Roles: member,reader,admin Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d283249e65f4780a0e2d3d9295b8fc8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant: admin Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant-Name: admin Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-User: admin Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-User-Domain-Id: default Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-User-Domain-Name: Default Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-User-Id: 39d74e0f698544f8a0905ee11faac3ad Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: X-User-Name: admin Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: method: > Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: exception: Flavor 84 could not be found. Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: action_args: {'id': '84'} Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:31.035239 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:31.036164 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.037663 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-0566a4c1-7426-4a9c-9ac3-b9e950dc9835 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:31.039001 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-0566a4c1-7426-4a9c-9ac3-b9e950dc9835 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389477 Oct 28 17:54:31.039001 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 17:54:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:54:31.045229 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-348f274c-b3b1-4ba6-9032-c5036d3987c6 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:31.060674 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-348f274c-b3b1-4ba6-9032-c5036d3987c6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018995 Oct 28 17:54:31.061456 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 17:54:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:31.071559 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-6247360e-fe3e-4f16-95a1-47cd50480ed6 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:31.086684 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-6247360e-fe3e-4f16-95a1-47cd50480ed6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019540 Oct 28 17:54:31.087218 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 17:54:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:31.096269 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-bbf105bc-3e33-4d76-87eb-6e1a375bc45e admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:31.101356 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.wsgi [None req-bbf105bc-3e33-4d76-87eb-6e1a375bc45e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-bbf105bc-3e33-4d76-87eb-6e1a375bc45e admin admin] Request method failure captured: Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: Accept: application/json Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: Accept-Encoding: gzip, deflate Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: Connection: keep-alive Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: Content-Length: 0 Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: Host: 10.222.0.16 Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: Openstack-Api-Version: compute 2.92 Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: Openstack-System-Scope: None Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: User-Agent: python-novaclient Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Auth-Token: gAAAAABjXBdW7fegoIH8MNz3FRBmSk2_ggZPlZWGTs_4VkzcO3aAF8NzMQraNIe0DuqLcYv6PpyAU5_yP2MIfHEcCAcj_WzPUvghLj5n4K7jte0HiXGQ5EYFGRGzh1s1d70sh5rSeONZMp2BaAABx9O9SYp0s0sRLBqv2ikxdvn-rzSTe69B4e8 Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Domain-Id: None Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Domain-Name: None Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Identity-Status: Confirmed Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Is-Admin-Project: True Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Domain-Id: default Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Domain-Name: Default Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Name: admin Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Role: member,reader,admin Oct 28 17:54:31.102846 n-d-862404-2 devstack@n-api.service[104618]: X-Roles: member,reader,admin Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d283249e65f4780a0e2d3d9295b8fc8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant: admin Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant-Name: admin Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-User: admin Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-User-Domain-Id: default Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-User-Domain-Name: Default Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-User-Id: 39d74e0f698544f8a0905ee11faac3ad Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: X-User-Name: admin Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: method: > Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: exception: Flavor 84 could not be found. Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: action_args: {'id': '84'} Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:31.104358 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:31.105273 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:31.106510 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-bbf105bc-3e33-4d76-87eb-6e1a375bc45e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:31.107839 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-bbf105bc-3e33-4d76-87eb-6e1a375bc45e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011392 Oct 28 17:54:31.107839 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 17:54:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:54:32.313091 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-6247360e-fe3e-4f16-95a1-47cd50480ed6 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:32.314051 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-6247360e-fe3e-4f16-95a1-47cd50480ed6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 28 17:54:32.314605 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 17:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:32.836178 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-a87afc95-8d13-4092-ad5a-b94b1c72c7bb admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:32.842049 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.wsgi [None req-a87afc95-8d13-4092-ad5a-b94b1c72c7bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-a87afc95-8d13-4092-ad5a-b94b1c72c7bb admin admin] Request method failure captured: Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: Accept: application/json Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: Accept-Encoding: gzip, deflate Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: Connection: keep-alive Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: Content-Length: 0 Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: Host: 10.222.0.16 Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: Openstack-Api-Version: compute 2.92 Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: Openstack-System-Scope: None Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: User-Agent: python-novaclient Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Auth-Token: gAAAAABjXBdYem19pTJnqddjoXxCoiC7nl1S-INb76a0Ta13weOVJI96MnuqqvlGRcPf2iG2P34mNdD-huFx7wtTvDfjBqFwML4TDzEk2aDiuWV7gJqHX_sjsjViuYOz3zYpLmcd4CfM9I7wytYQYjPVzDM76a11m6PDl124BTAb4ahc6rn8Y_k Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Domain-Id: None Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Domain-Name: None Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Identity-Status: Confirmed Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Is-Admin-Project: True Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Domain-Id: default Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Domain-Name: Default Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Project-Name: admin Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Role: member,reader,admin Oct 28 17:54:32.843529 n-d-862404-2 devstack@n-api.service[104618]: X-Roles: member,reader,admin Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d283249e65f4780a0e2d3d9295b8fc8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant: admin Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-Tenant-Name: admin Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-User: admin Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-User-Domain-Id: default Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-User-Domain-Name: Default Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-User-Id: 39d74e0f698544f8a0905ee11faac3ad Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: X-User-Name: admin Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: method: > Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: exception: Flavor 451 could not be found. Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: action_args: {'id': '451'} Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:32.845149 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:32.846148 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.847464 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-a87afc95-8d13-4092-ad5a-b94b1c72c7bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:32.848778 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-a87afc95-8d13-4092-ad5a-b94b1c72c7bb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392884 Oct 28 17:54:32.848778 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 17:54:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:54:32.855253 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-62220b87-8a7a-419b-a644-d1c86be60182 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:32.870411 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-62220b87-8a7a-419b-a644-d1c86be60182 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018721 Oct 28 17:54:32.870933 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 17:54:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:32.880152 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:32.895245 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018556 Oct 28 17:54:32.895763 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 17:54:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:32.905458 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-d32e7cc7-c03c-4bcd-b4db-3e071631bfbb admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:32.910343 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.wsgi [None req-d32e7cc7-c03c-4bcd-b4db-3e071631bfbb admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-d32e7cc7-c03c-4bcd-b4db-3e071631bfbb admin admin] Request method failure captured: Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: Accept: application/json Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: Accept-Encoding: gzip, deflate Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: Connection: keep-alive Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: Content-Length: 0 Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: Host: 10.222.0.16 Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: Openstack-Api-Version: compute 2.92 Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: Openstack-System-Scope: None Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: User-Agent: python-novaclient Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Auth-Token: gAAAAABjXBdYem19pTJnqddjoXxCoiC7nl1S-INb76a0Ta13weOVJI96MnuqqvlGRcPf2iG2P34mNdD-huFx7wtTvDfjBqFwML4TDzEk2aDiuWV7gJqHX_sjsjViuYOz3zYpLmcd4CfM9I7wytYQYjPVzDM76a11m6PDl124BTAb4ahc6rn8Y_k Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Domain-Id: None Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Domain-Name: None Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Identity-Status: Confirmed Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Is-Admin-Project: True Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Domain-Id: default Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Domain-Name: Default Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Project-Name: admin Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Role: member,reader,admin Oct 28 17:54:32.911857 n-d-862404-2 devstack@n-api.service[104617]: X-Roles: member,reader,admin Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d283249e65f4780a0e2d3d9295b8fc8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d283249e65f4780a0e2d3d9295b8fc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant: admin Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant-Id: 6d283249e65f4780a0e2d3d9295b8fc8 Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-Tenant-Name: admin Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-User: admin Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-User-Domain-Id: default Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-User-Domain-Name: Default Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-User-Id: 39d74e0f698544f8a0905ee11faac3ad Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: X-User-Name: admin Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: method: > Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: exception: Flavor 451 could not be found. Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: action_args: {'id': '451'} Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:32.913357 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:32.914412 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: ERROR nova.api.openstack.wsgi Oct 28 17:54:32.915663 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-d32e7cc7-c03c-4bcd-b4db-3e071631bfbb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:32.916894 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-d32e7cc7-c03c-4bcd-b4db-3e071631bfbb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011258 Oct 28 17:54:32.916894 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 17:54:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:54:34.132704 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:34.133709 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Oct 28 17:54:34.134102 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 17:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:34.656548 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-d0ad8435-ea8a-4cfb-b855-2490fa0fe8c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:34.676735 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-d0ad8435-ea8a-4cfb-b855-2490fa0fe8c6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406567 Oct 28 17:54:34.677297 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Oct 28 17:54:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:35.894312 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:35.895315 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 28 17:54:35.895711 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 17:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:36.420652 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-a4c145c8-89cf-47ca-871f-1b029c3c9f2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:36.439139 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-a4c145c8-89cf-47ca-871f-1b029c3c9f2f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403066 Oct 28 17:54:36.439679 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Oct 28 17:54:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:37.643288 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:37.644332 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 28 17:54:37.644727 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 17:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:38.164472 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-fac96b00-f83d-4523-a2e9-86db45e8c893 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:38.183070 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-fac96b00-f83d-4523-a2e9-86db45e8c893 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.401031 Oct 28 17:54:38.183620 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Oct 28 17:54:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:39.381244 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:39.382310 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 28 17:54:39.382735 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 17:54:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:39.903521 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-75a0e228-061d-4079-864a-2c14d0b6264b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:39.921728 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-75a0e228-061d-4079-864a-2c14d0b6264b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401609 Oct 28 17:54:39.922271 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Oct 28 17:54:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:41.117192 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:41.118221 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Oct 28 17:54:41.118613 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 17:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:41.639964 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-1de77a07-6f4e-4406-bdb9-6a62953a2f0f admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:41.659926 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-1de77a07-6f4e-4406-bdb9-6a62953a2f0f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401331 Oct 28 17:54:41.660460 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Oct 28 17:54:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:39.685529 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:39.686494 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-b804ccc1-f3bb-4788-b1ec-8d67f9bb3835 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 28 17:55:39.686922 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 17:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:39.698001 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:40.078244 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-0bf1649b-d998-4e8b-b20f-77bee83979c9 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:40.098217 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-0bf1649b-d998-4e8b-b20f-77bee83979c9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405239 Oct 28 17:55:40.098751 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 17:55:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:40.121832 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writing DB stats nova_api:SELECT=14 {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:40.125666 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-a2d3e9ec-6bdd-4682-a3d9-78aa1e4b7b41 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:40.134541 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-a2d3e9ec-6bdd-4682-a3d9-78aa1e4b7b41 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014103 Oct 28 17:55:40.135050 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Fri Oct 28 17:55:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:40.146517 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-fe543c03-51df-4bd4-bf33-f4ea7c330ae2 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:40.153796 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-fe543c03-51df-4bd4-bf33-f4ea7c330ae2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010865 Oct 28 17:55:40.154297 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Fri Oct 28 17:55:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:40.165322 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-78b666a3-1f8d-46d4-a74c-9429cadfd1c9 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:40.172393 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-78b666a3-1f8d-46d4-a74c-9429cadfd1c9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010575 Oct 28 17:55:40.172901 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Fri Oct 28 17:55:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:40.184397 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-5979b380-6235-4bbf-940d-833ff55d66f5 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:40.191401 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-5979b380-6235-4bbf-940d-833ff55d66f5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010390 Oct 28 17:55:40.191934 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Fri Oct 28 17:55:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:01:09.526438 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-78b666a3-1f8d-46d4-a74c-9429cadfd1c9 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:09.527440 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-78b666a3-1f8d-46d4-a74c-9429cadfd1c9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 28 18:01:09.527853 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 18:01:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:09.673507 n-d-862404-2 devstack@n-api.service[104617]: DEBUG dbcounter [-] [104617] Writing DB stats nova_api:SELECT=6 {{(pid=104617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:09.817090 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-9303ea02-8287-491a-8087-dd38d1c02232 admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:09.821757 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-9303ea02-8287-491a-8087-dd38d1c02232 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:09.822254 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-9303ea02-8287-491a-8087-dd38d1c02232 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:09.822681 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-9303ea02-8287-491a-8087-dd38d1c02232 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:09.823384 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-9303ea02-8287-491a-8087-dd38d1c02232 admin admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:09.823850 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-9303ea02-8287-491a-8087-dd38d1c02232 admin admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:09.824268 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-9303ea02-8287-491a-8087-dd38d1c02232 admin admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:09.863007 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-9303ea02-8287-491a-8087-dd38d1c02232 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.190737 Oct 28 18:01:09.863570 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 18:01:09 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:01:10.920110 n-d-862404-2 devstack@n-api.service[104618]: DEBUG nova.api.openstack.wsgi [None req-78b666a3-1f8d-46d4-a74c-9429cadfd1c9 admin admin] Calling method '>' {{(pid=104618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:10.921121 n-d-862404-2 devstack@n-api.service[104618]: INFO nova.api.openstack.requestlog [None req-78b666a3-1f8d-46d4-a74c-9429cadfd1c9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001775 Oct 28 18:01:10.921521 n-d-862404-2 devstack@n-api.service[104618]: [pid: 104618|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 18:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:11.114631 n-d-862404-2 devstack@n-api.service[104617]: DEBUG nova.api.openstack.wsgi [None req-6e240a96-8660-473b-bcfe-c39972ab70ae admin admin] Calling method '>' {{(pid=104617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:11.118019 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-6e240a96-8660-473b-bcfe-c39972ab70ae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:11.118497 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-6e240a96-8660-473b-bcfe-c39972ab70ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:11.118927 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-6e240a96-8660-473b-bcfe-c39972ab70ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:11.119634 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-6e240a96-8660-473b-bcfe-c39972ab70ae admin admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:11.120120 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-6e240a96-8660-473b-bcfe-c39972ab70ae admin admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:11.120535 n-d-862404-2 devstack@n-api.service[104617]: DEBUG oslo_concurrency.lockutils [None req-6e240a96-8660-473b-bcfe-c39972ab70ae admin admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:11.145121 n-d-862404-2 devstack@n-api.service[104617]: INFO nova.api.openstack.requestlog [None req-6e240a96-8660-473b-bcfe-c39972ab70ae admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.082028 Oct 28 18:01:11.145606 n-d-862404-2 devstack@n-api.service[104617]: [pid: 104617|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 18:01:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:01:56.401775 n-d-862404-2 devstack@n-api.service[104616]: Fri Oct 28 18:01:56 2022 - graceful shutdown triggered... Oct 28 18:01:56.401538 n-d-862404-2 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 18:01:56.402764 n-d-862404-2 devstack@n-api.service[104617]: Gracefully killing worker 1 (pid: 104617)... Oct 28 18:01:56.403512 n-d-862404-2 devstack@n-api.service[104618]: Gracefully killing worker 2 (pid: 104618)... Oct 28 18:01:56.533411 n-d-862404-2 devstack@n-api.service[104618]: DEBUG dbcounter [-] [104618] Writing DB stats nova_api:SELECT=4 {{(pid=104618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:57.402555 n-d-862404-2 devstack@n-api.service[104616]: worker 1 buried after 1 seconds Oct 28 18:01:57.403081 n-d-862404-2 devstack@n-api.service[104616]: worker 2 buried after 1 seconds Oct 28 18:01:57.403081 n-d-862404-2 devstack@n-api.service[104616]: goodbye to uWSGI. Oct 28 18:01:57.404193 n-d-862404-2 systemd[1]: devstack@n-api.service: Succeeded. Oct 28 18:01:57.404754 n-d-862404-2 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 18:01:57.408147 n-d-862404-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 18:01:57.424167 n-d-862404-2 devstack@n-api.service[120665]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 18:01:57 2022] *** Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: nodename: n-d-862404-2 Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: machine: x86_64 Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: clock source: unix Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: pcre jit disabled Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: detected number of CPU cores: 4 Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: current working directory: / Oct 28 18:01:57.443471 n-d-862404-2 devstack@n-api.service[120665]: detected binary path: /usr/bin/uwsgi-core Oct 28 18:01:57.444295 n-d-862404-2 devstack@n-api.service[120665]: your processes number limit is 47680 Oct 28 18:01:57.444295 n-d-862404-2 devstack@n-api.service[120665]: your memory page size is 4096 bytes Oct 28 18:01:57.444295 n-d-862404-2 devstack@n-api.service[120665]: detected max file descriptor number: 2048 Oct 28 18:01:57.444295 n-d-862404-2 devstack@n-api.service[120665]: lock engine: pthread robust mutexes Oct 28 18:01:57.444295 n-d-862404-2 devstack@n-api.service[120665]: thunder lock: enabled Oct 28 18:01:57.444295 n-d-862404-2 devstack@n-api.service[120665]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 18:01:57.444295 n-d-862404-2 devstack@n-api.service[120665]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 18:01:57.485734 n-d-862404-2 devstack@n-api.service[120665]: Python main interpreter initialized at 0x5561967dd9c0 Oct 28 18:01:57.485734 n-d-862404-2 devstack@n-api.service[120665]: python threads support enabled Oct 28 18:01:57.485734 n-d-862404-2 devstack@n-api.service[120665]: your server socket listen backlog is limited to 100 connections Oct 28 18:01:57.485734 n-d-862404-2 devstack@n-api.service[120665]: your mercy for graceful operations on workers is 90 seconds Oct 28 18:01:57.486192 n-d-862404-2 devstack@n-api.service[120665]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 18:01:57.486192 n-d-862404-2 devstack@n-api.service[120665]: *** Operational MODE: preforking *** Oct 28 18:01:57.486453 n-d-862404-2 devstack@n-api.service[120665]: *** uWSGI is running in multiple interpreter mode *** Oct 28 18:01:57.486453 n-d-862404-2 devstack@n-api.service[120665]: spawned uWSGI master process (pid: 120665) Oct 28 18:01:57.486644 n-d-862404-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 18:01:57.487330 n-d-862404-2 devstack@n-api.service[120665]: spawned uWSGI worker 1 (pid: 120679, cores: 1) Oct 28 18:01:57.487710 n-d-862404-2 devstack@n-api.service[120665]: spawned uWSGI worker 2 (pid: 120680, cores: 1) Oct 28 18:01:57.487710 n-d-862404-2 devstack@n-api.service[120665]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 18:01:58.158510 n-d-862404-2 devstack@n-api.service[120680]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 18:01:58.159114 n-d-862404-2 devstack@n-api.service[120679]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 18:01:59.425483 n-d-862404-2 devstack@n-api.service[120680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:01:59.425483 n-d-862404-2 devstack@n-api.service[120680]: from cryptography.utils import int_from_bytes Oct 28 18:01:59.426116 n-d-862404-2 devstack@n-api.service[120680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:01:59.426116 n-d-862404-2 devstack@n-api.service[120680]: from cryptography.utils import int_from_bytes Oct 28 18:01:59.432203 n-d-862404-2 devstack@n-api.service[120679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:01:59.432203 n-d-862404-2 devstack@n-api.service[120679]: from cryptography.utils import int_from_bytes Oct 28 18:01:59.432697 n-d-862404-2 devstack@n-api.service[120679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 18:01:59.432697 n-d-862404-2 devstack@n-api.service[120679]: from cryptography.utils import int_from_bytes Oct 28 18:02:01.871323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 18:02:01.871919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 18:02:01.872165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 18:02:01.872533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 18:02:01.872804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 18:02:01.873188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.873516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.873849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.874172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.875642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.875642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.876000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.876394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.876732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.876998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.877318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.877646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862404-2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.877978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.878280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.878591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.879100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.879579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.880097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.880560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.881226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.881883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.882438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.882918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.883269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.883592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.884090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.884283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.884595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.884927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.885244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.885648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862404-2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.885986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.886311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.886623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.887035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.887351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.887672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.888039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.888369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.888672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.889014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.889338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.889658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.889983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.891086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.891666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.892094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.892424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.892741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.893054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.893312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.893633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.893969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.894285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.894610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.894869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.895129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.895449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.895772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.896188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.896501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.896824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.897120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.897439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.897754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.898058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.898368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.898701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.899010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.899342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.899643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.899996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.900398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.900651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.900960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.901300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.901618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.901927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.902247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.902568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.902876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.903182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.903490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.903807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.904180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.904483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.904736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.905046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.905355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.905678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.906016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.906323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.906626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.907104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.907424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.907735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.908308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.908640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.908882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 18:02:01.909342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.909423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 18:02:01.909501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.909596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.909682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 18:02:01.909958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.910062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 18:02:01.910172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.910316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 18:02:01.910646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.910924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.911050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.911288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.911609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.911900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.912033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.912256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.912354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.912564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.912676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.912881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.913000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.913198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.913309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.913454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.913582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.913834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.914149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.914398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.914499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.914740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862404-2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.914845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.915071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.915180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.915374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.915495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.915691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.915981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.916100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.916297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.916433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.916652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.916893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.916998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.917226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.917459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.917588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.917776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.917900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.918151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.918360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.918497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.918819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.919080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.919331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.919445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.919685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.919948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.920066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.920276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.920389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.920592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.920728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.920920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.921243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.921344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.921594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.921794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.921902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.922205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.922299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.922512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.922631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.922834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.922980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862404-2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.923175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.923469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.923584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.923797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.924020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.924134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.924247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.924498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.924813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.924929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.925138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.925241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.925454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.925548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.925770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.925935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.926085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.926247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.926390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.926567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.926720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.926904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.927050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.927193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.927342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.927500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.927673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.927853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.928030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.928193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.928348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.928491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.928650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.928839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.929017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.929168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.929319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.929472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.929634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.929784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.929933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.930124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.930287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.930431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.930910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.931091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.931235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.931378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.932600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.932891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.933085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.933233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.933376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.933548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.933772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.933937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.934091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.934242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.934403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.934578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.934768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.934768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.935123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.935281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.935430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.935581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.935757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.935757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.936068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.936395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.936552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.936696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.936851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.937058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.937769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.937914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.938062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.938212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.938364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.938517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.938658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.938806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.938949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.939126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.939126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.939422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.939422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.939698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.939874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.940035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.940035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.940360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.940512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.940660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.941035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.941228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.941379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.941522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.941939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.942090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.942241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.942393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.942535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.942684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.942858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.943016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.943166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.943321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.943464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.943604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.943745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.943919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.944074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.944227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.944379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.944529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.944670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.944822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.944978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.945155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.945309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.945451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.945606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.945749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.945899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.946051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.946204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.946555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.946702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.946851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.947018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.947205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.947353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.947495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.948038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.948226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.948226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.948513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.948656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.948797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.948946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.949095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.949278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.949444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.949595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.949744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.949899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.950042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.950231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.950393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.950536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.950739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.951064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.951305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.951465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.951621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.952099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.952265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.952419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.952570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.952829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.953514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.953671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.953823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.953965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.954113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.954265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.954408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.954568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.954720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.955121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.955304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.955450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.955592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.955745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.955969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.956121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.956272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.956656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.956818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.956975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.957140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.957319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.957466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.957615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.957764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.957916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.958059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.958059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.958334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.958482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.958638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.958795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.959007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.959165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.959315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.959456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.959596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.959751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.959926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.960070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.960261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.960410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.960561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.960703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.960845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.961011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.961332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.961596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.961755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.961924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.962340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.962489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.962640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.962783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.963014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 18:02:01.963159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.963337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.963486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.963640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.963807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.964015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.964163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.964311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.964453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.964602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.964763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.964908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.965050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.965192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.965369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.965523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.965690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.965832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.965982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.966125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.966276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.966425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.966793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.966961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.967148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.967301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.967444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.967592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.967747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.967923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.968078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.968229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.968433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.968652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.968801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.968951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.969101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.969252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.969396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.969553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.969736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.969877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.970038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.970272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.970473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.970629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.970788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.972218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.972656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.972837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.973078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.973078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.973502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.973654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.973816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.973970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.974122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.974264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.974407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.974556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.974698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.974839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.974989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.975132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.975280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.975424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.975565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.975716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.975903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.976094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.976274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.976434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.976585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.976994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.977189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.977347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.977347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.977635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.977777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.977937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.978098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.978240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.978389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.978539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.978682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.978832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.978974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.979115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.979256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.979402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.979556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.979712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.979912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.980082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.980225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.980412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.980412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.980412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.980830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.980980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.981122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.981457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.981650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.981940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.982112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.982260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.982436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.982921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.983958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.984853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.984853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.984853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.984853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.984853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.984853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.984853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.984853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.985963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.986105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.986254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.986408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.986572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.986714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.986714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.986714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.986714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.987501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.987501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.987780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.987780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.988109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.988109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.988427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.988582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.988736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.988885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.989029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.989029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.989296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.989446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.989623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.989778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.989929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.990080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.990238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.990380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.990571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.990738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.990888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.991038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.991038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.991324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.991631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.991631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.992005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.992269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.992269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.992568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.992728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.993205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.993352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.993508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.993652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.993652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.993932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.994084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.994084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.994370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.994513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.994513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.994878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.995042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.995202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.995363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.995532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.996281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.996281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.996592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.996592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.996881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.997030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.997936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.998127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.998289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.998441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.998618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.998783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.998932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.999090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.999287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:01.999478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.000241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.000444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.000658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.001000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.001162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.001392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.001572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.001933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.002087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.002271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.002529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.002695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.002845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.003322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.003489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.003648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.003804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.004052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.004201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.004405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.004574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.004736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.004889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.004889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.005187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.005337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.005337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.005671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.005841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.005999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.005999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.006289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.006504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.006670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.006859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.007023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.007184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.007346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.007763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.007983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.008140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.008289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.008437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.008599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.008749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.008915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.009280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.009444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.009603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.009767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.009925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.010084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.010241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.010390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.010538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.010740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.010894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.011052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.011213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.011473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.011643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.011990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.012151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.012308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.012457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.012715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.012884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.013035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.013413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.013413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.013413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.013413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.013413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.013413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.014369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.014369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.014369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.014369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.014369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.014369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.014369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.016311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.016311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.016311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.016754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.016902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.017050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.017204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.017361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.017522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.017937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.017937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.018331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.018492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.018652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.018811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.018980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.019139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.019288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.019445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.019594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.019752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.019939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.020090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.020245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.020438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.020604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.020804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.020972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.021133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.021133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.021133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.021555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.021750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.021928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.022232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.022383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.022531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.022709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.022948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.023101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.023258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.023662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.023952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.024110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.024267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.024424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.024588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.024747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.024977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.025130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.025287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.025455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.025612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.025774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.025935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.026084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.026233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.026381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.026535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.026684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.026843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.026992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.027147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.027304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.027461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.027609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.027796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.028183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.028385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.028547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.028697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.028860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.029013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.029169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.029326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.029475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.029833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.030020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.030187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.030187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.030187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.030187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.030187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.030187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.031182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.031340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.031489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.031637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.031794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.031982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.032349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.032522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.032726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.032886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.033156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.033335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.033487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.033863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.034133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.034288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.034447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.034614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.034886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.035041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.035199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.035375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.035538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.035688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.035896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.036052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.036201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.036361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.036558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.036711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.037220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.037384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.037535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.037705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.037705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.038315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.038485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.038485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.038778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.038937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.039095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.039095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.039395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.039552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.039702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.039882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.040050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.040208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.040357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.040357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.040648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.040805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.041010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.041176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.041326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.041475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.041475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.041773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.041930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.042089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.042255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.042562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.042722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.042872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.043029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.043217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.043217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.043606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.043979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.044155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.044392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.044566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.044726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.044894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.045119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.045119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.045426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.045591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.045749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.045899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.046046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.046201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.046349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.046554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.046725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.046876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.047026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.047175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.047332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.047490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.047659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.047976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.048176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.048536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.048703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.048865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.049022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.049190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.049354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.049503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.049666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.049823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.049973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.050129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.050277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.050425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.050581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.050738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.050889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.051079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.051246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.051395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.051395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.051687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.051854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.052022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.052182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.052345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.052648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.052805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.052953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.053110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.053284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.053461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.053699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.053872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.054157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.054314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.054314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.054717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.054876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.055032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.055263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.055425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.055583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.055756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.055948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.056099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.056249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.056484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.056718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.056870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.057028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.057186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.057336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.057498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.057655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.057812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.057980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.058132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.058282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.058649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.058808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.058966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.059123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.059272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.059437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.059600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.059758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.059947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.060117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.060276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.060427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.060589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.060748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.060898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.061079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.061321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.061489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.061641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.061790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.061939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.062800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.063031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.063208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.063362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.063542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.063762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.063946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.064256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.064551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.064812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.064968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.065125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.065292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.065525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.065736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.065905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.066108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.066262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.066420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.066583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.066735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.066883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.067031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.067187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.067345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.067509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.067659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.067848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.067848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.068180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.068330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.068783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.068958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.069124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.069124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.069411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.069411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.069713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.069713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.070047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.070210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.070680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.070680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.071068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.071271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.071428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.071586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.071745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.071976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.072128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.072288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.072439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.072607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.073011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.073495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.073655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.073807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.073965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.073965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.074447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.074613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.074764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.075033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.075189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.075366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.075543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.075773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.075979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.076135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.076295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.076455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.076605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.076787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.076945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.076945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.077239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.077397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.077557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.077705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.078535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.079009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.079179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.079385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.079552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.079552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.080131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.080131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.080463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.080613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.080771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.080933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.080933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.081581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.084288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.084594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.084753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.084912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.085089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.085327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.085509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.085911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.086072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.086223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.086380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.086380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.086683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.086834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.086983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.086983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.087366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.087366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.087769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.088022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.088185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.088185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.088554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.088735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.089192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.089353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.089505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.089670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.089823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.089983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.090133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.090290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.090451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.090601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.090751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.090915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.090915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.091207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.091356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.091356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.091697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.091921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.091921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.092213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.092213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.092513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.092675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.092825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.092975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.093269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.093550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.093720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.093922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.094116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.094286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.094468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.094805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.094986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.095145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.095322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.095322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.095723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.096078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.096278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.096474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.096474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.096474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.096906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.097057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.097228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.097516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.097688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.097850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.098001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.098203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.098370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.098530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.098680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.098829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.098985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.099382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.099553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.099738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.099966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.100119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.100282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.100447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.101938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.101938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.102300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.102453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.102616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.102769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.102929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.103091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.103261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.103561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.103734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.103908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.104062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.104211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.104359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.104509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.104670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.104670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.105128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.105290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.105458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.105706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.105884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.106179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.106337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.106496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.106646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.106805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.106957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.107106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.107255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.107404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.107565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.107724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.107890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.108045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.108208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.108367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.108517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.108683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.108834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.109019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.109200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.109502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.109676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.109848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.110006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.110157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.110307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.110456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.110614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.110773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.110932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.111089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.111246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.111396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.111396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.111757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.112039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.112197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.112347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.112496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.112655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.112813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.112963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.113112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.113261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.113410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.113718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.113877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.114044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.114203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.114362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.114520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.114670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.114819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.115104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.115259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.115408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.115566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.115716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.115896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.116280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.116459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.116611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.116775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.116934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.117085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.117235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.117391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.117562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.117740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.117942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.118108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.118297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.118462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.118639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.118791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.118940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.119090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.119249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.119554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.119554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.119993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.120147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.120310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.120460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.120609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.120769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.120940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.121098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.121257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.121415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.121566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.121773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.121930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.122088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.122240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.122389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.122546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.122695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.122862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.123019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.123169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.123319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.123481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.123776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.123979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.124141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.124293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.124441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.125367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.125581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.125771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.125771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.126892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.127069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.127236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.127396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.127555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.127714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.127893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.128065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.128223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.128374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.128570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.128733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.128733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.129040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.129199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.129357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.129515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.129870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.130066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.130066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.130066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.130066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.130066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.130066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.130997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.131176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.131328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.131485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.131644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.131877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.132058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.132210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.132359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.132515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.132672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.132823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.132981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.133150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.133150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.133150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.133150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.133150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.133150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.133150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.134439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.134592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.134748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.134905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.134905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.135211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.135211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.135674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.135845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.136015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.136166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.136337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.136709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.136867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.137026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.137190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.137190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.137190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.137190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.137190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.137913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.138076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.138234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.138385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.138543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.138764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.138926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.139078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.139227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.139375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.139375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.139677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.140043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.140207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.140984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.141136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.141294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.141457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.141616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.141766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.141914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.142123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.142286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.142449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.142607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.142766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.142916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.143075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.143226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.143384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.143542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.143691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.143864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.144164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.144339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.144502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.144661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.144820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.144971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.145128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.145289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.145574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.145733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.145733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.146035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.146187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.146347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.146519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.146898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.147057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.147208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.147208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.147508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.147803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.148004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.148157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.148306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.148468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.148618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.148779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.148928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.149078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.149226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.149384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.149544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.149701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.149851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.150155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.150317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.150514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.150770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.150946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.151110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.151259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.151259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.151561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.151719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.151934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.152135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.152135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.152437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.152594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.152594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.152907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.153057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.153234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.153394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.153544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.153714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.153878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.154038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.154038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.154486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.154637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.154787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.154935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.155085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.155254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.155413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.155733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.156575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.156753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.157154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.157330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.157483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.157633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.157783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.157934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.158083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.158242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.158408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.158557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.158706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.158863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.159027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.159177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.159335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.159335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.159636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.159793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.159987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.160312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.160468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.160676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.160831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.160990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.161155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.161306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.161462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.161611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.161759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.161907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.162066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.162303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.162467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.162617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.162776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.162938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.163090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.163246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.163246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.163539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.163696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.163921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.164079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.164079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.164079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.164079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.164079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.164961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.165421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.166678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.166906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.167643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.168812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.168812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.168812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.168812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.168812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.168812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.168812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.168812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.169995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.169995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.169995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.169995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.169995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.169995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.169995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.169995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.171295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.171295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.171295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.171295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.171295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.171295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.171295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.171295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 18:02:02.173569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.173569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.173569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.173569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.173569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.174331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.174331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.174331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.174926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.175075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.175294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.175627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.178119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.178119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.178119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.178119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.178119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.178119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.178119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.179169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.179169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.179169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.179169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.179727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.179727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.180064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.180465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.180822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.181301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.181640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.181972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.182301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.182629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.182950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.183270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.183588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.183933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.184263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.184696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.185095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.185418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.185860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.186182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.186514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.186845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.187650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.187650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.188005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.188163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.188495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.188815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.189151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.189501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.189835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.190166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.190479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.190921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.191240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.191560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.191917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.192238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.192550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.192863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.193181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.193496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.193808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.194121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.194430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.194809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.195051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.196606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.196931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.197250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.197943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.198264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.198587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.199144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.199470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.199787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.200129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.200443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.200819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.201161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.201523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.201820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.202140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.202469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.203328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.203662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.204021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.204352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.204673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.205273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.205659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.205987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.206455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.206621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.206940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.207260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.207598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.208033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.208267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.208601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.208929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.209261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.209585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.209904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.210243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.210564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.210977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.211194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.211498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.211854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.212160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.212481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.212799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.213113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.213435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.213770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.214102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.214419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.214752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.215087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.215446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.215763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.216139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.216570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.216795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.217115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.217425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 18:02:02.217673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 18:02:02.243725 n-d-862404-2 devstack@n-api.service[120680]: INFO dbcounter [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Registered counter for database nova_api Oct 28 18:02:02.264381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_db.sqlalchemy.engines [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:02:02.272086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writer thread running {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:02:02.284168 n-d-862404-2 devstack@n-api.service[120679]: INFO dbcounter [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Registered counter for database nova_api Oct 28 18:02:02.306588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_db.sqlalchemy.engines [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:02:02.318932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writer thread running {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:02:02.333703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.context [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43f74929-bc21-41df-9120-e6be09c18015(cell1) {{(pid=120680) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 18:02:02.339005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:02.339984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:02.342529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:02.343635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:02.344300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:02.346915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:02.350196 n-d-862404-2 devstack@n-api.service[120680]: INFO dbcounter [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Registered counter for database nova_cell0 Oct 28 18:02:02.357080 n-d-862404-2 devstack@n-api.service[120680]: INFO dbcounter [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Registered counter for database nova_cell1 Oct 28 18:02:02.367904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_db.sqlalchemy.engines [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:02:02.377508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_db.sqlalchemy.engines [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:02:02.378194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writer thread running {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:02:02.384157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.context [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43f74929-bc21-41df-9120-e6be09c18015(cell1) {{(pid=120679) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 18:02:02.388348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:02.388998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:02.390701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:02.391457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:02.391952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:02.395025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:02.397678 n-d-862404-2 devstack@n-api.service[120679]: INFO dbcounter [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Registered counter for database nova_cell0 Oct 28 18:02:02.402275 n-d-862404-2 devstack@n-api.service[120679]: INFO dbcounter [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Registered counter for database nova_cell1 Oct 28 18:02:02.411142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_db.sqlalchemy.engines [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:02:02.412874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_db.sqlalchemy.engines [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:02:02.418447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writer thread running {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:02:02.529207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writer thread running {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:02:02.542486 n-d-862404-2 devstack@n-api.service[120680]: INFO dbcounter [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Registered counter for database nova_cell0 Oct 28 18:02:02.553429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_db.sqlalchemy.engines [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:02:02.559617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writer thread running {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:02:02.575297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writer thread running {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:02:02.586657 n-d-862404-2 devstack@n-api.service[120679]: INFO dbcounter [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Registered counter for database nova_cell0 Oct 28 18:02:02.594395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_db.sqlalchemy.engines [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 18:02:02.599769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writer thread running {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 18:02:02.904420 n-d-862404-2 devstack@n-api.service[120680]: WARNING keystonemiddleware.auth_token [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:02:02.912299 n-d-862404-2 devstack@n-api.service[120680]: WARNING keystonemiddleware.auth_token [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:02:02.933471 n-d-862404-2 devstack@n-api.service[120679]: WARNING keystonemiddleware.auth_token [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:02:02.940724 n-d-862404-2 devstack@n-api.service[120679]: WARNING keystonemiddleware.auth_token [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:02:03.257201 n-d-862404-2 devstack@n-api.service[120680]: WARNING keystonemiddleware.auth_token [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:02:03.263286 n-d-862404-2 devstack@n-api.service[120680]: WARNING keystonemiddleware.auth_token [None req-93234be7-cd5c-44c4-8c38-7337d23a7ebe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:02:03.269355 n-d-862404-2 devstack@n-api.service[120680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561967dd9c0 pid: 120680 (default app) Oct 28 18:02:03.287132 n-d-862404-2 devstack@n-api.service[120679]: WARNING keystonemiddleware.auth_token [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 18:02:03.293424 n-d-862404-2 devstack@n-api.service[120679]: WARNING keystonemiddleware.auth_token [None req-45b38346-8da0-4d75-a7c8-0bc052c85d52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 18:02:03.299425 n-d-862404-2 devstack@n-api.service[120679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561967dd9c0 pid: 120679 (default app) Oct 28 18:02:42.350793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:42.352429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:42.353322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:42.354621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:43.958667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Calling method '.version_select at 0x7f78dfbfaee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:43.971845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43f74929-bc21-41df-9120-e6be09c18015(cell1) {{(pid=120680) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 18:02:43.973517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:43.974217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:43.975898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:44.012499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:44.013110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:44.013552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:44.031766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:44.032658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:44.033311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:44.042239 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-614f04d3-7854-4945-a689-42fbea9d4791 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.698056 Oct 28 18:02:44.043043 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1208 bytes} [Fri Oct 28 18:02:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:02:44.377181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2d02ff4-4ba7-4241-80c2-40111d53917f tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1541046249"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:44.402497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.aggregate [None req-a2d02ff4-4ba7-4241-80c2-40111d53917f tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Generated uuid 49b6b9c2-9e4f-4e17-acc9-264d2bb70a94 for aggregate {{(pid=120679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:02:44.417353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:44.418476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:44.419362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:44.420272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:44.521834 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a2d02ff4-4ba7-4241-80c2-40111d53917f tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.460665 Oct 28 18:02:44.530896 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1/2] 10.222.0.16 () {62 vars in 1205 bytes} [Fri Oct 28 18:02:44 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:02:44.540132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6ebc4fc-0cad-4ef9-8bb5-272bfc5a17e1 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1066728247"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:44.843364 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6ebc4fc-0cad-4ef9-8bb5-272bfc5a17e1 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.310468 Oct 28 18:02:44.844585 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2/3] 10.222.0.16 () {62 vars in 1210 bytes} [Fri Oct 28 18:02:44 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:02:44.865263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab19f1c4-c617-423f-a062-1bb88920673b tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:44.890313 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ab19f1c4-c617-423f-a062-1bb88920673b tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.035171 Oct 28 18:02:44.892575 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2/4] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 18:02:44 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:02:44.903839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-924dbbf0-1880-4077-a6f6-52a5e67fe0c6 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:44.928949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924dbbf0-1880-4077-a6f6-52a5e67fe0c6 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:44.929369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924dbbf0-1880-4077-a6f6-52a5e67fe0c6 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:44.929809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924dbbf0-1880-4077-a6f6-52a5e67fe0c6 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:45.932960 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-924dbbf0-1880-4077-a6f6-52a5e67fe0c6 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.031142 Oct 28 18:02:45.932960 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3/5] 10.222.0.16 () {62 vars in 1232 bytes} [Fri Oct 28 18:02:44 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:02:46.001024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '.version_select at 0x7f78dfab1700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:46.048087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43f74929-bc21-41df-9120-e6be09c18015(cell1) {{(pid=120679) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 18:02:46.048979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.050681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.054530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:46.120374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.120998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.122326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:46.157825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.166458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.166994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:46.183558 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ec09f5d-87af-4fc9-9f1f-0bed7d66972c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.136204 Oct 28 18:02:46.184897 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 18:02:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:46.239439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-57cf59d7-4a6a-49d0-87fe-8463f4c0782d tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Calling method '.version_select at 0x7f78dfa44b80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:46.243411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57cf59d7-4a6a-49d0-87fe-8463f4c0782d tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.244892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57cf59d7-4a6a-49d0-87fe-8463f4c0782d tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.248369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57cf59d7-4a6a-49d0-87fe-8463f4c0782d tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:46.251731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57cf59d7-4a6a-49d0-87fe-8463f4c0782d tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.252365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57cf59d7-4a6a-49d0-87fe-8463f4c0782d tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.279773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57cf59d7-4a6a-49d0-87fe-8463f4c0782d tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:46.363676 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-57cf59d7-4a6a-49d0-87fe-8463f4c0782d tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.430425 Oct 28 18:02:46.368466 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 18:02:45 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:46.612898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ac9c48d4-9319-40d1-9d32-713a309cc064 tempest-AZAdminNegativeTestJSON-520098445 tempest-AZAdminNegativeTestJSON-520098445-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:46.616556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ac9c48d4-9319-40d1-9d32-713a309cc064 tempest-AZAdminNegativeTestJSON-520098445 tempest-AZAdminNegativeTestJSON-520098445-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'fa5e05ea524a461d85ece2fb6b438e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111f1c48339f4f3f8899d69b7006d6db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ac9c48d4-9319-40d1-9d32-713a309cc064 tempest-AZAdminNegativeTestJSON-520098445 tempest-AZAdminNegativeTestJSON-520098445-project] Request method failure captured: Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlC7xqdsac8s0cq9FsG6zdkrQ_OTA-i74ByLr3DKu0sRoJ20QGiywn2xj85iDZTuIt8VHhQcM8greeVCt5HQjvN1t9BRSZGtIIxUI870BcAl19MHzr62iVb3THRai4sFv6ZW09hwfhL-MpHhi5evm96NJnCqZdNpFzeipHIn3kTvoQ Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 111f1c48339f4f3f8899d69b7006d6db Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AZAdminNegativeTestJSON-520098445 Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:02:46.628726 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/111f1c48339f4f3f8899d69b7006d6db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/111f1c48339f4f3f8899d69b7006d6db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_111f1c48339f4f3f8899d69b7006d6db", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/111f1c48339f4f3f8899d69b7006d6db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AZAdminNegativeTestJSON-520098445 Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 111f1c48339f4f3f8899d69b7006d6db Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-520098445 Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AZAdminNegativeTestJSON-520098445-project Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: fa5e05ea524a461d85ece2fb6b438e8c Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AZAdminNegativeTestJSON-520098445-project Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 18:02:46.629769 n-d-862404-2 devstack@n-api.service[120679]: action_args: {} Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:46.630320 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:46.631129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ac9c48d4-9319-40d1-9d32-713a309cc064 tempest-AZAdminNegativeTestJSON-520098445 tempest-AZAdminNegativeTestJSON-520098445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:46.635064 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ac9c48d4-9319-40d1-9d32-713a309cc064 tempest-AZAdminNegativeTestJSON-520098445 tempest-AZAdminNegativeTestJSON-520098445-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.444149 Oct 28 18:02:46.635908 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 18:02:46 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 450 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:02:46.689391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8bfed13-3b33-499e-9c8d-afc4ae59a950 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:46.691198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8bfed13-3b33-499e-9c8d-afc4ae59a950 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.691842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8bfed13-3b33-499e-9c8d-afc4ae59a950 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.692415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8bfed13-3b33-499e-9c8d-afc4ae59a950 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:46.693291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8bfed13-3b33-499e-9c8d-afc4ae59a950 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.698500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8bfed13-3b33-499e-9c8d-afc4ae59a950 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.699120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8bfed13-3b33-499e-9c8d-afc4ae59a950 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:46.767749 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8bfed13-3b33-499e-9c8d-afc4ae59a950 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.398042 Oct 28 18:02:46.768899 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 18:02:46 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:02:46.773876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-18305d54-6ac3-4006-a7f8-79fdfa0e9eb0 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:46.807099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18305d54-6ac3-4006-a7f8-79fdfa0e9eb0 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.808030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18305d54-6ac3-4006-a7f8-79fdfa0e9eb0 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.808821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18305d54-6ac3-4006-a7f8-79fdfa0e9eb0 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:46.986006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a115d613-04c4-4ecf-9fe9-9d6b3cc2c23f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Calling method '.version_select at 0x7f78df228790>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:46.993583 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-18305d54-6ac3-4006-a7f8-79fdfa0e9eb0 tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.223426 Oct 28 18:02:46.994213 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 6/10] 10.222.0.16 () {62 vars in 1232 bytes} [Fri Oct 28 18:02:46 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:02:46.995408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a115d613-04c4-4ecf-9fe9-9d6b3cc2c23f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:46.995829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a115d613-04c4-4ecf-9fe9-9d6b3cc2c23f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:46.998228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a115d613-04c4-4ecf-9fe9-9d6b3cc2c23f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.000532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a115d613-04c4-4ecf-9fe9-9d6b3cc2c23f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:47.001014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a115d613-04c4-4ecf-9fe9-9d6b3cc2c23f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:47.008692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a115d613-04c4-4ecf-9fe9-9d6b3cc2c23f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.017357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-461f2276-f651-455e-94ba-a25fbda0df2c tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Calling method '.version_select at 0x7f78df1bc4c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:47.031418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-461f2276-f651-455e-94ba-a25fbda0df2c tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:47.033375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-461f2276-f651-455e-94ba-a25fbda0df2c tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:47.033830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-461f2276-f651-455e-94ba-a25fbda0df2c tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.034859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-461f2276-f651-455e-94ba-a25fbda0df2c tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:47.035068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-461f2276-f651-455e-94ba-a25fbda0df2c tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:47.035501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-461f2276-f651-455e-94ba-a25fbda0df2c tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.125775 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-461f2276-f651-455e-94ba-a25fbda0df2c tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.128964 Oct 28 18:02:47.134153 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 7/11] 10.222.0.16 () {58 vars in 1139 bytes} [Fri Oct 28 18:02:46 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:47.154626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd157253-435a-495d-90b1-b8a052a08250 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:47.156812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd157253-435a-495d-90b1-b8a052a08250 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:47.157304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd157253-435a-495d-90b1-b8a052a08250 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:47.157746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd157253-435a-495d-90b1-b8a052a08250 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.158481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd157253-435a-495d-90b1-b8a052a08250 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:47.158939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd157253-435a-495d-90b1-b8a052a08250 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:47.159381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd157253-435a-495d-90b1-b8a052a08250 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.165995 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a115d613-04c4-4ecf-9fe9-9d6b3cc2c23f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.521177 Oct 28 18:02:47.166602 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 18:02:46 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:47.181268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c49a0a81-4961-4068-929e-36db804fd35e tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:47.229794 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd157253-435a-495d-90b1-b8a052a08250 tempest-AZAdminV2TestJSON-1183333304 tempest-AZAdminV2TestJSON-1183333304-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.094501 Oct 28 18:02:47.235742 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 18:02:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:47.247594 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c49a0a81-4961-4068-929e-36db804fd35e tempest-AggregatesAdminTestV241-600319228 tempest-AggregatesAdminTestV241-600319228-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.079759 Oct 28 18:02:47.248350 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 6/14] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 18:02:47 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:47.254508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f19cbf70-4528-4881-ba5e-7071bcc05f2f tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Calling method '.version_select at 0x7f78df1bc9d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:47.274806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f19cbf70-4528-4881-ba5e-7071bcc05f2f tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:47.276846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f19cbf70-4528-4881-ba5e-7071bcc05f2f tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:47.277955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f19cbf70-4528-4881-ba5e-7071bcc05f2f tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.280792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f19cbf70-4528-4881-ba5e-7071bcc05f2f tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:47.285224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f19cbf70-4528-4881-ba5e-7071bcc05f2f tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:47.285907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f19cbf70-4528-4881-ba5e-7071bcc05f2f tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.348152 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f19cbf70-4528-4881-ba5e-7071bcc05f2f tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.110858 Oct 28 18:02:47.354495 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 9/15] 10.222.0.16 () {58 vars in 1145 bytes} [Fri Oct 28 18:02:47 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:02:47.359097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f48ad3eb-ab56-46f8-b933-f08d5dce605d tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-430875831", "name": "tempest-test_aggregate-821424047"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:47.411599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-f48ad3eb-ab56-46f8-b933-f08d5dce605d tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid 383a8502-e69f-4b8d-90cb-7ca5d0234b5c for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:02:47.457435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f48ad3eb-ab56-46f8-b933-f08d5dce605d tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.102036 Oct 28 18:02:47.459533 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 10/16] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Oct 28 18:02:47 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:47.474640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db3c0a24-9354-426a-81c6-739f1fc714ed tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:47.497600 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db3c0a24-9354-426a-81c6-739f1fc714ed tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.028408 Oct 28 18:02:47.498196 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 11/17] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:02:47 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:02:47.512202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f8613e0-7f28-4a82-9a56-8e3b6da84046 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:47.565329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f8613e0-7f28-4a82-9a56-8e3b6da84046 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:47.566255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f8613e0-7f28-4a82-9a56-8e3b6da84046 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:47.566939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f8613e0-7f28-4a82-9a56-8e3b6da84046 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:47.813022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f8613e0-7f28-4a82-9a56-8e3b6da84046 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 312 microversion: 2.1 time: 0.300174 Oct 28 18:02:47.814938 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 12/18] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:02:47 2022] POST /compute/v2.1/os-aggregates/2/action => generated 312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:48.111224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3022c5b1-0f4f-4002-88d7-3221a4d34c1a tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Calling method '.version_select at 0x7f78df1de5e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.116063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3022c5b1-0f4f-4002-88d7-3221a4d34c1a tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '9876c9463b56402b96aa4135ece97a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15ba17f3aa4443dbf90218922615d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3022c5b1-0f4f-4002-88d7-3221a4d34c1a tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Request method failure captured: Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlCdrkt761n5pOyeWUGX71JaG4R1bTU2aolSV_7CTc3iHLlZUEPyvSPZzkjOoghqlU2w4IOOaumZP_nb9799xDjfxE7O2zbGY_u6BGwm5sFgJbV8BRG0YphgzH1oZNMUN_4ImQzGIzVWnoo5usjIgw510HvNizjJ2AqbUMpkbKhUb8 Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:02:48.123470 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b15ba17f3aa4443dbf90218922615d11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 9876c9463b56402b96aa4135ece97a43 Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: action_args: {} Oct 28 18:02:48.124688 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.125497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 18:02:48.126492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.128910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3022c5b1-0f4f-4002-88d7-3221a4d34c1a tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.131001 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3022c5b1-0f4f-4002-88d7-3221a4d34c1a tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.874269 Oct 28 18:02:48.136084 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 7/19] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 18:02:47 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 887 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:02:48.146275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a41a172e-3ebf-4a85-b3ee-c967d95dafcb tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Calling method '.version_select at 0x7f78df1e5c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.149608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a41a172e-3ebf-4a85-b3ee-c967d95dafcb tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '9876c9463b56402b96aa4135ece97a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15ba17f3aa4443dbf90218922615d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a41a172e-3ebf-4a85-b3ee-c967d95dafcb tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Request method failure captured: Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-hosts/n-d-862404-2/reboot HTTP/1.1 Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlCdrkt761n5pOyeWUGX71JaG4R1bTU2aolSV_7CTc3iHLlZUEPyvSPZzkjOoghqlU2w4IOOaumZP_nb9799xDjfxE7O2zbGY_u6BGwm5sFgJbV8BRG0YphgzH1oZNMUN_4ImQzGIzVWnoo5usjIgw510HvNizjJ2AqbUMpkbKhUb8 Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:02:48.157257 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b15ba17f3aa4443dbf90218922615d11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 9876c9463b56402b96aa4135ece97a43 Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-d-862404-2'} Oct 28 18:02:48.158208 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.158813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 18:02:48.159706 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.160519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a41a172e-3ebf-4a85-b3ee-c967d95dafcb tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.160519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a41a172e-3ebf-4a85-b3ee-c967d95dafcb tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862404-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017143 Oct 28 18:02:48.163475 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 13/20] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Oct 28 18:02:48 2022] GET /compute/v2.1/os-hosts/n-d-862404-2/reboot => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:02:48.169607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12bed48c-1a12-4e2a-8f4b-bb6d075be22a tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Calling method '.version_select at 0x7f78df228670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.195279 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-12bed48c-1a12-4e2a-8f4b-bb6d075be22a tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12bed48c-1a12-4e2a-8f4b-bb6d075be22a tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Request method failure captured: Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlFqnEtVfFpW_ZkHdFFmZ2iLaP0NqKkVMuifMrpnDHgBRyek8a4Y3touemYSJ7qQi5405IZ9GESn6u19dSD3R6qhDU2_SZimAOlb2l6_LOSqYIH2oUlVSBv3EmXHeeTaxbRIprjmipbC1Kc9srSjCgr9T9DVlST_dE3SPwEo6x9gj8 Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:02:48.205736 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a67204ad0e4d4e10a13c2a6b783c4b53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8f49b152b2df4e6fb7257e45aa3c6095 Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'nonexistent_hostname'} Oct 28 18:02:48.206695 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:02:48.207385 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 18:02:48.212195 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12bed48c-1a12-4e2a-8f4b-bb6d075be22a tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.213402 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-12bed48c-1a12-4e2a-8f4b-bb6d075be22a tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.041897 Oct 28 18:02:48.217134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf75f87a-9c80-49c5-b76d-f631b0d234af tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Calling method '.version_select at 0x7f78df146af0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.220012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf75f87a-9c80-49c5-b76d-f631b0d234af tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '9876c9463b56402b96aa4135ece97a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15ba17f3aa4443dbf90218922615d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf75f87a-9c80-49c5-b76d-f631b0d234af tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Request method failure captured: Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-hosts/n-d-862404-2 HTTP/1.1 Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlCdrkt761n5pOyeWUGX71JaG4R1bTU2aolSV_7CTc3iHLlZUEPyvSPZzkjOoghqlU2w4IOOaumZP_nb9799xDjfxE7O2zbGY_u6BGwm5sFgJbV8BRG0YphgzH1oZNMUN_4ImQzGIzVWnoo5usjIgw510HvNizjJ2AqbUMpkbKhUb8 Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:02:48.221631 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b15ba17f3aa4443dbf90218922615d11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 9876c9463b56402b96aa4135ece97a43 Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-d-862404-2'} Oct 28 18:02:48.222802 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.223507 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 18:02:48.224519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.225250 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 8/21] 10.222.0.16 () {58 vars in 1212 bytes} [Fri Oct 28 18:02:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 18:02:48.225312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf75f87a-9c80-49c5-b76d-f631b0d234af tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.225705 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf75f87a-9c80-49c5-b76d-f631b0d234af tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862404-2" status: 403 len: 109 microversion: 2.1 time: 0.012466 Oct 28 18:02:48.230547 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 14/22] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 18:02:48 2022] GET /compute/v2.1/os-hosts/n-d-862404-2 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:02:48.237754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1334e273-f07a-4b5c-a74d-d6904af924ad tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Calling method '.version_select at 0x7f78df0c7430>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.258735 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-1334e273-f07a-4b5c-a74d-d6904af924ad tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1334e273-f07a-4b5c-a74d-d6904af924ad tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Request method failure captured: Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlFqnEtVfFpW_ZkHdFFmZ2iLaP0NqKkVMuifMrpnDHgBRyek8a4Y3touemYSJ7qQi5405IZ9GESn6u19dSD3R6qhDU2_SZimAOlb2l6_LOSqYIH2oUlVSBv3EmXHeeTaxbRIprjmipbC1Kc9srSjCgr9T9DVlST_dE3SPwEo6x9gj8 Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:02:48.260347 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a67204ad0e4d4e10a13c2a6b783c4b53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8f49b152b2df4e6fb7257e45aa3c6095 Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'nonexistent_hostname'} Oct 28 18:02:48.261317 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.261908 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.262874 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.263714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1334e273-f07a-4b5c-a74d-d6904af924ad tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.263714 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1334e273-f07a-4b5c-a74d-d6904af924ad tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030723 Oct 28 18:02:48.273786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-911be17b-9459-4807-8b72-d1df2ff932fe tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Calling method '.version_select at 0x7f78df146ee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.276425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-911be17b-9459-4807-8b72-d1df2ff932fe tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '9876c9463b56402b96aa4135ece97a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15ba17f3aa4443dbf90218922615d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:48.277345 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 9/23] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 18:02:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-911be17b-9459-4807-8b72-d1df2ff932fe tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Request method failure captured: Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-hosts/n-d-862404-2/shutdown HTTP/1.1 Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlCdrkt761n5pOyeWUGX71JaG4R1bTU2aolSV_7CTc3iHLlZUEPyvSPZzkjOoghqlU2w4IOOaumZP_nb9799xDjfxE7O2zbGY_u6BGwm5sFgJbV8BRG0YphgzH1oZNMUN_4ImQzGIzVWnoo5usjIgw510HvNizjJ2AqbUMpkbKhUb8 Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:02:48.278981 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b15ba17f3aa4443dbf90218922615d11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 9876c9463b56402b96aa4135ece97a43 Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-d-862404-2'} Oct 28 18:02:48.281282 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.282125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 18:02:48.282986 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.287569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-911be17b-9459-4807-8b72-d1df2ff932fe tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.290212 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-911be17b-9459-4807-8b72-d1df2ff932fe tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862404-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.019723 Oct 28 18:02:48.291238 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 15/24] 10.222.0.16 () {58 vars in 1194 bytes} [Fri Oct 28 18:02:48 2022] GET /compute/v2.1/os-hosts/n-d-862404-2/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:02:48.301764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a82a16c-93d7-4297-acc9-9aac5c699f8b tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Calling method '.version_select at 0x7f78df2285e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.312249 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3a82a16c-93d7-4297-acc9-9aac5c699f8b tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a82a16c-93d7-4297-acc9-9aac5c699f8b tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Request method failure captured: Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlFqnEtVfFpW_ZkHdFFmZ2iLaP0NqKkVMuifMrpnDHgBRyek8a4Y3touemYSJ7qQi5405IZ9GESn6u19dSD3R6qhDU2_SZimAOlb2l6_LOSqYIH2oUlVSBv3EmXHeeTaxbRIprjmipbC1Kc9srSjCgr9T9DVlST_dE3SPwEo6x9gj8 Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:02:48.316695 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a67204ad0e4d4e10a13c2a6b783c4b53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8f49b152b2df4e6fb7257e45aa3c6095 Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'nonexistent_hostname'} Oct 28 18:02:48.317727 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:02:48.318321 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 18:02:48.319200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a82a16c-93d7-4297-acc9-9aac5c699f8b tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.324422 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a82a16c-93d7-4297-acc9-9aac5c699f8b tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.021375 Oct 28 18:02:48.325647 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 10/25] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:02:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:02:48.332170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb55c7ba-0b39-48df-84ca-3f942f740756 tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Calling method '.version_select at 0x7f78df1cf5e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.334362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb55c7ba-0b39-48df-84ca-3f942f740756 tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '9876c9463b56402b96aa4135ece97a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15ba17f3aa4443dbf90218922615d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb55c7ba-0b39-48df-84ca-3f942f740756 tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Request method failure captured: Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-hosts/n-d-862404-2/startup HTTP/1.1 Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlCdrkt761n5pOyeWUGX71JaG4R1bTU2aolSV_7CTc3iHLlZUEPyvSPZzkjOoghqlU2w4IOOaumZP_nb9799xDjfxE7O2zbGY_u6BGwm5sFgJbV8BRG0YphgzH1oZNMUN_4ImQzGIzVWnoo5usjIgw510HvNizjJ2AqbUMpkbKhUb8 Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:02:48.336478 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b15ba17f3aa4443dbf90218922615d11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 9876c9463b56402b96aa4135ece97a43 Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-d-862404-2'} Oct 28 18:02:48.338280 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.339108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 18:02:48.340816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.341867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb55c7ba-0b39-48df-84ca-3f942f740756 tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.344267 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb55c7ba-0b39-48df-84ca-3f942f740756 tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-862404-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.017300 Oct 28 18:02:48.351070 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 16/26] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 18:02:48 2022] GET /compute/v2.1/os-hosts/n-d-862404-2/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:02:48.357412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d98d690-831e-4aa1-82a5-d3c093dce330 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Calling method '.version_select at 0x7f78df0c7af0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:48.368237 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4d98d690-831e-4aa1-82a5-d3c093dce330 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d98d690-831e-4aa1-82a5-d3c093dce330 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Request method failure captured: Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlFqnEtVfFpW_ZkHdFFmZ2iLaP0NqKkVMuifMrpnDHgBRyek8a4Y3touemYSJ7qQi5405IZ9GESn6u19dSD3R6qhDU2_SZimAOlb2l6_LOSqYIH2oUlVSBv3EmXHeeTaxbRIprjmipbC1Kc9srSjCgr9T9DVlST_dE3SPwEo6x9gj8 Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:02:48.370041 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a67204ad0e4d4e10a13c2a6b783c4b53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8f49b152b2df4e6fb7257e45aa3c6095 Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'nonexistent_hostname'} Oct 28 18:02:48.371073 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:02:48.371705 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 18:02:48.377871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d98d690-831e-4aa1-82a5-d3c093dce330 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d98d690-831e-4aa1-82a5-d3c093dce330 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019686 Oct 28 18:02:48.378744 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 11/27] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Oct 28 18:02:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:02:48.387637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b62e243-d892-472a-a75d-55ce07f22d2f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Action: 'update', calling method: .version_select at 0x7f78df1e53a0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b62e243-d892-472a-a75d-55ce07f22d2f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Request method failure captured: Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/os-hosts/n-d-862404-2 HTTP/1.1 Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 51 Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlFqnEtVfFpW_ZkHdFFmZ2iLaP0NqKkVMuifMrpnDHgBRyek8a4Y3touemYSJ7qQi5405IZ9GESn6u19dSD3R6qhDU2_SZimAOlb2l6_LOSqYIH2oUlVSBv3EmXHeeTaxbRIprjmipbC1Kc9srSjCgr9T9DVlST_dE3SPwEo6x9gj8 Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:02:48.393806 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a67204ad0e4d4e10a13c2a6b783c4b53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 8f49b152b2df4e6fb7257e45aa3c6095 Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: {"status": "enable", "maintenance_mode": "invalid"} Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.394900 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-d-862404-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance: Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.395545 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.396730 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.397614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.397614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:02:48.397614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:02:48.397614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 18:02:48.397614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.399310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b62e243-d892-472a-a75d-55ce07f22d2f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.400637 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b62e243-d892-472a-a75d-55ce07f22d2f tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862404-2" status: 400 len: 199 microversion: 2.1 time: 0.022051 Oct 28 18:02:48.402282 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 17/28] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:02:48 2022] PUT /compute/v2.1/os-hosts/n-d-862404-2 => generated 199 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:02:48.415782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5e272b6-3865-484e-9ecc-376d1af4ac93 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Action: 'update', calling method: .version_select at 0x7f78df1469d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5e272b6-3865-484e-9ecc-376d1af4ac93 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Request method failure captured: Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/os-hosts/n-d-862404-2 HTTP/1.1 Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 51 Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlFqnEtVfFpW_ZkHdFFmZ2iLaP0NqKkVMuifMrpnDHgBRyek8a4Y3touemYSJ7qQi5405IZ9GESn6u19dSD3R6qhDU2_SZimAOlb2l6_LOSqYIH2oUlVSBv3EmXHeeTaxbRIprjmipbC1Kc9srSjCgr9T9DVlST_dE3SPwEo6x9gj8 Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:02:48.420241 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a67204ad0e4d4e10a13c2a6b783c4b53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 8f49b152b2df4e6fb7257e45aa3c6095 Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: {"status": "invalid", "maintenance_mode": "enable"} Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.421922 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-d-862404-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance: Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.428818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.432101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.434087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.434087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:02:48.434087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:02:48.434087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 18:02:48.434087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.437859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5e272b6-3865-484e-9ecc-376d1af4ac93 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.438923 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5e272b6-3865-484e-9ecc-376d1af4ac93 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862404-2" status: 400 len: 189 microversion: 2.1 time: 0.030884 Oct 28 18:02:48.443007 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 18/29] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:02:48 2022] PUT /compute/v2.1/os-hosts/n-d-862404-2 => generated 189 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:02:48.459326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-671cf736-0881-4727-b445-fd3f4a5babdc tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Action: 'update', calling method: .version_select at 0x7f78df0fc1f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:48.465521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-671cf736-0881-4727-b445-fd3f4a5babdc tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '9876c9463b56402b96aa4135ece97a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15ba17f3aa4443dbf90218922615d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-671cf736-0881-4727-b445-fd3f4a5babdc tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Request method failure captured: Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/os-hosts/n-d-862404-2 HTTP/1.1 Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 50 Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlCdrkt761n5pOyeWUGX71JaG4R1bTU2aolSV_7CTc3iHLlZUEPyvSPZzkjOoghqlU2w4IOOaumZP_nb9799xDjfxE7O2zbGY_u6BGwm5sFgJbV8BRG0YphgzH1oZNMUN_4ImQzGIzVWnoo5usjIgw510HvNizjJ2AqbUMpkbKhUb8 Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:02:48.468008 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b15ba17f3aa4443dbf90218922615d11", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b15ba17f3aa4443dbf90218922615d11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b15ba17f3aa4443dbf90218922615d11 Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1057460253 Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 9876c9463b56402b96aa4135ece97a43 Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1057460253-project Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 18:02:48.469214 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-d-862404-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.469902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 18:02:48.471057 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.472879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-671cf736-0881-4727-b445-fd3f4a5babdc tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.473987 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-671cf736-0881-4727-b445-fd3f4a5babdc tempest-HostsAdminNegativeTestJSON-1057460253 tempest-HostsAdminNegativeTestJSON-1057460253-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862404-2" status: 403 len: 111 microversion: 2.1 time: 0.019824 Oct 28 18:02:48.474962 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 19/30] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:02:48 2022] PUT /compute/v2.1/os-hosts/n-d-862404-2 => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:02:48.486261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec6e2195-2cc8-48c6-91c9-eee106c5cddf tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Action: 'update', calling method: .version_select at 0x7f78df0fc9d0>, body: {"status": null, "maintenance_mode": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec6e2195-2cc8-48c6-91c9-eee106c5cddf tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Request method failure captured: Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/os-hosts/n-d-862404-2 HTTP/1.1 Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 42 Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlFqnEtVfFpW_ZkHdFFmZ2iLaP0NqKkVMuifMrpnDHgBRyek8a4Y3touemYSJ7qQi5405IZ9GESn6u19dSD3R6qhDU2_SZimAOlb2l6_LOSqYIH2oUlVSBv3EmXHeeTaxbRIprjmipbC1Kc9srSjCgr9T9DVlST_dE3SPwEo6x9gj8 Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:02:48.494513 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a67204ad0e4d4e10a13c2a6b783c4b53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 8f49b152b2df4e6fb7257e45aa3c6095 Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: {"status": null, "maintenance_mode": null} Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 18:02:48.495556 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-d-862404-2', 'body': {'status': None, 'maintenance_mode': None}} Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance: Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi None Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.496258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.497398 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.498316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:02:48.498316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:02:48.498316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 18:02:48.498316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.498316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec6e2195-2cc8-48c6-91c9-eee106c5cddf tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.498316 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec6e2195-2cc8-48c6-91c9-eee106c5cddf tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-862404-2" status: 400 len: 127 microversion: 2.1 time: 0.015872 Oct 28 18:02:48.506307 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 20/31] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:02:48 2022] PUT /compute/v2.1/os-hosts/n-d-862404-2 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:02:48.510935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-37e9abab-c24e-4ded-a8d3-b03d74fdf7e5 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Action: 'update', calling method: .version_select at 0x7f78df146430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:48.518745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.hosts [None req-37e9abab-c24e-4ded-a8d3-b03d74fdf7e5 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Enabling host nonexistent_hostname. Oct 28 18:02:48.533530 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-37e9abab-c24e-4ded-a8d3-b03d74fdf7e5 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-37e9abab-c24e-4ded-a8d3-b03d74fdf7e5 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Request method failure captured: Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 50 Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlFqnEtVfFpW_ZkHdFFmZ2iLaP0NqKkVMuifMrpnDHgBRyek8a4Y3touemYSJ7qQi5405IZ9GESn6u19dSD3R6qhDU2_SZimAOlb2l6_LOSqYIH2oUlVSBv3EmXHeeTaxbRIprjmipbC1Kc9srSjCgr9T9DVlST_dE3SPwEo6x9gj8 Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:02:48.538886 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a67204ad0e4d4e10a13c2a6b783c4b53", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a67204ad0e4d4e10a13c2a6b783c4b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a67204ad0e4d4e10a13c2a6b783c4b53 Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-908378692 Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 8f49b152b2df4e6fb7257e45aa3c6095 Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HostsAdminNegativeTestJSON-908378692-project-admin Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.539928 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 18:02:48.540603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:02:48.541440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:02:48.542363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-37e9abab-c24e-4ded-a8d3-b03d74fdf7e5 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:48.543064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-37e9abab-c24e-4ded-a8d3-b03d74fdf7e5 tempest-HostsAdminNegativeTestJSON-908378692 tempest-HostsAdminNegativeTestJSON-908378692-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033041 Oct 28 18:02:48.543064 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 21/32] 10.222.0.16 () {60 vars in 1211 bytes} [Fri Oct 28 18:02:48 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:02:48.646339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1170458767", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "availability_zone": "tempest-test_az-430875831"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:48.724482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:48.724891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:48.725946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:48.730673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:48.732958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:48.733865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:49.724969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:02:50.033826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:02:50.034250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:02:50.034726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:02:50.035135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:02:50.035550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:02:50.077488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:50.078511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:50.079103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:50.080037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:50.080896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:50.081509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:50.127498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Getting quotas for project 197ba3fbe250454ca0897cca868a826c. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:02:50.151096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Getting quotas for user 5ca78721dd094b08a9ca964324cddaa7 and project 197ba3fbe250454ca0897cca868a826c. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:02:50.174089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:02:50.179195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:02:50.259176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c9fab27-3d2a-456b-ad3b-a6d7b7068048 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862440 Oct 28 18:02:50.260080 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 12/33] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:02:50.275110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c3dd0ece-19ec-46e3-b816-ed7b0f9374a5 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:50.277250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c3dd0ece-19ec-46e3-b816-ed7b0f9374a5 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:02:52.221993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c3dd0ece-19ec-46e3-b816-ed7b0f9374a5 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:52.250231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c3dd0ece-19ec-46e3-b816-ed7b0f9374a5 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1242 microversion: 2.1 time: 1.976948 Oct 28 18:02:52.250991 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 22/34] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:50 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1242 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:52.626702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f0a0fd85-7feb-48db-963e-3761aad28766 tempest-FlavorMetadataValidation-958008876 tempest-FlavorMetadataValidation-958008876-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2143816187", "id": 1429670925, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:52.703459 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f0a0fd85-7feb-48db-963e-3761aad28766 tempest-FlavorMetadataValidation-958008876 tempest-FlavorMetadataValidation-958008876-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.666976 Oct 28 18:02:52.714290 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 13/35] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:02:52 2022] POST /compute/v2.1/flavors => generated 471 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:02:52.725457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32fee570-d9c9-4180-a6ca-21c4348a44d3 tempest-FlavorMetadataValidation-958008876 tempest-FlavorMetadataValidation-958008876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:53.071175 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32fee570-d9c9-4180-a6ca-21c4348a44d3 tempest-FlavorMetadataValidation-958008876 tempest-FlavorMetadataValidation-958008876-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1429670925/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.351753 Oct 28 18:02:53.072150 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 23/36] 10.222.0.16 () {62 vars in 1265 bytes} [Fri Oct 28 18:02:52 2022] POST /compute/v2.1/flavors/1429670925/os-extra_specs => generated 62 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:53.087570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e1c2cd8-c98f-4f40-bcc1-d7f30e8152fc tempest-FlavorMetadataValidation-958008876 tempest-FlavorMetadataValidation-958008876-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:53.180656 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e1c2cd8-c98f-4f40-bcc1-d7f30e8152fc tempest-FlavorMetadataValidation-958008876 tempest-FlavorMetadataValidation-958008876-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1429670925" status: 202 len: 0 microversion: 2.86 time: 0.098415 Oct 28 18:02:53.181252 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 14/37] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Oct 28 18:02:53 2022] DELETE /compute/v2.1/flavors/1429670925 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:02:53.192300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4fdb7c9-17d0-42de-b47a-0bd68d95ba3a tempest-FlavorMetadataValidation-958008876 tempest-FlavorMetadataValidation-958008876-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:53.274400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:53.275075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:02:53.281109 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d4fdb7c9-17d0-42de-b47a-0bd68d95ba3a tempest-FlavorMetadataValidation-958008876 tempest-FlavorMetadataValidation-958008876-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.092326 Oct 28 18:02:53.281953 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 24/38] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:02:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:02:53.303949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:53.304424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:53.304883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:53.305561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:53.313879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:53.314435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:53.665761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:53.689448 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04196f16-f87d-4c0f-8710-ed7e00c26e13 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1234 microversion: 2.1 time: 0.418122 Oct 28 18:02:53.692899 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 15/39] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:53 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1234 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:54.717005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:54.718533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:02:54.732081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:54.732771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:54.733560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:54.736690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:54.737345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:54.738041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:55.033814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:55.078764 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42789590-2643-4852-9a88-df06ec2d2b49 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1296 microversion: 2.1 time: 0.367282 Oct 28 18:02:55.084565 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 25/40] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:54 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1296 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:56.112196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:56.113044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:02:56.140918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:56.141430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:56.141884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:56.147620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:56.149302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:56.153447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:56.419700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:56.437297 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f6b7a17d-bb45-42b1-a1a2-41f3ff53d388 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1296 microversion: 2.1 time: 0.326523 Oct 28 18:02:56.459460 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 16/41] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:56 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1296 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:57.407736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:57.466720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:57.480939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:02:57.497692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:57.501142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:57.501902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:57.504718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:57.505463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:57.506228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:57.860673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:57.878501 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c80cb6b-d401-448d-a6bb-d48863c6dcef tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.415570 Oct 28 18:02:57.881385 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 17/42] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:57 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:58.187184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4da3909f-5c5b-44b0-8367-2448f7d25a67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.198276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da3909f-5c5b-44b0-8367-2448f7d25a67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:58.200401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da3909f-5c5b-44b0-8367-2448f7d25a67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:58.202048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e526395e-625d-4b24-ba51-7851f4545c13 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1002742103", "id": 992139288, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:58.202734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da3909f-5c5b-44b0-8367-2448f7d25a67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:58.204911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da3909f-5c5b-44b0-8367-2448f7d25a67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:58.209376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da3909f-5c5b-44b0-8367-2448f7d25a67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:58.210844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da3909f-5c5b-44b0-8367-2448f7d25a67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:58.232368 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e526395e-625d-4b24-ba51-7851f4545c13 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.334800 Oct 28 18:02:58.233518 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 18/43] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:02:57 2022] POST /compute/v2.1/flavors => generated 427 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:58.258182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-101dbfaa-4d0c-4ac2-b1ef-72f988e95110 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.314156 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4da3909f-5c5b-44b0-8367-2448f7d25a67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.920788 Oct 28 18:02:58.315846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 26/44] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:02:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:58.320990 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-101dbfaa-4d0c-4ac2-b1ef-72f988e95110 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/992139288" status: 202 len: 0 microversion: 2.1 time: 0.066411 Oct 28 18:02:58.325309 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 19/45] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:02:58 2022] DELETE /compute/v2.1/flavors/992139288 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:02:58.334836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c7fc90d-8303-4e6b-a647-4b4a648cef66 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.406722 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c7fc90d-8303-4e6b-a647-4b4a648cef66 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079216 Oct 28 18:02:58.413469 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 27/46] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:02:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:58.431529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f14670b-c8a9-43bd-8d1e-6a04cce336c5 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2141533905", "id": 87501353, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:58.485284 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f14670b-c8a9-43bd-8d1e-6a04cce336c5 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.056133 Oct 28 18:02:58.487171 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 20/47] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:02:58 2022] POST /compute/v2.1/flavors => generated 411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:58.498216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-280e89d3-1ef1-45b6-b866-26e0686c125f tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.540209 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-280e89d3-1ef1-45b6-b866-26e0686c125f tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.045301 Oct 28 18:02:58.565385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-82b56d7c-6b98-44bb-9b35-05192f8a38d7 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.568090 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 28/48] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:02:58 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:58.609638 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-82b56d7c-6b98-44bb-9b35-05192f8a38d7 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/87501353" status: 202 len: 0 microversion: 2.1 time: 0.049277 Oct 28 18:02:58.610246 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 21/49] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:02:58 2022] DELETE /compute/v2.1/flavors/87501353 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:02:58.623062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e3f44188-c94b-4706-ad65-17039d533db1 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.674448 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e3f44188-c94b-4706-ad65-17039d533db1 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059705 Oct 28 18:02:58.679153 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 29/50] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:02:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:58.697376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ca1da6a1-30a2-4cab-a047-d2e198635c80 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-729729962", "id": 1296809504, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:58.726899 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ca1da6a1-30a2-4cab-a047-d2e198635c80 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.033363 Oct 28 18:02:58.728779 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 22/51] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:02:58 2022] POST /compute/v2.1/flavors => generated 428 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:58.747445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35357149-6644-40a4-95cd-b6fcd5014c09 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.751233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:58.833736 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35357149-6644-40a4-95cd-b6fcd5014c09 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1296809504" status: 202 len: 0 microversion: 2.1 time: 0.096182 Oct 28 18:02:58.843306 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 30/52] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:02:58 2022] DELETE /compute/v2.1/flavors/1296809504 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:02:58.850570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fed9845e-1f64-482f-b006-316118c740ef tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.910018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:58.911015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:02:58.928820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:58.929752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:58.930411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:58.932667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:58.933392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:58.934348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:58.963799 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fed9845e-1f64-482f-b006-316118c740ef tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.115649 Oct 28 18:02:58.967807 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 23/53] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:02:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:58.990628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bc5ee48f-0556-445c-987c-2e3d256ba768 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1356008637", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:59.035468 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bc5ee48f-0556-445c-987c-2e3d256ba768 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.052294 Oct 28 18:02:59.037063 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 24/54] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:02:58 2022] POST /compute/v2.1/flavors => generated 507 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:59.050454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-39f8d940-0f6f-40d4-93bc-96d8fe4eef2e tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:59.075648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=11 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:59.109897 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-39f8d940-0f6f-40d4-93bc-96d8fe4eef2e tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/882ecd68-06da-4819-b7bb-486a26dfa281" status: 202 len: 0 microversion: 2.1 time: 0.064442 Oct 28 18:02:59.116032 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 25/55] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:02:59 2022] DELETE /compute/v2.1/flavors/882ecd68-06da-4819-b7bb-486a26dfa281 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:02:59.138461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2ca32a73-a76f-48c5-a4c4-88a8733c5d1d tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:59.176578 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2ca32a73-a76f-48c5-a4c4-88a8733c5d1d tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058831 Oct 28 18:02:59.192992 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 26/56] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:02:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:59.198680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a05edaa2-dfca-48c9-8ce1-56631aff3507 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1494072648", "id": "274d7f38-a129-4e1e-8181-f6b255b578ce", "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:59.221463 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a05edaa2-dfca-48c9-8ce1-56631aff3507 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.027233 Oct 28 18:02:59.241112 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 27/57] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:02:59 2022] POST /compute/v2.1/flavors => generated 507 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:59.254028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f769a9d0-34b7-46b7-90ef-8f7c80560406 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:59.287805 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f769a9d0-34b7-46b7-90ef-8f7c80560406 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/274d7f38-a129-4e1e-8181-f6b255b578ce" status: 202 len: 0 microversion: 2.1 time: 0.045128 Oct 28 18:02:59.288761 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 28/58] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:02:59 2022] DELETE /compute/v2.1/flavors/274d7f38-a129-4e1e-8181-f6b255b578ce => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:02:59.299776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-860cf428-2b97-4495-879a-9dfde8fecb25 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:59.377861 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-860cf428-2b97-4495-879a-9dfde8fecb25 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083345 Oct 28 18:02:59.391851 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:02:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:59.402209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12c018d2-f7be-457e-96d4-cd370c53c26d tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-455402059", "id": 182238167, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:59.449903 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-12c018d2-f7be-457e-96d4-cd370c53c26d tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.053400 Oct 28 18:02:59.459207 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 30/60] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:02:59 2022] POST /compute/v2.1/flavors => generated 410 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:59.465950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ae8cfcb-25a0-4fdc-8b50-4929be6ef285 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:59.510268 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ae8cfcb-25a0-4fdc-8b50-4929be6ef285 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/182238167" status: 200 len: 410 microversion: 2.1 time: 0.048657 Oct 28 18:02:59.516640 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 31/61] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:02:59 2022] GET /compute/v2.1/flavors/182238167 => generated 410 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:59.798373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:59.812009 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-000fef3c-489e-462b-91e7-8fc9fb93f1e9 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.905792 Oct 28 18:02:59.815993 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 31/62] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:58 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:59.933491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6bbe0bfa-354e-4e12-b539-509cdee7917c tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:00.070215 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6bbe0bfa-354e-4e12-b539-509cdee7917c tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.547616 Oct 28 18:03:00.070825 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:02:59 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:00.095964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-924a4d0e-e9f2-4ddf-8cc3-d179ed6ad536 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:00.142810 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-924a4d0e-e9f2-4ddf-8cc3-d179ed6ad536 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/182238167" status: 202 len: 0 microversion: 2.1 time: 0.049505 Oct 28 18:03:00.144131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 32/64] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:03:00 2022] DELETE /compute/v2.1/flavors/182238167 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:00.149314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:00.156328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6fa52e49-6939-41ea-ae63-74a5a50d874c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:00.167600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:00.224235 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6fa52e49-6939-41ea-ae63-74a5a50d874c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073827 Oct 28 18:03:00.226919 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:00.259448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a60466a-4828-402f-b74a-4d203399950f tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1409482402", "id": 1445096631, "os-flavor-access:is_public": "False"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:00.394594 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a60466a-4828-402f-b74a-4d203399950f tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.129508 Oct 28 18:03:00.395677 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:00 2022] POST /compute/v2.1/flavors => generated 430 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:00.433474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f14db031-b9af-4756-9e60-01299faf3073 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "1445096631"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:00.523203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f14db031-b9af-4756-9e60-01299faf3073 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] HTTP exception thrown: Flavor 1445096631 could not be found. Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f14db031-b9af-4756-9e60-01299faf3073 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] Request method failure captured: Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 107 Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlOVE5c2LeZrxHM__YqWb96ShRj9NoU0JuryCDc4U7N6YPJvncKUa_M_aKR7PFxLUBqam4cnn1pkfqu1mMzIn8PquAnFnHGCcJ-Mpzi05MmjqwtbdHh4Lwh1uVVeyNF05SwAbtljy2vgPKnEQa_ttBkr2AKuRs0SRJ8rcSOJ6I2DoA Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 893e8f589897406fbff1032ba798ef50 Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsAdminTestJSON-131813259 Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:00.542764 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/893e8f589897406fbff1032ba798ef50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/893e8f589897406fbff1032ba798ef50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_893e8f589897406fbff1032ba798ef50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/893e8f589897406fbff1032ba798ef50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsAdminTestJSON-131813259 Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 893e8f589897406fbff1032ba798ef50 Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-131813259 Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsAdminTestJSON-131813259-project Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 711f7461c45042b982c82e6a8113e582 Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsAdminTestJSON-131813259-project Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "test", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "1445096631"}} Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:00.544001 n-d-862404-2 devstack@n-api.service[120680]: exception: Flavor 1445096631 could not be found. Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '1445096631'}}} Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1445096631 could not be found. Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:00.544689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1445096631 could not be found. Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:00.545854 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:00.546962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:00.546962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:00.546962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:00.546962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1445096631 could not be found. Oct 28 18:03:00.546962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:00.546962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f14db031-b9af-4756-9e60-01299faf3073 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] Returning 400 to user: Flavor 1445096631 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:00.557106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f14db031-b9af-4756-9e60-01299faf3073 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.152354 Oct 28 18:03:00.558667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:00 2022] POST /compute/v2.1/servers => generated 81 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 28 18:03:00.571543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffa6e167-4a67-457b-b0a2-a568050d3412 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:00.607675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-1569db53-fdb0-4b11-97dc-c4f9aedee5f9 req-4726745e-2afc-432a-a423-525a098aa2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d2e06f-02c1-4aa8-8f3a-d09a51964b4c", "tag": "947a8b1e-12f9-4a75-9dc9-5226a9dfdd45"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:00.638778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1569db53-fdb0-4b11-97dc-c4f9aedee5f9 req-4726745e-2afc-432a-a423-525a098aa2aa service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:00.640580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1569db53-fdb0-4b11-97dc-c4f9aedee5f9 req-4726745e-2afc-432a-a423-525a098aa2aa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:00.648643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1569db53-fdb0-4b11-97dc-c4f9aedee5f9 req-4726745e-2afc-432a-a423-525a098aa2aa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:00.653760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffa6e167-4a67-457b-b0a2-a568050d3412 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1445096631" status: 202 len: 0 microversion: 2.1 time: 0.089781 Oct 28 18:03:00.656144 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 35/68] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:03:00 2022] DELETE /compute/v2.1/flavors/1445096631 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:00.664479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a975870a-dc9c-4fea-a9f7-bdb29edc3cca tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:00.707830 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-1569db53-fdb0-4b11-97dc-c4f9aedee5f9 req-4726745e-2afc-432a-a423-525a098aa2aa service nova] Creating event network-changed:947a8b1e-12f9-4a75-9dc9-5226a9dfdd45 for instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c on n-h1-862404-2 Oct 28 18:03:00.708398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1569db53-fdb0-4b11-97dc-c4f9aedee5f9 req-4726745e-2afc-432a-a423-525a098aa2aa service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:03:00.708864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1569db53-fdb0-4b11-97dc-c4f9aedee5f9 req-4726745e-2afc-432a-a423-525a098aa2aa service nova] Acquired lock "compute-rpcapi-router" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:03:00.714633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:00.715192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:00.716923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:00.719269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:00.720342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:00.721765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:00.765892 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a975870a-dc9c-4fea-a9f7-bdb29edc3cca tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.102496 Oct 28 18:03:00.765892 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 36/69] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:00.797684 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.compute.rpcapi [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 18:03:00.800368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] Releasing lock "compute-rpcapi-router" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:03:00.819207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6fbbd382-db02-4501-bc04-3345ff6b8905 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1502938759", "id": 1528551292, "os-flavor-access:is_public": "False"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:00.834844 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9fde4216-7efb-4210-82b5-7699b79dcd38 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432345 Oct 28 18:03:00.835734 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 34/70] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:00.845128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:00.848705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:00.864571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:00.866444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:00.868756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:00.869680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:00.871085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:00.873899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:00.928971 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6fbbd382-db02-4501-bc04-3345ff6b8905 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.129978 Oct 28 18:03:00.949954 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 37/71] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:00 2022] POST /compute/v2.1/flavors => generated 415 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:00.978932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd94f8d2-339d-4f71-ac22-9f0a1c41c0b2 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1485509839", "id": 497545664, "os-flavor-access:is_public": "True"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:01.055304 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd94f8d2-339d-4f71-ac22-9f0a1c41c0b2 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.103509 Oct 28 18:03:01.077476 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 38/72] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:00 2022] POST /compute/v2.1/flavors => generated 411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:01.084428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c07604c-baf0-42bc-bfe7-d29f838d69f5 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.197967 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c07604c-baf0-42bc-bfe7-d29f838d69f5 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.118488 Oct 28 18:03:01.203190 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 39/73] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:01.224615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a6df0ef-5b0d-4b52-a8a0-71eeecedcad8 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.246623 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a6df0ef-5b0d-4b52-a8a0-71eeecedcad8 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.037246 Oct 28 18:03:01.255546 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 40/74] 10.222.0.16 () {58 vars in 1177 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:01.277081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1e4ca89-2971-444b-b5ed-4d691238f67e tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.338444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e1e4ca89-2971-444b-b5ed-4d691238f67e tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.075343 Oct 28 18:03:01.346700 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 41/75] 10.222.0.16 () {58 vars in 1171 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:01.384128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c300c730-20d2-4d7f-9d9c-a757e784099d tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.426666 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c300c730-20d2-4d7f-9d9c-a757e784099d tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.067226 Oct 28 18:03:01.438108 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 42/76] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:01.467991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8234bb4a-73ec-41a3-ba70-a7275f5fcc17 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.524065 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8234bb4a-73ec-41a3-ba70-a7275f5fcc17 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.075949 Oct 28 18:03:01.528427 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 43/77] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:01.554641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13315da1-a2bc-47d3-8cd5-15af900caa6f tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.636455 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13315da1-a2bc-47d3-8cd5-15af900caa6f tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.085985 Oct 28 18:03:01.646909 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 44/78] 10.222.0.16 () {58 vars in 1175 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:01.675907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e6b409f-865c-4fbe-9a21-c3a37eeb610c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.768305 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e6b409f-865c-4fbe-9a21-c3a37eeb610c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.100056 Oct 28 18:03:01.782528 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 45/79] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:01.825099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0ef1b9dd-3d87-4eea-b6aa-e809057040c3 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.890997 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0ef1b9dd-3d87-4eea-b6aa-e809057040c3 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.071005 Oct 28 18:03:01.904164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 46/80] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:01.922036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe91115c-8748-4a16-b1e7-49990df2e96c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:01.982328 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe91115c-8748-4a16-b1e7-49990df2e96c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/497545664" status: 202 len: 0 microversion: 2.1 time: 0.064584 Oct 28 18:03:01.984705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 47/81] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:03:01 2022] DELETE /compute/v2.1/flavors/497545664 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:03:02.006409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3a88796-aad7-4c6e-a9bc-39426e4fddca tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:02.027541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:02.039518 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d093c73-cb2c-4cf8-b876-b4ffa575d5c0 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 1.202278 Oct 28 18:03:02.048529 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 35/82] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:00 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:02.100568 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3a88796-aad7-4c6e-a9bc-39426e4fddca tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.105855 Oct 28 18:03:02.101765 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 48/83] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:02.127356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ebc120e1-aaf0-4786-9d45-056253636455 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:02.168111 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ebc120e1-aaf0-4786-9d45-056253636455 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1528551292" status: 202 len: 0 microversion: 2.1 time: 0.045069 Oct 28 18:03:02.174502 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 36/84] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:03:02 2022] DELETE /compute/v2.1/flavors/1528551292 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:02.182149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b19c7943-b2e9-4e53-ba8f-5378264467df tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:02.239654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b19c7943-b2e9-4e53-ba8f-5378264467df tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064594 Oct 28 18:03:02.243578 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 49/85] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:02.281386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9748d03-f7a4-4821-b8b4-25891e36b843 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1737218972", "id": 461957868, "os-flavor-access:is_public": "False"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:02.313700 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9748d03-f7a4-4821-b8b4-25891e36b843 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.041729 Oct 28 18:03:02.325265 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 37/86] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:02 2022] POST /compute/v2.1/flavors => generated 412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:02.326774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44ba14e5-c699-4dff-998c-35fadc8d95a8 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:02.336651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:02.425608 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44ba14e5-c699-4dff-998c-35fadc8d95a8 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.096903 Oct 28 18:03:02.426835 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 50/87] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:02.462418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8f31377-e273-4667-90e5-2f9193aae753 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:02.531949 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8f31377-e273-4667-90e5-2f9193aae753 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074721 Oct 28 18:03:02.566908 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 38/88] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:02.567273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-17e567f6-3459-4783-8cad-79b20136141c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:02.605500 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-17e567f6-3459-4783-8cad-79b20136141c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/461957868" status: 202 len: 0 microversion: 2.1 time: 0.042073 Oct 28 18:03:02.606457 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 51/89] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:03:02 2022] DELETE /compute/v2.1/flavors/461957868 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:02.619955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c02da8ad-a607-44c0-9c6b-8e868f8c0864 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:02.714208 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c02da8ad-a607-44c0-9c6b-8e868f8c0864 tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.100085 Oct 28 18:03:02.728071 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 39/90] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:02.751597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3df5497-2502-467a-87e5-21e48dcc522a tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-27073948", "id": 314418496, "os-flavor-access:is_public": "True"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:02.785454 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3df5497-2502-467a-87e5-21e48dcc522a tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.039721 Oct 28 18:03:02.788671 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 52/91] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:02.819750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01ec3357-0742-414f-b15d-aaa9499ea4f2 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:02.918037 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01ec3357-0742-414f-b15d-aaa9499ea4f2 tempest-FlavorsAdminTestJSON-131813259 tempest-FlavorsAdminTestJSON-131813259-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.113241 Oct 28 18:03:02.919537 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 53/92] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:02 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:02.944099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9948a456-2fbd-4bc3-9f17-4a1c91f16a8c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:03.000108 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9948a456-2fbd-4bc3-9f17-4a1c91f16a8c tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/314418496" status: 202 len: 0 microversion: 2.1 time: 0.060551 Oct 28 18:03:03.001224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 54/93] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:03:02 2022] DELETE /compute/v2.1/flavors/314418496 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:03.010016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-868d30ae-4e47-4f3d-afa3-dd3519ec9b7f tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:03.070228 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-868d30ae-4e47-4f3d-afa3-dd3519ec9b7f tempest-FlavorsAdminTestJSON-1668629245 tempest-FlavorsAdminTestJSON-1668629245-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063752 Oct 28 18:03:03.080221 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 55/94] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:03.090252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:03.096943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:03.116835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:03.119803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:03.121267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:03.126123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:03.130171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:03.130879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:03.148793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42d3bae9-7694-4db2-92c1-99a5835d56a3 tempest-FlavorsV255TestJSON-1669544421 tempest-FlavorsV255TestJSON-1669544421-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2016274975", "id": 1407740633, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:03.210708 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42d3bae9-7694-4db2-92c1-99a5835d56a3 tempest-FlavorsV255TestJSON-1669544421 tempest-FlavorsV255TestJSON-1669544421-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.417372 Oct 28 18:03:03.214928 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 40/95] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:03:02 2022] POST /compute/v2.1/flavors => generated 449 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:03:03.508285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f342f3f-3fb2-4632-bf95-130247da33fe tempest-FlavorsV255TestJSON-26426206 tempest-FlavorsV255TestJSON-26426206-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:03.540409 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f342f3f-3fb2-4632-bf95-130247da33fe tempest-FlavorsV255TestJSON-26426206 tempest-FlavorsV255TestJSON-26426206-project] 10.222.0.16 "GET /compute/v2.1/flavors/1407740633" status: 200 len: 449 microversion: 2.55 time: 0.315959 Oct 28 18:03:03.544613 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 41/96] 10.222.0.16 () {60 vars in 1199 bytes} [Fri Oct 28 18:03:03 2022] GET /compute/v2.1/flavors/1407740633 => generated 449 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:03:03.559751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f63ef448-b84b-4248-b3d1-c0e6001c05af tempest-FlavorsV255TestJSON-1669544421 tempest-FlavorsV255TestJSON-1669544421-project-admin] Action: 'update', calling method: .version_select at 0x7f78dffccb80>, body: {"flavor": {"description": "new"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:03.704944 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f63ef448-b84b-4248-b3d1-c0e6001c05af tempest-FlavorsV255TestJSON-1669544421 tempest-FlavorsV255TestJSON-1669544421-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1407740633" status: 200 len: 450 microversion: 2.55 time: 0.148191 Oct 28 18:03:03.709233 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 42/97] 10.222.0.16 () {62 vars in 1219 bytes} [Fri Oct 28 18:03:03 2022] PUT /compute/v2.1/flavors/1407740633 => generated 450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:03:03.725808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bbaeb430-2995-4c06-bd03-b12a2cc25d13 tempest-FlavorsV255TestJSON-26426206 tempest-FlavorsV255TestJSON-26426206-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:03.818727 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bbaeb430-2995-4c06-bd03-b12a2cc25d13 tempest-FlavorsV255TestJSON-26426206 tempest-FlavorsV255TestJSON-26426206-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.102736 Oct 28 18:03:03.828051 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 43/98] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:03:03 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:03:03.854019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46b1ebcc-b312-41d3-a62c-fb69e470b20a tempest-FlavorsV255TestJSON-26426206 tempest-FlavorsV255TestJSON-26426206-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:03.923026 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-46b1ebcc-b312-41d3-a62c-fb69e470b20a tempest-FlavorsV255TestJSON-26426206 tempest-FlavorsV255TestJSON-26426206-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.073238 Oct 28 18:03:03.940612 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 44/99] 10.222.0.16 () {60 vars in 1166 bytes} [Fri Oct 28 18:03:03 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:03:03.963438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f8f1c32-244d-437c-9503-0ea6512a8b0f tempest-FlavorsV255TestJSON-1669544421 tempest-FlavorsV255TestJSON-1669544421-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:04.030775 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f8f1c32-244d-437c-9503-0ea6512a8b0f tempest-FlavorsV255TestJSON-1669544421 tempest-FlavorsV255TestJSON-1669544421-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1407740633" status: 202 len: 0 microversion: 2.55 time: 0.073842 Oct 28 18:03:04.040879 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 45/100] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Oct 28 18:03:03 2022] DELETE /compute/v2.1/flavors/1407740633 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:03:04.051503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2650c5d-04cd-45a1-9c65-33c912466515 tempest-FlavorsV255TestJSON-1669544421 tempest-FlavorsV255TestJSON-1669544421-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:04.160460 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2650c5d-04cd-45a1-9c65-33c912466515 tempest-FlavorsV255TestJSON-1669544421 tempest-FlavorsV255TestJSON-1669544421-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.106767 Oct 28 18:03:04.163420 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 46/101] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:03:04 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:04.246862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:04.268110 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-740da43a-4d10-478b-bc7d-16dc1eece867 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 1.179156 Oct 28 18:03:04.269961 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 56/102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:03 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:05.294161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:05.296326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:05.307878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:05.308488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:05.308938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:05.309663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:05.310127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:05.320925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:06.013621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:06.026187 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dac5bd4c-c12e-459d-a14c-4f502c279adb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.736188 Oct 28 18:03:06.028734 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 47/103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:05 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:07.063123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:07.065690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:07.084190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:07.084706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:07.085150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:07.085876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:07.086373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:07.086807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:07.768875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:07.779506 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a186ad98-612b-4485-ac65-8df7a921ea7c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.726327 Oct 28 18:03:07.788842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 57/104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:07 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:08.863129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:08.864438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:08.952587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:08.952587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:08.952587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:08.952587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:08.953554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:08.953554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:09.390178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:09.407220 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e538cd91-f55f-4d77-80fa-45e177aa0a72 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.577382 Oct 28 18:03:09.414743 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 48/105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:08 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:10.090907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:10.447437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:10.448861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:10.462520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:10.463005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:10.463610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:10.464543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:10.465183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:10.465758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:10.700451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1876760765", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "b6597dab-3369-40d8-b5f8-eb1a8f5f7d67"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:10.769156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:10.818749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] validate_networks() for [('b6597dab-3369-40d8-b5f8-eb1a8f5f7d67', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:03:10.833022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:10.843612 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-193c627e-2717-414d-a28e-a749231ef6cd tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.398499 Oct 28 18:03:10.845738 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 49/106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:10 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:11.871889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:11.872522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:11.901674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:11.903867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:11.905968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:11.908777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:11.909431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:11.911222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:12.257978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:12.270011 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.402791 Oct 28 18:03:12.270661 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 50/107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:11 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:12.272226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:12.273505 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea1304a3-9f1c-4882-95ee-c0ddb870619a tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001875 Oct 28 18:03:12.273876 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 51/108] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 18:03:12 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 18:03:13.201355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:03:13.202103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:03:13.202295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:03:13.203406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:03:13.203993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:03:13.228900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:13.229807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:13.230446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:13.231541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:13.232245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:13.233626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:13.257665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=55 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:13.286882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for project 452c29fdc8114bb985893db1a9d29426. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:03:13.299954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:13.301006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:13.312488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=18,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:13.315019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:13.316118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:13.317321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:13.318549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:13.320329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:13.321875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for user 584b38d4097042999ad262ea77966602 and project 452c29fdc8114bb985893db1a9d29426. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:03:13.322055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:13.379469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:03:13.390590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:03:13.540773 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90e0cde8-8c24-4b33-82b2-b5fab0cbb536 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.454890 Oct 28 18:03:13.542581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 58/109] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3458 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:03:13.689517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:13.701203 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f48a5f8-7647-44dc-8e77-5c5f6ffcee33 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.408260 Oct 28 18:03:13.710843 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 52/110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:13 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:13.743075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-63fc9d3b-5ddf-448b-90a0-28fad7cb84d2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:13.746766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-63fc9d3b-5ddf-448b-90a0-28fad7cb84d2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:13.949348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-63fc9d3b-5ddf-448b-90a0-28fad7cb84d2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:13.970974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-63fc9d3b-5ddf-448b-90a0-28fad7cb84d2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:13.979263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-63fc9d3b-5ddf-448b-90a0-28fad7cb84d2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:13.983093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-63fc9d3b-5ddf-448b-90a0-28fad7cb84d2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1262 microversion: 2.25 time: 0.269782 Oct 28 18:03:13.983886 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 53/111] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:13 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1262 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:14.285673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78dee258b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:14.299725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.302265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.302599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.323804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.324945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.340562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.386187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.387088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.388658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.399647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fcc89db8-5823-46ea-aaa1-6dcffbd00f40 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.854242 Oct 28 18:03:14.401585 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 59/112] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:14.416304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78def515e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:14.418191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.418737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.419331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.501428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.504074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.504533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.518477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=73 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:14.558535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.559594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.560328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.584108 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e481b057-965b-4a11-8e92-93b0bba61d58 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.171901 Oct 28 18:03:14.587734 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 54/113] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 18:03:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:14.609502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78deda7d30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:14.617350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.618091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.619326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.668401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.672328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.676048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.734971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.736559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:14.737237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:14.740871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.742272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.747646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.751644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.752095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.760427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.761403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.765428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.765879 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c79d5fef-fed7-47bb-a606-8ca11199f13c tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.156250 Oct 28 18:03:14.767141 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 60/114] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:14.780617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86c61719-37e8-47f5-86c1-ade7162d5bc0 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78deda7dc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:14.786381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c61719-37e8-47f5-86c1-ade7162d5bc0 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.789471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c61719-37e8-47f5-86c1-ade7162d5bc0 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.791708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c61719-37e8-47f5-86c1-ade7162d5bc0 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.838449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c61719-37e8-47f5-86c1-ade7162d5bc0 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.841432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c61719-37e8-47f5-86c1-ade7162d5bc0 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.844436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c61719-37e8-47f5-86c1-ade7162d5bc0 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.860933 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86c61719-37e8-47f5-86c1-ade7162d5bc0 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.087203 Oct 28 18:03:14.864212 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 61/115] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:14.881945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df3aef57-6d7f-4f74-a251-13e5f29e8fc9 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78deda7940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:14.885339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df3aef57-6d7f-4f74-a251-13e5f29e8fc9 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.886149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df3aef57-6d7f-4f74-a251-13e5f29e8fc9 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.887709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df3aef57-6d7f-4f74-a251-13e5f29e8fc9 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.923207 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df3aef57-6d7f-4f74-a251-13e5f29e8fc9 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.046818 Oct 28 18:03:14.925527 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 62/116] 10.222.0.16 () {58 vars in 1179 bytes} [Fri Oct 28 18:03:14 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:14.945105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78ded5c310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:14.953276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:14.954237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:14.956781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.006039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.006843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.007476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.025114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.025860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.026617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.079469 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-876b2a57-aafc-4706-8b1a-e3d5525172cc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.146068 Oct 28 18:03:15.082145 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 63/117] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:03:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:15.094597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a94d44f7-9195-4c58-81ff-9b12141fc0e1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:15.095732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a94d44f7-9195-4c58-81ff-9b12141fc0e1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:15.135040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:15.147432 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a95ecdb9-48ba-4e03-9fd7-b0bcbdd65c76 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.415589 Oct 28 18:03:15.164239 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 55/118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:14 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:15.171442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-37be3e75-c5a9-4224-a04e-fb1a90a5cdfc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78dee2d940>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:15.178598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37be3e75-c5a9-4224-a04e-fb1a90a5cdfc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.182824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37be3e75-c5a9-4224-a04e-fb1a90a5cdfc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.183754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37be3e75-c5a9-4224-a04e-fb1a90a5cdfc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.188980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a94d44f7-9195-4c58-81ff-9b12141fc0e1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:15.198450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a94d44f7-9195-4c58-81ff-9b12141fc0e1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:15.199917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a94d44f7-9195-4c58-81ff-9b12141fc0e1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:15.201038 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a94d44f7-9195-4c58-81ff-9b12141fc0e1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1262 microversion: 2.25 time: 0.117760 Oct 28 18:03:15.202155 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 64/119] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:15 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:15.213774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37be3e75-c5a9-4224-a04e-fb1a90a5cdfc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.216759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37be3e75-c5a9-4224-a04e-fb1a90a5cdfc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.218052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37be3e75-c5a9-4224-a04e-fb1a90a5cdfc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.231205 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-37be3e75-c5a9-4224-a04e-fb1a90a5cdfc tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.065598 Oct 28 18:03:15.248242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a978567d-d756-4026-a529-c7bd25cb1e55 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78decaaaf0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:15.248649 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 56/120] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:15.250675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a978567d-d756-4026-a529-c7bd25cb1e55 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.251471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a978567d-d756-4026-a529-c7bd25cb1e55 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.252435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a978567d-d756-4026-a529-c7bd25cb1e55 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.284665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a978567d-d756-4026-a529-c7bd25cb1e55 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.285158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a978567d-d756-4026-a529-c7bd25cb1e55 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.285612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a978567d-d756-4026-a529-c7bd25cb1e55 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.313284 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a978567d-d756-4026-a529-c7bd25cb1e55 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.068000 Oct 28 18:03:15.314583 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 65/121] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:15 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:15.333581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Calling method '.version_select at 0x7f78dee2de50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:15.333581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.333581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.334045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.361475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:15.378308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.378831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.382109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.406776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:15.407287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:15.407732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:15.460221 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f393e9a6-825b-41ea-8c84-7d4635f11b54 tempest-HypervisorAdminTestJSON-997765072 tempest-HypervisorAdminTestJSON-997765072-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.132924 Oct 28 18:03:15.472729 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 57/122] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 18:03:15 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:16.183651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:16.183651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:16.191183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:16.202760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:16.203228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:16.207696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:16.208157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:16.208600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:16.236134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:16.237586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:16.262831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:16.263334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:16.274306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:16.278635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:16.280184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:16.292326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:16.493088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:16.501828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:16.503308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:16.504494 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-67390846-3567-45dd-a8e4-f6665dca4b6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1314 microversion: 2.25 time: 0.274290 Oct 28 18:03:16.514958 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 58/123] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:16 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:03:16.585234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:16.607065 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f668c71a-4e6e-40bb-87c0-659fe19e2f7e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.434144 Oct 28 18:03:16.614391 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 66/124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:16 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:17.535104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:17.535796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:17.552886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:17.554013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:17.560222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:17.561726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:17.565305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:17.566856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:17.636635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:17.637258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:17.649393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:17.649841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:17.650287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:17.673245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:17.673716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:17.674204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:17.821591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:17.845160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:17.846651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:17.847833 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-700e1597-1a82-4511-ac57-85841f9e269d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1320 microversion: 2.25 time: 0.318401 Oct 28 18:03:17.848402 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 59/125] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:17 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:18.263159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:18.275315 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-62d9daa0-0416-4cb2-8db7-5bbf371063cb tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.642288 Oct 28 18:03:18.286545 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 67/126] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:17 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:18.892325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:18.895199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:18.926631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:18.927233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:18.929154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:18.929910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:18.930372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:18.930798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:19.272104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:19.290160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:19.294413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:19.300123 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f9d20cd-efa7-40a9-8a86-fdee0e5c3ef8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1320 microversion: 2.25 time: 0.417716 Oct 28 18:03:19.307097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:19.308489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:19.320162 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 60/127] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:18 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:19.322388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:19.323112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:19.323755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:19.325820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:19.327435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:19.329011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:19.704665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-91f60d30-0682-4c6e-8ada-429c06696a8e tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052 tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:19.710841 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-91f60d30-0682-4c6e-8ada-429c06696a8e tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052 tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-91f60d30-0682-4c6e-8ada-429c06696a8e tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052 tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052-project-admin] Request method failure captured: Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlnMepM_5oiFckeVD0_h_FtMv0fqRU5NK7JJEKpabjMaQQnUFyK4iY4b7yBcQtWskUT-H1Cyn3hcv9k3f9R9vcHvzKPlFc6shPHc1VolBqHAaAqtgPq-J0yPzj7zMmihNiA2nsVAXojPgQFsX54hXKBbIXYQnmdHwRytQ3UQoJNm60 Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: d5c428c10ffd493e843b3b1effa36914 Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052 Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:03:19.735474 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5c428c10ffd493e843b3b1effa36914"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d5c428c10ffd493e843b3b1effa36914"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d5c428c10ffd493e843b3b1effa36914", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d5c428c10ffd493e843b3b1effa36914"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052 Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: d5c428c10ffd493e843b3b1effa36914 Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052 Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052-project-admin Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 31c56bce92ed40d6ba7af2b73c8cd6c1 Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052-project-admin Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:03:19.736765 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid timestamp for date invalid_time Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'invalid_time'} Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:19.737362 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-91f60d30-0682-4c6e-8ada-429c06696a8e tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052 tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:19.738404 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-91f60d30-0682-4c6e-8ada-429c06696a8e tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052 tempest-InstanceUsageAuditLogNegativeTestJSON-1467861052-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.355363 Oct 28 18:03:19.739172 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 61/128] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 18:03:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 356 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:03:19.925753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:19.944204 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f89490e-d8a1-4864-a7ab-7a4536022b31 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.639110 Oct 28 18:03:19.945231 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 68/129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:19 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:20.133294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8169aa71-3395-422c-9875-f0da6a46469c tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:20.147335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8169aa71-3395-422c-9875-f0da6a46469c tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '0b631d34df7b4eb3bf041048fe8283e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a776911c1041eaab461dfba51701e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8169aa71-3395-422c-9875-f0da6a46469c tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] Request method failure captured: Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBllO1tX881vKGaLykN3YfEvIglqkDfhJ1ko7p4ZUP8PUXktaFRvb8l9wXb0xfh6qI_yDjoAMsXOt3PoKp-qMOQIToh8sydYz7yPmZ5lSeam5W8YtEYJGmZvtJTuImMuSPA3808_2Mr-03jaqbIJqwWyChJ2kHYWeXUlJm5r1m3DeN4 Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c1a776911c1041eaab461dfba51701e0 Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:03:20.156413 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a776911c1041eaab461dfba51701e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a776911c1041eaab461dfba51701e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1a776911c1041eaab461dfba51701e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1a776911c1041eaab461dfba51701e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c1a776911c1041eaab461dfba51701e0 Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 0b631d34df7b4eb3bf041048fe8283e5 Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project Oct 28 18:03:20.157560 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: action_args: {} Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:20.158202 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 18:03:20.159430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:20.163425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8169aa71-3395-422c-9875-f0da6a46469c tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:20.165482 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8169aa71-3395-422c-9875-f0da6a46469c tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.421383 Oct 28 18:03:20.166457 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 62/130] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 18:03:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:03:20.175505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c77b9fa2-7034-45a3-af1d-47747df9148d tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:20.177540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c77b9fa2-7034-45a3-af1d-47747df9148d tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '0b631d34df7b4eb3bf041048fe8283e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a776911c1041eaab461dfba51701e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c77b9fa2-7034-45a3-af1d-47747df9148d tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] Request method failure captured: Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2018:03:20 HTTP/1.1 Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBllO1tX881vKGaLykN3YfEvIglqkDfhJ1ko7p4ZUP8PUXktaFRvb8l9wXb0xfh6qI_yDjoAMsXOt3PoKp-qMOQIToh8sydYz7yPmZ5lSeam5W8YtEYJGmZvtJTuImMuSPA3808_2Mr-03jaqbIJqwWyChJ2kHYWeXUlJm5r1m3DeN4 Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c1a776911c1041eaab461dfba51701e0 Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:20.179654 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a776911c1041eaab461dfba51701e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a776911c1041eaab461dfba51701e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1a776911c1041eaab461dfba51701e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1a776911c1041eaab461dfba51701e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c1a776911c1041eaab461dfba51701e0 Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 0b631d34df7b4eb3bf041048fe8283e5 Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project Oct 28 18:03:20.181365 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2022-10-28 18:03:20'} Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:20.182050 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 18:03:20.183418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:20.186594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c77b9fa2-7034-45a3-af1d-47747df9148d tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:20.187679 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c77b9fa2-7034-45a3-af1d-47747df9148d tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457 tempest-InstanceUsageAuditLogNegativeTestJSON-1373853457-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 18:03:20" status: 403 len: 128 microversion: 2.1 time: 0.016360 Oct 28 18:03:20.192050 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 69/131] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:03:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2018%3A03%3A20 => generated 128 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:20.343408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:20.344247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:20.362828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:20.363326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:20.366305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:20.369278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:20.369868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:20.371693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:20.550125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:20.565418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:20.567231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:20.568659 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c6bde93e-5d27-4312-828a-cdf68bd8ae2f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1320 microversion: 2.25 time: 0.238749 Oct 28 18:03:20.575856 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 63/132] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:20 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:20.976583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:20.977331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:21.003435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:21.004006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:21.011232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:21.017361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:21.017973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:21.024550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:21.400013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:21.415115 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92f57fe9-704f-43a6-b543-7258cd4e0a0b tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.444765 Oct 28 18:03:21.416786 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 70/133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:20 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:21.613796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:21.614515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:21.627297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:21.628405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:21.629038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:21.630781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:21.632024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:21.632784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:21.742560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:21.771617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:21.773776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:21.775124 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff8e1727-26c2-405d-ab9e-50bf6805a857 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1320 microversion: 2.25 time: 0.166268 Oct 28 18:03:21.776547 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 64/134] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:21 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:22.447981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:22.448570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:22.469635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:22.470389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:22.474568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:22.477152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:22.477793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:22.479073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:22.804375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:22.804989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:22.819048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:22.819535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:22.820006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:22.820722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:22.821176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:22.821601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:23.258627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:23.681819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:23.698352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:23.700101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:23.701324 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dff8c31d-45a9-49a6-9964-1735e16844d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1320 microversion: 2.25 time: 0.901079 Oct 28 18:03:23.702275 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 65/135] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:22 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1320 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:03:23.961664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:23.981975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:24.005845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6107bcc2-f3d4-4022-b0be-a4668061f04e tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 1.567811 Oct 28 18:03:24.009330 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 71/136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:22 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:24.260399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9af752bf-0ae4-4f00-a60f-7fb336483b9c tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Action: 'create', calling method: .version_select at 0x7f78dedd0f70>, body: {"keypair": {"name": "tempest-keypair-512283950", "type": "ssh", "user_id": "d1fcea64f7554f58a45a7c5b72d64e41", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjT6r0kkFLVSp65prcR1f0lnVJoQdjMpiNxXxV4huFHCa7SmpNbfAnepI7y482IuNVeN3Tu1a0vCF4+6xK83q3yrDxf/HGI951g7bTIWkZbgw9uJjdISyZl3i87MS8LPA=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:24.335411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9af752bf-0ae4-4f00-a60f-7fb336483b9c tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Getting quotas for project 7421365aea5144658ffbb4b3174efbdb. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:03:24.357444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9af752bf-0ae4-4f00-a60f-7fb336483b9c tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Getting quotas for user 23b2e83f0c8343aab87360babfa0877c and project 7421365aea5144658ffbb4b3174efbdb. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:03:24.413506 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9af752bf-0ae4-4f00-a60f-7fb336483b9c tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.498938 Oct 28 18:03:24.419083 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 66/137] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:03:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 505 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 18:03:24.446946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d6951cc-d14e-480b-ad3a-20b242129170 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Action: 'create', calling method: .version_select at 0x7f78decaa5e0>, body: {"keypair": {"name": "tempest-keypair-473335572", "type": "ssh", "user_id": "d1fcea64f7554f58a45a7c5b72d64e41", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLliZVDHJgjixxbqWx2kWNP5n3RFlJN0A2CF7soRspve4zSDAaZZL/HqT6RahrZMs59rdKK0QdWYaAxbWEVi6lsZ5icFOeBYZSTCGkQ9aFNT+tHONO/60Btaem76dDHIA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:24.507510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5d6951cc-d14e-480b-ad3a-20b242129170 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Getting quotas for project 7421365aea5144658ffbb4b3174efbdb. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:03:24.528665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5d6951cc-d14e-480b-ad3a-20b242129170 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Getting quotas for user 23b2e83f0c8343aab87360babfa0877c and project 7421365aea5144658ffbb4b3174efbdb. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:03:24.615031 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d6951cc-d14e-480b-ad3a-20b242129170 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.184203 Oct 28 18:03:24.616010 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 72/138] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:03:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 18:03:24.635010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48c55add-c91c-4de4-9e45-b5f91d3a10d2 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Calling method '.version_select at 0x7f78decaa160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:24.667302 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48c55add-c91c-4de4-9e45-b5f91d3a10d2 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-512283950?user_id=d1fcea64f7554f58a45a7c5b72d64e41" status: 200 len: 511 microversion: 2.10 time: 0.038685 Oct 28 18:03:24.670140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 73/139] 10.222.0.16 () {60 vars in 1337 bytes} [Fri Oct 28 18:03:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-512283950?user_id=d1fcea64f7554f58a45a7c5b72d64e41 => generated 511 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:03:24.695246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48a372a4-f2f9-4daa-a974-80b2a2b8ce0b tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Action: 'create', calling method: .version_select at 0x7f78decaa0d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1364947271", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEKVk349LtUfjyAipDiNYkfOPYcbXxotEVBJyYgs0O10O7Li11oX02msPmdXrQguciBEoICVYDmMfzLLMZKJa4Z6WPlR82gnCGr8tnLiHXGBi232kbj/GjzPARb9zRvIg=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:24.733655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-48a372a4-f2f9-4daa-a974-80b2a2b8ce0b tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Getting quotas for project 7421365aea5144658ffbb4b3174efbdb. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:03:24.740988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-48a372a4-f2f9-4daa-a974-80b2a2b8ce0b tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Getting quotas for user 23b2e83f0c8343aab87360babfa0877c and project 7421365aea5144658ffbb4b3174efbdb. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:03:24.775375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-97120292-ec90-4198-91a9-aa05ae8f5c62 req-4077d966-6510-4547-97f6-6fcc2e88de0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d2e06f-02c1-4aa8-8f3a-d09a51964b4c", "name": "network-vif-plugged", "status": "completed", "tag": "947a8b1e-12f9-4a75-9dc9-5226a9dfdd45"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:24.801012 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48a372a4-f2f9-4daa-a974-80b2a2b8ce0b tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.110113 Oct 28 18:03:24.801937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 74/140] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:03:24 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 18:03:24.809301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-97120292-ec90-4198-91a9-aa05ae8f5c62 req-4077d966-6510-4547-97f6-6fcc2e88de0d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:24.809948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-97120292-ec90-4198-91a9-aa05ae8f5c62 req-4077d966-6510-4547-97f6-6fcc2e88de0d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:24.811572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-97120292-ec90-4198-91a9-aa05ae8f5c62 req-4077d966-6510-4547-97f6-6fcc2e88de0d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:24.839944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:24.842444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:24.854915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:24.857843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:24.864597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:24.868008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:24.869245 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-97120292-ec90-4198-91a9-aa05ae8f5c62 req-4077d966-6510-4547-97f6-6fcc2e88de0d service nova] Creating event network-vif-plugged:947a8b1e-12f9-4a75-9dc9-5226a9dfdd45 for instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c on n-h1-862404-2 Oct 28 18:03:24.872118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:24.873073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:24.896535 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-97120292-ec90-4198-91a9-aa05ae8f5c62 req-4077d966-6510-4547-97f6-6fcc2e88de0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271404 Oct 28 18:03:24.906611 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 67/141] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:24.937551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-84fab8ea-3d0d-4c5b-b269-24569c14fb7e tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Calling method '.version_select at 0x7f78def62c10>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:24.956296 n-d-862404-2 devstack@n-api.service[120679]: WARNING oslo_db.sqlalchemy.utils [None req-84fab8ea-3d0d-4c5b-b269-24569c14fb7e tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 18:03:24.980966 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-84fab8ea-3d0d-4c5b-b269-24569c14fb7e tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=d1fcea64f7554f58a45a7c5b72d64e41" status: 200 len: 724 microversion: 2.10 time: 0.072910 Oct 28 18:03:24.982264 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 68/142] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Oct 28 18:03:24 2022] GET /compute/v2.1/os-keypairs?user_id=d1fcea64f7554f58a45a7c5b72d64e41 => generated 724 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:03:24.994893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a35922c-b329-49b0-a80b-1cb582e9fa5d tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Calling method '.version_select at 0x7f78dee141f0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:25.050808 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9a35922c-b329-49b0-a80b-1cb582e9fa5d tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1364947271" status: 204 len: 0 microversion: 2.10 time: 0.059906 Oct 28 18:03:25.063270 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 69/143] 10.222.0.16 () {60 vars in 1325 bytes} [Fri Oct 28 18:03:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1364947271 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:03:25.070686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:25.071862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:25.088226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:25.089206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:25.095657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:25.114466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:25.115300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:25.116044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:25.218028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:25.246004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:25.251446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:25.254661 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-628a237a-be9b-4cd9-8a7f-4778ac8a12a5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1320 microversion: 2.25 time: 0.434677 Oct 28 18:03:25.256808 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 75/144] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:24 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:25.275377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e452bb95-69bb-494f-9d73-b215684678d4 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Calling method '.version_select at 0x7f78decaad30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:25.333586 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e452bb95-69bb-494f-9d73-b215684678d4 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-473335572?user_id=d1fcea64f7554f58a45a7c5b72d64e41" status: 204 len: 0 microversion: 2.10 time: 0.073163 Oct 28 18:03:25.342210 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 76/145] 10.222.0.16 () {60 vars in 1340 bytes} [Fri Oct 28 18:03:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-473335572?user_id=d1fcea64f7554f58a45a7c5b72d64e41 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:03:25.368617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7cd0fb75-988a-4bf2-88eb-7b3405300874 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] Calling method '.version_select at 0x7f78dece1820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:25.423249 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7cd0fb75-988a-4bf2-88eb-7b3405300874 tempest-KeyPairsV210TestJSON-1760260760 tempest-KeyPairsV210TestJSON-1760260760-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-512283950?user_id=d1fcea64f7554f58a45a7c5b72d64e41" status: 204 len: 0 microversion: 2.10 time: 0.077305 Oct 28 18:03:25.424065 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 77/146] 10.222.0.16 () {60 vars in 1340 bytes} [Fri Oct 28 18:03:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-512283950?user_id=d1fcea64f7554f58a45a7c5b72d64e41 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:03:26.267477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:26.278241 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff78b93c-2392-400c-a3b0-c2869ccf7609 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 1.213238 Oct 28 18:03:26.278834 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 70/147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:25 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:26.300448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:26.301577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:26.324759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:26.326694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:26.327345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:26.328117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:26.330458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:26.331331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:26.929907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:26.949124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:26.951527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:26.957399 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5d4fe3f-9b84-461e-9498-c56dd3ee43d6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.663176 Oct 28 18:03:26.957994 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 78/148] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:26 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:27.305101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:27.305826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:27.315682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:27.319400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:27.320021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:27.320876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:27.329611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:27.330471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:27.725420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:27.763016 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-692fc3cd-0406-4d52-b223-9e56ceeeac78 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1338 microversion: 2.1 time: 0.462224 Oct 28 18:03:27.773071 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 71/149] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:27 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1338 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:27.985825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:27.986621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:28.005798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:28.007751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:28.010423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:28.011966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:28.013276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:28.014868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:28.738883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:28.753055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:28.760627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:28.763140 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80b89fbd-a285-4c88-a769-5d0dd686ab0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.783037 Oct 28 18:03:28.765736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 79/150] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:27 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:28.803783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:28.804452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:28.813519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:28.814010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:28.819796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:28.821243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:28.824411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:28.826510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:29.266243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:29.274450 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-34f2db78-6c4f-4a90-a76b-fc975523f20c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1488 microversion: 2.1 time: 0.476738 Oct 28 18:03:29.275044 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 72/151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:28 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1488 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:29.305577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:29.306297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:29.320224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:29.320827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:29.321972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:29.322777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:29.323314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:29.323833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:29.804782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:29.805532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:29.821021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:29.821786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:29.822494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:29.823375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:29.824036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:29.824615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:30.046137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:30.070087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:30.073419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:30.074820 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f742eed-9e79-41b6-8807-82415332fedd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.274939 Oct 28 18:03:30.088169 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 73/152] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:29 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:03:31.813738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ec0b4396-c74b-444e-83d9-98abf1dc088b tempest-QuotaClassesAdminTestJSON-1241001044 tempest-QuotaClassesAdminTestJSON-1241001044-project-admin] Calling method '.version_select at 0x7f78dee26670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:31.877224 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ec0b4396-c74b-444e-83d9-98abf1dc088b tempest-QuotaClassesAdminTestJSON-1241001044 tempest-QuotaClassesAdminTestJSON-1241001044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.794043 Oct 28 18:03:31.888406 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 74/153] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 18:03:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:31.903779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:31.906742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:31.994992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:31.996527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:31.996993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:31.998290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:31.998977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:31.999591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.040356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e499343d-9828-4762-9771-920cb0ad796e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1639 microversion: 2.1 time: 2.740193 Oct 28 18:03:32.049165 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 80/154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:29 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1639 bytes in 2750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:32.372303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:32.384726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8d74758c-f844-4d1f-9c03-49c4b098ed4d req-273eb9ff-d092-4adb-b379-d6253cab37a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d5060e3-1d73-4594-a7f6-7369dba3c88a", "tag": "b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:32.399122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:32.409347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:32.419451 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-52da76e7-0c8d-4b8a-ae06-fc7cf84e7153 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.530765 Oct 28 18:03:32.422798 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 75/155] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:31 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:32.437859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8d74758c-f844-4d1f-9c03-49c4b098ed4d req-273eb9ff-d092-4adb-b379-d6253cab37a3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.438274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8d74758c-f844-4d1f-9c03-49c4b098ed4d req-273eb9ff-d092-4adb-b379-d6253cab37a3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.438916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1230ef1-b0ce-4f5b-a3c2-5ebf26f4aea0 tempest-QuotaClassesAdminTestJSON-1241001044 tempest-QuotaClassesAdminTestJSON-1241001044-project-admin] Action: 'update', calling method: .version_select at 0x7f78dee26310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:32.440005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8d74758c-f844-4d1f-9c03-49c4b098ed4d req-273eb9ff-d092-4adb-b379-d6253cab37a3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.532816 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8d74758c-f844-4d1f-9c03-49c4b098ed4d req-273eb9ff-d092-4adb-b379-d6253cab37a3 service nova] Creating event network-changed:b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694 for instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a on n-h2-862404-2 Oct 28 18:03:32.533414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8d74758c-f844-4d1f-9c03-49c4b098ed4d req-273eb9ff-d092-4adb-b379-d6253cab37a3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:03:32.534883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8d74758c-f844-4d1f-9c03-49c4b098ed4d req-273eb9ff-d092-4adb-b379-d6253cab37a3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:03:32.556308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.557652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.562469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.564923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.569171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.571494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.614765 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.compute.rpcapi [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 18:03:32.619127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] Releasing lock "compute-rpcapi-router" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:03:32.653359 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4462e5e-5520-4227-805a-59537f6c3051 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.601502 Oct 28 18:03:32.655846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 81/156] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:32.668677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:32.671535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:32.699150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.700432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.702227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.706812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.709195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.711678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.777553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:03:33.015487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:33.151766 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08c0c507-db35-43c8-ba05-96c2b6151058 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 204 len: 0 microversion: 2.1 time: 0.493819 Oct 28 18:03:33.158288 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 82/157] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:03:32 2022] DELETE /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:03:33.193983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:33.203548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:33.228178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:33.230629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:33.231887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:33.234307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:33.236033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:33.238357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:33.647375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=11,nova_api:DELETE=1,nova_api:UPDATE=11 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:33.738968 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1230ef1-b0ce-4f5b-a3c2-5ebf26f4aea0 tempest-QuotaClassesAdminTestJSON-1241001044 tempest-QuotaClassesAdminTestJSON-1241001044-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.309490 Oct 28 18:03:33.740536 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 76/158] 10.222.0.16 () {60 vars in 1206 bytes} [Fri Oct 28 18:03:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:33.745975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:33.747071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:33.759266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:33.761701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:33.762683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:33.764500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:33.765532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:33.766332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.085449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:34.157255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:34.159527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:34.160734 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1350e6fc-9a42-40ab-b55c-6a75a1f40624 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.419101 Oct 28 18:03:34.166836 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 77/159] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:33 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:34.173165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ade7ba75-777c-4b75-aa8f-e643d77a8e01 tempest-QuotaClassesAdminTestJSON-1241001044 tempest-QuotaClassesAdminTestJSON-1241001044-project-admin] Calling method '.version_select at 0x7f78deebd8b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:34.174968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:34.182944 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80185478-8a67-4965-a014-bde619d59bc7 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1494 microversion: 2.1 time: 1.019770 Oct 28 18:03:34.188614 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 83/160] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:33 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1494 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:34.198698 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ade7ba75-777c-4b75-aa8f-e643d77a8e01 tempest-QuotaClassesAdminTestJSON-1241001044 tempest-QuotaClassesAdminTestJSON-1241001044-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.028090 Oct 28 18:03:34.199964 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 78/161] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 18:03:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:34.212995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff95b63c-e49a-4c25-a420-7e87e2faca4d tempest-QuotaClassesAdminTestJSON-1241001044 tempest-QuotaClassesAdminTestJSON-1241001044-project-admin] Action: 'update', calling method: .version_select at 0x7f78dec72940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:34.261619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:34.426874 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff95b63c-e49a-4c25-a420-7e87e2faca4d tempest-QuotaClassesAdminTestJSON-1241001044 tempest-QuotaClassesAdminTestJSON-1241001044-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.217898 Oct 28 18:03:34.427477 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 84/162] 10.222.0.16 () {60 vars in 1206 bytes} [Fri Oct 28 18:03:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:34.945219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0b1980f-6a8e-4ed4-a0a4-f7d9a2334743 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:34.969639 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e0b1980f-6a8e-4ed4-a0a4-f7d9a2334743 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.436475 Oct 28 18:03:34.970265 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 79/163] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:03:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:35.190927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:35.191831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:35.212982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:35.217504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:35.218326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:35.219258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:35.219983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:35.223051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:35.452072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ebc96e8d-1136-41a3-bd58-ca36b6c6ba5e tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1790801384", "id": 209755473, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:35.528496 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ebc96e8d-1136-41a3-bd58-ca36b6c6ba5e tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.533247 Oct 28 18:03:35.530517 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 85/164] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:34 2022] POST /compute/v2.1/flavors => generated 422 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:35.552285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:35.556604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:35.569421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:35.573609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:35.578904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:35.580070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:35.581927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:35.582920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:35.753559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:35.769282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:35.771089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:35.773444 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2f58733e-c077-498a-8944-def840d084a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.586093 Oct 28 18:03:35.775028 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 80/165] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:35 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:35.936398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28a05f6d-33b3-4e4d-9295-dce6a98774c7 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Calling method '.version_select at 0x7f78ded88a60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:36.147297 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28a05f6d-33b3-4e4d-9295-dce6a98774c7 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f51bcff598274135b2e049268546e25a" status: 200 len: 371 microversion: 2.1 time: 0.366569 Oct 28 18:03:36.149022 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 81/166] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:03:35 2022] GET /compute/v2.1/os-quota-sets/f51bcff598274135b2e049268546e25a => generated 371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:36.153648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de27bd7d-46d8-4411-aa87-7b5241d4b1d1 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:36.174832 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de27bd7d-46d8-4411-aa87-7b5241d4b1d1 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024545 Oct 28 18:03:36.186721 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 82/167] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 18:03:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:03:36.191690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2af5840e-f6f6-48cc-bde7-10509444655f tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Action: 'update', calling method: .version_select at 0x7f78deebd4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:36.348751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2af5840e-f6f6-48cc-bde7-10509444655f tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:36.362144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2af5840e-f6f6-48cc-bde7-10509444655f tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:36.362685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2af5840e-f6f6-48cc-bde7-10509444655f tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:36.363525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2af5840e-f6f6-48cc-bde7-10509444655f tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:36.364033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2af5840e-f6f6-48cc-bde7-10509444655f tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:36.367694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2af5840e-f6f6-48cc-bde7-10509444655f tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:36.385506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:36.554720 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2af5840e-f6f6-48cc-bde7-10509444655f tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/f51bcff598274135b2e049268546e25a" status: 200 len: 328 microversion: 2.1 time: 0.366571 Oct 28 18:03:36.563299 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 83/168] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:03:36 2022] PUT /compute/v2.1/os-quota-sets/f51bcff598274135b2e049268546e25a => generated 328 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:36.574492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cc2bbc17-3212-48ec-ae6f-ce4a52fb8c0f tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1811546505", "id": 956165666, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:36.637469 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cc2bbc17-3212-48ec-ae6f-ce4a52fb8c0f tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.066929 Oct 28 18:03:36.638071 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 84/169] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:36 2022] POST /compute/v2.1/flavors => generated 422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:36.651671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-83defff9-33bb-40b1-88e1-87cf4f99cf06 req-f2aee4b2-97f4-44e2-9b20-bfa5a98b7dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d2e06f-02c1-4aa8-8f3a-d09a51964b4c", "name": "network-vif-deleted", "tag": "947a8b1e-12f9-4a75-9dc9-5226a9dfdd45"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:36.675243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-83defff9-33bb-40b1-88e1-87cf4f99cf06 req-f2aee4b2-97f4-44e2-9b20-bfa5a98b7dd5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:36.675735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-83defff9-33bb-40b1-88e1-87cf4f99cf06 req-f2aee4b2-97f4-44e2-9b20-bfa5a98b7dd5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:36.680335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-83defff9-33bb-40b1-88e1-87cf4f99cf06 req-f2aee4b2-97f4-44e2-9b20-bfa5a98b7dd5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:36.698952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca78721dd094b08a9ca964324cddaa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197ba3fbe250454ca0897cca868a826c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:36.710983 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-83defff9-33bb-40b1-88e1-87cf4f99cf06 req-f2aee4b2-97f4-44e2-9b20-bfa5a98b7dd5 service nova] Creating event network-vif-deleted:947a8b1e-12f9-4a75-9dc9-5226a9dfdd45 for instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c on n-h1-862404-2 Oct 28 18:03:36.721475 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92404a0f-ccf8-4609-bbb8-578316a7b12d tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 200 len: 1494 microversion: 2.1 time: 1.180966 Oct 28 18:03:36.721475 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 86/170] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:35 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 1494 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:36.725768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9cde845b-e605-4b92-8f6f-7d9192e2ebb3 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:36.732821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-83defff9-33bb-40b1-88e1-87cf4f99cf06 req-f2aee4b2-97f4-44e2-9b20-bfa5a98b7dd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093153 Oct 28 18:03:36.733934 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 85/171] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:36.749783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0f308be-0bfd-4eff-aaac-b19b5e957474 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:36.758390 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9cde845b-e605-4b92-8f6f-7d9192e2ebb3 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/f51bcff598274135b2e049268546e25a" status: 202 len: 0 microversion: 2.1 time: 0.043720 Oct 28 18:03:36.759490 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 87/172] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:03:36 2022] DELETE /compute/v2.1/os-quota-sets/f51bcff598274135b2e049268546e25a => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:36.774725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfd4b28c-bc62-4607-b0ca-2e908f9fad10 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Calling method '.version_select at 0x7f78dece1280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:36.798921 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e0f308be-0bfd-4eff-aaac-b19b5e957474 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.058623 Oct 28 18:03:36.802348 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 86/173] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 18:03:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:03:36.815223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:36.817011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:36.832215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:36.843717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:36.844259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:36.845080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:36.845613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:36.847394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:36.929556 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cfd4b28c-bc62-4607-b0ca-2e908f9fad10 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f51bcff598274135b2e049268546e25a" status: 200 len: 371 microversion: 2.1 time: 0.165673 Oct 28 18:03:36.930604 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 88/174] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:03:36 2022] GET /compute/v2.1/os-quota-sets/f51bcff598274135b2e049268546e25a => generated 371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:36.937219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5915b865-bfa7-471e-b4d4-6eafe574c8d0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Action: 'create', calling method: .version_select at 0x7f78debc8ee0>, body: {"keypair": {"name": "tempest-keypair-591347395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAndREjrqD3Sx8BaeyeOvPGltBPoicAN/9npKuO6VxQSZI8qZ2Pmn6J20MJgCrraIKHfK7YmjGhVHNrINGTh54Hi53ACyxT2g5hpUSlBm0oYhcCe/BGUivIAJcqVFm84bw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:37.037996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5915b865-bfa7-471e-b4d4-6eafe574c8d0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Getting quotas for project c23cb0ccf6b342ba983516131c90956a. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:03:37.086682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5915b865-bfa7-471e-b4d4-6eafe574c8d0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Getting quotas for user 7d8ca12f168244f8a2ee4ee78f6263fc and project c23cb0ccf6b342ba983516131c90956a. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:03:37.168363 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5915b865-bfa7-471e-b4d4-6eafe574c8d0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.235961 Oct 28 18:03:37.173732 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 89/175] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:03:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:37.191697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:37.211377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:37.219463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:37.223678 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a9cd6a2-cf38-4255-8ff8-842d9e01fd98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.413246 Oct 28 18:03:37.224449 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 87/176] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:36 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:37.332906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6fb97db1-5ed9-49e1-a3ff-9dd11a6dce5a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Calling method '.version_select at 0x7f78dec27af0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:37.716116 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6fb97db1-5ed9-49e1-a3ff-9dd11a6dce5a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c7b0a97d730c4720b2a4cf894e5e735c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.387494 Oct 28 18:03:37.717996 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 90/177] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:03:37 2022] GET /compute/v2.1/os-quota-sets/c7b0a97d730c4720b2a4cf894e5e735c/defaults => generated 371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:37.765768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:37.777868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:37.799311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:37.806245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:37.809661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:37.810726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:37.814970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:37.816578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:37.882884 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] HTTP exception thrown: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Request method failure captured: Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c HTTP/1.1 Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlCEC25aRcVsYCjH9yuVWIFrPuUEHQv-g97qgNeo4usNaD0-O1eWtPyFKm1od4AJOkTKl_IkWUtVLgQ5WEHWDlaUoThe8CFXHv3ZqnbIUdnMGY1pzm1kh9nbZh6B_N8Dsa6R4cH7I8Bgmwq4ecXalW-DYLM7pjsjnFs8_7-1fU0AFk Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 197ba3fbe250454ca0897cca868a826c Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:03:37.891842 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_197ba3fbe250454ca0897cca868a826c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 197ba3fbe250454ca0897cca868a826c Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AggregatesAdminTestJSON-963500604-project Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 5ca78721dd094b08a9ca964324cddaa7 Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AggregatesAdminTestJSON-963500604-project Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:37.893371 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '65d2e06f-02c1-4aa8-8f3a-d09a51964b4c'} Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:37.894061 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:37.895899 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:37.901767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Returning 404 to user: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:37.904873 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff1e0b81-af9a-4c11-90d9-4d1a4a1e9612 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 404 len: 111 microversion: 2.1 time: 0.165366 Oct 28 18:03:37.905710 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 88/178] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:37 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:37.914574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81d21725-cc11-4d22-b0a2-d87c4161b339 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:37.933122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81d21725-cc11-4d22-b0a2-d87c4161b339 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:37.933619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81d21725-cc11-4d22-b0a2-d87c4161b339 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:37.934057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81d21725-cc11-4d22-b0a2-d87c4161b339 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:38.235445 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81d21725-cc11-4d22-b0a2-d87c4161b339 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 297 microversion: 2.1 time: 0.324550 Oct 28 18:03:38.236109 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 91/179] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:37 2022] POST /compute/v2.1/os-aggregates/2/action => generated 297 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:38.254410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5899b9ac-38cf-4081-be09-2a9a4653bed5 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:38.261508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:38.262127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:38.275617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:38.276116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:38.276556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:38.278532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:38.279944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:38.286454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:38.307211 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5899b9ac-38cf-4081-be09-2a9a4653bed5 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.057048 Oct 28 18:03:38.308876 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 89/180] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:38 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:38.322858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a08b3861-e29f-461f-bea2-715497ca49d2 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Action: 'update', calling method: .version_select at 0x7f78deef4430>, body: {"quota_set": {"ram": "5120"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:38.707534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:38.717170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:38.718619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:38.719745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be13bf5d-6e1f-4f6d-bb73-a868fbbf5a92 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.462149 Oct 28 18:03:38.736206 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 92/181] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:38 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:38.741105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-153322c5-bbab-4c7e-b46b-328d3ef39454 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1923184822"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:38.750139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-153322c5-bbab-4c7e-b46b-328d3ef39454 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid 0a325aec-6e40-460b-9c5c-95147a3ab517 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:38.850191 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-153322c5-bbab-4c7e-b46b-328d3ef39454 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.111241 Oct 28 18:03:38.851497 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 93/182] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:38.876609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ecb65161-fb0c-4358-94a2-2d3f9ab794e0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:38.916848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb65161-fb0c-4358-94a2-2d3f9ab794e0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:38.917726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb65161-fb0c-4358-94a2-2d3f9ab794e0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:38.919392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb65161-fb0c-4358-94a2-2d3f9ab794e0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:38.956749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a08b3861-e29f-461f-bea2-715497ca49d2 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:38.960916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a08b3861-e29f-461f-bea2-715497ca49d2 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:38.962226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a08b3861-e29f-461f-bea2-715497ca49d2 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:38.964482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a08b3861-e29f-461f-bea2-715497ca49d2 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:38.969417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a08b3861-e29f-461f-bea2-715497ca49d2 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:38.972956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a08b3861-e29f-461f-bea2-715497ca49d2 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:39.117035 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a08b3861-e29f-461f-bea2-715497ca49d2 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/2ca57b5e4af74751b4bcd11f1acf2710" status: 200 len: 328 microversion: 2.1 time: 0.805256 Oct 28 18:03:39.146727 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 90/183] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:03:38 2022] PUT /compute/v2.1/os-quota-sets/2ca57b5e4af74751b4bcd11f1acf2710 => generated 328 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:39.151927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfbd7c65-6c57-410f-9bb6-fbeba5b05147 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Calling method '.version_select at 0x7f78dede3700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:39.276147 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ecb65161-fb0c-4358-94a2-2d3f9ab794e0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.413977 Oct 28 18:03:39.276804 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 94/184] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:39.289533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4ddd1c4-1afc-4599-b368-c58f8ebd3ed0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:39.314602 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d4ddd1c4-1afc-4599-b368-c58f8ebd3ed0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.028980 Oct 28 18:03:39.322246 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 95/185] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:03:39 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:39.343319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f72400c1-77a9-4ebe-8228-8ce83ad0c2d3 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:39.371786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f72400c1-77a9-4ebe-8228-8ce83ad0c2d3 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:39.372595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f72400c1-77a9-4ebe-8228-8ce83ad0c2d3 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:39.373266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f72400c1-77a9-4ebe-8228-8ce83ad0c2d3 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:39.602805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfbd7c65-6c57-410f-9bb6-fbeba5b05147 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:39.604440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfbd7c65-6c57-410f-9bb6-fbeba5b05147 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:39.604887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfbd7c65-6c57-410f-9bb6-fbeba5b05147 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:39.614087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfbd7c65-6c57-410f-9bb6-fbeba5b05147 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:39.615112 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f72400c1-77a9-4ebe-8228-8ce83ad0c2d3 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.290119 Oct 28 18:03:39.615708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfbd7c65-6c57-410f-9bb6-fbeba5b05147 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:39.616328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfbd7c65-6c57-410f-9bb6-fbeba5b05147 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:39.623583 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 96/186] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:39 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:39.636151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0aaa55dd-865a-430c-b8ea-d6ddf1e575f6 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:39.697096 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfbd7c65-6c57-410f-9bb6-fbeba5b05147 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2ca57b5e4af74751b4bcd11f1acf2710/detail" status: 200 len: 916 microversion: 2.1 time: 0.549251 Oct 28 18:03:39.703959 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 91/187] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:03:39 2022] GET /compute/v2.1/os-quota-sets/2ca57b5e4af74751b4bcd11f1acf2710/detail => generated 916 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:39.732930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0aaa55dd-865a-430c-b8ea-d6ddf1e575f6 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.101288 Oct 28 18:03:39.734259 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 97/188] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:39 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:39.762897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19b384b8-8883-47ec-8cf7-4c33b36cc1fb tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-795701003"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:39.767234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.aggregate [None req-19b384b8-8883-47ec-8cf7-4c33b36cc1fb tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid 4f3ebd72-c461-4784-94f7-67a22f04e91a for aggregate {{(pid=120679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:39.781517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:39.782523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:39.810577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:39.815002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:39.818447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:39.821039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:39.823512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:39.828186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:39.851657 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-19b384b8-8883-47ec-8cf7-4c33b36cc1fb tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.090006 Oct 28 18:03:39.853788 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 92/189] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:39.889237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0bff00ff-b257-4b38-8200-e7ed680c4503 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:39.945195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bff00ff-b257-4b38-8200-e7ed680c4503 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:39.945195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bff00ff-b257-4b38-8200-e7ed680c4503 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:39.945195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bff00ff-b257-4b38-8200-e7ed680c4503 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:40.540066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:40.558820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:40.574075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:40.577366 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b82654a-ebb7-4723-a0f4-392fad011f01 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.807615 Oct 28 18:03:40.586752 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 98/190] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:39 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:40.611202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Action: 'update', calling method: .version_select at 0x7f78debb8790>, body: {"quota_set": {"ram": "2048"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:40.947246 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0bff00ff-b257-4b38-8200-e7ed680c4503 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 1.064503 Oct 28 18:03:40.948801 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 93/191] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:39 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:40.962394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2d2ce59a-fc10-41bf-9222-054b22e1f623 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:40.985953 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2d2ce59a-fc10-41bf-9222-054b22e1f623 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.028109 Oct 28 18:03:40.991306 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 94/192] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:03:40 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:41.003053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-627499d0-f63b-4871-b9ae-900e412f538d tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:41.033794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-627499d0-f63b-4871-b9ae-900e412f538d tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.035634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-627499d0-f63b-4871-b9ae-900e412f538d tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.036801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-627499d0-f63b-4871-b9ae-900e412f538d tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.278722 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-627499d0-f63b-4871-b9ae-900e412f538d tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.280849 Oct 28 18:03:41.284066 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 95/193] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:40 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:41.291872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e2c7b1c-39fa-482f-974f-a8b875abca38 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:41.328209 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e2c7b1c-39fa-482f-974f-a8b875abca38 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.039884 Oct 28 18:03:41.332018 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 96/194] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:41 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:41.347794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50c11c58-8723-4524-b1b4-3792b77e1db3 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2145301198"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:41.351726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.354394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.356770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.358312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.359325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.aggregate [None req-50c11c58-8723-4524-b1b4-3792b77e1db3 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid 1d885764-11a9-4dc4-b860-50de8fa08dc0 for aggregate {{(pid=120679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:41.359635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.360226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.378782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:41.403192 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50c11c58-8723-4524-b1b4-3792b77e1db3 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064303 Oct 28 18:03:41.403871 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 97/195] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:41.427309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-580867271", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "956165666", "adminPass": "***", "networks": [{"uuid": "103c60d9-e6e4-41aa-a693-d527b9d61e57"}], "security_groups": [{"name": "tempest-securitygroup--931329983"}], "key_name": "tempest-keypair-591347395", "user_data": "}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:41.456466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.457268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.458457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.459426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.460263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.461768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.518361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:UPDATE=9,nova_api:SELECT=81,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:41.590070 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00589d48-6599-4d8d-abbe-22ee07e8a16a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/2ca57b5e4af74751b4bcd11f1acf2710?user_id=060653b24436461c9993136c32e00971" status: 200 len: 328 microversion: 2.1 time: 1.000660 Oct 28 18:03:41.593099 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 99/196] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:03:40 2022] PUT /compute/v2.1/os-quota-sets/2ca57b5e4af74751b4bcd11f1acf2710?user_id=060653b24436461c9993136c32e00971 => generated 328 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:41.604815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b844d2bb-94c6-4324-aafe-deaf6936bbf7 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:41.619398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b844d2bb-94c6-4324-aafe-deaf6936bbf7 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.620175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b844d2bb-94c6-4324-aafe-deaf6936bbf7 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.620852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b844d2bb-94c6-4324-aafe-deaf6936bbf7 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.676640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] validate_networks() for [('103c60d9-e6e4-41aa-a693-d527b9d61e57', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:03:41.818909 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b844d2bb-94c6-4324-aafe-deaf6936bbf7 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.224668 Oct 28 18:03:41.820260 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 100/197] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:41 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:41.825987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e07e016-ed05-4fec-98ce-6c5341ecdc10 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Calling method '.version_select at 0x7f78deb82b80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:42.308965 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e07e016-ed05-4fec-98ce-6c5341ecdc10 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2ca57b5e4af74751b4bcd11f1acf2710?user_id=060653b24436461c9993136c32e00971" status: 200 len: 370 microversion: 2.1 time: 0.487421 Oct 28 18:03:42.309561 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 101/198] 10.222.0.16 () {58 vars in 1323 bytes} [Fri Oct 28 18:03:41 2022] GET /compute/v2.1/os-quota-sets/2ca57b5e4af74751b4bcd11f1acf2710?user_id=060653b24436461c9993136c32e00971 => generated 370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:42.322554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:42.323474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:42.331481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.332561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.333228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.334211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.334866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.335492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.716898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:42.727468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:42.735212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:42.736448 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-255158fa-ae39-4c0b-a74b-59b801d27055 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.417939 Oct 28 18:03:42.737018 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 102/199] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:42 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:42.756018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-81d7bb4a-4821-4600-a125-3686e8f0d4f0 req-b8b54836-4079-479a-88dd-e70c2f0b4b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5060e3-1d73-4594-a7f6-7369dba3c88a", "name": "network-vif-plugged", "status": "completed", "tag": "b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:42.787745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81d7bb4a-4821-4600-a125-3686e8f0d4f0 req-b8b54836-4079-479a-88dd-e70c2f0b4b77 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.789932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81d7bb4a-4821-4600-a125-3686e8f0d4f0 req-b8b54836-4079-479a-88dd-e70c2f0b4b77 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.791882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81d7bb4a-4821-4600-a125-3686e8f0d4f0 req-b8b54836-4079-479a-88dd-e70c2f0b4b77 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.834234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-81d7bb4a-4821-4600-a125-3686e8f0d4f0 req-b8b54836-4079-479a-88dd-e70c2f0b4b77 service nova] Creating event network-vif-plugged:b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694 for instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a on n-h2-862404-2 Oct 28 18:03:42.844371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:03:42.845163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:03:42.845578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:03:42.846189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:03:42.846823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:03:42.857005 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-81d7bb4a-4821-4600-a125-3686e8f0d4f0 req-b8b54836-4079-479a-88dd-e70c2f0b4b77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100709 Oct 28 18:03:42.860135 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 103/200] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:42.869790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.870972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-09f75823-7137-410a-be57-f3222151f981 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:42.880002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.881312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.887311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.887801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.888802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.895978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09f75823-7137-410a-be57-f3222151f981 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.897201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09f75823-7137-410a-be57-f3222151f981 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.897891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09f75823-7137-410a-be57-f3222151f981 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.978245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Getting quotas for project c23cb0ccf6b342ba983516131c90956a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:03:42.987882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Getting quotas for user 7d8ca12f168244f8a2ee4ee78f6263fc and project c23cb0ccf6b342ba983516131c90956a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:03:43.022740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:03:43.029337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:03:43.116167 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1f77d572-24d9-40ed-83f2-47662a6db76d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.698237 Oct 28 18:03:43.117220 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 98/201] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:03:43.123612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-339b8934-84e6-43d8-b739-50d91df58ae9 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Calling method '.version_select at 0x7f78decf39d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:43.161101 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-09f75823-7137-410a-be57-f3222151f981 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.298037 Oct 28 18:03:43.161949 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 104/202] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:42 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:43.172187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81291f72-fefe-432b-8bac-32fcd6260764 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:43.173435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81291f72-fefe-432b-8bac-32fcd6260764 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:43.329327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-81291f72-fefe-432b-8bac-32fcd6260764 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:43.336723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=41 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:43.339515 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81291f72-fefe-432b-8bac-32fcd6260764 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1261 microversion: 2.1 time: 0.176479 Oct 28 18:03:43.348168 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 105/203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:43 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:43.354016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08968df9-9e8b-48d5-bca4-60b896fb9460 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:43.438211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08968df9-9e8b-48d5-bca4-60b896fb9460 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.085369 Oct 28 18:03:43.440289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 106/204] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:43 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:43.452455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-18d628f8-1ef8-494a-bc04-6406d564823e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1585922630"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:43.458540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-18d628f8-1ef8-494a-bc04-6406d564823e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid fb6c719c-11dd-47a0-aefb-7173c58e3714 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:43.511798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-18d628f8-1ef8-494a-bc04-6406d564823e tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064935 Oct 28 18:03:43.512781 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 107/205] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:43.519114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2bed996-d7ad-41e3-a20f-9d08aefcec74 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-486230378"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:43.528260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-f2bed996-d7ad-41e3-a20f-9d08aefcec74 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid 2948a822-0d9a-419e-8d26-255bc990eb11 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:43.532016 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-339b8934-84e6-43d8-b739-50d91df58ae9 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/c7b0a97d730c4720b2a4cf894e5e735c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.412957 Oct 28 18:03:43.532699 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 99/206] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:03:43 2022] GET /compute/v2.1/os-quota-sets/c7b0a97d730c4720b2a4cf894e5e735c/defaults => generated 371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:43.537890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e36943e2-7653-4ecc-87d4-bea72afee5f9 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:43.573491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2bed996-d7ad-41e3-a20f-9d08aefcec74 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058899 Oct 28 18:03:43.581812 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 108/207] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:43.593828 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e36943e2-7653-4ecc-87d4-bea72afee5f9 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.059489 Oct 28 18:03:43.594697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9596e38-445b-446a-983a-b82ce8cb6272 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Action: 'update', calling method: .version_select at 0x7f78deb82dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:43.595474 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 100/208] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:43 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:43.608671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb358bbd-7e57-4670-8d61-f5cd583ff58f tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:43.629058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb358bbd-7e57-4670-8d61-f5cd583ff58f tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:43.636587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb358bbd-7e57-4670-8d61-f5cd583ff58f tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:43.647177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb358bbd-7e57-4670-8d61-f5cd583ff58f tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:43.799568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9596e38-445b-446a-983a-b82ce8cb6272 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:43.800139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9596e38-445b-446a-983a-b82ce8cb6272 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:43.801476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9596e38-445b-446a-983a-b82ce8cb6272 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:43.802434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9596e38-445b-446a-983a-b82ce8cb6272 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:43.802997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9596e38-445b-446a-983a-b82ce8cb6272 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:43.803835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9596e38-445b-446a-983a-b82ce8cb6272 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:43.918260 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb358bbd-7e57-4670-8d61-f5cd583ff58f tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.315669 Oct 28 18:03:43.927709 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 101/209] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:43 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:43.933408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ed630a1-8662-46ef-a8ee-ef416e389e6c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:43.947302 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4ed630a1-8662-46ef-a8ee-ef416e389e6c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ed630a1-8662-46ef-a8ee-ef416e389e6c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Request method failure captured: Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlEktG-kVHLTK2gPs7wFfMT6VGOfgGTC7fYz7gLJH-rtnAM1Q1eBbrxJ4j45HU3BML3dn8rhrhuUVafs0mWVZPuw2Awra1oXedFP_tgv0rGst_0WY-ufTjmSLwgThGUwcszyq1wzBARdeFpgtUorrX72iVtNVS0fCEDUNMVaNyesys Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: e48816297f1240f7955b575f81db8454 Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:03:43.973785 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e48816297f1240f7955b575f81db8454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e48816297f1240f7955b575f81db8454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e48816297f1240f7955b575f81db8454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e48816297f1240f7955b575f81db8454"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: e48816297f1240f7955b575f81db8454 Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AggregatesAdminTestJSON-208402899-project-admin Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 73893f83cade4c659cecfb8da90dbc9b Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AggregatesAdminTestJSON-208402899-project-admin Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: exception: Aggregate 6 could not be found. Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '6'} Oct 28 18:03:43.975515 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:43.977916 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:43.979391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ed630a1-8662-46ef-a8ee-ef416e389e6c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:43.980756 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4ed630a1-8662-46ef-a8ee-ef416e389e6c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.051648 Oct 28 18:03:43.984530 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 102/210] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:03:43 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:03:43.987749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:43.990741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:44.014443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.014685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.015219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.024991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.029836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.030588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.289287 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9596e38-445b-446a-983a-b82ce8cb6272 tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/c7b0a97d730c4720b2a4cf894e5e735c" status: 200 len: 329 microversion: 2.1 time: 0.708741 Oct 28 18:03:44.290095 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 109/211] 10.222.0.16 () {60 vars in 1263 bytes} [Fri Oct 28 18:03:43 2022] PUT /compute/v2.1/os-quota-sets/c7b0a97d730c4720b2a4cf894e5e735c => generated 329 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:44.303208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a8a646e-0a4d-456b-b558-9bdf032492ac tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:44.333755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:44.340733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a8a646e-0a4d-456b-b558-9bdf032492ac tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.341362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a8a646e-0a4d-456b-b558-9bdf032492ac tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.342000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a8a646e-0a4d-456b-b558-9bdf032492ac tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.343763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:44.346581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:44.348131 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74885f13-a585-41fe-aa7d-e4c9ec1ab508 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.365037 Oct 28 18:03:44.349856 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 103/212] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:43 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:44.356108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc33c63f-04e1-4776-971c-880baf9db402 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:44.369418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-dc33c63f-04e1-4776-971c-880baf9db402 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc33c63f-04e1-4776-971c-880baf9db402 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Request method failure captured: Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlEktG-kVHLTK2gPs7wFfMT6VGOfgGTC7fYz7gLJH-rtnAM1Q1eBbrxJ4j45HU3BML3dn8rhrhuUVafs0mWVZPuw2Awra1oXedFP_tgv0rGst_0WY-ufTjmSLwgThGUwcszyq1wzBARdeFpgtUorrX72iVtNVS0fCEDUNMVaNyesys Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: e48816297f1240f7955b575f81db8454 Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:03:44.373958 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e48816297f1240f7955b575f81db8454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e48816297f1240f7955b575f81db8454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e48816297f1240f7955b575f81db8454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e48816297f1240f7955b575f81db8454"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: e48816297f1240f7955b575f81db8454 Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AggregatesAdminTestJSON-208402899-project-admin Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 73893f83cade4c659cecfb8da90dbc9b Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AggregatesAdminTestJSON-208402899-project-admin Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: exception: Aggregate 6 could not be found. Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '6'} Oct 28 18:03:44.375267 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:44.376166 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:44.377522 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:44.378884 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:44.378884 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:44.378884 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:44.378884 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 28 18:03:44.378884 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.380244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc33c63f-04e1-4776-971c-880baf9db402 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:44.381276 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc33c63f-04e1-4776-971c-880baf9db402 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.030324 Oct 28 18:03:44.389546 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 104/213] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:44 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:03:44.395502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2a87a37-85a1-4522-ba01-25a0dbe7316a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Action: 'update', calling method: .version_select at 0x7f78dee26790>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:44.398991 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2a8a646e-0a4d-456b-b558-9bdf032492ac tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-862404-2. Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a8a646e-0a4d-456b-b558-9bdf032492ac tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Request method failure captured: Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 39 Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlR1QlCdg7MxjIbGMw_Fh56GuKBM9K1lXSjWVAoYTqWec3x1ITNPcXIsBJgUs1uvJmu3Wxlz-8CXdr4i1SpdMEyYvut2EOTsf_79UZQsKegQBIvt8yWWiKfMYjSpPc7zFXXfOAwKYgHR5jvG5usaXU_Fm0P4vBlUKI70X3OBu6HkLE Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:03:44.496883 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e6216bbe5304638a6bb8f5caaa61254", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: af5ac5a007f44fd68ec3ee348661b24c Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: {"add_host": {"host": "n-h1-862404-2"}} Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:44.498270 n-d-862404-2 devstack@n-api.service[120680]: exception: Aggregate 7 already has host n-h1-862404-2. Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-862404-2'}}} Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result.read() Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 18:03:44.499302 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-862404-2-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 18:03:44.501696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 18:03:44.502841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 18:03:44.503992 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result.read() Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-862404-2-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 18, 3, 44, 385457), 'updated_at': None, 'host': 'n-h1-862404-2', 'aggregate_id': 7}] Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:44.504898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6643, in add_host_to_aggregate Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-862404-2. Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.505942 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-862404-2. Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:44.507454 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:44.510893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-862404-2. Oct 28 18:03:44.510893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:44.510893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a8a646e-0a4d-456b-b558-9bdf032492ac tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-862404-2. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:44.511261 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a8a646e-0a4d-456b-b558-9bdf032492ac tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.219743 Oct 28 18:03:44.512324 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 110/214] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:44 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 28 18:03:44.526522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:44.533714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:44.555362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=19,nova_api:DELETE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:44.560626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.564965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.565670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.567257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.567933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.569674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.590653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a87a37-85a1-4522-ba01-25a0dbe7316a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.594465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a87a37-85a1-4522-ba01-25a0dbe7316a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.597477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a87a37-85a1-4522-ba01-25a0dbe7316a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.598389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a87a37-85a1-4522-ba01-25a0dbe7316a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.601772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a87a37-85a1-4522-ba01-25a0dbe7316a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.603954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a87a37-85a1-4522-ba01-25a0dbe7316a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.847924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:44.862499 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00cb27e6-1801-4f35-af1f-990daf1be5a5 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1257 microversion: 2.1 time: 0.344425 Oct 28 18:03:44.863411 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 111/215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:44 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1257 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:44.884345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-263f59ac-7668-4280-97af-87e4a52675ba tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-447878947", "name": "tempest-test_aggregate-1514534323"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:44.927305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-263f59ac-7668-4280-97af-87e4a52675ba tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid a8cefee7-d2b6-4b48-9255-b4942d21a729 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:44.931525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:45.004371 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-263f59ac-7668-4280-97af-87e4a52675ba tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.139712 Oct 28 18:03:45.005191 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 112/216] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Oct 28 18:03:44 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:45.009830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-220fe75e-7f57-47ad-9c6d-19b57d058ea8 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:45.035412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220fe75e-7f57-47ad-9c6d-19b57d058ea8 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.036399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220fe75e-7f57-47ad-9c6d-19b57d058ea8 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.038278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220fe75e-7f57-47ad-9c6d-19b57d058ea8 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.229932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=18,nova_api:DELETE=2,nova_api:UPDATE=12 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:45.261573 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-220fe75e-7f57-47ad-9c6d-19b57d058ea8 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.255507 Oct 28 18:03:45.262624 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 113/217] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:45 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:45.314210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c53c1d46-0b4d-4511-886e-f3ddc4893c16 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:45.334764 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2a87a37-85a1-4522-ba01-25a0dbe7316a tempest-QuotasAdminTestJSON-281232028 tempest-QuotasAdminTestJSON-281232028-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/c7b0a97d730c4720b2a4cf894e5e735c" status: 200 len: 329 microversion: 2.1 time: 0.943429 Oct 28 18:03:45.336284 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 105/218] 10.222.0.16 () {60 vars in 1263 bytes} [Fri Oct 28 18:03:44 2022] PUT /compute/v2.1/os-quota-sets/c7b0a97d730c4720b2a4cf894e5e735c => generated 329 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:45.341908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d47e4d53-7f43-489b-b541-1e9f847898a1 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:45.395377 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d47e4d53-7f43-489b-b541-1e9f847898a1 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.050476 Oct 28 18:03:45.399925 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 106/219] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:45 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:45.414355 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c53c1d46-0b4d-4511-886e-f3ddc4893c16 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.129350 Oct 28 18:03:45.418232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:45.418753 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 114/220] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:45 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:45.421936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:45.437895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-406fdb74-cdf6-4fe5-a3e0-aaac5c36911e tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-74942661"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:45.443944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.444849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.447614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-406fdb74-cdf6-4fe5-a3e0-aaac5c36911e tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid 01553557-3e6c-4ef5-a8f3-dc8b0756811e for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:45.448094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.449202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.451684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.453947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.490037 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-406fdb74-cdf6-4fe5-a3e0-aaac5c36911e tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.069638 Oct 28 18:03:45.491389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 115/221] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:45 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:45.506238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6979a166-7ab3-44eb-8d0f-e03ced9cdc44 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:45.517683 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6979a166-7ab3-44eb-8d0f-e03ced9cdc44 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6979a166-7ab3-44eb-8d0f-e03ced9cdc44 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Request method failure captured: Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlEktG-kVHLTK2gPs7wFfMT6VGOfgGTC7fYz7gLJH-rtnAM1Q1eBbrxJ4j45HU3BML3dn8rhrhuUVafs0mWVZPuw2Awra1oXedFP_tgv0rGst_0WY-ufTjmSLwgThGUwcszyq1wzBARdeFpgtUorrX72iVtNVS0fCEDUNMVaNyesys Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e48816297f1240f7955b575f81db8454 Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:03:45.520147 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e48816297f1240f7955b575f81db8454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e48816297f1240f7955b575f81db8454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e48816297f1240f7955b575f81db8454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e48816297f1240f7955b575f81db8454"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e48816297f1240f7955b575f81db8454 Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminTestJSON-208402899-project-admin Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 73893f83cade4c659cecfb8da90dbc9b Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminTestJSON-208402899-project-admin Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: exception: Aggregate 8 could not be found. Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8'} Oct 28 18:03:45.521296 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:45.522012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 28 18:03:45.523002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.528494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6979a166-7ab3-44eb-8d0f-e03ced9cdc44 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:45.530631 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6979a166-7ab3-44eb-8d0f-e03ced9cdc44 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.037053 Oct 28 18:03:45.532496 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 116/222] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:03:45 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:03:45.540859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d8499f6-e95b-49f2-a6c6-71ef19c3e962 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Calling method '.version_select at 0x7f78de9a7d30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:45.545848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8499f6-e95b-49f2-a6c6-71ef19c3e962 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.546920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8499f6-e95b-49f2-a6c6-71ef19c3e962 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.547836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8499f6-e95b-49f2-a6c6-71ef19c3e962 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.548752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8499f6-e95b-49f2-a6c6-71ef19c3e962 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.549535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8499f6-e95b-49f2-a6c6-71ef19c3e962 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.551213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8499f6-e95b-49f2-a6c6-71ef19c3e962 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.596864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d8499f6-e95b-49f2-a6c6-71ef19c3e962 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.062761 Oct 28 18:03:45.598757 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 117/223] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 18:03:45 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:45.875409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c587eac-7060-460f-8154-117a81eb0fef tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:45.880982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c587eac-7060-460f-8154-117a81eb0fef tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'b190280d33cb48538a022a3e464013f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e76bece870047a9b52ddb599472481f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c587eac-7060-460f-8154-117a81eb0fef tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Request method failure captured: Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 39 Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlOCG5Sp3pGMnLJZOesdKDAKfx9jBDOJ8mSKQQ-clhdFDMrBLr3UVzxXkfGVe8-8DMtQhTArm7_ZEgGzDHqeW9N-4t6hT6UwyLrn3_-8yzElVEP1OF9mQqDiDcg4f1C8bJmXNog-PzVvzpydeusM68xhgfhtFppwtsW193vKqaLY4k Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:45.889776 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e76bece870047a9b52ddb599472481f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e76bece870047a9b52ddb599472481f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b190280d33cb48538a022a3e464013f5 Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: {"add_host": {"host": "n-h1-862404-2"}} Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:45.890940 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-862404-2'}}} Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:45.891760 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 18:03:45.892795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.895897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c587eac-7060-460f-8154-117a81eb0fef tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:45.895897 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c587eac-7060-460f-8154-117a81eb0fef tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.291339 Oct 28 18:03:45.901403 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 118/224] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 18:03:45 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:45.917423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8af6cfcc-9853-4bf5-a9a2-c387fb68b27b tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:45.942686 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8af6cfcc-9853-4bf5-a9a2-c387fb68b27b tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8af6cfcc-9853-4bf5-a9a2-c387fb68b27b tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Request method failure captured: Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlEktG-kVHLTK2gPs7wFfMT6VGOfgGTC7fYz7gLJH-rtnAM1Q1eBbrxJ4j45HU3BML3dn8rhrhuUVafs0mWVZPuw2Awra1oXedFP_tgv0rGst_0WY-ufTjmSLwgThGUwcszyq1wzBARdeFpgtUorrX72iVtNVS0fCEDUNMVaNyesys Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e48816297f1240f7955b575f81db8454 Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:03:45.944792 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e48816297f1240f7955b575f81db8454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e48816297f1240f7955b575f81db8454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e48816297f1240f7955b575f81db8454", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e48816297f1240f7955b575f81db8454"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e48816297f1240f7955b575f81db8454 Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-208402899 Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminTestJSON-208402899-project-admin Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 73893f83cade4c659cecfb8da90dbc9b Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminTestJSON-208402899-project-admin Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: exception: Aggregate 8 could not be found. Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8'} Oct 28 18:03:45.945940 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:45.946642 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:45.947594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:45.948752 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:45.948752 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:45.948752 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:45.948752 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 28 18:03:45.948752 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:45.948752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8af6cfcc-9853-4bf5-a9a2-c387fb68b27b tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:45.948752 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8af6cfcc-9853-4bf5-a9a2-c387fb68b27b tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.042664 Oct 28 18:03:45.948752 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 119/225] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:45 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:03:45.956286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34b657d1-968f-430c-b5b9-60f382632d60 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Calling method '.version_select at 0x7f78de95e820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:45.965873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34b657d1-968f-430c-b5b9-60f382632d60 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.967019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34b657d1-968f-430c-b5b9-60f382632d60 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.967601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34b657d1-968f-430c-b5b9-60f382632d60 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.968642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34b657d1-968f-430c-b5b9-60f382632d60 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.969688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34b657d1-968f-430c-b5b9-60f382632d60 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.970119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34b657d1-968f-430c-b5b9-60f382632d60 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.006525 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34b657d1-968f-430c-b5b9-60f382632d60 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.051006 Oct 28 18:03:46.007293 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 120/226] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:45 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.016768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.017515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:46.026311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.026947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.027967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.028729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.030108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.030561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.144171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:46.158419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:46.163929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:46.171804 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b5035f0e-d351-4354-bc5f-b1593d4e9358 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1362 microversion: 2.25 time: 0.769670 Oct 28 18:03:46.176040 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 107/227] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:45 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1362 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:46.181050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6c23b85d-c2ef-4292-aae0-06e4f71e4972 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.220933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:46.233210 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f070176-0aeb-4776-8654-a521e0ca37f6 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1319 microversion: 2.1 time: 0.222514 Oct 28 18:03:46.234674 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 121/228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:46 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:46.246276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec0f38ee-fcdd-46f4-8ccc-179c370cd77f tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-670125332"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.246673 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6c23b85d-c2ef-4292-aae0-06e4f71e4972 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.065979 Oct 28 18:03:46.249811 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 108/229] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:46 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:46.258358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-ec0f38ee-fcdd-46f4-8ccc-179c370cd77f tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid 92f7b6e0-b0bb-4fcb-9717-097c9636eab5 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:46.263940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f5ec7f6b-c65e-4604-9df8-81b9135640e6 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Calling method '.version_select at 0x7f78deef48b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.278447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5ec7f6b-c65e-4604-9df8-81b9135640e6 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.282283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5ec7f6b-c65e-4604-9df8-81b9135640e6 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.282768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5ec7f6b-c65e-4604-9df8-81b9135640e6 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.283569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5ec7f6b-c65e-4604-9df8-81b9135640e6 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.290998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5ec7f6b-c65e-4604-9df8-81b9135640e6 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.291676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5ec7f6b-c65e-4604-9df8-81b9135640e6 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.298753 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec0f38ee-fcdd-46f4-8ccc-179c370cd77f tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061144 Oct 28 18:03:46.306328 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 122/230] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.310717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-23a30582-d383-4f82-8904-59e519ac25e3 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-324982667"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.325295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-23a30582-d383-4f82-8904-59e519ac25e3 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid 59ca0bdb-fc5a-4245-896d-84a2c608ea51 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:46.356862 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f5ec7f6b-c65e-4604-9df8-81b9135640e6 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.105608 Oct 28 18:03:46.361044 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 109/231] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 18:03:46 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.379222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49719b11-b6a7-407a-bd52-6c89f4452384 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.399200 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-23a30582-d383-4f82-8904-59e519ac25e3 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.095927 Oct 28 18:03:46.399833 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 123/232] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.417500 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49719b11-b6a7-407a-bd52-6c89f4452384 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.055142 Oct 28 18:03:46.418099 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 110/233] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:46 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.424169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3442b72-6721-4f78-b5b8-06021677cbf7 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Calling method '.version_select at 0x7f78deb44790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.438359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-352801919"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.447756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3442b72-6721-4f78-b5b8-06021677cbf7 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.454133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3442b72-6721-4f78-b5b8-06021677cbf7 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.454770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3442b72-6721-4f78-b5b8-06021677cbf7 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.475230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.475760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.476262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.493920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3442b72-6721-4f78-b5b8-06021677cbf7 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.495066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3442b72-6721-4f78-b5b8-06021677cbf7 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.495525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3442b72-6721-4f78-b5b8-06021677cbf7 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.503417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.504209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.504812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.524478 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-352801919 could not be found. Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Request method failure captured: Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 57 Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlR1QlCdg7MxjIbGMw_Fh56GuKBM9K1lXSjWVAoYTqWec3x1ITNPcXIsBJgUs1uvJmu3Wxlz-8CXdr4i1SpdMEyYvut2EOTsf_79UZQsKegQBIvt8yWWiKfMYjSpPc7zFXXfOAwKYgHR5jvG5usaXU_Fm0P4vBlUKI70X3OBu6HkLE Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:03:46.529333 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e6216bbe5304638a6bb8f5caaa61254", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: af5ac5a007f44fd68ec3ee348661b24c Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: {"add_host": {"host": "tempest-nonexist_host-352801919"}} Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:03:46.530708 n-d-862404-2 devstack@n-api.service[120679]: exception: Compute host tempest-nonexist_host-352801919 could not be found. Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-352801919'}}} Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-352801919' is not mapped to any cell Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.531535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6623, in add_host_to_aggregate Oct 28 18:03:46.532791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-352801919 could not be found. Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-352801919 could not be found. Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.534058 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.535382 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.535382 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:46.535382 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:46.535382 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:46.535382 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:46.535382 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-352801919 could not be found. Oct 28 18:03:46.535382 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.540464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-352801919 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:46.543967 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-964d018c-930d-4f59-9b02-7d77b4a6168b tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.116242 Oct 28 18:03:46.545661 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 111/234] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:46.556482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-758022fc-4f57-44d2-beec-baec04f08fd9 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.568465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3442b72-6721-4f78-b5b8-06021677cbf7 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-862404-2" status: 200 len: 467 microversion: 2.1 time: 0.167557 Oct 28 18:03:46.569639 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 124/235] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 18:03:46 2022] GET /compute/v2.1/os-hosts/n-h1-862404-2 => generated 467 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.574211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc51e506-deae-4e1a-8c2d-2b7c87e82f18 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.627871 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-758022fc-4f57-44d2-beec-baec04f08fd9 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.080497 Oct 28 18:03:46.638804 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 112/236] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.640209 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc51e506-deae-4e1a-8c2d-2b7c87e82f18 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.069263 Oct 28 18:03:46.640799 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 125/237] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:46 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:46.652095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-343d3474-d619-4a2d-9119-7cfe119490a0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.652282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17adafb6-1170-402e-8dfa-2204b8b5c5d5 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Calling method '.version_select at 0x7f78df1da9d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.671882 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-343d3474-d619-4a2d-9119-7cfe119490a0 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.029816 Oct 28 18:03:46.680976 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 126/238] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:46 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.681753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17adafb6-1170-402e-8dfa-2204b8b5c5d5 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.683283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17adafb6-1170-402e-8dfa-2204b8b5c5d5 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.683736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17adafb6-1170-402e-8dfa-2204b8b5c5d5 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.687569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a583347-8f16-4cba-9ee2-6f3c9c188ffb tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a583347-8f16-4cba-9ee2-6f3c9c188ffb tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Request method failure captured: Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 283 Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlR1QlCdg7MxjIbGMw_Fh56GuKBM9K1lXSjWVAoYTqWec3x1ITNPcXIsBJgUs1uvJmu3Wxlz-8CXdr4i1SpdMEyYvut2EOTsf_79UZQsKegQBIvt8yWWiKfMYjSpPc7zFXXfOAwKYgHR5jvG5usaXU_Fm0P4vBlUKI70X3OBu6HkLE Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:03:46.691885 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e6216bbe5304638a6bb8f5caaa61254", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: af5ac5a007f44fd68ec3ee348661b24c Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:46.693330 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:03:46.694044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:46.694725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:46.695852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:46.696875 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:03:46.696875 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:03:46.696875 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:03:46.696875 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.697875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a583347-8f16-4cba-9ee2-6f3c9c188ffb tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:46.698898 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a583347-8f16-4cba-9ee2-6f3c9c188ffb tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016531 Oct 28 18:03:46.699981 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 127/239] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:03:46.715427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-444c5e0f-bdf1-4335-b663-d6b379b18a94 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.729213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17adafb6-1170-402e-8dfa-2204b8b5c5d5 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.729726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17adafb6-1170-402e-8dfa-2204b8b5c5d5 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.730169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17adafb6-1170-402e-8dfa-2204b8b5c5d5 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.758085 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-444c5e0f-bdf1-4335-b663-d6b379b18a94 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.056830 Oct 28 18:03:46.763293 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 128/240] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:46 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:46.768082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50ebd5fc-b700-4520-8f13-49e123ba7301 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50ebd5fc-b700-4520-8f13-49e123ba7301 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Request method failure captured: Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 27 Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlR1QlCdg7MxjIbGMw_Fh56GuKBM9K1lXSjWVAoYTqWec3x1ITNPcXIsBJgUs1uvJmu3Wxlz-8CXdr4i1SpdMEyYvut2EOTsf_79UZQsKegQBIvt8yWWiKfMYjSpPc7zFXXfOAwKYgHR5jvG5usaXU_Fm0P4vBlUKI70X3OBu6HkLE Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:03:46.771932 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e6216bbe5304638a6bb8f5caaa61254", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: af5ac5a007f44fd68ec3ee348661b24c Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: {"aggregate": {"name": ""}} Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:46.773561 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '' Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:46.774395 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:03:46.776060 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.777316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50ebd5fc-b700-4520-8f13-49e123ba7301 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:46.777316 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50ebd5fc-b700-4520-8f13-49e123ba7301 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009019 Oct 28 18:03:46.777316 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 129/241] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:03:46.795249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71428cd0-155e-423c-9103-7783b93ec219 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-459937756", "availability_zone": "tempest-test_az-218647578"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.801513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-71428cd0-155e-423c-9103-7783b93ec219 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid 9738abe5-9cf1-4904-894e-cc52509dc3d2 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:46.805563 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17adafb6-1170-402e-8dfa-2204b8b5c5d5 tempest-HostsAdminTestJSON-281869033 tempest-HostsAdminTestJSON-281869033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-862404-2" status: 200 len: 467 microversion: 2.1 time: 0.163896 Oct 28 18:03:46.811804 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 113/242] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 18:03:46 2022] GET /compute/v2.1/os-hosts/n-h2-862404-2 => generated 467 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.828043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8675e546-f412-4d40-b56f-5fd778575e72 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1671068086"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.847217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8675e546-f412-4d40-b56f-5fd778575e72 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'b190280d33cb48538a022a3e464013f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e76bece870047a9b52ddb599472481f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8675e546-f412-4d40-b56f-5fd778575e72 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Request method failure captured: Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 60 Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlOCG5Sp3pGMnLJZOesdKDAKfx9jBDOJ8mSKQQ-clhdFDMrBLr3UVzxXkfGVe8-8DMtQhTArm7_ZEgGzDHqeW9N-4t6hT6UwyLrn3_-8yzElVEP1OF9mQqDiDcg4f1C8bJmXNog-PzVvzpydeusM68xhgfhtFppwtsW193vKqaLY4k Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:03:46.853896 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e76bece870047a9b52ddb599472481f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e76bece870047a9b52ddb599472481f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: b190280d33cb48538a022a3e464013f5 Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: {"aggregate": {"name": "tempest-test_aggregate-1671068086"}} Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:03:46.855345 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1671068086'}}} Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:03:46.856153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:03:46.857645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 18:03:46.858671 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:46.858671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8675e546-f412-4d40-b56f-5fd778575e72 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:46.858671 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8675e546-f412-4d40-b56f-5fd778575e72 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.048105 Oct 28 18:03:46.858671 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 114/243] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:46.878479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-512e25b8-3546-4d0c-8263-515535c80743 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-813684429"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.896270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.aggregate [None req-512e25b8-3546-4d0c-8263-515535c80743 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid b6f94e21-7a71-44a9-805c-aede49af5c3b for aggregate {{(pid=120679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:46.904024 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71428cd0-155e-423c-9103-7783b93ec219 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.126954 Oct 28 18:03:46.904714 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 130/244] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.928563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44efb3ef-be3c-4df9-abf2-f3c387547206 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-459937756_new", "availability_zone": "tempest-test_az-218647578_new"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.967741 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-512e25b8-3546-4d0c-8263-515535c80743 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103334 Oct 28 18:03:46.971090 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 115/245] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:46.987406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4ba81f1-5ada-410f-b1c8-a0a85dedc3c0 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-813684429"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:46.993598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.aggregate [None req-c4ba81f1-5ada-410f-b1c8-a0a85dedc3c0 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid 164f2f63-6d18-42a3-8b39-b95e7a9b9e40 for aggregate {{(pid=120679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:47.009246 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-c4ba81f1-5ada-410f-b1c8-a0a85dedc3c0 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-813684429 already exists. Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4ba81f1-5ada-410f-b1c8-a0a85dedc3c0 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Request method failure captured: Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 59 Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlR1QlCdg7MxjIbGMw_Fh56GuKBM9K1lXSjWVAoYTqWec3x1ITNPcXIsBJgUs1uvJmu3Wxlz-8CXdr4i1SpdMEyYvut2EOTsf_79UZQsKegQBIvt8yWWiKfMYjSpPc7zFXXfOAwKYgHR5jvG5usaXU_Fm0P4vBlUKI70X3OBu6HkLE Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:03:47.011719 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e6216bbe5304638a6bb8f5caaa61254", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: af5ac5a007f44fd68ec3ee348661b24c Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: {"aggregate": {"name": "tempest-test_aggregate-813684429"}} Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:03:47.013746 n-d-862404-2 devstack@n-api.service[120679]: exception: Aggregate tempest-test_aggregate-813684429 already exists. Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-813684429'}}} Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6460, in create_aggregate Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 28 18:03:47.014517 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-813684429 already exists. Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:47.015625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-813684429 already exists. Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-813684429 already exists. Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4ba81f1-5ada-410f-b1c8-a0a85dedc3c0 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-813684429 already exists. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:47.016896 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c4ba81f1-5ada-410f-b1c8-a0a85dedc3c0 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.034351 Oct 28 18:03:47.017948 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 116/246] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:46 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:03:47.025239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6214c161-4f95-47c4-8416-5cfa2fa174c9 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:47.094053 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6214c161-4f95-47c4-8416-5cfa2fa174c9 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.072359 Oct 28 18:03:47.110123 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 117/247] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:47 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:47.146257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-abb2d458-4791-4a08-a6d6-c37169d8fa51 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-289865018"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:47.157762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.aggregate [None req-abb2d458-4791-4a08-a6d6-c37169d8fa51 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid 9095b332-31bb-4e86-b2d9-f0115d63fabd for aggregate {{(pid=120679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:47.205691 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-abb2d458-4791-4a08-a6d6-c37169d8fa51 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.094259 Oct 28 18:03:47.214156 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 118/248] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:47.223099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:47.224022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:47.233395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.234181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.235729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:47.236764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.237404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.237974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:47.299072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44efb3ef-be3c-4df9-abf2-f3c387547206 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.299642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44efb3ef-be3c-4df9-abf2-f3c387547206 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.300609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44efb3ef-be3c-4df9-abf2-f3c387547206 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:47.417967 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44efb3ef-be3c-4df9-abf2-f3c387547206 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 334 microversion: 2.1 time: 0.501593 Oct 28 18:03:47.427559 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 131/249] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 18:03:46 2022] PUT /compute/v2.1/os-aggregates/12 => generated 334 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:47.441432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d494b54-be2f-419f-a4c2-4393347cf58e tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:47.447974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d494b54-be2f-419f-a4c2-4393347cf58e tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'b190280d33cb48538a022a3e464013f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e76bece870047a9b52ddb599472481f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d494b54-be2f-419f-a4c2-4393347cf58e tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Request method failure captured: Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlOCG5Sp3pGMnLJZOesdKDAKfx9jBDOJ8mSKQQ-clhdFDMrBLr3UVzxXkfGVe8-8DMtQhTArm7_ZEgGzDHqeW9N-4t6hT6UwyLrn3_-8yzElVEP1OF9mQqDiDcg4f1C8bJmXNog-PzVvzpydeusM68xhgfhtFppwtsW193vKqaLY4k Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:47.454495 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e76bece870047a9b52ddb599472481f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e76bece870047a9b52ddb599472481f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b190280d33cb48538a022a3e464013f5 Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 18:03:47.456226 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '14'} Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:47.456964 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 18:03:47.458085 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:47.463155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d494b54-be2f-419f-a4c2-4393347cf58e tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:47.465677 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d494b54-be2f-419f-a4c2-4393347cf58e tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.042144 Oct 28 18:03:47.468383 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 132/250] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:47 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:47.489685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:47.490556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:47.509886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.510557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.513060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:47.515433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.516135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.517972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:48.044719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:48.054250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:48.056979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:48.073154 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7ad99298-230e-4f08-8bb4-2dee0c0aa7cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1557 microversion: 2.25 time: 0.856681 Oct 28 18:03:48.080597 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 119/251] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:47 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1557 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:48.093421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7eea672-ff7c-45ab-aa79-e3af42d11f88 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:48.124738 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7eea672-ff7c-45ab-aa79-e3af42d11f88 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 551 microversion: 2.1 time: 0.036276 Oct 28 18:03:48.132241 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 120/252] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:03:48 2022] GET /compute/v2.1/os-aggregates => generated 551 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:48.134952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-971ab3d5-22bf-44af-b344-14fcd7e934b4 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:48.193574 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-971ab3d5-22bf-44af-b344-14fcd7e934b4 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.065376 Oct 28 18:03:48.201109 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 121/253] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:48 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:48.812224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:48.827833 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be929ca9-e628-45fd-bb41-51c10fc010b2 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1386 microversion: 2.1 time: 1.357815 Oct 28 18:03:48.831439 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 133/254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:47 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1386 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:48.846074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:48.846998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:48.852478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea59dae7-dab0-4e6c-9085-d19c6d87d8e5 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:48.860921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:48.864158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:48.866282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:48.867799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:48.868738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:48.871530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:48.951242 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea59dae7-dab0-4e6c-9085-d19c6d87d8e5 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.117471 Oct 28 18:03:48.961489 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 134/255] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:48 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:48.983158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2dbf4b13-b3d4-4857-a02f-e4f89bf19b67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.034927 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2dbf4b13-b3d4-4857-a02f-e4f89bf19b67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2dbf4b13-b3d4-4857-a02f-e4f89bf19b67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Request method failure captured: Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlR1QlCdg7MxjIbGMw_Fh56GuKBM9K1lXSjWVAoYTqWec3x1ITNPcXIsBJgUs1uvJmu3Wxlz-8CXdr4i1SpdMEyYvut2EOTsf_79UZQsKegQBIvt8yWWiKfMYjSpPc7zFXXfOAwKYgHR5jvG5usaXU_Fm0P4vBlUKI70X3OBu6HkLE Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:03:49.037135 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e6216bbe5304638a6bb8f5caaa61254", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: af5ac5a007f44fd68ec3ee348661b24c Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: exception: Aggregate -1 could not be found. Oct 28 18:03:49.038496 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '-1'} Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 18:03:49.039277 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.040486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2dbf4b13-b3d4-4857-a02f-e4f89bf19b67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2dbf4b13-b3d4-4857-a02f-e4f89bf19b67 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.075990 Oct 28 18:03:49.041533 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 135/256] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:48 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:03:49.044739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5345955-4abb-4f91-9ae5-df50b4cfc075 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1985348705"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:49.060034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-d5345955-4abb-4f91-9ae5-df50b4cfc075 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Generated uuid 36928a21-04f2-4bdc-a98c-82952cbd40fb for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:49.104085 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5345955-4abb-4f91-9ae5-df50b4cfc075 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.063537 Oct 28 18:03:49.105021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 136/257] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:49.118217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43754a9b-eca7-4c16-96b8-ff8191089d95 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-386444130"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:49.121651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-43754a9b-eca7-4c16-96b8-ff8191089d95 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid 426fc5f8-c10d-4529-8d96-620ba2d0cc77 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:49.146291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:DELETE=9,nova_api:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:49.187014 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43754a9b-eca7-4c16-96b8-ff8191089d95 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080699 Oct 28 18:03:49.188113 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 137/258] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:49.194066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfd35bdd-7225-4899-8c36-ca0a6223ec36 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.213749 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dfd35bdd-7225-4899-8c36-ca0a6223ec36 tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.024458 Oct 28 18:03:49.224658 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 138/259] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:03:49 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:49.229788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9526b39d-afc7-49d0-a3a9-1502e0c85dee tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.231584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9526b39d-afc7-49d0-a3a9-1502e0c85dee tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'b190280d33cb48538a022a3e464013f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e76bece870047a9b52ddb599472481f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9526b39d-afc7-49d0-a3a9-1502e0c85dee tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Request method failure captured: Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlOCG5Sp3pGMnLJZOesdKDAKfx9jBDOJ8mSKQQ-clhdFDMrBLr3UVzxXkfGVe8-8DMtQhTArm7_ZEgGzDHqeW9N-4t6hT6UwyLrn3_-8yzElVEP1OF9mQqDiDcg4f1C8bJmXNog-PzVvzpydeusM68xhgfhtFppwtsW193vKqaLY4k Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:49.236266 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e76bece870047a9b52ddb599472481f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e76bece870047a9b52ddb599472481f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b190280d33cb48538a022a3e464013f5 Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 18:03:49.237597 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '16'} Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:49.238268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 18:03:49.239278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.244761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9526b39d-afc7-49d0-a3a9-1502e0c85dee tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:49.245920 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9526b39d-afc7-49d0-a3a9-1502e0c85dee tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.020005 Oct 28 18:03:49.256623 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 139/260] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:49 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:49.261636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7316a5ce-e5d2-482e-a34d-18d6512d0e2c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.316843 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7316a5ce-e5d2-482e-a34d-18d6512d0e2c tempest-AggregatesAdminTestJSON-208402899 tempest-AggregatesAdminTestJSON-208402899-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.058746 Oct 28 18:03:49.317805 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 140/261] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:49 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:49.322679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06af3ee6-6cf0-4585-a6a1-e9c5000c24f1 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.413884 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06af3ee6-6cf0-4585-a6a1-e9c5000c24f1 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.094593 Oct 28 18:03:49.414987 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 141/262] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:49 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:49.423901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.424915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:49.434363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.436873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.437602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.438625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.439633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.440607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.448020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:49.462979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] HTTP exception thrown: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Request method failure captured: Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c HTTP/1.1 Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlCEC25aRcVsYCjH9yuVWIFrPuUEHQv-g97qgNeo4usNaD0-O1eWtPyFKm1od4AJOkTKl_IkWUtVLgQ5WEHWDlaUoThe8CFXHv3ZqnbIUdnMGY1pzm1kh9nbZh6B_N8Dsa6R4cH7I8Bgmwq4ecXalW-DYLM7pjsjnFs8_7-1fU0AFk Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 197ba3fbe250454ca0897cca868a826c Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:49.465875 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_197ba3fbe250454ca0897cca868a826c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 197ba3fbe250454ca0897cca868a826c Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminTestJSON-963500604-project Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5ca78721dd094b08a9ca964324cddaa7 Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminTestJSON-963500604-project Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.468115 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '65d2e06f-02c1-4aa8-8f3a-d09a51964b4c'} Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:49.468893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.470157 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.473901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Returning 404 to user: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:49.474993 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e1a6713c-5e04-4a7f-a96a-532db827d016 tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 404 len: 111 microversion: 2.1 time: 0.058557 Oct 28 18:03:49.476025 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 142/263] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:03:49 2022] DELETE /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:49.483780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a98f880-23a7-4893-bbd9-f2307437430c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.494656 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8a98f880-23a7-4893-bbd9-f2307437430c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a98f880-23a7-4893-bbd9-f2307437430c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Request method failure captured: Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlR1QlCdg7MxjIbGMw_Fh56GuKBM9K1lXSjWVAoYTqWec3x1ITNPcXIsBJgUs1uvJmu3Wxlz-8CXdr4i1SpdMEyYvut2EOTsf_79UZQsKegQBIvt8yWWiKfMYjSpPc7zFXXfOAwKYgHR5jvG5usaXU_Fm0P4vBlUKI70X3OBu6HkLE Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:03:49.496877 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e6216bbe5304638a6bb8f5caaa61254", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: af5ac5a007f44fd68ec3ee348661b24c Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: exception: Aggregate -1 could not be found. Oct 28 18:03:49.498700 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '-1'} Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.499494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 18:03:49.500825 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.504570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a98f880-23a7-4893-bbd9-f2307437430c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:49.506283 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a98f880-23a7-4893-bbd9-f2307437430c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029130 Oct 28 18:03:49.507295 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 143/264] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:03:49 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:03:49.516858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.517709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] [instance: 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:49.526557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.527236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.527833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.529335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.529965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.530562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.547318 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] HTTP exception thrown: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Request method failure captured: Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c HTTP/1.1 Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlCEC25aRcVsYCjH9yuVWIFrPuUEHQv-g97qgNeo4usNaD0-O1eWtPyFKm1od4AJOkTKl_IkWUtVLgQ5WEHWDlaUoThe8CFXHv3ZqnbIUdnMGY1pzm1kh9nbZh6B_N8Dsa6R4cH7I8Bgmwq4ecXalW-DYLM7pjsjnFs8_7-1fU0AFk Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 197ba3fbe250454ca0897cca868a826c Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:49.549347 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_197ba3fbe250454ca0897cca868a826c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/197ba3fbe250454ca0897cca868a826c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 197ba3fbe250454ca0897cca868a826c Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-963500604 Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminTestJSON-963500604-project Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5ca78721dd094b08a9ca964324cddaa7 Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminTestJSON-963500604-project Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.550812 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '65d2e06f-02c1-4aa8-8f3a-d09a51964b4c'} Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:49.551601 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. Oct 28 18:03:49.552956 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.555166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] Returning 404 to user: Instance 65d2e06f-02c1-4aa8-8f3a-d09a51964b4c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:49.556251 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cca526d6-62d9-42c2-91e3-24e078b7e14c tempest-AggregatesAdminTestJSON-963500604 tempest-AggregatesAdminTestJSON-963500604-project] 10.222.0.16 "GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c" status: 404 len: 111 microversion: 2.1 time: 0.047103 Oct 28 18:03:49.557602 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 144/265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:49 2022] GET /compute/v2.1/servers/65d2e06f-02c1-4aa8-8f3a-d09a51964b4c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:49.578089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-caf98662-e4f6-409e-95d1-a4724d2a2a95 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.582059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-caf98662-e4f6-409e-95d1-a4724d2a2a95 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'b190280d33cb48538a022a3e464013f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e76bece870047a9b52ddb599472481f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-caf98662-e4f6-409e-95d1-a4724d2a2a95 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Request method failure captured: Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlOCG5Sp3pGMnLJZOesdKDAKfx9jBDOJ8mSKQQ-clhdFDMrBLr3UVzxXkfGVe8-8DMtQhTArm7_ZEgGzDHqeW9N-4t6hT6UwyLrn3_-8yzElVEP1OF9mQqDiDcg4f1C8bJmXNog-PzVvzpydeusM68xhgfhtFppwtsW193vKqaLY4k Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:49.588165 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e76bece870047a9b52ddb599472481f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e76bece870047a9b52ddb599472481f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b190280d33cb48538a022a3e464013f5 Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 18:03:49.589608 n-d-862404-2 devstack@n-api.service[120680]: action_args: {} Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:49.590385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 18:03:49.592384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:49.594356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-caf98662-e4f6-409e-95d1-a4724d2a2a95 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:49.597456 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-caf98662-e4f6-409e-95d1-a4724d2a2a95 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.037768 Oct 28 18:03:49.600072 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 145/266] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:03:49 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:49.611271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e5822e4-1991-4875-85ba-8c79a4480b84 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1656044251"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:49.629386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-8e5822e4-1991-4875-85ba-8c79a4480b84 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid b5f22420-2126-4dd9-99fd-8a80d8dfb420 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:49.650714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid 9d5060e3-1d73-4594-a7f6-7369dba3c88a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:03:49.674344 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e5822e4-1991-4875-85ba-8c79a4480b84 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069352 Oct 28 18:03:49.675250 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 146/267] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:49.696022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd93ea4c-0ebb-4ec5-a5d2-3d0cc92a342c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:49.729141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd93ea4c-0ebb-4ec5-a5d2-3d0cc92a342c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.729643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd93ea4c-0ebb-4ec5-a5d2-3d0cc92a342c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.730079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd93ea4c-0ebb-4ec5-a5d2-3d0cc92a342c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.808464 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e2c033af-384d-46c4-82c2-91eed448d257 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 2050 microversion: 2.25 time: 1.605854 Oct 28 18:03:49.813285 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 122/268] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:48 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 2050 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:49.845314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.846370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:49.856207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.857602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.859735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.860858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.861697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.868976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.975588 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dd93ea4c-0ebb-4ec5-a5d2-3d0cc92a342c tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.292273 Oct 28 18:03:49.985122 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 147/269] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:03:49 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:49.991141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:50.003181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:50.035977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.036565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.037019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.037766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.038229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.038659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.436674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid 9d5060e3-1d73-4594-a7f6-7369dba3c88a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:03:50.451115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:50.462520 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac45f98f-06d0-4e09-ae62-dd6cc5088726 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1386 microversion: 2.1 time: 0.476297 Oct 28 18:03:50.465643 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 148/270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:49 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1386 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:50.473160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82ea92b5-a662-407e-8da0-7091bdf701f1 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:50.484623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82ea92b5-a662-407e-8da0-7091bdf701f1 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'b190280d33cb48538a022a3e464013f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e76bece870047a9b52ddb599472481f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82ea92b5-a662-407e-8da0-7091bdf701f1 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Request method failure captured: Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 42 Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlOCG5Sp3pGMnLJZOesdKDAKfx9jBDOJ8mSKQQ-clhdFDMrBLr3UVzxXkfGVe8-8DMtQhTArm7_ZEgGzDHqeW9N-4t6hT6UwyLrn3_-8yzElVEP1OF9mQqDiDcg4f1C8bJmXNog-PzVvzpydeusM68xhgfhtFppwtsW193vKqaLY4k Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:50.486838 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8e76bece870047a9b52ddb599472481f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8e76bece870047a9b52ddb599472481f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8e76bece870047a9b52ddb599472481f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8e76bece870047a9b52ddb599472481f Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554491981 Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b190280d33cb48538a022a3e464013f5 Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554491981-project Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: {"remove_host": {"host": "n-h1-862404-2"}} Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:50.489010 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-862404-2'}}} Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:50.490127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 18:03:50.491636 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:50.500823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82ea92b5-a662-407e-8da0-7091bdf701f1 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:50.502059 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82ea92b5-a662-407e-8da0-7091bdf701f1 tempest-AggregatesAdminNegativeTestJSON-554491981 tempest-AggregatesAdminNegativeTestJSON-554491981-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.033948 Oct 28 18:03:50.510405 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1aa1df9c-8985-423d-a9fa-e9cd108f21bc tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 2050 microversion: 2.25 time: 0.668089 Oct 28 18:03:50.510667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 149/271] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:03:50 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:50.531856 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 123/272] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:49 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 2050 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:03:50.532319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8fd341c-ef2f-45a6-bcc2-95f837421d3a tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:50.543129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9f786e6-0f54-4582-8f5a-e4a35726a9d8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:50.547320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9f786e6-0f54-4582-8f5a-e4a35726a9d8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.547831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9f786e6-0f54-4582-8f5a-e4a35726a9d8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.553217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9f786e6-0f54-4582-8f5a-e4a35726a9d8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.554038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9f786e6-0f54-4582-8f5a-e4a35726a9d8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.554507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9f786e6-0f54-4582-8f5a-e4a35726a9d8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.554928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9f786e6-0f54-4582-8f5a-e4a35726a9d8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.612974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8fd341c-ef2f-45a6-bcc2-95f837421d3a tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.614194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8fd341c-ef2f-45a6-bcc2-95f837421d3a tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.615395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8fd341c-ef2f-45a6-bcc2-95f837421d3a tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.659012 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d9f786e6-0f54-4582-8f5a-e4a35726a9d8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.119776 Oct 28 18:03:50.666822 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 124/273] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 18:03:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:03:50.687989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0e9dbef4-4aa2-4a3f-b9fb-7acf445e53bc req-2269bae4-39a5-4e1c-846c-661b41d02fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8a4193-8c20-48d7-830c-11d97b58e409", "tag": "0ebbdf8c-307c-4e5c-bb1d-babf5352d450"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:50.714852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e9dbef4-4aa2-4a3f-b9fb-7acf445e53bc req-2269bae4-39a5-4e1c-846c-661b41d02fed service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.715506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e9dbef4-4aa2-4a3f-b9fb-7acf445e53bc req-2269bae4-39a5-4e1c-846c-661b41d02fed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.716165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e9dbef4-4aa2-4a3f-b9fb-7acf445e53bc req-2269bae4-39a5-4e1c-846c-661b41d02fed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.734064 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0e9dbef4-4aa2-4a3f-b9fb-7acf445e53bc req-2269bae4-39a5-4e1c-846c-661b41d02fed service nova] Creating event network-changed:0ebbdf8c-307c-4e5c-bb1d-babf5352d450 for instance 2e8a4193-8c20-48d7-830c-11d97b58e409 on n-h1-862404-2 Oct 28 18:03:50.746014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0e9dbef4-4aa2-4a3f-b9fb-7acf445e53bc req-2269bae4-39a5-4e1c-846c-661b41d02fed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072004 Oct 28 18:03:50.749654 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 125/274] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:50.756675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862404-2", "block_migration": "auto"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:50.760721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:50.798174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.798679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.799120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.808697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.809292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.809742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.945723 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8fd341c-ef2f-45a6-bcc2-95f837421d3a tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.432492 Oct 28 18:03:50.950110 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 150/275] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:03:50 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:50.961369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26608c9f-bb24-433b-b9fa-eadc24a033ab tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:50.978538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'flavor' on Instance uuid 9d5060e3-1d73-4594-a7f6-7369dba3c88a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:03:51.032957 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26608c9f-bb24-433b-b9fa-eadc24a033ab tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.077940 Oct 28 18:03:51.041890 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 151/276] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:50 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:51.048902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0fcaa8bb-e57b-41cb-a840-17b2e85051eb tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1880238756"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:51.071618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.aggregate [None req-0fcaa8bb-e57b-41cb-a840-17b2e85051eb tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Generated uuid e532f28f-9465-4998-8884-bb56eec3f438 for aggregate {{(pid=120680) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:03:51.113829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Going to try to live migrate instance to n-h1-862404-2 {{(pid=120679) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:03:51.116375 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0fcaa8bb-e57b-41cb-a840-17b2e85051eb tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073087 Oct 28 18:03:51.116993 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 152/277] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:03:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:51.130456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:51.143512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:51.144396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:51.145169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:51.154157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:51.155130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:51.156156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:51.170367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.compute.aggregates [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 18:03:51.171240 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Request method failure captured: Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 42 Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlR1QlCdg7MxjIbGMw_Fh56GuKBM9K1lXSjWVAoYTqWec3x1ITNPcXIsBJgUs1uvJmu3Wxlz-8CXdr4i1SpdMEyYvut2EOTsf_79UZQsKegQBIvt8yWWiKfMYjSpPc7zFXXfOAwKYgHR5jvG5usaXU_Fm0P4vBlUKI70X3OBu6HkLE Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:03:51.173357 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6e6216bbe5304638a6bb8f5caaa61254", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6e6216bbe5304638a6bb8f5caaa61254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6e6216bbe5304638a6bb8f5caaa61254 Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-330664000 Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: af5ac5a007f44fd68ec3ee348661b24c Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: {"remove_host": {"host": "nonexist_host"}} Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:03:51.174667 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 18:03:51.175349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6685, in remove_host_from_aggregate Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 28 18:03:51.176502 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.177551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:51.178710 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:51.178710 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:51.178710 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:51.178710 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:51.178710 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 28 18:03:51.178710 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:51.181947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:51.183049 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bad9cccb-bc77-480e-a9d4-3571e776c242 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.056853 Oct 28 18:03:51.187880 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 153/278] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:03:51 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 18:03:51.193459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-947e6b4b-7cf3-44f6-9c1c-32a43519f6a4 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:51.230306 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-947e6b4b-7cf3-44f6-9c1c-32a43519f6a4 tempest-AggregatesAdminNegativeTestJSON-330664000 tempest-AggregatesAdminNegativeTestJSON-330664000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.041069 Oct 28 18:03:51.236579 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 154/279] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:03:51 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:03:51.493438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:51.494612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:51.515535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:51.519550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:51.523659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:51.524730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:51.533280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:51.539781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:52.843113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:52.864082 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c26f5db-a1e7-410e-a509-a00c191b5606 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1386 microversion: 2.1 time: 1.375051 Oct 28 18:03:52.868458 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 155/280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:51 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1386 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:53.893258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:53.894001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:53.904632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:53.905202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:53.906872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:53.907640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:53.909437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:53.911097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:54.272926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=35 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:54.313357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:54.322665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c979e17f-d230-4b0b-ba5b-3bdc7fe18b46 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1386 microversion: 2.1 time: 0.435715 Oct 28 18:03:54.329381 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 156/281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:53 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1386 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:55.321427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=18 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:55.982892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aad955ef-6cff-4a77-a51b-3c391f253ffe tempest-FloatingIPDetailsNegativeTestJSON-1761543688 tempest-FloatingIPDetailsNegativeTestJSON-1761543688-project] Calling method '.version_select at 0x7f78de8e6550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:56.201733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-aad955ef-6cff-4a77-a51b-3c391f253ffe tempest-FloatingIPDetailsNegativeTestJSON-1761543688 tempest-FloatingIPDetailsNegativeTestJSON-1761543688-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f40ffdb1-38ec-49d2-bbcb-7434ea512056 could not be found", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:03:56.203133 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-aad955ef-6cff-4a77-a51b-3c391f253ffe tempest-FloatingIPDetailsNegativeTestJSON-1761543688 tempest-FloatingIPDetailsNegativeTestJSON-1761543688-project] HTTP exception thrown: Floating IP not found for ID f40ffdb1-38ec-49d2-bbcb-7434ea512056 Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aad955ef-6cff-4a77-a51b-3c391f253ffe tempest-FloatingIPDetailsNegativeTestJSON-1761543688 tempest-FloatingIPDetailsNegativeTestJSON-1761543688-project] Request method failure captured: Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-floating-ips/f40ffdb1-38ec-49d2-bbcb-7434ea512056 HTTP/1.1 Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmLgIIWBLTqBNgf3k19RbUF2Tk2ZD_AdYfMhZ8TBV7vlrYjgpQpKLwEJrY5L0cxQRHkpTnow2froVYYkRsEg9u89ZoaKKnFCQsrnh4nQGBk4y7dS-jT37nMwgMLI_i6OM2KEJI83_er4QH6l0bbeLP61R5Q-5u36OOlHmAlxx-b180 Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: fc04e0aa757b4c1ca8bdb76ddfd392ce Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1761543688 Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:03:56.239361 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc04e0aa757b4c1ca8bdb76ddfd392ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fc04e0aa757b4c1ca8bdb76ddfd392ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fc04e0aa757b4c1ca8bdb76ddfd392ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fc04e0aa757b4c1ca8bdb76ddfd392ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1761543688 Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: fc04e0aa757b4c1ca8bdb76ddfd392ce Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1761543688 Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1761543688-project Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 369ca980267c415c8e48f0a611a6ca44 Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1761543688-project Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: exception: Floating IP not found for ID f40ffdb1-38ec-49d2-bbcb-7434ea512056 Oct 28 18:03:56.240885 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f40ffdb1-38ec-49d2-bbcb-7434ea512056'} Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:03:56.241700 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f40ffdb1-38ec-49d2-bbcb-7434ea512056 could not be found Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c843bdd8-3aef-4167-a347-47578bc723c8'] Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f40ffdb1-38ec-49d2-bbcb-7434ea512056. Oct 28 18:03:56.242928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f40ffdb1-38ec-49d2-bbcb-7434ea512056 Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:56.244152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:56.245518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:56.245518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f40ffdb1-38ec-49d2-bbcb-7434ea512056 Oct 28 18:03:56.245518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:03:56.245518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aad955ef-6cff-4a77-a51b-3c391f253ffe tempest-FloatingIPDetailsNegativeTestJSON-1761543688 tempest-FloatingIPDetailsNegativeTestJSON-1761543688-project] Returning 404 to user: Floating IP not found for ID f40ffdb1-38ec-49d2-bbcb-7434ea512056 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:56.246260 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aad955ef-6cff-4a77-a51b-3c391f253ffe tempest-FloatingIPDetailsNegativeTestJSON-1761543688 tempest-FloatingIPDetailsNegativeTestJSON-1761543688-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/f40ffdb1-38ec-49d2-bbcb-7434ea512056" status: 404 len: 111 microversion: 2.1 time: 1.091144 Oct 28 18:03:56.247024 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 157/282] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:03:55 2022] GET /compute/v2.1/os-floating-ips/f40ffdb1-38ec-49d2-bbcb-7434ea512056 => generated 111 bytes in 1093 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:03:56.257002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:56.257556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:56.280659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:56.282329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:56.283032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:56.285073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:56.285803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:56.286412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:56.713614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:56.742124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9bf8620a-fb43-495c-9575-1af1afcefc28 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1386 microversion: 2.1 time: 0.485475 Oct 28 18:03:56.743242 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 158/283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:56 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1386 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:58.186684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Calling method '.version_select at 0x7f78de8e6550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:58.193893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.194661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.195354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.228519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.228929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.229375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.281876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.282393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.285924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.315986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.319101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.319587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.371155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.371631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.374942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.402607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-94babd5f-36dc-4011-8be8-28a8ca26b3fc tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.957947 Oct 28 18:03:58.405094 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 159/284] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Oct 28 18:03:57 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:03:58.425242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:58.427503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:58.447122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.448447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.449050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.450917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.451916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.452710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.061149 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f40613ea-981a-4da8-bedc-e757908f1992 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a/action" status: 202 len: 0 microversion: 2.25 time: 8.308967 Oct 28 18:03:59.066556 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 126/285] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:03:50 2022] POST /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a/action => generated 0 bytes in 8316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:03:59.080036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Calling method '.version_select at 0x7f78dee2d550>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:59.121156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.136015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.137281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.213638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:59.234687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.239984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-11f79679-606c-42c8-ae29-d6ec9fcd765c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1386 microversion: 2.1 time: 0.821931 Oct 28 18:03:59.248258 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 160/286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:58 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1386 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:59.251899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.254041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.271055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:59.278911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-627f7b63-e27f-420e-9a47-ff98b045ffc5 req-a3995e11-f641-4739-9cd6-f9b950a6ca4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8a4193-8c20-48d7-830c-11d97b58e409", "name": "network-vif-plugged", "status": "completed", "tag": "0ebbdf8c-307c-4e5c-bb1d-babf5352d450"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:59.327724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.328513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.329124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.342969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.343716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.344347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.364257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-627f7b63-e27f-420e-9a47-ff98b045ffc5 req-a3995e11-f641-4739-9cd6-f9b950a6ca4c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.365038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-627f7b63-e27f-420e-9a47-ff98b045ffc5 req-a3995e11-f641-4739-9cd6-f9b950a6ca4c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.365634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-627f7b63-e27f-420e-9a47-ff98b045ffc5 req-a3995e11-f641-4739-9cd6-f9b950a6ca4c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.396043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.397107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.400465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.403119 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-627f7b63-e27f-420e-9a47-ff98b045ffc5 req-a3995e11-f641-4739-9cd6-f9b950a6ca4c service nova] Creating event network-vif-plugged:0ebbdf8c-307c-4e5c-bb1d-babf5352d450 for instance 2e8a4193-8c20-48d7-830c-11d97b58e409 on n-h1-862404-2 Oct 28 18:03:59.412789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f02dc49d-efba-4b25-8a69-1b8eed7fc873 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.344890 Oct 28 18:03:59.414709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-627f7b63-e27f-420e-9a47-ff98b045ffc5 req-a3995e11-f641-4739-9cd6-f9b950a6ca4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164904 Oct 28 18:03:59.416522 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 161/287] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:59.418451 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 127/288] 10.222.0.16 () {60 vars in 1222 bytes} [Fri Oct 28 18:03:59 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:03:59.437483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3ef4f6b8-c5e2-463c-9fba-51aa9ebc6a29 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Calling method '.version_select at 0x7f78dead2670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:59.439237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:59.444414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ef4f6b8-c5e2-463c-9fba-51aa9ebc6a29 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.447676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:03:59.458824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ef4f6b8-c5e2-463c-9fba-51aa9ebc6a29 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.459509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ef4f6b8-c5e2-463c-9fba-51aa9ebc6a29 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.468253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.476540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.478933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.479930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.480406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.480839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.532979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ef4f6b8-c5e2-463c-9fba-51aa9ebc6a29 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.533502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ef4f6b8-c5e2-463c-9fba-51aa9ebc6a29 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.533956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ef4f6b8-c5e2-463c-9fba-51aa9ebc6a29 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.564446 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3ef4f6b8-c5e2-463c-9fba-51aa9ebc6a29 tempest-HypervisorAdminV253TestBase-1954321777 tempest-HypervisorAdminV253TestBase-1954321777-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/326e7b5a-5c3f-4f90-8aeb-a1be635c0c68" status: 200 len: 792 microversion: 2.53 time: 0.138036 Oct 28 18:03:59.565074 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 128/289] 10.222.0.16 () {60 vars in 1298 bytes} [Fri Oct 28 18:03:59 2022] GET /compute/v2.1/os-hypervisors/326e7b5a-5c3f-4f90-8aeb-a1be635c0c68 => generated 792 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:04:00.051700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:00.062221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:00.068542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:00.069773 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba788682-f7d9-4363-9899-fb8fcaa1245c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.651969 Oct 28 18:04:00.094664 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 162/290] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:03:59 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:00.262417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-713919894", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:00.268963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:00.270633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:00.281193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:00.281948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:00.283899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:00.284792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:00.288116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:00.288744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:00.401722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:00.560899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=16 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:00.754564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:00.767140 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a9224f98-5d8e-466f-8409-1a30c60cad99 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1386 microversion: 2.1 time: 0.501752 Oct 28 18:04:00.785173 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 163/291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:00 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1386 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:01.101804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:01.103303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:01.114060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.114566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.115063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.125668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.126304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.126910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.175446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=15 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:01.178059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:01.178681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:01.181056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:01.184143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:01.185142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:01.227752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.229285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.232009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.233147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.233869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.234578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.261753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Getting quotas for project 29db18378f22441fbd07962e67a41562. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:01.269379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Getting quotas for user 60dbbe5b5867422eb8c4f7348fc7fad3 and project 29db18378f22441fbd07962e67a41562. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:01.281540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:01.291806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:01.297296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:01.380812 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a493ea7e-7335-4a83-97b9-a8b239c5c1ce tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.628646 Oct 28 18:04:01.382221 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 129/292] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:04:01.597297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17890475-0610-4a99-9c0b-066324808b32 tempest-FlavorsV261TestJSON-80373602 tempest-FlavorsV261TestJSON-80373602-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1108142596", "id": 1901360986, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:01.647677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17890475-0610-4a99-9c0b-066324808b32 tempest-FlavorsV261TestJSON-80373602 tempest-FlavorsV261TestJSON-80373602-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.263807 Oct 28 18:04:01.663609 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 130/293] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:04:01 2022] POST /compute/v2.1/flavors => generated 468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:04:01.688547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7c67b00-1a89-47a5-8124-0ac346e092fd tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:01.693884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b7c67b00-1a89-47a5-8124-0ac346e092fd tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:02.011754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:02.021404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7c67b00-1a89-47a5-8124-0ac346e092fd tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:02.031118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:02.037818 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7c67b00-1a89-47a5-8124-0ac346e092fd tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1219 microversion: 2.1 time: 0.372949 Oct 28 18:04:02.038397 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 131/294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:01 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1219 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:02.042313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:02.046714 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e44e61c-9f52-40a7-872a-5e81134a723a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.949278 Oct 28 18:04:02.057030 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 164/295] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:01 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:04:02.068785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:02.082673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:02.116761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:02.117276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:02.117724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:02.118440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:02.118903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:02.119332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:02.557007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4bea1e5-5e57-4ac6-85ec-99cfdcc62ca5 tempest-FlavorsV261TestJSON-1285949707 tempest-FlavorsV261TestJSON-1285949707-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:02.587335 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4bea1e5-5e57-4ac6-85ec-99cfdcc62ca5 tempest-FlavorsV261TestJSON-1285949707 tempest-FlavorsV261TestJSON-1285949707-project] 10.222.0.16 "GET /compute/v2.1/flavors/1901360986" status: 200 len: 468 microversion: 2.61 time: 0.547124 Oct 28 18:04:02.587911 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 132/296] 10.222.0.16 () {60 vars in 1199 bytes} [Fri Oct 28 18:04:02 2022] GET /compute/v2.1/flavors/1901360986 => generated 468 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:04:02.612779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e133033f-2ddc-408d-8834-2e70fff0ed4f tempest-FlavorsV261TestJSON-80373602 tempest-FlavorsV261TestJSON-80373602-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:02.694947 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e133033f-2ddc-408d-8834-2e70fff0ed4f tempest-FlavorsV261TestJSON-80373602 tempest-FlavorsV261TestJSON-80373602-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1901360986" status: 200 len: 469 microversion: 2.61 time: 0.096810 Oct 28 18:04:02.706732 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 133/297] 10.222.0.16 () {62 vars in 1219 bytes} [Fri Oct 28 18:04:02 2022] PUT /compute/v2.1/flavors/1901360986 => generated 469 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:04:02.711624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4279faef-ad95-4092-9e53-fa43e40fe575 tempest-FlavorsV261TestJSON-1285949707 tempest-FlavorsV261TestJSON-1285949707-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:02.845185 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4279faef-ad95-4092-9e53-fa43e40fe575 tempest-FlavorsV261TestJSON-1285949707 tempest-FlavorsV261TestJSON-1285949707-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 7154 microversion: 2.61 time: 0.137222 Oct 28 18:04:02.848010 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 134/298] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:04:02 2022] GET /compute/v2.1/flavors/detail => generated 7154 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:02.871116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7a992d16-8d20-475b-8688-0a429736b10a tempest-FlavorsV261TestJSON-1285949707 tempest-FlavorsV261TestJSON-1285949707-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:02.959626 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7a992d16-8d20-475b-8688-0a429736b10a tempest-FlavorsV261TestJSON-1285949707 tempest-FlavorsV261TestJSON-1285949707-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.61 time: 0.092850 Oct 28 18:04:02.971946 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 135/299] 10.222.0.16 () {60 vars in 1166 bytes} [Fri Oct 28 18:04:02 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:02.992953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d4a42bd-0f43-4daa-b17b-b69958ed6e36 tempest-FlavorsV261TestJSON-80373602 tempest-FlavorsV261TestJSON-80373602-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:03.047049 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d4a42bd-0f43-4daa-b17b-b69958ed6e36 tempest-FlavorsV261TestJSON-80373602 tempest-FlavorsV261TestJSON-80373602-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1901360986" status: 202 len: 0 microversion: 2.61 time: 0.069622 Oct 28 18:04:03.049209 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 136/300] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Oct 28 18:04:02 2022] DELETE /compute/v2.1/flavors/1901360986 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:04:03.075064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3fbd99a3-0c25-45b2-bc50-5c448c8d3fa6 tempest-FlavorsV261TestJSON-80373602 tempest-FlavorsV261TestJSON-80373602-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:03.138902 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3fbd99a3-0c25-45b2-bc50-5c448c8d3fa6 tempest-FlavorsV261TestJSON-80373602 tempest-FlavorsV261TestJSON-80373602-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6695 microversion: 2.61 time: 0.084594 Oct 28 18:04:03.147248 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 137/301] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:04:03 2022] GET /compute/v2.1/flavors/detail => generated 6695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:04:03.165364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:03.166290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:03.201346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.204886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.205578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:03.208124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.210628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.211624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:03.491214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:03.524630 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5c0cf998-6b6e-4ece-8c1e-63c995c9305e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1215 microversion: 2.1 time: 0.371108 Oct 28 18:04:03.529971 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 138/302] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:03 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1215 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:03.556469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:03.564433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:03.572344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.573189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.573854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:03.574864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.576280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.576952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:03.681915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:03.692356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8b82de5c-f17e-4d43-9f2b-5b33f081c32c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1584 microversion: 2.1 time: 1.632679 Oct 28 18:04:03.692983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 165/303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:02 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1584 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:03.733233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3112dd53-bdd1-4989-8b4b-fed2aabfc58d req-3f859f51-5b6d-422e-bd61-152ad40f4973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5060e3-1d73-4594-a7f6-7369dba3c88a", "name": "network-vif-unplugged", "status": "completed", "tag": "b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:03.777047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3112dd53-bdd1-4989-8b4b-fed2aabfc58d req-3f859f51-5b6d-422e-bd61-152ad40f4973 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.778093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3112dd53-bdd1-4989-8b4b-fed2aabfc58d req-3f859f51-5b6d-422e-bd61-152ad40f4973 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.780376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3112dd53-bdd1-4989-8b4b-fed2aabfc58d req-3f859f51-5b6d-422e-bd61-152ad40f4973 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:03.853908 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3112dd53-bdd1-4989-8b4b-fed2aabfc58d req-3f859f51-5b6d-422e-bd61-152ad40f4973 service nova] Creating event network-vif-unplugged:b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694 for instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a on n-h2-862404-2 Oct 28 18:04:03.874754 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3112dd53-bdd1-4989-8b4b-fed2aabfc58d req-3f859f51-5b6d-422e-bd61-152ad40f4973 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145574 Oct 28 18:04:03.881693 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 166/304] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:03.910021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:03.910998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:03.923111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.924005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.924619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:03.925531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.927545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.928354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:04.283043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:04.295255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:04.301702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:04.303965 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a47d58a6-f2ee-47a0-9ceb-79be30c8134d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.771622 Oct 28 18:04:04.304555 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 139/305] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:03 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:04.554470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:04.555432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:04.576516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:04.577179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:04.579524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:04.580390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:04.581102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:04.581542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:04.662093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed710363-6c2f-4b75-a312-c92544e318af tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.778236 Oct 28 18:04:04.664106 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 167/306] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:04:03 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409/os-interface => generated 284 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:05.051112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:05.087795 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-345c880c-bcf0-4cd6-8049-6d9608938a23 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1277 microversion: 2.1 time: 0.522940 Oct 28 18:04:05.087795 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 140/307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:04 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1277 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:05.338058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:05.338668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:05.355616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:05.356138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:05.356597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:05.357692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:05.358158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:05.358582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:06.031500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e65145b9-6035-4d56-8fbb-e474beaed4c3 req-61b6f7f7-ba71-44d3-b458-46d5908a98a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d5060e3-1d73-4594-a7f6-7369dba3c88a", "tag": "b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:06.061327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e65145b9-6035-4d56-8fbb-e474beaed4c3 req-61b6f7f7-ba71-44d3-b458-46d5908a98a2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:06.062654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e65145b9-6035-4d56-8fbb-e474beaed4c3 req-61b6f7f7-ba71-44d3-b458-46d5908a98a2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:06.063698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e65145b9-6035-4d56-8fbb-e474beaed4c3 req-61b6f7f7-ba71-44d3-b458-46d5908a98a2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:06.069755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:06.078705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:06.083738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:06.093810 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e168866-47e5-49fd-b8a1-31a5da1bf84e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.758943 Oct 28 18:04:06.094922 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 168/308] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:05 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:06.102192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:06.103066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:06.123391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:06.124246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:06.124837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:06.125726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:06.126336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:06.126919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:06.129836 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e65145b9-6035-4d56-8fbb-e474beaed4c3 req-61b6f7f7-ba71-44d3-b458-46d5908a98a2 service nova] Creating event network-changed:b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694 for instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a on n-h2-862404-2 Oct 28 18:04:06.148703 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e65145b9-6035-4d56-8fbb-e474beaed4c3 req-61b6f7f7-ba71-44d3-b458-46d5908a98a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121253 Oct 28 18:04:06.156164 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 141/309] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:06.312196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:06.318429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:06.328937 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b17f7c8f-4b99-42a9-a307-57fe77ac2274 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1277 microversion: 2.1 time: 0.232084 Oct 28 18:04:06.330103 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 169/310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:06 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:07.102402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-839943927", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:07.126411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:07.129205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:07.185994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:07.187660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:07.188583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:07.189588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:07.192569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:07.195755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:07.296156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:07.952929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:07.967641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:07.971234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:07.972673 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6bea8275-6848-4fb7-a208-342095a377ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.854581 Oct 28 18:04:07.988265 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 170/311] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:07 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:07.988265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:07.995974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:08.000978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:08.001470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:08.001901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:08.002601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:08.003052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:08.003472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:08.389271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:08.390267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:08.390895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:08.391458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:08.392120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:08.422515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:08.423366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:08.424052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:08.425034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:08.425664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:08.428452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:08.493132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Getting quotas for project da54e9373f4a4c2589e52ceb91b3ac65. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:08.521397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Getting quotas for user fc9ca55f61c2469e85558049ef468a07 and project da54e9373f4a4c2589e52ceb91b3ac65. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:08.558191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:08.564897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:08.672122 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e25b00c1-9369-475a-8e46-8ad1b63c9147 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.114838 Oct 28 18:04:08.673524 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 142/312] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:04:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:04:08.905987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:08.916945 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f6ac641-6997-482b-90f8-c267efc5d26e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1319 microversion: 2.1 time: 0.938879 Oct 28 18:04:08.920532 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 171/313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:07 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1319 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:08.925811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53454e4c-3e0c-498f-9205-19c632f54e13 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:08.937471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-53454e4c-3e0c-498f-9205-19c632f54e13 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:08.967200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=87,nova_api:DELETE=9 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:09.182730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-53454e4c-3e0c-498f-9205-19c632f54e13 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:09.203758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5b4a71d0-5a21-4074-b897-4cb7c3b0c3bd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Action: 'create', calling method: .version_select at 0x7f78dead95e0>, body: {"keypair": {"name": "tempest-keypair-1274057998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt7sej3xGznNGRgrkMrFMUt8tx8sD5t11zWq5fkzcdmzJW2tg/efdI8Kxtg2JDjLJhKH5IgZHPIGJLQ7/apBK3VXrccU8+FAVAQ9hU426BdEAnk1AIfXj5DW1LS4ofy0A=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:09.204517 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-53454e4c-3e0c-498f-9205-19c632f54e13 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1221 microversion: 2.1 time: 0.279859 Oct 28 18:04:09.208125 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 172/314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:08 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1221 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:09.239431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:09.240404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:09.246776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:09.248336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:09.248993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:09.250055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:09.250720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:09.251458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:09.255576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-5b4a71d0-5a21-4074-b897-4cb7c3b0c3bd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Getting quotas for project 39852f78ac9d456285d7f5adf8c6393a. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:09.290207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-5b4a71d0-5a21-4074-b897-4cb7c3b0c3bd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Getting quotas for user e5cfefffc1d24ac2baab212eb85a67f4 and project 39852f78ac9d456285d7f5adf8c6393a. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:09.332646 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5b4a71d0-5a21-4074-b897-4cb7c3b0c3bd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.657798 Oct 28 18:04:09.335487 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 143/315] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:04:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:09.348615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a4db6241-85bd-48fa-8b5a-8d5fc6e87d04 req-1a15997a-2db4-4cb8-aff9-935fc0c9c9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8a4193-8c20-48d7-830c-11d97b58e409", "tag": "0ebbdf8c-307c-4e5c-bb1d-babf5352d450"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:09.364243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a4db6241-85bd-48fa-8b5a-8d5fc6e87d04 req-1a15997a-2db4-4cb8-aff9-935fc0c9c9db service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:09.365477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a4db6241-85bd-48fa-8b5a-8d5fc6e87d04 req-1a15997a-2db4-4cb8-aff9-935fc0c9c9db service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:09.366198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a4db6241-85bd-48fa-8b5a-8d5fc6e87d04 req-1a15997a-2db4-4cb8-aff9-935fc0c9c9db service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:09.414598 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a4db6241-85bd-48fa-8b5a-8d5fc6e87d04 req-1a15997a-2db4-4cb8-aff9-935fc0c9c9db service nova] Creating event network-changed:0ebbdf8c-307c-4e5c-bb1d-babf5352d450 for instance 2e8a4193-8c20-48d7-830c-11d97b58e409 on n-h1-862404-2 Oct 28 18:04:09.441247 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a4db6241-85bd-48fa-8b5a-8d5fc6e87d04 req-1a15997a-2db4-4cb8-aff9-935fc0c9c9db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101205 Oct 28 18:04:09.444005 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 144/316] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:09.474403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:09.475699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:09.484729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:09.485413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:09.486717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:09.488109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:09.489033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:09.489722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:09.839039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:09.877645 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f96c26f4-9f49-4ec3-808c-5b51da66ac33 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 200 len: 1584 microversion: 2.1 time: 0.655537 Oct 28 18:04:09.878516 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 173/317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:09 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 1584 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:09.945126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:09.946510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:09.970120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:09.970859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:09.971615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:09.972493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:09.973132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:09.973560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:10.271033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:10.290226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:10.299173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:10.303280 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-92471d2a-8b36-486c-b9c5-43e68f70a721 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.850124 Oct 28 18:04:10.305391 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 145/318] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:09 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:10.522742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:10.540069 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77f8847b-1176-4042-aad8-3f2cc9e7cae0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1319 microversion: 2.1 time: 0.597675 Oct 28 18:04:10.542590 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 174/319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:09 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:10.550403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:10.551429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:10.572823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:10.573717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:10.574510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:10.576547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:10.577330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:10.578371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:10.601947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6b46b5b-0a06-48cf-84fe-1b444531ffd0 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Calling method '.version_select at 0x7f78deae0a60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:10.603754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6b46b5b-0a06-48cf-84fe-1b444531ffd0 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e824713fb20b4a3c9529f6526319fd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5ba056a072472eb4a7218be464c1cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6b46b5b-0a06-48cf-84fe-1b444531ffd0 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Request method failure captured: Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmYsTr4iqEuVU0pf2_UZA1s8U2fMbb_iiAcRMItsb1c0dyWzTDju3gwRykVGgkmSR1fkCnd_ff0_evySobrdv_UXjAbdGUB5ab9fVfcbmtBbNPFFgDODRkTEn2DTBXoh0B-UKkrRAUKoi2wMwAe4jrKXTiqUXvLTrB4mw2zabFj6Ws Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:10.615892 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da5ba056a072472eb4a7218be464c1cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e824713fb20b4a3c9529f6526319fd23 Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: action_args: {} Oct 28 18:04:10.617289 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:04:10.618028 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 18:04:10.619095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.620258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6b46b5b-0a06-48cf-84fe-1b444531ffd0 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:10.620258 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e6b46b5b-0a06-48cf-84fe-1b444531ffd0 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.311261 Oct 28 18:04:10.624432 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 146/320] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 18:04:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 318 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:10.637031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ec093136-1aa2-4049-aedf-56a45fbd0471 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Calling method '.version_select at 0x7f78deae8ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:10.642953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ec093136-1aa2-4049-aedf-56a45fbd0471 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e824713fb20b4a3c9529f6526319fd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5ba056a072472eb4a7218be464c1cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ec093136-1aa2-4049-aedf-56a45fbd0471 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Request method failure captured: Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmYsTr4iqEuVU0pf2_UZA1s8U2fMbb_iiAcRMItsb1c0dyWzTDju3gwRykVGgkmSR1fkCnd_ff0_evySobrdv_UXjAbdGUB5ab9fVfcbmtBbNPFFgDODRkTEn2DTBXoh0B-UKkrRAUKoi2wMwAe4jrKXTiqUXvLTrB4mw2zabFj6Ws Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:10.649790 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da5ba056a072472eb4a7218be464c1cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e824713fb20b4a3c9529f6526319fd23 Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: action_args: {} Oct 28 18:04:10.651353 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:04:10.652247 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 18:04:10.654447 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.660357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ec093136-1aa2-4049-aedf-56a45fbd0471 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:10.663630 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ec093136-1aa2-4049-aedf-56a45fbd0471 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.036002 Oct 28 18:04:10.670009 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 147/321] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:04:10 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:10.685490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1e681cc2-9e3d-4575-95c8-25aea81b7544 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Calling method '.version_select at 0x7f78dea6c670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:10.692323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1e681cc2-9e3d-4575-95c8-25aea81b7544 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e824713fb20b4a3c9529f6526319fd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5ba056a072472eb4a7218be464c1cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1e681cc2-9e3d-4575-95c8-25aea81b7544 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Request method failure captured: Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmYsTr4iqEuVU0pf2_UZA1s8U2fMbb_iiAcRMItsb1c0dyWzTDju3gwRykVGgkmSR1fkCnd_ff0_evySobrdv_UXjAbdGUB5ab9fVfcbmtBbNPFFgDODRkTEn2DTBXoh0B-UKkrRAUKoi2wMwAe4jrKXTiqUXvLTrB4mw2zabFj6Ws Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:10.696311 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da5ba056a072472eb4a7218be464c1cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e824713fb20b4a3c9529f6526319fd23 Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: action_args: {} Oct 28 18:04:10.697762 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:04:10.698644 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 18:04:10.699903 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:10.701553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1e681cc2-9e3d-4575-95c8-25aea81b7544 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:10.701553 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1e681cc2-9e3d-4575-95c8-25aea81b7544 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.026561 Oct 28 18:04:10.705110 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 148/322] 10.222.0.16 () {58 vars in 1179 bytes} [Fri Oct 28 18:04:10 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:10.823005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:10.834576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c537ff6-34c6-4feb-a71b-9b847274a8d7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1273 microversion: 2.1 time: 0.289829 Oct 28 18:04:10.851886 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 175/323] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:10 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:11.298403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ed2d30a9-7946-49b7-952c-1e78851290c6 req-d1d583f7-20c0-4c7c-8481-8a3ff187197b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0df6bd-0498-41c4-9fa3-f278edf1ee88", "tag": "1a8a434e-610a-4afc-8173-97a667588624"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:11.317764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed2d30a9-7946-49b7-952c-1e78851290c6 req-d1d583f7-20c0-4c7c-8481-8a3ff187197b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.318254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed2d30a9-7946-49b7-952c-1e78851290c6 req-d1d583f7-20c0-4c7c-8481-8a3ff187197b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.318685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed2d30a9-7946-49b7-952c-1e78851290c6 req-d1d583f7-20c0-4c7c-8481-8a3ff187197b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.344537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ed2d30a9-7946-49b7-952c-1e78851290c6 req-d1d583f7-20c0-4c7c-8481-8a3ff187197b service nova] Creating event network-changed:1a8a434e-610a-4afc-8173-97a667588624 for instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 on n-h2-862404-2 Oct 28 18:04:11.353029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ed2d30a9-7946-49b7-952c-1e78851290c6 req-d1d583f7-20c0-4c7c-8481-8a3ff187197b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058504 Oct 28 18:04:11.355409 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 176/324] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:04:11.360941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:11.368846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:11.378809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.388915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.389374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.390136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.390587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.391023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.452346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Calling method '.version_select at 0x7f78dead2e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:11.460367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.461100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.461605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.506777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.507272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.507719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.531037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.531543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.532018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.542344 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-665c9ecc-1c9e-46c9-8add-6f501b07782e tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.834417 Oct 28 18:04:11.543285 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 149/325] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:04:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:11.554671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b01a7cb-0c83-45bd-a65a-44c3e0f01379 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Calling method '.version_select at 0x7f78dea6cb80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:11.562535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4b01a7cb-0c83-45bd-a65a-44c3e0f01379 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e824713fb20b4a3c9529f6526319fd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5ba056a072472eb4a7218be464c1cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b01a7cb-0c83-45bd-a65a-44c3e0f01379 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Request method failure captured: Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmYsTr4iqEuVU0pf2_UZA1s8U2fMbb_iiAcRMItsb1c0dyWzTDju3gwRykVGgkmSR1fkCnd_ff0_evySobrdv_UXjAbdGUB5ab9fVfcbmtBbNPFFgDODRkTEn2DTBXoh0B-UKkrRAUKoi2wMwAe4jrKXTiqUXvLTrB4mw2zabFj6Ws Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:11.564570 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da5ba056a072472eb4a7218be464c1cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e824713fb20b4a3c9529f6526319fd23 Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1'} Oct 28 18:04:11.565738 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:04:11.566444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 18:04:11.567435 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.569158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b01a7cb-0c83-45bd-a65a-44c3e0f01379 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:11.572384 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4b01a7cb-0c83-45bd-a65a-44c3e0f01379 tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021499 Oct 28 18:04:11.573467 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 150/326] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 18:04:11 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:11.582344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:11.583193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:11.599614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.600417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.602838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.604232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.604884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.606835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.881746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:11.893189 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8165d69a-24c4-4932-b849-09907098e7c8 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1319 microversion: 2.1 time: 0.318334 Oct 28 18:04:11.897389 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 151/327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:11 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:11.911851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0d91889-582e-4562-ad16-45f878657a6f tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Calling method '.version_select at 0x7f78dead25e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:11.913434 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-a0d91889-582e-4562-ad16-45f878657a6f tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] HTTP exception thrown: Hypervisor with ID 'a2c0f57c-2278-45f6-88d7-f0ccf9d8975f' could not be found. Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0d91889-582e-4562-ad16-45f878657a6f tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Request method failure captured: Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hypervisors/a2c0f57c-2278-45f6-88d7-f0ccf9d8975f/uptime HTTP/1.1 Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmZmIK4xYJA8rD_gmvST5h4PvyNHFak2XTqS7Ob_cvCF5feHAKv5Su_8u2bRPpCYJaCHTooMsWBYfEBf_gblZBI9W9eDUu_uZrxmQ6L_NDuZ6rw_WhvzWGVX1BreJmZ90lmmbj27WdBzD-3gGhgRNtBqB128vSfI9YMDmMJG3iMulg Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a58c93c6c1164c36af754918e2487abf Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1149931513 Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:04:11.931584 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a58c93c6c1164c36af754918e2487abf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a58c93c6c1164c36af754918e2487abf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a58c93c6c1164c36af754918e2487abf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a58c93c6c1164c36af754918e2487abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1149931513 Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a58c93c6c1164c36af754918e2487abf Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1149931513 Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c1ce3f42bfe94c0aa035cd3db698af5a Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: exception: Hypervisor with ID 'a2c0f57c-2278-45f6-88d7-f0ccf9d8975f' could not be found. Oct 28 18:04:11.933273 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'a2c0f57c-2278-45f6-88d7-f0ccf9d8975f'} Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a2c0f57c-2278-45f6-88d7-f0ccf9d8975f' Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 18:04:11.934248 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a2c0f57c-2278-45f6-88d7-f0ccf9d8975f' could not be found. Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:11.936792 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.938505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:11.938505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:11.938505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:11.938505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:11.938505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:11.938505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a2c0f57c-2278-45f6-88d7-f0ccf9d8975f' could not be found. Oct 28 18:04:11.938505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:11.940937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0d91889-582e-4562-ad16-45f878657a6f tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Returning 404 to user: Hypervisor with ID 'a2c0f57c-2278-45f6-88d7-f0ccf9d8975f' could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:11.942122 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0d91889-582e-4562-ad16-45f878657a6f tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/a2c0f57c-2278-45f6-88d7-f0ccf9d8975f/uptime" status: 404 len: 123 microversion: 2.1 time: 0.043533 Oct 28 18:04:11.942854 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 152/328] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 18:04:11 2022] GET /compute/v2.1/os-hypervisors/a2c0f57c-2278-45f6-88d7-f0ccf9d8975f/uptime => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:11.960682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:11.962120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:11.973727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.974574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.975195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.976165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.976795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.977375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.235512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:12.248244 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cd5ca185-b9ba-4f24-a376-5890d93fccf0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1279 microversion: 2.1 time: 0.297977 Oct 28 18:04:12.249624 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 153/329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:11 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:12.256193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Calling method '.version_select at 0x7f78dea6c310>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:12.258163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.258823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.259523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.304369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.305168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.305838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.323161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.324108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.324750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.332413 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2734a472-c5dc-4ed3-aae6-3f6e766843cf tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079751 Oct 28 18:04:12.339738 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 154/330] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:04:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:12.350250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da7f31a6-14bb-4059-b356-4eca6ac1a20f tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Calling method '.version_select at 0x7f78dea6c280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:12.357758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-da7f31a6-14bb-4059-b356-4eca6ac1a20f tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e824713fb20b4a3c9529f6526319fd23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5ba056a072472eb4a7218be464c1cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da7f31a6-14bb-4059-b356-4eca6ac1a20f tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Request method failure captured: Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmYsTr4iqEuVU0pf2_UZA1s8U2fMbb_iiAcRMItsb1c0dyWzTDju3gwRykVGgkmSR1fkCnd_ff0_evySobrdv_UXjAbdGUB5ab9fVfcbmtBbNPFFgDODRkTEn2DTBXoh0B-UKkrRAUKoi2wMwAe4jrKXTiqUXvLTrB4mw2zabFj6Ws Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:12.359754 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da5ba056a072472eb4a7218be464c1cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da5ba056a072472eb4a7218be464c1cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: da5ba056a072472eb4a7218be464c1cc Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-943028864 Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e824713fb20b4a3c9529f6526319fd23 Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-943028864-project Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1'} Oct 28 18:04:12.361010 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:04:12.361752 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 18:04:12.362812 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.367143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da7f31a6-14bb-4059-b356-4eca6ac1a20f tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:12.367143 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-da7f31a6-14bb-4059-b356-4eca6ac1a20f tempest-HypervisorAdminNegativeTestJSON-943028864 tempest-HypervisorAdminNegativeTestJSON-943028864-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020184 Oct 28 18:04:12.367143 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 155/331] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:04:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:12.374639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52474420-7501-470f-b9fd-6890ac6c71be tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Calling method '.version_select at 0x7f78dea2be50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:12.380064 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-52474420-7501-470f-b9fd-6890ac6c71be tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] HTTP exception thrown: Hypervisor with ID '9d1105ce-f4f8-4e4f-a641-968afd074375' could not be found. Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52474420-7501-470f-b9fd-6890ac6c71be tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Request method failure captured: Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hypervisors/9d1105ce-f4f8-4e4f-a641-968afd074375 HTTP/1.1 Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmZmIK4xYJA8rD_gmvST5h4PvyNHFak2XTqS7Ob_cvCF5feHAKv5Su_8u2bRPpCYJaCHTooMsWBYfEBf_gblZBI9W9eDUu_uZrxmQ6L_NDuZ6rw_WhvzWGVX1BreJmZ90lmmbj27WdBzD-3gGhgRNtBqB128vSfI9YMDmMJG3iMulg Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a58c93c6c1164c36af754918e2487abf Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1149931513 Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:04:12.384132 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a58c93c6c1164c36af754918e2487abf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a58c93c6c1164c36af754918e2487abf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a58c93c6c1164c36af754918e2487abf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a58c93c6c1164c36af754918e2487abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1149931513 Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a58c93c6c1164c36af754918e2487abf Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1149931513 Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c1ce3f42bfe94c0aa035cd3db698af5a Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: exception: Hypervisor with ID '9d1105ce-f4f8-4e4f-a641-968afd074375' could not be found. Oct 28 18:04:12.385333 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '9d1105ce-f4f8-4e4f-a641-968afd074375'} Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9d1105ce-f4f8-4e4f-a641-968afd074375' Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 18:04:12.385997 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:04:12.387144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9d1105ce-f4f8-4e4f-a641-968afd074375' could not be found. Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9d1105ce-f4f8-4e4f-a641-968afd074375' could not be found. Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52474420-7501-470f-b9fd-6890ac6c71be tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] Returning 404 to user: Hypervisor with ID '9d1105ce-f4f8-4e4f-a641-968afd074375' could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-52474420-7501-470f-b9fd-6890ac6c71be tempest-HypervisorAdminNegativeTestJSON-1149931513 tempest-HypervisorAdminNegativeTestJSON-1149931513-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/9d1105ce-f4f8-4e4f-a641-968afd074375" status: 404 len: 123 microversion: 2.1 time: 0.016100 Oct 28 18:04:12.390840 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 156/332] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 18:04:12 2022] GET /compute/v2.1/os-hypervisors/9d1105ce-f4f8-4e4f-a641-968afd074375 => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:04:12.411388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:12.429586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:12.433486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:12.438435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25ce0af0-42be-4f36-8194-62e4391d8f88 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 1.080494 Oct 28 18:04:12.439468 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 177/333] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:11 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:12.922479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:12.923097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:12.936549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.937061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.938807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.949443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.951592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.952124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.056421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Calling method '.version_select at 0x7f78deae83a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:13.075437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.076058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.076507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.113230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.113970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.114643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.143639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.144164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.144604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.177992 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e13fd1c-b2d7-4648-a2ed-a30990b118b7 tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.645890 Oct 28 18:04:13.178987 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 157/334] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:04:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:04:13.190175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-557b65c3-6601-4571-924b-97386c1525af tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Calling method '.version_select at 0x7f78dea2b820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:13.192275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-557b65c3-6601-4571-924b-97386c1525af tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.193114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-557b65c3-6601-4571-924b-97386c1525af tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.193717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-557b65c3-6601-4571-924b-97386c1525af tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.222390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-557b65c3-6601-4571-924b-97386c1525af tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.223256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-557b65c3-6601-4571-924b-97386c1525af tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.224965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-557b65c3-6601-4571-924b-97386c1525af tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.244229 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-557b65c3-6601-4571-924b-97386c1525af tempest-HypervisorAdminV228Test-1551041050 tempest-HypervisorAdminV228Test-1551041050-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.053249 Oct 28 18:04:13.245078 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 158/335] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 18:04:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:04:13.276019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:13.276754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:13.287121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.287616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.288071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.288776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.296392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.297292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.552815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:13.574292 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25172469-feb3-4a13-8cfd-41469cc3f73d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1319 microversion: 2.1 time: 0.656115 Oct 28 18:04:13.575290 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 178/336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:12 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1319 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:13.583178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:13.596127 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1cbfd681-aed5-45d2-a99a-d4548afc5776 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1321 microversion: 2.1 time: 0.325200 Oct 28 18:04:13.596718 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 159/337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:13 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:13.610863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:13.611483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:13.631190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.634554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.634999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.636674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:13.637136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:13.637744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.856937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc7ba37b-0be1-4608-ad9d-2cbd6124eb9b tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Calling method '.version_select at 0x7f78de80d820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:13.883918 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-bc7ba37b-0be1-4608-ad9d-2cbd6124eb9b tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] HTTP exception thrown: Image not found. Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc7ba37b-0be1-4608-ad9d-2cbd6124eb9b tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Request method failure captured: Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/images/58a4701c-331c-4921-a05b-3259d4fed9f2/metadata/os_distro HTTP/1.1 Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmdDWgdkEBrAFXN3hN2Gq3abXCmU1Q6595K1iLVmdr7uvAC_RZSy7kBcg4PwbB2A4AY8rDd-nR-87CXxL8YX3Ar4IHIAZn1l96KNxg3AXUIKPLMu4DbYIj3y6dctm3wSr3E1ItaUEQp6J6_ufvGf80_psFX3FTVq_JVw9BxBlRBiZo Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:04:13.912477 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1a5de273961461aaaee8c52b6bdc7dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e2efee75af704469aa36d5eb9bab18eb Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'image_id': '58a4701c-331c-4921-a05b-3259d4fed9f2', 'id': 'os_distro'} Oct 28 18:04:13.913707 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:13.914497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 58a4701c-331c-4921-a05b-3259d4fed9f2 Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:13.916377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58a4701c-331c-4921-a05b-3259d4fed9f2 could not be found. Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:13.917692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:13.920591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc7ba37b-0be1-4608-ad9d-2cbd6124eb9b tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:13.923009 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc7ba37b-0be1-4608-ad9d-2cbd6124eb9b tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] 10.222.0.16 "DELETE /compute/v2.1/images/58a4701c-331c-4921-a05b-3259d4fed9f2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.337303 Oct 28 18:04:13.923009 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 179/338] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 18:04:13 2022] DELETE /compute/v2.1/images/58a4701c-331c-4921-a05b-3259d4fed9f2/metadata/os_distro => generated 62 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:04:13.923009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-734095903", "imageRef": "b0318820-eb6e-448a-ab93-13eda9a7a3e4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f9ee392d-8eec-4387-96d4-15e319eadd38"}], "security_groups": [{"name": "tempest-securitygroup--56878025"}], "key_name": "tempest-keypair-1274057998", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:14.086202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] validate_networks() for [('f9ee392d-8eec-4387-96d4-15e319eadd38', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:14.187264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:14.195964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:14.197409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:14.198564 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-527089b9-e0b3-43d5-9e57-9d6f2a51366a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.600932 Oct 28 18:04:14.199430 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 160/339] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:13 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:14.228917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ebd87cbb-422a-4fab-8911-bde66071471f tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Calling method '.version_select at 0x7f78dea8e790>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:14.272723 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ebd87cbb-422a-4fab-8911-bde66071471f tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] HTTP exception thrown: Image not found. Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ebd87cbb-422a-4fab-8911-bde66071471f tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Request method failure captured: Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/images/86fd1256-ae5a-4cfc-bcf5-eb4f73afd3db/metadata/os_version HTTP/1.1 Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmdDWgdkEBrAFXN3hN2Gq3abXCmU1Q6595K1iLVmdr7uvAC_RZSy7kBcg4PwbB2A4AY8rDd-nR-87CXxL8YX3Ar4IHIAZn1l96KNxg3AXUIKPLMu4DbYIj3y6dctm3wSr3E1ItaUEQp6J6_ufvGf80_psFX3FTVq_JVw9BxBlRBiZo Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:14.277746 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1a5de273961461aaaee8c52b6bdc7dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e2efee75af704469aa36d5eb9bab18eb Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'image_id': '86fd1256-ae5a-4cfc-bcf5-eb4f73afd3db', 'id': 'os_version'} Oct 28 18:04:14.279441 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.280380 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 86fd1256-ae5a-4cfc-bcf5-eb4f73afd3db Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.281786 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 86fd1256-ae5a-4cfc-bcf5-eb4f73afd3db could not be found. Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:14.284199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:04:14.286416 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.289328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ebd87cbb-422a-4fab-8911-bde66071471f tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:14.290398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ebd87cbb-422a-4fab-8911-bde66071471f tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] 10.222.0.16 "GET /compute/v2.1/images/86fd1256-ae5a-4cfc-bcf5-eb4f73afd3db/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.088473 Oct 28 18:04:14.291898 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 161/340] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 18:04:14 2022] GET /compute/v2.1/images/86fd1256-ae5a-4cfc-bcf5-eb4f73afd3db/metadata/os_version => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:04:14.299542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-558b8ced-a97f-430c-b013-65c094b5b439 req-cdb8fbf4-a296-4da8-bf54-76da00846a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79903379-95d0-4ccc-80bc-92db11a67d3c", "tag": "4f75b54a-cca9-4e37-896d-e273eed3b2c4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:14.311711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-558b8ced-a97f-430c-b013-65c094b5b439 req-cdb8fbf4-a296-4da8-bf54-76da00846a4d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.312330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-558b8ced-a97f-430c-b013-65c094b5b439 req-cdb8fbf4-a296-4da8-bf54-76da00846a4d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.312890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-558b8ced-a97f-430c-b013-65c094b5b439 req-cdb8fbf4-a296-4da8-bf54-76da00846a4d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:14.325847 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-558b8ced-a97f-430c-b013-65c094b5b439 req-cdb8fbf4-a296-4da8-bf54-76da00846a4d service nova] Creating event network-changed:4f75b54a-cca9-4e37-896d-e273eed3b2c4 for instance 79903379-95d0-4ccc-80bc-92db11a67d3c on n-h1-862404-2 Oct 28 18:04:14.332776 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-558b8ced-a97f-430c-b013-65c094b5b439 req-cdb8fbf4-a296-4da8-bf54-76da00846a4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039115 Oct 28 18:04:14.333981 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 162/341] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:14.341845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-95cd4b9d-757e-4fb4-9936-5665a5bfd9ba tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Calling method '.version_select at 0x7f78dea2b3a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:14.371065 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-95cd4b9d-757e-4fb4-9936-5665a5bfd9ba tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] HTTP exception thrown: Image not found. Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-95cd4b9d-757e-4fb4-9936-5665a5bfd9ba tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Request method failure captured: Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/images/87e47eb6-2336-44a6-8198-02190963189f/metadata HTTP/1.1 Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmdDWgdkEBrAFXN3hN2Gq3abXCmU1Q6595K1iLVmdr7uvAC_RZSy7kBcg4PwbB2A4AY8rDd-nR-87CXxL8YX3Ar4IHIAZn1l96KNxg3AXUIKPLMu4DbYIj3y6dctm3wSr3E1ItaUEQp6J6_ufvGf80_psFX3FTVq_JVw9BxBlRBiZo Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:14.374435 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1a5de273961461aaaee8c52b6bdc7dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e2efee75af704469aa36d5eb9bab18eb Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'image_id': '87e47eb6-2336-44a6-8198-02190963189f'} Oct 28 18:04:14.375874 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.376763 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 87e47eb6-2336-44a6-8198-02190963189f Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.377931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 87e47eb6-2336-44a6-8198-02190963189f could not be found. Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:14.379229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:04:14.380550 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.382697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-95cd4b9d-757e-4fb4-9936-5665a5bfd9ba tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:14.383978 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-95cd4b9d-757e-4fb4-9936-5665a5bfd9ba tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] 10.222.0.16 "GET /compute/v2.1/images/87e47eb6-2336-44a6-8198-02190963189f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048283 Oct 28 18:04:14.384693 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 163/342] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:04:14 2022] GET /compute/v2.1/images/87e47eb6-2336-44a6-8198-02190963189f/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:04:14.395189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce65b13c-f75c-48ef-b3c7-a1a7e4ad00a4 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Action: 'update_all', calling method: .version_select at 0x7f78dea92a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:14.426772 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ce65b13c-f75c-48ef-b3c7-a1a7e4ad00a4 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] HTTP exception thrown: Image not found. Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce65b13c-f75c-48ef-b3c7-a1a7e4ad00a4 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Request method failure captured: Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: request: PUT /compute/v2.1/images/f78c6a31-2ca5-4e8a-a407-a2317a757d2c/metadata HTTP/1.1 Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 57 Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmdDWgdkEBrAFXN3hN2Gq3abXCmU1Q6595K1iLVmdr7uvAC_RZSy7kBcg4PwbB2A4AY8rDd-nR-87CXxL8YX3Ar4IHIAZn1l96KNxg3AXUIKPLMu4DbYIj3y6dctm3wSr3E1ItaUEQp6J6_ufvGf80_psFX3FTVq_JVw9BxBlRBiZo Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:14.430184 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1a5de273961461aaaee8c52b6bdc7dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e2efee75af704469aa36d5eb9bab18eb Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:14.431665 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'image_id': 'f78c6a31-2ca5-4e8a-a407-a2317a757d2c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.432544 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f78c6a31-2ca5-4e8a-a407-a2317a757d2c Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.433610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f78c6a31-2ca5-4e8a-a407-a2317a757d2c could not be found. Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:14.438840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:04:14.439998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.441109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce65b13c-f75c-48ef-b3c7-a1a7e4ad00a4 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:14.441109 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ce65b13c-f75c-48ef-b3c7-a1a7e4ad00a4 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] 10.222.0.16 "PUT /compute/v2.1/images/f78c6a31-2ca5-4e8a-a407-a2317a757d2c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040646 Oct 28 18:04:14.441109 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 164/343] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:04:14 2022] PUT /compute/v2.1/images/f78c6a31-2ca5-4e8a-a407-a2317a757d2c/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 18:04:14.450905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cf2bd7b-5142-4dda-b61d-8c16130df0ed tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Action: 'update', calling method: .version_select at 0x7f78dea920d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:14.483106 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6cf2bd7b-5142-4dda-b61d-8c16130df0ed tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] HTTP exception thrown: Image not found. Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cf2bd7b-5142-4dda-b61d-8c16130df0ed tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Request method failure captured: Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: request: PUT /compute/v2.1/images/46d14db3-ec1b-4ca3-bded-883db8dafe59/metadata/os_distro HTTP/1.1 Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 30 Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmdDWgdkEBrAFXN3hN2Gq3abXCmU1Q6595K1iLVmdr7uvAC_RZSy7kBcg4PwbB2A4AY8rDd-nR-87CXxL8YX3Ar4IHIAZn1l96KNxg3AXUIKPLMu4DbYIj3y6dctm3wSr3E1ItaUEQp6J6_ufvGf80_psFX3FTVq_JVw9BxBlRBiZo Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:14.486029 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1a5de273961461aaaee8c52b6bdc7dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e2efee75af704469aa36d5eb9bab18eb Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: {"meta": {"os_distro": "alt"}} Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:04:14.487328 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'image_id': '46d14db3-ec1b-4ca3-bded-883db8dafe59', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.488208 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 46d14db3-ec1b-4ca3-bded-883db8dafe59 Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.489326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46d14db3-ec1b-4ca3-bded-883db8dafe59 could not be found. Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:14.490480 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:04:14.491757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.493660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cf2bd7b-5142-4dda-b61d-8c16130df0ed tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:14.494684 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6cf2bd7b-5142-4dda-b61d-8c16130df0ed tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] 10.222.0.16 "PUT /compute/v2.1/images/46d14db3-ec1b-4ca3-bded-883db8dafe59/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.050565 Oct 28 18:04:14.496019 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 165/344] 10.222.0.16 () {60 vars in 1310 bytes} [Fri Oct 28 18:04:14 2022] PUT /compute/v2.1/images/46d14db3-ec1b-4ca3-bded-883db8dafe59/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:04:14.506644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3f21556-2007-4b51-8235-b7e2f0534c67 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Action: 'create', calling method: .version_select at 0x7f78dead93a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:14.535431 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-c3f21556-2007-4b51-8235-b7e2f0534c67 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] HTTP exception thrown: Image not found. Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3f21556-2007-4b51-8235-b7e2f0534c67 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Request method failure captured: Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/images/305383a4-0609-4c7c-96af-c0524e52e7de/metadata HTTP/1.1 Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 57 Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmdDWgdkEBrAFXN3hN2Gq3abXCmU1Q6595K1iLVmdr7uvAC_RZSy7kBcg4PwbB2A4AY8rDd-nR-87CXxL8YX3Ar4IHIAZn1l96KNxg3AXUIKPLMu4DbYIj3y6dctm3wSr3E1ItaUEQp6J6_ufvGf80_psFX3FTVq_JVw9BxBlRBiZo Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:14.537625 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1a5de273961461aaaee8c52b6bdc7dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1a5de273961461aaaee8c52b6bdc7dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c1a5de273961461aaaee8c52b6bdc7dd Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837 Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e2efee75af704469aa36d5eb9bab18eb Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1702401837-project Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:04:14.539042 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'image_id': '305383a4-0609-4c7c-96af-c0524e52e7de', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.540011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 305383a4-0609-4c7c-96af-c0524e52e7de Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:04:14.541019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 305383a4-0609-4c7c-96af-c0524e52e7de could not be found. Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:14.544475 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:04:14.545681 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:14.546775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3f21556-2007-4b51-8235-b7e2f0534c67 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:14.546775 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c3f21556-2007-4b51-8235-b7e2f0534c67 tempest-ImagesMetadataNegativeTestJSON-1702401837 tempest-ImagesMetadataNegativeTestJSON-1702401837-project] 10.222.0.16 "POST /compute/v2.1/images/305383a4-0609-4c7c-96af-c0524e52e7de/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040181 Oct 28 18:04:14.546775 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 166/345] 10.222.0.16 () {60 vars in 1281 bytes} [Fri Oct 28 18:04:14 2022] POST /compute/v2.1/images/305383a4-0609-4c7c-96af-c0524e52e7de/metadata => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 18:04:14.598845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:14.599780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:14.616155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:14.626703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.632756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.634137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:14.639140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.641696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.642639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:14.953547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:14.954601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:14.955288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:14.956198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:14.956950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:14.970954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.971448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.972350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:14.973870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.974650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.975487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:15.007936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Getting quotas for project 39852f78ac9d456285d7f5adf8c6393a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:15.014464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Getting quotas for user e5cfefffc1d24ac2baab212eb85a67f4 and project 39852f78ac9d456285d7f5adf8c6393a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:15.035391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:15.038455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0318820-eb6e-448a-ab93-13eda9a7a3e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:15.111271 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b34026b-44cd-481f-9ff6-89c2a5119e6a tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.195084 Oct 28 18:04:15.119446 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 180/346] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:04:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:04:15.128124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:15.129155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:15.152553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:15.153640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:15.154526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:15.155433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:15.156531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:15.157093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:15.459310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:15.471767 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87d04ae3-6f58-4937-a148-e71ff3f0755d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1321 microversion: 2.1 time: 0.350188 Oct 28 18:04:15.474673 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 181/347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:15 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:15.483488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-775234db-6f66-4248-823a-0f074a9ba5fa tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:15.484884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-775234db-6f66-4248-823a-0f074a9ba5fa tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:15.521359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:15.529478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:15.535932 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-31d7756d-4522-4f20-becc-ec53a6bbf00d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1319 microversion: 2.1 time: 0.939956 Oct 28 18:04:15.548477 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 167/348] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:14 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1319 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:15.555487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:15.557145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:15.584093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:15.586670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:15.589181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:15.589941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:15.590414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:15.591537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:15.629656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-775234db-6f66-4248-823a-0f074a9ba5fa tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:15.640000 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-775234db-6f66-4248-823a-0f074a9ba5fa tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1245 microversion: 2.1 time: 0.164108 Oct 28 18:04:15.640589 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 182/349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:15 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1245 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:16.089209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:16.106435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:16.108708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:16.112140 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-68ef6e8a-b5c7-4fbc-be10-5165e95a4493 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.562317 Oct 28 18:04:16.130604 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 168/350] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:15 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:16.501386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:16.502061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:16.508577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.509149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.509625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.510329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.510797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.511217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.564410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:16.565600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:16.573901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.574800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.576351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.577411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.578106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.578763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.683646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:16.688993 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03eef1a6-7c4b-45f4-b4d7-f0f7e3eb5014 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1321 microversion: 2.1 time: 0.193246 Oct 28 18:04:16.692522 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 183/351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:16 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:16.701235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:16.701888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:16.717802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.718588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.719385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.720421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.721558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.722384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.809629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:16.820819 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b332cdc0-496b-4601-9dee-855174f978c3 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1319 microversion: 2.1 time: 0.260791 Oct 28 18:04:16.841682 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 169/352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:16 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:16.860671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:16.870464 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6aae8055-83cf-42d4-9dab-587970f474c6 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1297 microversion: 2.1 time: 0.176823 Oct 28 18:04:16.873613 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 184/353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:16 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1297 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:17.140357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:17.141015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:17.147529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.148138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.148758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:17.149713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.150313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.150908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:17.406108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:17.417576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:17.421343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:17.422919 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-39057bb8-8dca-4ae5-861d-7c78844051be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.287123 Oct 28 18:04:17.436626 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 170/354] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:17 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:17.715071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:17.715746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:17.737507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.739866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.740343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:17.741223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.741552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.741980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:17.857388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:17.858692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:17.877240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.881536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.882253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:17.882734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.883224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.889568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:18.371199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:18.383515 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1a01fd88-868e-4e1f-8058-5f3569ebfdce tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1321 microversion: 2.1 time: 0.670870 Oct 28 18:04:18.386827 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 185/355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:17 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:18.416476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:18.418398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:18.441480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:18.444488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:18.447981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:18.448992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:18.454656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:18.458797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:18.468321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:18.866769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:18.886431 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67a7032d-31e9-427c-8ac7-bfa79b9462f9 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.483466 Oct 28 18:04:18.889519 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 186/356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:18 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:18.896554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f4898cbe-9c66-4f8d-9a42-e336b6fc34de req-7e703fff-e409-470b-b1c7-758b4e45da6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0df6bd-0498-41c4-9fa3-f278edf1ee88", "name": "network-vif-plugged", "status": "completed", "tag": "1a8a434e-610a-4afc-8173-97a667588624"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:18.931106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f4898cbe-9c66-4f8d-9a42-e336b6fc34de req-7e703fff-e409-470b-b1c7-758b4e45da6c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:18.933183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f4898cbe-9c66-4f8d-9a42-e336b6fc34de req-7e703fff-e409-470b-b1c7-758b4e45da6c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:18.934941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f4898cbe-9c66-4f8d-9a42-e336b6fc34de req-7e703fff-e409-470b-b1c7-758b4e45da6c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:18.969498 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f4898cbe-9c66-4f8d-9a42-e336b6fc34de req-7e703fff-e409-470b-b1c7-758b4e45da6c service nova] Creating event network-vif-plugged:1a8a434e-610a-4afc-8173-97a667588624 for instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 on n-h2-862404-2 Oct 28 18:04:18.982219 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f4898cbe-9c66-4f8d-9a42-e336b6fc34de req-7e703fff-e409-470b-b1c7-758b4e45da6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090498 Oct 28 18:04:18.982833 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 187/357] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:18.996966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:19.001684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:19.044523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:19.048204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:19.048933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:19.050433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:19.053016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:19.053849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:19.241053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:19.295480 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-931f8aa5-74cd-468d-9581-90ad2e86003a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1319 microversion: 2.1 time: 1.438295 Oct 28 18:04:19.299611 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 171/358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:17 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1319 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:19.415028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:19.416240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:19.430645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=18 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:19.434824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:19.437357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:19.441906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:19.448460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:19.451567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:19.454414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:19.584076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:19.597811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:19.600771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:19.601999 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6626c86-f6b4-46b5-a2c2-0a4455b078ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1567 microversion: 2.25 time: 0.614071 Oct 28 18:04:19.607062 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 188/359] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:18 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1567 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:20.236878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-808209612", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:20.364672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:20.588230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:20.603926 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-910bc05f-99ca-4187-8bce-c3fcbf075d98 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1321 microversion: 2.1 time: 1.193941 Oct 28 18:04:20.604772 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 172/360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:19 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1321 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:20.610329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:20.616791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:20.633266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:20.634010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:20.634601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:20.635481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:20.636161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:20.636742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.488862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:21.490471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:21.491284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:21.491903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:21.492585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:21.535807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:21.538075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:21.539353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:21.541737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.542671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:21.543639 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0c8f873a-6ef9-47d1-ab9d-400e4408beab tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.937497 Oct 28 18:04:21.545846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:21.546523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.564233 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 173/361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:20 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:21.604017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:21.605580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:21.619238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:21.621010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:21.625470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.626718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:21.628049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:21.628622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.638127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:21.652623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for user 3415953e10c445bfa3dcc5a3335826c8 and project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:21.681621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:21.686140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:21.852022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd422f67-40bd-4196-97d0-51ae832d009d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243712 Oct 28 18:04:21.852697 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 189/362] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:04:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:04:22.191453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3df8af45-c1fc-49ea-b02a-387310dadc96 tempest-InstanceUsageAuditLogTestJSON-1417946505 tempest-InstanceUsageAuditLogTestJSON-1417946505-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:22.252324 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3df8af45-c1fc-49ea-b02a-387310dadc96 tempest-InstanceUsageAuditLogTestJSON-1417946505 tempest-InstanceUsageAuditLogTestJSON-1417946505-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 18:04:20" status: 200 len: 318 microversion: 2.1 time: 0.391889 Oct 28 18:04:22.252942 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 190/363] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:04:21 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2018%3A04%3A20 => generated 318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:22.277341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:22.279465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:22.295024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.295836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.296534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:22.297515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.298198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.298792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:22.479591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:22.492242 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cee2f33a-0e46-48e0-b189-86b55a4a5cbc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1469 microversion: 2.1 time: 0.924744 Oct 28 18:04:22.496851 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 174/364] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:21 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1469 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:22.512103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:22.514882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:22.533856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.540091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.542301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:22.544522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.545238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.547199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.036562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:23.086075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:23.092011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:23.095305 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff5911cb-0e37-4d5e-a3ef-e59f1c708f06 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1557 microversion: 2.25 time: 0.829762 Oct 28 18:04:23.096224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 191/365] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:22 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1557 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:23.108399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-32c48971-3458-4396-91db-7d37109d9498 req-d3e8805e-0fd8-442c-b616-b26fa2ace2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4903a6b7-6be5-4773-8a04-4ba37da9f892", "tag": "ab693c9c-62a7-4740-a0b7-d6103bcfb486"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:23.120224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:23.129586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32c48971-3458-4396-91db-7d37109d9498 req-d3e8805e-0fd8-442c-b616-b26fa2ace2ed service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.132930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32c48971-3458-4396-91db-7d37109d9498 req-d3e8805e-0fd8-442c-b616-b26fa2ace2ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.134827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32c48971-3458-4396-91db-7d37109d9498 req-d3e8805e-0fd8-442c-b616-b26fa2ace2ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.148854 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5aca0331-baba-4676-879d-4b302023498f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1321 microversion: 2.1 time: 0.649229 Oct 28 18:04:23.166285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-32c48971-3458-4396-91db-7d37109d9498 req-d3e8805e-0fd8-442c-b616-b26fa2ace2ed service nova] Creating event network-changed:ab693c9c-62a7-4740-a0b7-d6103bcfb486 for instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 on n-h2-862404-2 Oct 28 18:04:23.171074 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 175/366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:22 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1321 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:23.180727 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-32c48971-3458-4396-91db-7d37109d9498 req-d3e8805e-0fd8-442c-b616-b26fa2ace2ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079064 Oct 28 18:04:23.184138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 192/367] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:23.185840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:23.187689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:23.196341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.197248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.197910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.198983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.199098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ee11f8c-6ec1-4ca8-b023-7cdee8b2d708 tempest-InstanceUsageAuditLogTestJSON-1417946505 tempest-InstanceUsageAuditLogTestJSON-1417946505-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:23.200495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.202063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.238502 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ee11f8c-6ec1-4ca8-b023-7cdee8b2d708 tempest-InstanceUsageAuditLogTestJSON-1417946505 tempest-InstanceUsageAuditLogTestJSON-1417946505-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.046953 Oct 28 18:04:23.239323 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 193/368] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 18:04:23 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:23.332572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:23.344189 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b08eb547-7f9d-4f35-9243-a9c3cdad794e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1264 microversion: 2.1 time: 0.170722 Oct 28 18:04:23.357498 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 176/369] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:23 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:23.369899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:23.370876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:23.379324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.380099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.381158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.382146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.382822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.383503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.591000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:23.599773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:23.625062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.626552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.628414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.633556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.635688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.637151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.735126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:04:23.754848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:23.769734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:23.778704 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4dea622d-4a01-4ae0-b312-b2fc46d768ad tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.419103 Oct 28 18:04:23.797979 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 177/370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:23 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:23.833931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-76f2e3e4-ab4c-4ac3-a065-46dfc2904b69 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '.version_select at 0x7f78de999af0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:23.849699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76f2e3e4-ab4c-4ac3-a065-46dfc2904b69 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.850004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76f2e3e4-ab4c-4ac3-a065-46dfc2904b69 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.850506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76f2e3e4-ab4c-4ac3-a065-46dfc2904b69 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.929423 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-76f2e3e4-ab4c-4ac3-a065-46dfc2904b69 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.105385 Oct 28 18:04:23.940660 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 178/371] 10.222.0.16 () {60 vars in 1184 bytes} [Fri Oct 28 18:04:23 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:04:23.954699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:23.957129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:23.978993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.982523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.986766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.003404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.007384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.011077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.211167 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-185bb9a8-7a76-40ea-9b33-17402a66a04d tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 204 len: 0 microversion: 2.1 time: 0.970721 Oct 28 18:04:24.215099 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 194/372] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:23 2022] DELETE /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 0 bytes in 975 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:04:24.239257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1c37f7a8-40b5-4fce-a932-a4e272e00cb1 req-ac94ea63-48d9-4115-a12f-48c8d5ca993e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79903379-95d0-4ccc-80bc-92db11a67d3c", "name": "network-vif-plugged", "status": "completed", "tag": "4f75b54a-cca9-4e37-896d-e273eed3b2c4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:24.310139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1c37f7a8-40b5-4fce-a932-a4e272e00cb1 req-ac94ea63-48d9-4115-a12f-48c8d5ca993e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.311105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1c37f7a8-40b5-4fce-a932-a4e272e00cb1 req-ac94ea63-48d9-4115-a12f-48c8d5ca993e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.311671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1c37f7a8-40b5-4fce-a932-a4e272e00cb1 req-ac94ea63-48d9-4115-a12f-48c8d5ca993e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.348128 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1c37f7a8-40b5-4fce-a932-a4e272e00cb1 req-ac94ea63-48d9-4115-a12f-48c8d5ca993e service nova] Creating event network-vif-plugged:4f75b54a-cca9-4e37-896d-e273eed3b2c4 for instance 79903379-95d0-4ccc-80bc-92db11a67d3c on n-h1-862404-2 Oct 28 18:04:24.377256 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1c37f7a8-40b5-4fce-a932-a4e272e00cb1 req-ac94ea63-48d9-4115-a12f-48c8d5ca993e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136287 Oct 28 18:04:24.381119 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 195/373] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:24.393120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:24.395025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:24.406760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.408147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.409384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.411137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.412635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.430252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.861548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid 9d5060e3-1d73-4594-a7f6-7369dba3c88a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:24.864130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:24.877465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff3f3c08-1cb8-44de-83dc-87d7bd77d709 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1321 microversion: 2.1 time: 0.494562 Oct 28 18:04:24.879473 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 196/374] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:24 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:24.885683 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6bb04382-f657-48b7-a0d5-08b837993fe4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 2050 microversion: 2.25 time: 0.942138 Oct 28 18:04:24.887024 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 179/375] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:23 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 2050 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:24.889963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:24.890748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:24.909300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.909930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.910378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.911283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.914305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:24.916587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.919804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.921114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:24.943156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.944665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.945719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.946936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.947986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.949257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.109683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:25.134944 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0146e610-17cf-48bf-a855-a994bd7ed685 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1270 microversion: 2.1 time: 0.244969 Oct 28 18:04:25.136174 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 180/376] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:24 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1270 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:25.142086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:25.145983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:25.165238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:25.165953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.166859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.168048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:25.169485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.170319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.202152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:25.216096 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d5be644-880e-4bd7-8924-5ed38b8da7b4 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1475 microversion: 2.1 time: 0.333427 Oct 28 18:04:25.217034 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 197/377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:24 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1475 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:25.227949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-69851777", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "b6597dab-3369-40d8-b5f8-eb1a8f5f7d67"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:25.327707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] validate_networks() for [('b6597dab-3369-40d8-b5f8-eb1a8f5f7d67', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:25.528537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:25.542302 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08fa924f-bfe9-4378-899c-5fba5a6d1545 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.404579 Oct 28 18:04:25.544458 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 181/378] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:25 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:25.927016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:25.927016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:25.935460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:25.936833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.937494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.939112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:25.940294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.941077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:26.375772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:26.388541 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d594501-e37c-4ea5-8a2e-e43931789279 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1321 microversion: 2.1 time: 0.469704 Oct 28 18:04:26.389403 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 182/379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:25 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:26.405083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:26.405954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:26.419362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:26.420100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:26.420549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:26.421277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:26.421740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:26.422176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:27.037883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:27.057732 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-339db3da-9b8d-402c-b61f-76aced62be58 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1312 microversion: 2.1 time: 0.666007 Oct 28 18:04:27.061868 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 183/380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:26 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1312 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:27.071860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:27.075744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:27.094152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.095220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:27.096978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:27.098624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.100406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:27.102039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:27.211182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:27.211788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:27.212179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:27.212660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:27.213070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:27.228845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.232100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:27.232757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:27.233554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.236879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:27.241014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:27.294793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for project 452c29fdc8114bb985893db1a9d29426. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:27.304072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for user 584b38d4097042999ad262ea77966602 and project 452c29fdc8114bb985893db1a9d29426. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:27.339553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:27.349178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:27.479537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-658b211c-6c4d-490c-8502-dff7997b97fe tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.261205 Oct 28 18:04:27.494913 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 198/381] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:04:27.506455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:27.509102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:27.512050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:27.522955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.523708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:27.524420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:27.540234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.549115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:27.549821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:28.175602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:28.186358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:28.204217 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08244f2e-2327-45a9-8546-1f1a72658b3e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1475 microversion: 2.1 time: 1.136504 Oct 28 18:04:28.205388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 184/382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:27 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1475 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:28.216894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:28.217701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:28.233549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:28.234559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:28.235166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:28.236337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:28.236961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:28.240037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:28.328831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:28.338262 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-17a3b959-d82c-4cdb-8856-f7107e6a3f7d tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.841119 Oct 28 18:04:28.343637 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 199/383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:27 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:28.358133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea6d8013-5302-4794-b85a-5df05ae162f8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:28.358775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ea6d8013-5302-4794-b85a-5df05ae162f8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:28.507416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea6d8013-5302-4794-b85a-5df05ae162f8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:28.524934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea6d8013-5302-4794-b85a-5df05ae162f8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:28.526761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea6d8013-5302-4794-b85a-5df05ae162f8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:28.528766 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea6d8013-5302-4794-b85a-5df05ae162f8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1260 microversion: 2.25 time: 0.183270 Oct 28 18:04:28.529923 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 200/384] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:28 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:28.535699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:28.543094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:28.566789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:28.567639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:28.569934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:28.570849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:28.571624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:28.572343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.022766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:29.045872 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc40e22c-d4aa-4d52-8806-e46f960861ef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1312 microversion: 2.1 time: 0.514549 Oct 28 18:04:29.046931 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 201/385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:28 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:29.236048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:29.238136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:29.250038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.256123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.261444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.265529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.266066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.266518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.532204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:29.546755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:29.550478 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-115b2358-e44d-46f6-b96b-bbcb30ddcc38 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1433 microversion: 2.1 time: 0.320812 Oct 28 18:04:29.556152 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 202/386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:29 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1433 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:29.579105 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e6351665-ffb7-4562-945b-82aad08ef955 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1471 microversion: 2.1 time: 1.369728 Oct 28 18:04:29.580844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:29.588171 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 185/387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:28 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1471 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:29.590960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:29.604684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-218df2a2-dc8d-422e-8a1c-9e217633181b req-8f85be5d-0b66-4f26-bcca-9a224f7bdf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0df6bd-0498-41c4-9fa3-f278edf1ee88", "name": "network-vif-deleted", "tag": "1a8a434e-610a-4afc-8173-97a667588624"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:29.631470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.638644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.642071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.644120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.648370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.651578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.675679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-218df2a2-dc8d-422e-8a1c-9e217633181b req-8f85be5d-0b66-4f26-bcca-9a224f7bdf55 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.679517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-218df2a2-dc8d-422e-8a1c-9e217633181b req-8f85be5d-0b66-4f26-bcca-9a224f7bdf55 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.684429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-218df2a2-dc8d-422e-8a1c-9e217633181b req-8f85be5d-0b66-4f26-bcca-9a224f7bdf55 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.730722 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-218df2a2-dc8d-422e-8a1c-9e217633181b req-8f85be5d-0b66-4f26-bcca-9a224f7bdf55 service nova] Creating event network-vif-deleted:1a8a434e-610a-4afc-8173-97a667588624 for instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 on n-h2-862404-2 Oct 28 18:04:29.748958 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-218df2a2-dc8d-422e-8a1c-9e217633181b req-8f85be5d-0b66-4f26-bcca-9a224f7bdf55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158678 Oct 28 18:04:29.749599 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 186/388] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:29.770010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:29.770727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:29.808017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.808487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.810133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.810936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.811413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.811873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.211700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:30.215440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:30.223643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c488284c-eec7-49db-b610-0e8ca5dfaef0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.665171 Oct 28 18:04:30.224951 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 203/389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:29 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:30.235719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:30.237418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:30.238569 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eeac6bfa-d962-456e-a96e-f54d741dff1e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1312 microversion: 2.25 time: 0.478939 Oct 28 18:04:30.239113 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 187/390] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:29 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1312 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:30.253920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:30.254929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:30.263763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.264714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.265461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.266484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.267261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.267983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.911335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3bf84695-1b94-4053-987c-9e4a5b8d7398 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:30.913116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3bf84695-1b94-4053-987c-9e4a5b8d7398 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] [instance: 32dddcd6-9eab-44f8-8db7-db255b7c0c23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:30.921225 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3bf84695-1b94-4053-987c-9e4a5b8d7398 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] HTTP exception thrown: Instance 32dddcd6-9eab-44f8-8db7-db255b7c0c23 could not be found. Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3bf84695-1b94-4053-987c-9e4a5b8d7398 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Request method failure captured: Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/32dddcd6-9eab-44f8-8db7-db255b7c0c23/action HTTP/1.1 Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 15 Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmVIJcbosHyUV5ZZWxy8LBjO0IwteQKTDAXKL0lxb2y3Q2nVDO5G6PuCEeD06XiHXjDjZMhIw4lUHQFur8Xz8wiJRCHnuW0ATsxGl2EXv5CpHOASkoNbc3_-VLJkIWjNVB3a8R7U4Kl9MYfTO4zuV3_cBl-8IfsaWTr1m6qaEwrX64 Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:04:30.944590 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d8029d331d2438bb54ff7bfc5b07490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d3f123f3d5e0445982f259596ffc77e9 Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: {"migrate": {}} Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:04:30.945955 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 32dddcd6-9eab-44f8-8db7-db255b7c0c23 could not be found. Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '32dddcd6-9eab-44f8-8db7-db255b7c0c23', 'body': {'migrate': {}}} Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32dddcd6-9eab-44f8-8db7-db255b7c0c23 could not be found. Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:30.946731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32dddcd6-9eab-44f8-8db7-db255b7c0c23 could not be found. Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32dddcd6-9eab-44f8-8db7-db255b7c0c23 could not be found. Oct 28 18:04:30.947910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.951138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3bf84695-1b94-4053-987c-9e4a5b8d7398 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Returning 404 to user: Instance 32dddcd6-9eab-44f8-8db7-db255b7c0c23 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:30.954224 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3bf84695-1b94-4053-987c-9e4a5b8d7398 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/32dddcd6-9eab-44f8-8db7-db255b7c0c23/action" status: 404 len: 111 microversion: 2.1 time: 0.728153 Oct 28 18:04:30.956588 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 204/391] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:04:30 2022] POST /compute/v2.1/servers/32dddcd6-9eab-44f8-8db7-db255b7c0c23/action => generated 111 bytes in 731 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:30.985238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:30.986970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:31.009289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:31.013671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:31.016266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:31.043291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:31.056601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:31.061233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:31.064813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:31.067845 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c2cd2ad-f972-4c80-9295-86bd1b0ed1ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1312 microversion: 2.1 time: 0.827477 Oct 28 18:04:31.069832 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 188/392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:30 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1312 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:31.076061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6fd332ec-69d5-4553-87ca-8c63f46b45e6 req-946cc33c-dd86-41b7-ac41-080c2d97451d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59b3563e-22f8-45f6-88b2-49ead221357d", "tag": "c10ccf0a-9c11-409f-9e38-de38e13aa335"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:31.103943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6fd332ec-69d5-4553-87ca-8c63f46b45e6 req-946cc33c-dd86-41b7-ac41-080c2d97451d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:31.106061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6fd332ec-69d5-4553-87ca-8c63f46b45e6 req-946cc33c-dd86-41b7-ac41-080c2d97451d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:31.108946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6fd332ec-69d5-4553-87ca-8c63f46b45e6 req-946cc33c-dd86-41b7-ac41-080c2d97451d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:31.158908 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6fd332ec-69d5-4553-87ca-8c63f46b45e6 req-946cc33c-dd86-41b7-ac41-080c2d97451d service nova] Creating event network-changed:c10ccf0a-9c11-409f-9e38-de38e13aa335 for instance 59b3563e-22f8-45f6-88b2-49ead221357d on n-h1-862404-2 Oct 28 18:04:31.175087 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6fd332ec-69d5-4553-87ca-8c63f46b45e6 req-946cc33c-dd86-41b7-ac41-080c2d97451d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097393 Oct 28 18:04:31.175087 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 189/393] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:31.238433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:31.243023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:31.243023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:31.243270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lazy-loading 'fault' on Instance uuid 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:31.248953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-598572705", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:31.373805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:31.661749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:31.674134 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29994c3b-d6f5-494d-ab5c-8896c7b31e49 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 200 len: 1309 microversion: 2.1 time: 0.710068 Oct 28 18:04:31.681242 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 205/394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:30 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 1309 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:31.698093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:31.700356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:31.726012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:31.726519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:31.729298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:31.730115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:31.732181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:31.732181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.222109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:32.223061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:32.223544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:32.224195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:32.224627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:32.235570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.236218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.236595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.237540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.238037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.238471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.258454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Getting quotas for project da54e9373f4a4c2589e52ceb91b3ac65. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:32.265265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Getting quotas for user fc9ca55f61c2469e85558049ef468a07 and project da54e9373f4a4c2589e52ceb91b3ac65. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:32.272499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:32.281307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:32.284170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:32.284341 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32b3e71e-10a1-4e89-9103-8751d2baa0bf tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.601156 Oct 28 18:04:32.299392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 206/395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:31 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:32.306206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:32.306828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:32.313971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.314759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.315211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.315946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.316557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.317149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.335693 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6fae362b-027f-4d28-beb8-7a598f64f97c tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091864 Oct 28 18:04:32.336652 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 190/396] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:04:32.345537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:32.346157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:32.363406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.363933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.364376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.365123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.365856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.366285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.438119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:32.453032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:32.456001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:32.457724 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5b48cc1b-2c57-4a2a-b5a2-fd02bee450c3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1318 microversion: 2.25 time: 0.156178 Oct 28 18:04:32.458799 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 207/397] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:32 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:32.467356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0761c222-ef96-4c59-a56d-a4c847d71b45 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:32.468456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0761c222-ef96-4c59-a56d-a4c847d71b45 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:32.518769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:32.527255 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0bcd9716-f124-4f63-a2eb-0de44ad64a75 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1312 microversion: 2.1 time: 0.189824 Oct 28 18:04:32.528221 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 191/398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:32 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:32.619723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0761c222-ef96-4c59-a56d-a4c847d71b45 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:32.635727 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0761c222-ef96-4c59-a56d-a4c847d71b45 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1221 microversion: 2.1 time: 0.175671 Oct 28 18:04:32.637983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 208/399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:32 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1221 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:32.704274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:32.704926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:32.723765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.724307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.724789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.727361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.727861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.728289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.744324 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] HTTP exception thrown: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Request method failure captured: Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 HTTP/1.1 Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmMCV-K9ccdVuVjwpaBaXp1s5oERHOJLzI-qHPX262vInXlK6CmHkdrAV_c4wsovsgNlau6iS6lqhuOvfDMohLs3eG4F7yb8udrE9QxuCWtLLfdpADitDxoAvF5Mp-IPvX1gGhoQpIz8Ef43tFdveeiISmj-6lbAoAr13nHbSLahCg Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:32.747389 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29db18378f22441fbd07962e67a41562", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29db18378f22441fbd07962e67a41562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 60dbbe5b5867422eb8c4f7348fc7fad3 Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:32.748706 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '9f0df6bd-0498-41c4-9fa3-f278edf1ee88'} Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:32.749444 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:32.750583 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:32.751596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Returning 404 to user: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:32.751596 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-accdf2c3-6045-4ab0-9232-c1b9e01dfb7a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 404 len: 111 microversion: 2.1 time: 0.050405 Oct 28 18:04:32.751596 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 192/400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:32 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:32.927506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1896319087", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:33.012761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:33.309842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:33.311214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:33.318850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.319727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.320420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.321663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.328853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.329647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.414704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:33.415957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:33.418127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:33.419220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:33.421176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:33.442016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.447999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.448953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.450685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.452816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.453493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.503448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Getting quotas for project 29db18378f22441fbd07962e67a41562. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:33.512751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Getting quotas for user 60dbbe5b5867422eb8c4f7348fc7fad3 and project 29db18378f22441fbd07962e67a41562. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:33.552135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:33.554815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:33.593772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:33.602951 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5180c5d0-b9a3-4dbe-bfee-bed0bade6a39 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.298782 Oct 28 18:04:33.603533 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 193/401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:33 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:33.610641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:33.621292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:33.633637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.640250 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2c3705a-dfb1-4719-b070-d8bf85123e9e tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718423 Oct 28 18:04:33.641648 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 209/402] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:04:33.663729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.664346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.665116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.665589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.666241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.935931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1885400489", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "d98ef463-74a4-479c-b632-73800f8bbec7"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:34.047775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:34.060660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:34.067199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:34.071024 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-18fd7399-541d-4b2a-a40b-7f457888276f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1360 microversion: 2.25 time: 0.463768 Oct 28 18:04:34.072290 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 194/403] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:33 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1360 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:34.081569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:34.096161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:34.099289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] validate_networks() for [('d98ef463-74a4-479c-b632-73800f8bbec7', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:34.112806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:34.113562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:34.114220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:34.116131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:34.116837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:34.120687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:34.874406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:34.893771 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-67ec8681-87ce-41db-965e-60392fddcdd0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1312 microversion: 2.1 time: 0.819095 Oct 28 18:04:34.901018 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 195/404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:34 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1312 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:34.927347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:34.930079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:34.966785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:34.967506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:34.968326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:34.972376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:34.973060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:34.973651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:35.266906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:35.268339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:35.269368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:35.270317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:35.271682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:35.304573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=41 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:35.310123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:35.310877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:35.311478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:35.315009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:35.320042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:35.323952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:35.428713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:35.442067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:35.453852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for user 46b892cd4bff49b78773d9b78da06bcd and project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:35.457925 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23dcf2d1-dfb4-4a9f-9557-4c86bdeaf559 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1216 microversion: 2.1 time: 0.553169 Oct 28 18:04:35.460612 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 196/405] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:34 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1216 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:35.476601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:35.477429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:35.489623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:35.490145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:35.490594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:35.491356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:35.495360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:35.496116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:35.501912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:35.509580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:35.627293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a695eb0-ce30-4794-ab6c-58590074d9cc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984199 Oct 28 18:04:35.627975 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 210/406] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:04:35.644774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:35.645714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:35.654588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:35.655079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:35.655509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:35.669267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:35.669740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:35.670335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:36.191786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:36.204615 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1970c5a6-e1b2-4338-ba2b-ab3a39ff1f25 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.572863 Oct 28 18:04:36.205780 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 211/407] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:35 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:36.222155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:36.224216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:36.243460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:36.249105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:36.252869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:36.259352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:36.261192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:36.263642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:36.681923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:36.695473 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a2d35a63-46fb-4e95-8547-e42968bc735e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1279 microversion: 2.1 time: 1.233547 Oct 28 18:04:36.698059 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 197/408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:35 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1279 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:36.710694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6289f7e9-95c1-4d55-832e-36175fbd6c81 req-6390cc80-37e5-4b8f-be86-4d2c2b1f3ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9053ad37-860b-4069-80b5-9657ddb3e53d", "tag": "4413e0ac-d5e4-4c8e-bfbf-f4eb63123267"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:36.735065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6289f7e9-95c1-4d55-832e-36175fbd6c81 req-6390cc80-37e5-4b8f-be86-4d2c2b1f3ad2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:36.737280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6289f7e9-95c1-4d55-832e-36175fbd6c81 req-6390cc80-37e5-4b8f-be86-4d2c2b1f3ad2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:36.739701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6289f7e9-95c1-4d55-832e-36175fbd6c81 req-6390cc80-37e5-4b8f-be86-4d2c2b1f3ad2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:36.770223 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6289f7e9-95c1-4d55-832e-36175fbd6c81 req-6390cc80-37e5-4b8f-be86-4d2c2b1f3ad2 service nova] Creating event network-changed:4413e0ac-d5e4-4c8e-bfbf-f4eb63123267 for instance 9053ad37-860b-4069-80b5-9657ddb3e53d on n-h2-862404-2 Oct 28 18:04:36.781726 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6289f7e9-95c1-4d55-832e-36175fbd6c81 req-6390cc80-37e5-4b8f-be86-4d2c2b1f3ad2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081173 Oct 28 18:04:36.784765 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 198/409] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:36.790161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2b05e447-2209-4bed-a373-4ccc45f120b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:36.799120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2b05e447-2209-4bed-a373-4ccc45f120b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:37.079407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2b05e447-2209-4bed-a373-4ccc45f120b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:37.090915 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2b05e447-2209-4bed-a373-4ccc45f120b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1208 microversion: 2.1 time: 0.304172 Oct 28 18:04:37.092167 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 199/410] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:36 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1208 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:37.098133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:37.099065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:37.107560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:37.108405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:37.109023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:37.110012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:37.110881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:37.111510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:37.521795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:37.547904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:37.560550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:37.580024 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6f76a04-c800-4468-a9fe-74e1a5167818 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1360 microversion: 2.25 time: 1.363855 Oct 28 18:04:37.582251 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 212/411] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:36 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1360 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:37.587654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:37.588570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:37.602105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:37.602856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:37.603484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:37.604391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:37.605020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:37.605840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:37.953049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:37.969796 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6532758f-6a84-4775-a7bd-acf3780bbc6f tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1278 microversion: 2.1 time: 0.386197 Oct 28 18:04:37.986664 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 213/412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:37 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1278 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:38.000878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:38.001960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:38.002488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:38.011680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.013291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.014332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.016236 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7380483d-cab0-429e-822f-3d3903e5d287 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1312 microversion: 2.1 time: 0.919014 Oct 28 18:04:38.016981 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 200/413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:37 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1312 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:38.024194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.024194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.024194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.055208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:38.057621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:38.095330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.096182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.096648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.097536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.098770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.099536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.328143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:38.344129 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-61b7b26b-0da2-4b92-8f29-1f2f3399ab2b tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1279 microversion: 2.1 time: 0.314592 Oct 28 18:04:38.347503 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 201/414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:38 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1279 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:38.354994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:38.357013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:38.390095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:38.395170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.397610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.398396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.400956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.401965 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6f27d83-05cb-4a99-975a-d12325981dc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.408174 Oct 28 18:04:38.404403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.406110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.423379 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 214/415] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:37 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:38.431645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1077db86-fa22-4d79-be27-d2768bd86cec req-b32a2429-0a6f-4f87-9bb3-19f545966896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b3563e-22f8-45f6-88b2-49ead221357d", "name": "network-vif-plugged", "status": "completed", "tag": "c10ccf0a-9c11-409f-9e38-de38e13aa335"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:38.469950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1077db86-fa22-4d79-be27-d2768bd86cec req-b32a2429-0a6f-4f87-9bb3-19f545966896 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.470426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1077db86-fa22-4d79-be27-d2768bd86cec req-b32a2429-0a6f-4f87-9bb3-19f545966896 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.470896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1077db86-fa22-4d79-be27-d2768bd86cec req-b32a2429-0a6f-4f87-9bb3-19f545966896 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.481310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:38.504844 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1077db86-fa22-4d79-be27-d2768bd86cec req-b32a2429-0a6f-4f87-9bb3-19f545966896 service nova] Creating event network-vif-plugged:c10ccf0a-9c11-409f-9e38-de38e13aa335 for instance 59b3563e-22f8-45f6-88b2-49ead221357d on n-h1-862404-2 Oct 28 18:04:38.515211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1077db86-fa22-4d79-be27-d2768bd86cec req-b32a2429-0a6f-4f87-9bb3-19f545966896 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090138 Oct 28 18:04:38.516051 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 215/416] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:38.613487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:38.615934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:38.631578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.632888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.633815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.635707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:38.636350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:38.637834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:38.699424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:38.710994 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0664878f-93e5-47da-b8f9-27583ba2db5e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1268 microversion: 2.1 time: 0.361862 Oct 28 18:04:38.731517 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 202/417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:38 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1268 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:39.006327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:39.014382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:39.015094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:39.027651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:39.029730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.030286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:39.030829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.031379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.032667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a68cb05a-dd76-4660-b0bb-b85a8e4827c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1360 microversion: 2.25 time: 0.427260 Oct 28 18:04:39.032883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.033452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.034102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.034304 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 216/418] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:38 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1360 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:04:39.062078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:39.063455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:39.088181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.091735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.092766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.094485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.095247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.095915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.360616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:39.369429 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b490935-44bc-4d89-94e6-205d794c0763 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1312 microversion: 2.1 time: 0.326446 Oct 28 18:04:39.370026 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 217/419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:39 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:39.375435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:39.376183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:39.382621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.383237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.383955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.384738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.385417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.386217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.481442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:39.489503 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b11792a-105d-4be5-9de2-4d5767dc7023 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1279 microversion: 2.1 time: 0.118128 Oct 28 18:04:39.490101 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 218/420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:39 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1279 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:39.494870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:39.495477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:39.501797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.502291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.502722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.503425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.503893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.504502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.831447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:39.832197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:39.844307 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96cb7809-fff3-4768-b807-0baa22b868a0 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1320 microversion: 2.1 time: 0.848277 Oct 28 18:04:39.845556 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 203/421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:38 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1320 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:39.846376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df8f7201-2108-48ef-aee2-71e604572bd1 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.354972 Oct 28 18:04:39.847295 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 219/422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:39 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:39.854360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:39.855009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:39.861407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.861969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.862478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:39.863622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:39.864110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:39.865296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:40.048695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:40.069312 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4df53ab2-a811-47e5-a2dc-cfd70978d268 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1266 microversion: 2.1 time: 0.221348 Oct 28 18:04:40.086535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:40.086535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:40.091841 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 204/423] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:39 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:40.101202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:40.103244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:40.103881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:40.104760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:40.105515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:40.106400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:40.397967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:40.398677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:40.423322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:40.434074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:40.436122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:40.437853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:40.440155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:40.440850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:40.522469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:40.539391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:40.544895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:40.549345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68616812-f4cc-448c-ae23-136ef7c4f041 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1360 microversion: 2.25 time: 0.487494 Oct 28 18:04:40.549958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 220/424] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:40 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1360 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:40.562679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:40.564773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:40.585864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:40.587064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:40.588064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:40.591888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:40.592617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:40.593707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:40.933511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:40.947049 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbad6e18-2436-42f6-8451-de3eaca48b21 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.395983 Oct 28 18:04:40.947657 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 221/425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:40 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:40.953271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-eb155b7a-4df4-4fc7-b046-b1811e10dd3e req-fb36c284-72c7-4523-ba6c-8abf58b105c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4903a6b7-6be5-4773-8a04-4ba37da9f892", "name": "network-vif-plugged", "status": "completed", "tag": "ab693c9c-62a7-4740-a0b7-d6103bcfb486"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:40.974965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb155b7a-4df4-4fc7-b046-b1811e10dd3e req-fb36c284-72c7-4523-ba6c-8abf58b105c1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:40.975486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb155b7a-4df4-4fc7-b046-b1811e10dd3e req-fb36c284-72c7-4523-ba6c-8abf58b105c1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:40.975971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb155b7a-4df4-4fc7-b046-b1811e10dd3e req-fb36c284-72c7-4523-ba6c-8abf58b105c1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:40.994546 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-eb155b7a-4df4-4fc7-b046-b1811e10dd3e req-fb36c284-72c7-4523-ba6c-8abf58b105c1 service nova] Creating event network-vif-plugged:ab693c9c-62a7-4740-a0b7-d6103bcfb486 for instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 on n-h2-862404-2 Oct 28 18:04:41.000641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:41.003036 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-eb155b7a-4df4-4fc7-b046-b1811e10dd3e req-fb36c284-72c7-4523-ba6c-8abf58b105c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054021 Oct 28 18:04:41.004461 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 222/426] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:41.006299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:41.012847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:41.013876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:41.025781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.027590 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-878f1f2e-035e-49de-add1-5a3b6139c989 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1312 microversion: 2.1 time: 0.633670 Oct 28 18:04:41.028181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.041498 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 205/427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:40 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1312 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:41.047058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:41.048746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:41.049301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.049415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:41.050038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.050803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:41.084536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.085044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.088438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:41.089216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.089842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.090490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:41.489348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:41.498865 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea3aeb42-a1b2-4fd6-811b-44affb07f3f2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1320 microversion: 2.1 time: 0.492897 Oct 28 18:04:41.516345 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 223/428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:41 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:41.525955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6b4e512a-b53e-4486-bcc0-198b0589efd7 req-1c934d20-8668-4e03-afd6-5a0092438ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1f7e30-e351-4ac5-adaa-1746018fa6e8", "tag": "525ca189-c0d7-42f3-b700-d8e232b70c13"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:41.541832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6b4e512a-b53e-4486-bcc0-198b0589efd7 req-1c934d20-8668-4e03-afd6-5a0092438ce0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.542533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6b4e512a-b53e-4486-bcc0-198b0589efd7 req-1c934d20-8668-4e03-afd6-5a0092438ce0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.543877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6b4e512a-b53e-4486-bcc0-198b0589efd7 req-1c934d20-8668-4e03-afd6-5a0092438ce0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:41.559421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6b4e512a-b53e-4486-bcc0-198b0589efd7 req-1c934d20-8668-4e03-afd6-5a0092438ce0 service nova] Creating event network-changed:525ca189-c0d7-42f3-b700-d8e232b70c13 for instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 on n-h1-862404-2 Oct 28 18:04:41.567025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:41.570261 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6b4e512a-b53e-4486-bcc0-198b0589efd7 req-1c934d20-8668-4e03-afd6-5a0092438ce0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050663 Oct 28 18:04:41.572052 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 224/429] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:41.575531 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7cc390e8-35fb-49c4-aea7-97cdc654b2f4 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.542505 Oct 28 18:04:41.578560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:41.579433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:41.584199 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 206/430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:41 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:41.589038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:41.589654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:41.596379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.597408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.598107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:41.604087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.604087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.604087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:41.604087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.604496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.604496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:41.605693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:41.607364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:41.609588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.159742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:42.176751 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b23dbc70-7556-4c06-a451-0df5ea6f018e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1308 microversion: 2.1 time: 0.602643 Oct 28 18:04:42.178114 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 225/431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:41 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:42.185698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:42.186872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:42.196144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.197331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.198176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.199395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.209048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.209658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.246523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:42.252167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:42.267367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:42.273080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:42.275991 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6bb971c3-5a78-4d65-b274-3adda9979f6c tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1360 microversion: 2.25 time: 0.689202 Oct 28 18:04:42.277068 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 207/432] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:41 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1360 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:42.289009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:42.289867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:42.300708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.301848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.302472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.303439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.304147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.304724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.616857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:42.629511 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2618ee1-85a5-47a6-958c-dc504cb670c7 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.449286 Oct 28 18:04:42.645509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 226/433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:42 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:42.651639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2f45f7cf-d7df-422e-99b9-1f7d5e2e54c3 req-1dbdfe56-5776-4761-80a1-8f285c3cbe87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f930e848-f660-4a13-a2a2-a979ccbcbe7e", "tag": "a41d4e2d-0574-4bcc-b516-174268e798c2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:42.663176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2f45f7cf-d7df-422e-99b9-1f7d5e2e54c3 req-1dbdfe56-5776-4761-80a1-8f285c3cbe87 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.664141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2f45f7cf-d7df-422e-99b9-1f7d5e2e54c3 req-1dbdfe56-5776-4761-80a1-8f285c3cbe87 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.665128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2f45f7cf-d7df-422e-99b9-1f7d5e2e54c3 req-1dbdfe56-5776-4761-80a1-8f285c3cbe87 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.680392 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2f45f7cf-d7df-422e-99b9-1f7d5e2e54c3 req-1dbdfe56-5776-4761-80a1-8f285c3cbe87 service nova] Creating event network-changed:a41d4e2d-0574-4bcc-b516-174268e798c2 for instance f930e848-f660-4a13-a2a2-a979ccbcbe7e on n-h2-862404-2 Oct 28 18:04:42.687028 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2f45f7cf-d7df-422e-99b9-1f7d5e2e54c3 req-1dbdfe56-5776-4761-80a1-8f285c3cbe87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040081 Oct 28 18:04:42.688224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 227/434] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:42.693425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:42.694195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:42.703759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.704827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.705923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.707251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.707888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.708498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.776579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:42.799608 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5eb74138-3280-4924-9865-8c584a9dacf3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1461 microversion: 2.1 time: 0.519866 Oct 28 18:04:42.800544 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 208/435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:42 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1461 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:42.812157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:42.812771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:42.826009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.826503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.826941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:42.827659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:42.828119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:42.828540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:43.019301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:43.030607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b954c4c5-4403-4acf-9b63-7337a0c77dfe tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1320 microversion: 2.1 time: 0.340975 Oct 28 18:04:43.047367 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 228/436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:42 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:43.223746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:43.233138 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d72b9a65-ba9e-4893-a13d-3432cb58bab7 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1369 microversion: 2.1 time: 0.425261 Oct 28 18:04:43.234570 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 209/437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:42 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1369 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:43.239506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:43.242638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:43.250262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:43.253971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:43.254561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:43.255061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:43.258146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:43.259986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:43.260603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:43.286169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:43.288860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:43.306411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:43.307721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:43.315912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:43.318604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:43.322039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:43.324516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:43.718063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:43.728402 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65dad42c-72e0-4d71-8e5e-db5f0cf94e95 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1308 microversion: 2.1 time: 0.492211 Oct 28 18:04:43.746677 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 210/438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:43 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1308 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:43.753730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:43.760988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:43.770083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:43.771027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:43.771849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:43.772988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:43.773650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:43.774425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:43.935688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c238e182-40b8-4d06-b874-254500399424 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1612 microversion: 2.1 time: 0.883695 Oct 28 18:04:43.936328 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 229/439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:43 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1612 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:43.956086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:43.956982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:43.975470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:43.976420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:43.977186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:43.978071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:43.978698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:43.979129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.020285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:44.029116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:44.031461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:44.032900 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c1204dc-453f-43b8-95e8-f0502dc35012 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1360 microversion: 2.25 time: 0.284854 Oct 28 18:04:44.034012 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 211/440] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:43 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1360 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:44.038751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:44.039463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:44.046962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.054102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.055160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.056347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.066781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.067692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.156703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '71b476f967ce43ffba2db93cf8280563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0e70f015684fc1be169e373d94762c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:44.157541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] flavor_id is None. Assuming migration. {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 28 18:04:44.158062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:04:44.312355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:44.321505 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0efbfa7a-2fae-48b9-985c-0854b4ad31eb tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.384147 Oct 28 18:04:44.322096 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 230/441] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:43 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:44.327146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:44.327961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:44.334698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.335179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.335646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.336592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.337198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.337775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.358502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e73ac9d6-4877-471c-b642-15708642f584 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d/action" status: 202 len: 0 microversion: 2.1 time: 0.323248 Oct 28 18:04:44.359654 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 212/442] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:04:44 2022] POST /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:04:44.366506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2c421b4c-9d3b-4a5b-91f6-d230da28dd07 req-1a547466-4eba-4520-af08-f33d329b4bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9053ad37-860b-4069-80b5-9657ddb3e53d", "name": "network-vif-plugged", "status": "completed", "tag": "4413e0ac-d5e4-4c8e-bfbf-f4eb63123267"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:44.378905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c421b4c-9d3b-4a5b-91f6-d230da28dd07 req-1a547466-4eba-4520-af08-f33d329b4bd1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.379392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c421b4c-9d3b-4a5b-91f6-d230da28dd07 req-1a547466-4eba-4520-af08-f33d329b4bd1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.379875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c421b4c-9d3b-4a5b-91f6-d230da28dd07 req-1a547466-4eba-4520-af08-f33d329b4bd1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.392243 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2c421b4c-9d3b-4a5b-91f6-d230da28dd07 req-1a547466-4eba-4520-af08-f33d329b4bd1 service nova] Creating event network-vif-plugged:4413e0ac-d5e4-4c8e-bfbf-f4eb63123267 for instance 9053ad37-860b-4069-80b5-9657ddb3e53d on n-h2-862404-2 Oct 28 18:04:44.397623 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2c421b4c-9d3b-4a5b-91f6-d230da28dd07 req-1a547466-4eba-4520-af08-f33d329b4bd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036424 Oct 28 18:04:44.398253 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 213/443] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:44.406203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:44.407122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:44.414108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.414885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.415494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.416402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.417168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.417752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.624709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:44.634406 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5178ad9-4d24-4cae-a98f-f1fdee883166 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1320 microversion: 2.1 time: 0.311077 Oct 28 18:04:44.635756 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 231/444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:44 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:44.641974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:44.642866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:44.652135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:44.654738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.655503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.656228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.657551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.657978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:44.658486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.659388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.666751 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20999faa-dc84-4862-b19d-455acfd78f09 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1556 microversion: 2.1 time: 0.266456 Oct 28 18:04:44.667350 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 214/445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:44 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1556 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:44.709318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:44.711116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:44.722730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.723553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.724246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.725238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:44.726515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:44.727202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:44.998565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:45.010390 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4cd5b690-8482-4da1-ac2d-461fcbe8513f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1470 microversion: 2.1 time: 0.373283 Oct 28 18:04:45.014123 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 232/446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:44 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1470 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:45.026292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1f5fe8f3-f3ab-4a04-93d9-a37466349953 req-72c71af1-c851-430f-bc51-a9c4afbc9b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3ae6b5-7f14-4401-9680-ebcf1756a40c", "tag": "49b723c1-8f4b-436a-97df-a9b610186ba2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:45.055706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f5fe8f3-f3ab-4a04-93d9-a37466349953 req-72c71af1-c851-430f-bc51-a9c4afbc9b46 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.057844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f5fe8f3-f3ab-4a04-93d9-a37466349953 req-72c71af1-c851-430f-bc51-a9c4afbc9b46 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.060676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f5fe8f3-f3ab-4a04-93d9-a37466349953 req-72c71af1-c851-430f-bc51-a9c4afbc9b46 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.102950 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1f5fe8f3-f3ab-4a04-93d9-a37466349953 req-72c71af1-c851-430f-bc51-a9c4afbc9b46 service nova] Creating event network-changed:49b723c1-8f4b-436a-97df-a9b610186ba2 for instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c on n-h2-862404-2 Oct 28 18:04:45.113361 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1f5fe8f3-f3ab-4a04-93d9-a37466349953 req-72c71af1-c851-430f-bc51-a9c4afbc9b46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097298 Oct 28 18:04:45.114670 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 233/447] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:45.122368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:45.123502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:45.137934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.141238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.141521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.144881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.145850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.147052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.165919 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-02415b9b-b8ee-43a2-af62-0811a5a50a0f tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.471133 Oct 28 18:04:45.166699 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 215/448] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:04:44 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-interface => generated 285 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:45.172440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:45.174103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:45.193274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.200217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.202018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.206592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.207095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.210590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.393935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:45.483402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=5 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:45.651555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:45.658233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:45.661671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:45.673048 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff8939c1-957e-476b-9b58-85e9f62b55e7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1360 microversion: 2.25 time: 0.504719 Oct 28 18:04:45.673667 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 216/449] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:45 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1360 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:45.678724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:45.679503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:45.686480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.687166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.687804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.688738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.689353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.689936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.730162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:45.740784 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-473b073b-173b-49e7-a9cc-5c1dc33752ca tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1308 microversion: 2.1 time: 0.623859 Oct 28 18:04:45.744599 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 234/450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:45 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1308 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:45.757130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:45.759874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:45.772319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.772963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.774483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.777685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:45.778388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:45.778922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:45.827440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:46.163547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:46.175861 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-de13a4fa-36b3-4124-a501-0ceacea91a1c tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1320 microversion: 2.1 time: 0.430015 Oct 28 18:04:46.180625 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 235/451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:45 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1320 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:46.186783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:46.193425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:46.206710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:46.208349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:46.209566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:46.211580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:46.213342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:46.213948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:46.560117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:46.575066 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4103e991-0272-4ed8-aa50-d8aaad3dd08a tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.899381 Oct 28 18:04:46.575982 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 217/452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:45 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:46.703354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:46.704763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:46.718229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:46.718939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:46.719580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:46.722704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:46.723391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:46.724142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:46.890842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:46.901822 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97789f1b-8e2a-4882-87e1-d67ffe790369 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1470 microversion: 2.1 time: 0.719852 Oct 28 18:04:46.902467 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 236/453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:46 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1470 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:46.912372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:46.913209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:46.924434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:46.926246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:46.926851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:46.927755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:46.928576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:46.929180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.066990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:47.077972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:47.088231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:47.090562 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17607cf6-b205-4d9f-8c73-c3794a6064d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1555 microversion: 2.25 time: 0.391069 Oct 28 18:04:47.093395 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 218/454] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:46 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1555 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:04:47.117426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:47.118066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:47.133993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:47.143858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:47.144358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:47.144992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.145883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:47.148262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:47.148894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.234384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:47.246959 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a85d00d3-9caf-49c7-b8af-4ba2822d681c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1308 microversion: 2.1 time: 0.341426 Oct 28 18:04:47.249041 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 237/455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:46 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:47.264083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:47.264747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:47.285430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:47.285953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:47.286397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.287115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:47.287580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:47.291244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.561007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid 9053ad37-860b-4069-80b5-9657ddb3e53d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:47.583784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:47.588478 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-34d8bc3f-7763-4397-81cb-0511ad574fd4 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 2046 microversion: 2.25 time: 0.475207 Oct 28 18:04:47.593024 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 219/456] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:47 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 2046 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:47.616465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0e3c2e2-66cf-4ca9-9e2a-f4adb90603a7 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1320 microversion: 2.1 time: 0.366134 Oct 28 18:04:47.619401 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 238/457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:47 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1320 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:47.626717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:47.627365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:47.627585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:47.628541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:47.646088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:47.646680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:47.647135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.648043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:47.648725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:47.649308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.671667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:47.672191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:47.679032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.679930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:47.680421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:47.689776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:47.948702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid 9053ad37-860b-4069-80b5-9657ddb3e53d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:48.071850 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c59fc7a7-83f0-4a1d-b22a-abe0fa887d63 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 2046 microversion: 2.25 time: 0.450711 Oct 28 18:04:48.072771 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 239/458] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:47 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 2046 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:48.089044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e745df2b-e7e5-4108-acd8-783257294e99 req-6943c4e1-7d4a-4f59-b5c9-2ad19564f665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1f7e30-e351-4ac5-adaa-1746018fa6e8", "name": "network-vif-plugged", "status": "completed", "tag": "525ca189-c0d7-42f3-b700-d8e232b70c13"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:48.119834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e745df2b-e7e5-4108-acd8-783257294e99 req-6943c4e1-7d4a-4f59-b5c9-2ad19564f665 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.120370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e745df2b-e7e5-4108-acd8-783257294e99 req-6943c4e1-7d4a-4f59-b5c9-2ad19564f665 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.120814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e745df2b-e7e5-4108-acd8-783257294e99 req-6943c4e1-7d4a-4f59-b5c9-2ad19564f665 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.141149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e745df2b-e7e5-4108-acd8-783257294e99 req-6943c4e1-7d4a-4f59-b5c9-2ad19564f665 service nova] Creating event network-vif-plugged:525ca189-c0d7-42f3-b700-d8e232b70c13 for instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 on n-h1-862404-2 Oct 28 18:04:48.152196 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e745df2b-e7e5-4108-acd8-783257294e99 req-6943c4e1-7d4a-4f59-b5c9-2ad19564f665 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077321 Oct 28 18:04:48.153627 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 240/459] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:48.164431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:48.169917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:48.179623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.181532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.182210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.185381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.186144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.187682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.478159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:48.495359 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b36080bc-1775-41c8-ab6c-7c1e25a0a0ee tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.884895 Oct 28 18:04:48.496738 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 220/460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:47 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:48.506167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-27dceea4-722e-4f5a-a785-ebdd42965793 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:48.516755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27dceea4-722e-4f5a-a785-ebdd42965793 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.517657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27dceea4-722e-4f5a-a785-ebdd42965793 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.518324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27dceea4-722e-4f5a-a785-ebdd42965793 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.519457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27dceea4-722e-4f5a-a785-ebdd42965793 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.520193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27dceea4-722e-4f5a-a785-ebdd42965793 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.521329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27dceea4-722e-4f5a-a785-ebdd42965793 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.578895 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-27dceea4-722e-4f5a-a785-ebdd42965793 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.078916 Oct 28 18:04:48.585250 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 221/461] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 18:04:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:04:48.594991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:48.597491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:48.613131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.614911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.615582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.618257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.618940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.622617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.663154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:48.697197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:48.724934 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb3b080d-2690-469d-8b8d-c5a47d301fa5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1470 microversion: 2.1 time: 0.567835 Oct 28 18:04:48.725827 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 241/462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:48 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1470 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:48.737781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:48.754477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:48.763776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.764582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.765637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.766909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.767527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.768667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:48.948260 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-669d969b-2926-42bf-ad9f-e5870e253646 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d/action" status: 202 len: 0 microversion: 2.25 time: 0.216344 Oct 28 18:04:48.954380 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 242/463] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:04:48 2022] POST /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:04:48.964331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:48.966746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:48.967462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:48.973160 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d224f9c-38a9-4d0c-a386-ae94f15f3184 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1308 microversion: 2.1 time: 0.386350 Oct 28 18:04:48.987836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:48.991133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:48.995697 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 222/464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:48 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:49.002241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-87264674-6e25-422c-86c7-7a188ae3200b req-76f4b3f2-1733-4bd5-a0f0-d9ddb8aab11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4903a6b7-6be5-4773-8a04-4ba37da9f892", "tag": "ab693c9c-62a7-4740-a0b7-d6103bcfb486"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:49.007386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:49.008295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:49.008788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:49.009275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:49.032109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87264674-6e25-422c-86c7-7a188ae3200b req-76f4b3f2-1733-4bd5-a0f0-d9ddb8aab11d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:49.032789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87264674-6e25-422c-86c7-7a188ae3200b req-76f4b3f2-1733-4bd5-a0f0-d9ddb8aab11d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:49.035450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87264674-6e25-422c-86c7-7a188ae3200b req-76f4b3f2-1733-4bd5-a0f0-d9ddb8aab11d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:49.063418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-87264674-6e25-422c-86c7-7a188ae3200b req-76f4b3f2-1733-4bd5-a0f0-d9ddb8aab11d service nova] Creating event network-changed:ab693c9c-62a7-4740-a0b7-d6103bcfb486 for instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 on n-h2-862404-2 Oct 28 18:04:49.072285 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-87264674-6e25-422c-86c7-7a188ae3200b req-76f4b3f2-1733-4bd5-a0f0-d9ddb8aab11d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074710 Oct 28 18:04:49.077259 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 223/465] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:49.086649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:49.092160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:49.098444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:49.099144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:49.099782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:49.100697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:49.101503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:49.102101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:49.397057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:49.405932 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1502b9e9-d82b-41b2-838a-cc3b84f132b2 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1320 microversion: 2.1 time: 0.452528 Oct 28 18:04:49.428111 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 243/466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:48 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1320 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:49.522410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid 9053ad37-860b-4069-80b5-9657ddb3e53d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:49.555409 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed5ccf3a-dfbb-419a-8771-74f5a1b627c8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 2051 microversion: 2.25 time: 0.471998 Oct 28 18:04:49.556703 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 224/467] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:49 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 2051 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:49.628694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:49.629586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:49.635787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:49.636306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:49.636791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:49.637502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:49.637966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:49.638546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:49.767759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:49.771630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:49.782643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:49.784225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:49.784910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:49.785841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:49.786510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:49.787765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.024666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:50.037441 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75d38a3b-9632-411c-be12-ae683b64454e tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.412749 Oct 28 18:04:50.038288 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 244/468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:49 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:50.046913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:50.048534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:50.061617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.064655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.066899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.069233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.069739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.071304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.089517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:50.102694 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f0e0e7c-ef36-4e75-abaf-3cfa4e3dbe72 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1470 microversion: 2.1 time: 0.355347 Oct 28 18:04:50.106520 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 225/469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:49 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:50.433892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:50.434897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:50.442349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.443037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.443710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.444623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.445342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.445858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.479257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:50.493654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32394d52-72ca-459f-9a18-4213d3793425 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1308 microversion: 2.1 time: 0.454082 Oct 28 18:04:50.496189 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 245/470] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:50 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:50.582743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:50.584187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:50.592546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.593354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.594273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.595267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.595981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.596634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.619791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:50.631554 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-316fdf38-a941-4ec9-bf65-d64f73c50cd5 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1470 microversion: 2.1 time: 0.201586 Oct 28 18:04:50.633693 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 226/471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:50 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:50.656297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:50.658711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:50.665353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.666147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.666597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.667324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.667837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.668622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.766924 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eac69af0-6574-4558-9c8d-51270f5ed8cd tempest-DeleteServersAdminTestJSON-159536151 tempest-DeleteServersAdminTestJSON-159536151-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8/action" status: 202 len: 0 microversion: 2.1 time: 0.114342 Oct 28 18:04:50.768059 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 227/472] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:04:50 2022] POST /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:04:50.776621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:50.777676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:50.784525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.785376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.786026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.786948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.787673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.788351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.826390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:50.826390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:50.826782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:50.827230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lazy-loading 'fault' on Instance uuid af1f7e30-e351-4ac5-adaa-1746018fa6e8 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:51.042639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid 9053ad37-860b-4069-80b5-9657ddb3e53d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:51.077996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68bb2539-71c3-41eb-a023-fcaa2ad958e8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 2031 microversion: 2.25 time: 0.499214 Oct 28 18:04:51.092357 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 246/473] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:50 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 2031 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:04:51.092357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:51.092357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:51.109790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:51.110276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:51.110709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:51.111433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:51.111905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:51.112328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:51.348146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:51.363503 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f0b62845-f4a7-4c02-839c-05d870913685 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1453 microversion: 2.1 time: 0.590812 Oct 28 18:04:51.364374 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 228/474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:50 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1453 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:51.390833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862404-2", "block_migration": "auto"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:51.393891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:51.402744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:51.403401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:51.403851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:51.404719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:51.405003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:51.405419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:51.439972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'flavor' on Instance uuid 9053ad37-860b-4069-80b5-9657ddb3e53d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:51.466297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Going to try to live migrate instance to n-h1-862404-2 {{(pid=120679) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:04:51.519784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:51.530284 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c322743-56bc-4806-a9c3-1a2cb8dcd6ec tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.444284 Oct 28 18:04:51.533397 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 247/475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:51 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:51.549767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:51.550401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:51.568277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:51.572438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:51.572923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:51.573685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:51.574831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:51.575471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:51.823593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:51.835935 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d017e42c-7ea8-4e9c-8fdd-c094bb5bb1f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.293825 Oct 28 18:04:51.836917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 248/476] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:51 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:51.842285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:51.842775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:51.857385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:51.857882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:51.868642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:51.869666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:51.870158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:51.870593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:51.921290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:04:51.981932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:52.082808 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8492a727-948a-4bcf-a496-40a29174fa83 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 204 len: 0 microversion: 2.1 time: 0.244487 Oct 28 18:04:52.086735 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 249/477] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:51 2022] DELETE /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:04:52.094247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:52.095248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:52.101565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.102432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.103059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.104014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.104658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.105310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.271248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:52.281774 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9411279e-150d-4a14-bfac-ed33111b039e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1308 microversion: 2.1 time: 0.193724 Oct 28 18:04:52.283033 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 250/478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:52 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:52.288335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:52.288952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:52.305528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.306031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.306468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.307524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.308027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.309609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.352690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.353266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.353867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.354324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lazy-loading 'fault' on Instance uuid af1f7e30-e351-4ac5-adaa-1746018fa6e8 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:52.502602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:52.510489 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c4e30e7b-3a24-4c2b-8872-027238b70426 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1459 microversion: 2.1 time: 0.226017 Oct 28 18:04:52.511258 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 251/479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:52 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1459 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:52.558259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:52.558905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:52.565633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.566433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.567115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.567962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.568649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.569882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.736627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:52.744745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e10265e0-f484-4f72-ac56-5eaa1e957861 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.190258 Oct 28 18:04:52.745404 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 252/480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:52 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:52.781798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-788ec0e1-07b0-4754-b520-c7ca4d687bda req-daf5f9dd-33ae-45b6-90a9-93cf76a95491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3ae6b5-7f14-4401-9680-ebcf1756a40c", "name": "network-vif-plugged", "status": "completed", "tag": "49b723c1-8f4b-436a-97df-a9b610186ba2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:52.791120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-788ec0e1-07b0-4754-b520-c7ca4d687bda req-daf5f9dd-33ae-45b6-90a9-93cf76a95491 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.791604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-788ec0e1-07b0-4754-b520-c7ca4d687bda req-daf5f9dd-33ae-45b6-90a9-93cf76a95491 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.792081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-788ec0e1-07b0-4754-b520-c7ca4d687bda req-daf5f9dd-33ae-45b6-90a9-93cf76a95491 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.804904 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-788ec0e1-07b0-4754-b520-c7ca4d687bda req-daf5f9dd-33ae-45b6-90a9-93cf76a95491 service nova] Creating event network-vif-plugged:49b723c1-8f4b-436a-97df-a9b610186ba2 for instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c on n-h2-862404-2 Oct 28 18:04:52.812173 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-788ec0e1-07b0-4754-b520-c7ca4d687bda req-daf5f9dd-33ae-45b6-90a9-93cf76a95491 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034323 Oct 28 18:04:52.813837 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 253/481] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:52.864091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:52.865405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:52.896285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.897049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.897533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:52.898895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:52.899463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:52.900309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:53.105664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:53.114949 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-83a4bfb5-9b94-4765-b250-c946783f3c66 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.256728 Oct 28 18:04:53.129342 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 254/482] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:52 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:53.307286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:53.308034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:53.318666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:53.319204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:53.320078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:53.322104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:53.322451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:53.325149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:53.489925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:53.497926 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d9692af-b550-47fe-9ac6-b4b81ac94650 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1308 microversion: 2.1 time: 0.194973 Oct 28 18:04:53.504437 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 255/483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:53 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:53.535844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:53.536550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:53.556970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:53.561750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:53.565001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:53.566030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:53.570661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:53.571362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:53.614921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:53.615426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:53.616053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:53.616727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lazy-loading 'fault' on Instance uuid af1f7e30-e351-4ac5-adaa-1746018fa6e8 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:53.967775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:53.993580 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b050b911-2d82-4d00-8522-6b761ec48d21 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1459 microversion: 2.1 time: 0.449147 Oct 28 18:04:54.010418 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 256/484] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:53 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1459 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:54.020924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:54.021851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:54.030795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:54.031691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:54.032374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:54.033480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:54.034150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:54.035481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:54.375994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:54.395032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-459b3268-b893-4297-9f9d-afb6fa0e2313 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.390856 Oct 28 18:04:54.411836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 257/485] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:54 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:54.557556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-63854129", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "93172da3-2cc7-4d23-b5e8-59c944e1e4c4"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:54.629856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] validate_networks() for [('93172da3-2cc7-4d23-b5e8-59c944e1e4c4', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:54.672248 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-01a56cb5-8acf-4374-beeb-240b84e15e3c tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d/action" status: 202 len: 0 microversion: 2.25 time: 3.287113 Oct 28 18:04:54.674522 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 229/486] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:04:51 2022] POST /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d/action => generated 0 bytes in 3309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:04:54.680749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:54.682392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:54.692214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:54.692617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:54.693204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:54.693961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:54.695407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:54.695579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:54.994851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:55.008902 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-da794a84-b2fe-4dab-9ed3-c85c78c902ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.332948 Oct 28 18:04:55.010173 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 230/487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:54 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:55.020278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:55.028780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:55.035653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.038706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.039446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.042288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.043231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.050406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.291791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:55.301017 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f05366ef-b9c0-415e-a5d0-7828b94c3874 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1488 microversion: 2.1 time: 0.289496 Oct 28 18:04:55.301528 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 231/488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:55 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1488 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:55.325258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:55.326068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:55.335125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.336764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.337416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.339151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.340553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.341536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.532936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:55.533903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:55.534569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:55.535143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:55.535998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:55.544673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:55.545562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.546047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.546473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.547192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.547640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.548084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.553065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:55.554463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:55.555622 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ced868ac-4573-4002-9620-96bbf8f0a9c8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.236105 Oct 28 18:04:55.556527 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 232/489] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:55 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:55.563300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-edad88b8-c1f8-43a7-959b-7918e500c179 req-e48401c1-d4c0-44bb-8b98-815644cfa65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f930e848-f660-4a13-a2a2-a979ccbcbe7e", "name": "network-vif-plugged", "status": "completed", "tag": "a41d4e2d-0574-4bcc-b516-174268e798c2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:55.572705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-edad88b8-c1f8-43a7-959b-7918e500c179 req-e48401c1-d4c0-44bb-8b98-815644cfa65a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.573185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-edad88b8-c1f8-43a7-959b-7918e500c179 req-e48401c1-d4c0-44bb-8b98-815644cfa65a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.573612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-edad88b8-c1f8-43a7-959b-7918e500c179 req-e48401c1-d4c0-44bb-8b98-815644cfa65a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.582639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for project 8253dbe510dd462f974f37fce0a5d990. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:55.588592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for user 12dea4e86fd14c07859b48e22493b9dd and project 8253dbe510dd462f974f37fce0a5d990. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:55.595348 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-edad88b8-c1f8-43a7-959b-7918e500c179 req-e48401c1-d4c0-44bb-8b98-815644cfa65a service nova] Creating event network-vif-plugged:a41d4e2d-0574-4bcc-b516-174268e798c2 for instance f930e848-f660-4a13-a2a2-a979ccbcbe7e on n-h2-862404-2 Oct 28 18:04:55.600847 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-edad88b8-c1f8-43a7-959b-7918e500c179 req-e48401c1-d4c0-44bb-8b98-815644cfa65a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041923 Oct 28 18:04:55.601461 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 233/490] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:55.602310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:55.604767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:55.608775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-91174417-89c3-4708-8eda-457d1a55b360 req-bd4f268b-d2c6-4035-8c6d-1c9a14b4035a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1f7e30-e351-4ac5-adaa-1746018fa6e8", "name": "network-vif-deleted", "tag": "525ca189-c0d7-42f3-b700-d8e232b70c13"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:55.624137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-91174417-89c3-4708-8eda-457d1a55b360 req-bd4f268b-d2c6-4035-8c6d-1c9a14b4035a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.624744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-91174417-89c3-4708-8eda-457d1a55b360 req-bd4f268b-d2c6-4035-8c6d-1c9a14b4035a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.625174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-91174417-89c3-4708-8eda-457d1a55b360 req-bd4f268b-d2c6-4035-8c6d-1c9a14b4035a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.637655 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-91174417-89c3-4708-8eda-457d1a55b360 req-bd4f268b-d2c6-4035-8c6d-1c9a14b4035a service nova] Creating event network-vif-deleted:525ca189-c0d7-42f3-b700-d8e232b70c13 for instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 on n-h1-862404-2 Oct 28 18:04:55.642534 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-91174417-89c3-4708-8eda-457d1a55b360 req-bd4f268b-d2c6-4035-8c6d-1c9a14b4035a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039359 Oct 28 18:04:55.643138 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 234/491] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:55.648671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:55.649371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:55.655852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.656575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.657458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.658336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.658792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.659217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.662778 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f610d23-a5a3-4a59-b61a-931bd5736e77 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.258818 Oct 28 18:04:55.663742 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 258/492] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:04:55.670228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:55.671088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:55.677581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.678273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.678865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.679720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.680349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.681056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.711682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.722055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.722532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.723022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lazy-loading 'fault' on Instance uuid af1f7e30-e351-4ac5-adaa-1746018fa6e8 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:55.825086 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-513c1872-9398-45d0-b22c-cb1b7f3d9049 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c/action" status: 202 len: 0 microversion: 2.1 time: 0.157079 Oct 28 18:04:55.829230 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 259/493] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:04:55 2022] POST /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:04:55.833763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbe5b5867422eb8c4f7348fc7fad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29db18378f22441fbd07962e67a41562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:55.837093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:55.841587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:55.857571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.858348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.859551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.862252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:55.862897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:55.863694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:55.866016 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f679c974-af4c-4fd9-80a1-a3a1e76a0cca tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 200 len: 1310 microversion: 2.1 time: 0.221683 Oct 28 18:04:55.866616 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 235/494] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:55 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 1310 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:55.907517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6855e520-f438-48b1-be59-52d99dff3087 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:55.908940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6855e520-f438-48b1-be59-52d99dff3087 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:56.004315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6855e520-f438-48b1-be59-52d99dff3087 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:56.011648 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6855e520-f438-48b1-be59-52d99dff3087 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1209 microversion: 2.1 time: 0.135025 Oct 28 18:04:56.024981 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 236/495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:55 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1209 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:56.033791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:56.034787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:56.041774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.042434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.043801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.044556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.045014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.045439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.078083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:56.253601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:56.267543 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ceb5b257-e3c4-40d0-86bc-22029951942d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1493 microversion: 2.1 time: 0.239591 Oct 28 18:04:56.270001 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 237/496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:56 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1493 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:56.284938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:56.285973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:56.303863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.305453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.307389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.311792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.313409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.314081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.326893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:56.344345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-836d19ea-8137-4d41-a8a6-2c3d463b4a26 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1321 microversion: 2.1 time: 0.513539 Oct 28 18:04:56.348037 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 260/497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:55 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:56.542142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:56.552036 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e5e86afb-97ea-4547-8607-1ed8a2132a21 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.280270 Oct 28 18:04:56.552607 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 238/498] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:56 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:56.586674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:56.587499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:56.598674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.599467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.600797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.601881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.602743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.603344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.894856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:56.896475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:56.904182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.904859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.905521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.906433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.907107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.907895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.932729 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] HTTP exception thrown: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Request method failure captured: Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 HTTP/1.1 Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmMCV-K9ccdVuVjwpaBaXp1s5oERHOJLzI-qHPX262vInXlK6CmHkdrAV_c4wsovsgNlau6iS6lqhuOvfDMohLs3eG4F7yb8udrE9QxuCWtLLfdpADitDxoAvF5Mp-IPvX1gGhoQpIz8Ef43tFdveeiISmj-6lbAoAr13nHbSLahCg Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:56.935136 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29db18378f22441fbd07962e67a41562", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29db18378f22441fbd07962e67a41562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 60dbbe5b5867422eb8c4f7348fc7fad3 Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.936707 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'af1f7e30-e351-4ac5-adaa-1746018fa6e8'} Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:56.937535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.938750 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.941686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Returning 404 to user: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:56.945957 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f70d3cce-2f20-4a58-82a1-0521fff1fc1d tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 404 len: 111 microversion: 2.1 time: 0.056545 Oct 28 18:04:56.949697 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 239/499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:56 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:56.961255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:56.961977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:56.972187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.972869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.973337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.973993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:56.974707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:56.975314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:56.991600 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] HTTP exception thrown: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Request method failure captured: Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 HTTP/1.1 Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmMCV-K9ccdVuVjwpaBaXp1s5oERHOJLzI-qHPX262vInXlK6CmHkdrAV_c4wsovsgNlau6iS6lqhuOvfDMohLs3eG4F7yb8udrE9QxuCWtLLfdpADitDxoAvF5Mp-IPvX1gGhoQpIz8Ef43tFdveeiISmj-6lbAoAr13nHbSLahCg Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:56.993326 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29db18378f22441fbd07962e67a41562", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29db18378f22441fbd07962e67a41562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 60dbbe5b5867422eb8c4f7348fc7fad3 Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.994870 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'af1f7e30-e351-4ac5-adaa-1746018fa6e8'} Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:56.995730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:56.998258 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.000247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Returning 404 to user: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:57.000247 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-325abc56-cdaa-4b66-a5ee-e8c7637977ab tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "DELETE /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 404 len: 111 microversion: 2.1 time: 0.040404 Oct 28 18:04:57.000247 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 240/500] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:56 2022] DELETE /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:57.004690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:57.005312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: af1f7e30-e351-4ac5-adaa-1746018fa6e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.013286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.013799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.014411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.015290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.015934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.016523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.024543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:57.034668 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] HTTP exception thrown: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Request method failure captured: Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 HTTP/1.1 Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmMCV-K9ccdVuVjwpaBaXp1s5oERHOJLzI-qHPX262vInXlK6CmHkdrAV_c4wsovsgNlau6iS6lqhuOvfDMohLs3eG4F7yb8udrE9QxuCWtLLfdpADitDxoAvF5Mp-IPvX1gGhoQpIz8Ef43tFdveeiISmj-6lbAoAr13nHbSLahCg Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:04:57.036454 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29db18378f22441fbd07962e67a41562", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29db18378f22441fbd07962e67a41562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 60dbbe5b5867422eb8c4f7348fc7fad3 Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:57.037946 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'af1f7e30-e351-4ac5-adaa-1746018fa6e8'} Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:57.038779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. Oct 28 18:04:57.040225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.041513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Returning 404 to user: Instance af1f7e30-e351-4ac5-adaa-1746018fa6e8 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:57.041513 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cdd59f22-52b6-4713-a564-9c19b2c0732a tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8" status: 404 len: 111 microversion: 2.1 time: 0.037414 Oct 28 18:04:57.041754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:57.043848 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 241/501] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:56 2022] GET /compute/v2.1/servers/af1f7e30-e351-4ac5-adaa-1746018fa6e8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:57.044185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:57.047291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:57.047421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb45bcbe-39f6-4f75-afeb-6cea980be243 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.465811 Oct 28 18:04:57.059890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.060078 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 261/502] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:56 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:57.060162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.060162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.060162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.060162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.060453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.060453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.060582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:57.061841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.078054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.078561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.084195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.089284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.090408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.090860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.118803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] HTTP exception thrown: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Request method failure captured: Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 HTTP/1.1 Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmMCV-K9ccdVuVjwpaBaXp1s5oERHOJLzI-qHPX262vInXlK6CmHkdrAV_c4wsovsgNlau6iS6lqhuOvfDMohLs3eG4F7yb8udrE9QxuCWtLLfdpADitDxoAvF5Mp-IPvX1gGhoQpIz8Ef43tFdveeiISmj-6lbAoAr13nHbSLahCg Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:04:57.121302 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29db18378f22441fbd07962e67a41562", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29db18378f22441fbd07962e67a41562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 60dbbe5b5867422eb8c4f7348fc7fad3 Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.122945 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '9f0df6bd-0498-41c4-9fa3-f278edf1ee88'} Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:57.123650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.126385 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.132814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Returning 404 to user: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:57.133995 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8aa0dfb1-9a9a-498c-a696-168c60b891a9 tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 404 len: 111 microversion: 2.1 time: 0.083611 Oct 28 18:04:57.134774 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 262/503] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:57 2022] DELETE /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:57.146710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:57.147353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] [instance: 9f0df6bd-0498-41c4-9fa3-f278edf1ee88] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.157876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.158383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.158626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:57.158821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.159757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.160405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.161011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.167619 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b2bc8f2-3edc-4a4b-a48c-d65b6ab83f02 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1261 microversion: 2.1 time: 0.124244 Oct 28 18:04:57.169803 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 242/504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:57 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1261 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:57.186010 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] HTTP exception thrown: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Request method failure captured: Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 HTTP/1.1 Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmMCV-K9ccdVuVjwpaBaXp1s5oERHOJLzI-qHPX262vInXlK6CmHkdrAV_c4wsovsgNlau6iS6lqhuOvfDMohLs3eG4F7yb8udrE9QxuCWtLLfdpADitDxoAvF5Mp-IPvX1gGhoQpIz8Ef43tFdveeiISmj-6lbAoAr13nHbSLahCg Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:04:57.187623 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/29db18378f22441fbd07962e67a41562"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_29db18378f22441fbd07962e67a41562", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/29db18378f22441fbd07962e67a41562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 29db18378f22441fbd07962e67a41562 Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1642185388 Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 60dbbe5b5867422eb8c4f7348fc7fad3 Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersAdminTestJSON-1642185388-project Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.188883 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '9f0df6bd-0498-41c4-9fa3-f278edf1ee88'} Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:57.189602 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. Oct 28 18:04:57.190799 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:04:57.193702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] Returning 404 to user: Instance 9f0df6bd-0498-41c4-9fa3-f278edf1ee88 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:57.193702 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4d5ad0f-c197-430c-918a-3f659bb92ddc tempest-DeleteServersAdminTestJSON-1642185388 tempest-DeleteServersAdminTestJSON-1642185388-project] 10.222.0.16 "GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88" status: 404 len: 111 microversion: 2.1 time: 0.049844 Oct 28 18:04:57.197179 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 263/505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:57 2022] GET /compute/v2.1/servers/9f0df6bd-0498-41c4-9fa3-f278edf1ee88 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:04:57.299088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:57.299873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.308183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.309340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.310033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.310813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.311647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.312247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.370572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:57.371984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.382129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.382886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.383489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.384656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.388685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.390323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.480718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:57.493873 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-75dc98bd-0098-49db-a8ea-7a322e6a6869 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 200 len: 1473 microversion: 2.1 time: 0.199174 Oct 28 18:04:57.494637 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 243/506] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:57 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 1473 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:57.519053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1836643667"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:57.530444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.541186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.541682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.542124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.542872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.548435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.549144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.674879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:57.688855 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-289c0803-47e6-4dc9-bf39-01c37b3445b9 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1470 microversion: 2.1 time: 0.322466 Oct 28 18:04:57.689924 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 264/507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:57 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1470 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:57.711946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:57.712582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.723036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.727107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.727733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.728497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.732340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.733054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.924953 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-52e197fb-a482-4f91-89fa-7be66f1c83a8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c/action" status: 202 len: 0 microversion: 2.1 time: 0.408345 Oct 28 18:04:57.932266 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 244/508] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:04:57 2022] POST /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 28 18:04:57.940160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e273c855-98c1-4a75-87c9-74950d8a33dd req-d0bb9d10-f932-4054-a25f-bb9b4f228734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9053ad37-860b-4069-80b5-9657ddb3e53d", "name": "network-vif-unplugged", "status": "completed", "tag": "4413e0ac-d5e4-4c8e-bfbf-f4eb63123267"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:57.958451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e273c855-98c1-4a75-87c9-74950d8a33dd req-d0bb9d10-f932-4054-a25f-bb9b4f228734 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.958939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e273c855-98c1-4a75-87c9-74950d8a33dd req-d0bb9d10-f932-4054-a25f-bb9b4f228734 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.959554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e273c855-98c1-4a75-87c9-74950d8a33dd req-d0bb9d10-f932-4054-a25f-bb9b4f228734 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.974664 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e273c855-98c1-4a75-87c9-74950d8a33dd req-d0bb9d10-f932-4054-a25f-bb9b4f228734 service nova] Creating event network-vif-unplugged:4413e0ac-d5e4-4c8e-bfbf-f4eb63123267 for instance 9053ad37-860b-4069-80b5-9657ddb3e53d on n-h2-862404-2 Oct 28 18:04:57.979775 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e273c855-98c1-4a75-87c9-74950d8a33dd req-d0bb9d10-f932-4054-a25f-bb9b4f228734 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044414 Oct 28 18:04:57.981390 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 245/509] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:57.987229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:57.987606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:57.994843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.995306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.996713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:57.997458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:57.998023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:57.998661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:58.032111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lazy-loading 'flavor' on Instance uuid f930e848-f660-4a13-a2a2-a979ccbcbe7e {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:58.120538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:58.148043 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae05cb29-7ab1-4efa-97ce-f18f9269d101 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.453889 Oct 28 18:04:58.165427 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 265/510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:57 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:58.182916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5626de4-dba2-412b-aef4-fcd0033d1c70 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de798ee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:58.196962 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1205fb78-0ef5-4a97-a4b7-771a5f375859 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e/action" status: 202 len: 0 microversion: 2.1 time: 0.214142 Oct 28 18:04:58.198117 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 246/511] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:04:57 2022] POST /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:04:58.236047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:58.236769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:58.256149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:58.256566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:58.257053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:58.257774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:58.260915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:58.261434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:58.299301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5626de4-dba2-412b-aef4-fcd0033d1c70 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.129471 Oct 28 18:04:58.299979 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 266/512] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:04:58 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:58.305891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:58.309876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:58.325725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:58.326680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:58.327410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:58.328441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:58.329124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:58.329930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:58.403524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:58.407748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:58.415038 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3cdd8f26-efe9-48b5-8466-4ed90de098a4 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1267 microversion: 2.1 time: 0.113219 Oct 28 18:04:58.416196 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 267/513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:58 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:58.423610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:58.424248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:58.431315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:58.432043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:58.432766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:58.433857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:58.434487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:58.435253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:58.539181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:58.592220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:58.603097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:58.608053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:58.611587 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-beca48b2-5947-4de0-9d20-14b1b1690701 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.408766 Oct 28 18:04:58.613511 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 247/514] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:58 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:04:58.750584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8fd0aa33-7ba7-4b83-ab71-17246585a555 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1629 microversion: 2.1 time: 0.333056 Oct 28 18:04:58.756081 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 268/515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:58 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1629 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:59.178880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:59.181077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:59.189569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:59.190382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:59.191088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:59.192036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:59.193276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:59.193912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:59.315156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f8b22b8-6ca0-4488-beac-8ecb06a26e54 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de8e6e50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:59.395060 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f8b22b8-6ca0-4488-beac-8ecb06a26e54 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.079587 Oct 28 18:04:59.396287 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 269/516] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:04:59 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:59.442888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:59.444010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:59.455350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:59.457760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:59.458361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:59.460945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:59.464193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:59.465612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:59.482278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:59.493496 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-adc1d433-63eb-42cf-9187-2069d7e3f4d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.320110 Oct 28 18:04:59.496355 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 248/517] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:59 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:59.640827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:59.642816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:59.659182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:59.662419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:59.663263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:59.664875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:59.665371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:59.665813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:59.688644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:59.698119 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8578a393-b423-4c96-9661-1759cee89f95 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1309 microversion: 2.1 time: 0.259249 Oct 28 18:04:59.701618 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 270/518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:59 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:59.774488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:59.775914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:04:59.785587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:59.786397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:59.787075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:59.788030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:59.789167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:59.789809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:59.948340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:59.964086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:59.968384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:59.971275 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1ba10fd-cb61-4e6a-bb61-e3ec8c559295 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.336102 Oct 28 18:04:59.971974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-002277a4-d054-465c-9865-1c01c73b27f5 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1612 microversion: 2.1 time: 0.201217 Oct 28 18:04:59.973836 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 249/519] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:04:59 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:04:59.988928 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 271/520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:59 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1612 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:00.012358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:00.013588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:00.021115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1ed72712-b8a9-4ae7-91c7-32d959864ebe req-975bd98e-48d0-4ef4-8b72-c9a3ba474a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9053ad37-860b-4069-80b5-9657ddb3e53d", "tag": "4413e0ac-d5e4-4c8e-bfbf-f4eb63123267"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:00.028889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:00.036741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1ed72712-b8a9-4ae7-91c7-32d959864ebe req-975bd98e-48d0-4ef4-8b72-c9a3ba474a38 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.037521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1ed72712-b8a9-4ae7-91c7-32d959864ebe req-975bd98e-48d0-4ef4-8b72-c9a3ba474a38 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.038268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1ed72712-b8a9-4ae7-91c7-32d959864ebe req-975bd98e-48d0-4ef4-8b72-c9a3ba474a38 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.038548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.039449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.040027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.041223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.041894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.042697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.053704 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1ed72712-b8a9-4ae7-91c7-32d959864ebe req-975bd98e-48d0-4ef4-8b72-c9a3ba474a38 service nova] Creating event network-changed:4413e0ac-d5e4-4c8e-bfbf-f4eb63123267 for instance 9053ad37-860b-4069-80b5-9657ddb3e53d on n-h2-862404-2 Oct 28 18:05:00.060518 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1ed72712-b8a9-4ae7-91c7-32d959864ebe req-975bd98e-48d0-4ef4-8b72-c9a3ba474a38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043088 Oct 28 18:05:00.061402 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 272/521] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:05:00.088795 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] HTTP exception thrown: Cannot 'migrate' instance f930e848-f660-4a13-a2a2-a979ccbcbe7e while it is in vm_state suspended Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Request method failure captured: Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e/action HTTP/1.1 Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 15 Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmVIJcbosHyUV5ZZWxy8LBjO0IwteQKTDAXKL0lxb2y3Q2nVDO5G6PuCEeD06XiHXjDjZMhIw4lUHQFur8Xz8wiJRCHnuW0ATsxGl2EXv5CpHOASkoNbc3_-VLJkIWjNVB3a8R7U4Kl9MYfTO4zuV3_cBl-8IfsaWTr1m6qaEwrX64 Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:05:00.092327 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d8029d331d2438bb54ff7bfc5b07490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: d3f123f3d5e0445982f259596ffc77e9 Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: {"migrate": {}} Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:05:00.093952 n-d-862404-2 devstack@n-api.service[120679]: exception: Cannot 'migrate' instance f930e848-f660-4a13-a2a2-a979ccbcbe7e while it is in vm_state suspended Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f930e848-f660-4a13-a2a2-a979ccbcbe7e', 'body': {'migrate': {}}} Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f930e848-f660-4a13-a2a2-a979ccbcbe7e in vm_state suspended. Cannot resize while the instance is in this state. Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.094871 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance f930e848-f660-4a13-a2a2-a979ccbcbe7e while it is in vm_state suspended Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:00.096275 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:00.097565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:00.097565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:00.097565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance f930e848-f660-4a13-a2a2-a979ccbcbe7e while it is in vm_state suspended Oct 28 18:05:00.097565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.097565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Returning 409 to user: Cannot 'migrate' instance f930e848-f660-4a13-a2a2-a979ccbcbe7e while it is in vm_state suspended {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:00.098417 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-664ffa91-aba4-479d-921b-544143ce6da2 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e/action" status: 409 len: 148 microversion: 2.1 time: 0.091151 Oct 28 18:05:00.099852 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 250/522] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:00 2022] POST /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e/action => generated 148 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:05:00.110967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-decf281d-7d60-4dad-a189-542cd9d2a2f7 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-decf281d-7d60-4dad-a189-542cd9d2a2f7 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Request method failure captured: Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c/action HTTP/1.1 Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 39 Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmVIJcbosHyUV5ZZWxy8LBjO0IwteQKTDAXKL0lxb2y3Q2nVDO5G6PuCEeD06XiHXjDjZMhIw4lUHQFur8Xz8wiJRCHnuW0ATsxGl2EXv5CpHOASkoNbc3_-VLJkIWjNVB3a8R7U4Kl9MYfTO4zuV3_cBl-8IfsaWTr1m6qaEwrX64 Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:05:00.114835 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d8029d331d2438bb54ff7bfc5b07490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d3f123f3d5e0445982f259596ffc77e9 Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: {"os-resetState": {"state": "invalid"}} Oct 28 18:05:00.116194 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '79903379-95d0-4ccc-80bc-92db11a67d3c', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:00.116867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:05:00.118065 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 18:05:00.119178 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.119178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-decf281d-7d60-4dad-a189-542cd9d2a2f7 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:00.119178 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-decf281d-7d60-4dad-a189-542cd9d2a2f7 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c/action" status: 400 len: 144 microversion: 2.1 time: 0.010459 Oct 28 18:05:00.119178 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 273/523] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:00 2022] POST /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c/action => generated 144 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:05:00.130308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11c8e44e-78c3-489e-811e-605e11f2f102 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11c8e44e-78c3-489e-811e-605e11f2f102 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Request method failure captured: Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c/action HTTP/1.1 Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 31 Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmVIJcbosHyUV5ZZWxy8LBjO0IwteQKTDAXKL0lxb2y3Q2nVDO5G6PuCEeD06XiHXjDjZMhIw4lUHQFur8Xz8wiJRCHnuW0ATsxGl2EXv5CpHOASkoNbc3_-VLJkIWjNVB3a8R7U4Kl9MYfTO4zuV3_cBl-8IfsaWTr1m6qaEwrX64 Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:05:00.139567 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d8029d331d2438bb54ff7bfc5b07490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: d3f123f3d5e0445982f259596ffc77e9 Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: {"os-resetState": {"state": 1}} Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:05:00.141123 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '79903379-95d0-4ccc-80bc-92db11a67d3c', 'body': {'os-resetState': {'state': 1}}} Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 1 Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:00.142004 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 18:05:00.143381 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.144980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11c8e44e-78c3-489e-811e-605e11f2f102 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:00.147102 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11c8e44e-78c3-489e-811e-605e11f2f102 tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c/action" status: 400 len: 120 microversion: 2.1 time: 0.020832 Oct 28 18:05:00.154248 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 251/524] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:00 2022] POST /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c/action => generated 120 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:05:00.159133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b75470b1-86c4-4994-a883-13cb7a9ec8ec tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:00.161744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b75470b1-86c4-4994-a883-13cb7a9ec8ec tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Failed to fetch instance by id 999 {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2983}} Oct 28 18:05:00.162576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b75470b1-86c4-4994-a883-13cb7a9ec8ec tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b75470b1-86c4-4994-a883-13cb7a9ec8ec tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Request method failure captured: Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 37 Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmVIJcbosHyUV5ZZWxy8LBjO0IwteQKTDAXKL0lxb2y3Q2nVDO5G6PuCEeD06XiHXjDjZMhIw4lUHQFur8Xz8wiJRCHnuW0ATsxGl2EXv5CpHOASkoNbc3_-VLJkIWjNVB3a8R7U4Kl9MYfTO4zuV3_cBl-8IfsaWTr1m6qaEwrX64 Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:05:00.169299 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d8029d331d2438bb54ff7bfc5b07490", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d8029d331d2438bb54ff7bfc5b07490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6d8029d331d2438bb54ff7bfc5b07490 Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1090279721 Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d3f123f3d5e0445982f259596ffc77e9 Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1090279721-project-admin Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: {"os-resetState": {"state": "error"}} Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:00.171079 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 999 could not be found. Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2984, in get Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:00.172307 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 18:05:00.173592 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:00.176607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b75470b1-86c4-4994-a883-13cb7a9ec8ec tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:00.177892 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b75470b1-86c4-4994-a883-13cb7a9ec8ec tempest-ServersAdminNegativeTestJSON-1090279721 tempest-ServersAdminNegativeTestJSON-1090279721-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.022665 Oct 28 18:05:00.183596 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 274/525] 10.222.0.16 () {60 vars in 1179 bytes} [Fri Oct 28 18:05:00 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:05:00.190094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:00.191285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:00.200603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.201430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.202157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.203097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.203996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.204655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.235027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:05:00.340712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:00.347871 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df5b0e85-e719-42d9-8ad4-7f32d44edeff tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 204 len: 0 microversion: 2.1 time: 0.161788 Oct 28 18:05:00.348437 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 252/526] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:05:00 2022] DELETE /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:05:00.357214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:00.357937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:00.372043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.372912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.373818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.374824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.375537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.376294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.416155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b3c0c91-d4b0-45a4-bc78-a1a9e2bbbf31 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de76a040>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:00.490744 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b3c0c91-d4b0-45a4-bc78-a1a9e2bbbf31 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.079940 Oct 28 18:05:00.502360 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 253/527] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:00 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:00.522370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:00.523586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:00.530276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.530786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.531234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.532478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.533311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.533760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.561951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:00.603997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:00.614784 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8f5c763c-814c-4fc3-905e-1aa910824f06 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1467 microversion: 2.1 time: 0.262049 Oct 28 18:05:00.633542 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 275/528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:00 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1467 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:00.654574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-42f0be8a-56fc-41ea-96a9-224c3ceeb1e1 req-3111bd79-f55b-4e1b-a478-f885508c44cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7e8cea-b2a4-437f-9036-98060f5e182c", "tag": "8592cf03-4542-4f98-93b2-7c1f1ab5bbeb"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:00.674072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42f0be8a-56fc-41ea-96a9-224c3ceeb1e1 req-3111bd79-f55b-4e1b-a478-f885508c44cf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.675060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42f0be8a-56fc-41ea-96a9-224c3ceeb1e1 req-3111bd79-f55b-4e1b-a478-f885508c44cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.676025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42f0be8a-56fc-41ea-96a9-224c3ceeb1e1 req-3111bd79-f55b-4e1b-a478-f885508c44cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.691857 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-42f0be8a-56fc-41ea-96a9-224c3ceeb1e1 req-3111bd79-f55b-4e1b-a478-f885508c44cf service nova] Creating event network-changed:8592cf03-4542-4f98-93b2-7c1f1ab5bbeb for instance 0f7e8cea-b2a4-437f-9036-98060f5e182c on n-h1-862404-2 Oct 28 18:05:00.699647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-42f0be8a-56fc-41ea-96a9-224c3ceeb1e1 req-3111bd79-f55b-4e1b-a478-f885508c44cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048171 Oct 28 18:05:00.701064 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 276/529] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:00.723424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:00.724419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:00.733225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.734034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.734633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.736464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:00.737477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:00.738372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:00.857148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:00.872055 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a2fa646-ad04-4610-a1fd-47821d705876 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.353470 Oct 28 18:05:00.872641 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 254/530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:00 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:00.998002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:00.999019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:01.002730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:01.011605 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29e04107-7d31-4bab-92c4-1a321503cc51 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1309 microversion: 2.1 time: 0.292450 Oct 28 18:05:01.012964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:01.013481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:01.013921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:01.017655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:01.018325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:01.018822 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 277/531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:00 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:01.020031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:01.292232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:01.310272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:01.311843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:01.313113 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d2ad160-9243-46f5-87e5-abcee3a88dd2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.320367 Oct 28 18:05:01.324687 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 255/532] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:00 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:05:01.508299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d8fc3dd-9f62-4192-bb8b-4a15aa49d030 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de7f6820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:01.553386 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d8fc3dd-9f62-4192-bb8b-4a15aa49d030 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.048865 Oct 28 18:05:01.553916 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 256/533] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:01 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:01.559467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-edd95bc6-56a2-44ac-93dd-4bbca030bb53 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-765270916", "id": 2024865381, "os-flavor-access:is_public": "False"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:01.577024 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-edd95bc6-56a2-44ac-93dd-4bbca030bb53 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.137710 Oct 28 18:05:01.577638 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 278/534] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:01 2022] POST /compute/v2.1/flavors => generated 430 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:01.590270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bc23a3ae-43ce-43cf-a39c-eaafa8372dfe tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2794367adc8e446a8f73c3b0fad9cc2b"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:01.644646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:01.645524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:01.651745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:01.652317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:01.652874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:01.653582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:01.654038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:01.654465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:01.665043 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bc23a3ae-43ce-43cf-a39c-eaafa8372dfe tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2024865381/action" status: 200 len: 97 microversion: 2.1 time: 0.078569 Oct 28 18:05:01.665956 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 257/535] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:01 2022] POST /compute/v2.1/flavors/2024865381/action => generated 97 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:05:01.844043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:01.844698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8cc77cc9-1234-46ae-9c3e-593b9db79cc2 tempest-FlavorsAccessTestJSON-1498966653 tempest-FlavorsAccessTestJSON-1498966653-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:01.852799 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5de7804c-390b-4c68-9a2a-71ef8f2507d3 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1467 microversion: 2.1 time: 0.213187 Oct 28 18:05:01.853384 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 279/536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:01 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1467 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:01.882242 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8cc77cc9-1234-46ae-9c3e-593b9db79cc2 tempest-FlavorsAccessTestJSON-1498966653 tempest-FlavorsAccessTestJSON-1498966653-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.204667 Oct 28 18:05:01.883280 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 258/537] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:01 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:01.896876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:01.898337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:01.905103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:01.905833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:01.905977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5299447e-ed30-4565-b3c6-ba9f178cc5ea tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2794367adc8e446a8f73c3b0fad9cc2b"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:01.906754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:01.908205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:01.908824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:01.910116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:01.982334 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5299447e-ed30-4565-b3c6-ba9f178cc5ea tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2024865381/action" status: 200 len: 21 microversion: 2.1 time: 0.080568 Oct 28 18:05:01.983183 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 259/538] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:01 2022] POST /compute/v2.1/flavors/2024865381/action => generated 21 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:05:01.993595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-258550e4-fa40-4252-ad21-7c055ca4c7fc tempest-FlavorsAccessTestJSON-1498966653 tempest-FlavorsAccessTestJSON-1498966653-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.019125 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-258550e4-fa40-4252-ad21-7c055ca4c7fc tempest-FlavorsAccessTestJSON-1498966653 tempest-FlavorsAccessTestJSON-1498966653-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.029056 Oct 28 18:05:02.019640 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 260/539] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:01 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:02.038759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.039728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:02.047044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:02.047843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:02.048529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:02.049538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:02.050403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:02.051042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:02.068685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:02.081569 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-147abcc9-f8ea-4e27-ab5e-d0eec6e38380 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.188909 Oct 28 18:05:02.088885 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 280/540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:01 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:02.100459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c361e49-b93e-4ab1-8209-be64def6d220 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.118976 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c361e49-b93e-4ab1-8209-be64def6d220 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2024865381" status: 202 len: 0 microversion: 2.1 time: 0.026728 Oct 28 18:05:02.120310 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 281/541] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:05:02 2022] DELETE /compute/v2.1/flavors/2024865381 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:02.129727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67244992-7340-45d1-881d-a9b913840849 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.156168 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67244992-7340-45d1-881d-a9b913840849 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.030974 Oct 28 18:05:02.157140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 282/542] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:02 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:02.178094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39454202-1d1c-4327-929e-b00d09d455d4 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1698209086", "id": 1168504896, "os-flavor-access:is_public": "False"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:02.209668 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39454202-1d1c-4327-929e-b00d09d455d4 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.035247 Oct 28 18:05:02.210839 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 283/543] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:02 2022] POST /compute/v2.1/flavors => generated 431 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:05:02.225935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f27f8e8-861d-4f99-a8d6-415a22170c71 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.244743 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f27f8e8-861d-4f99-a8d6-415a22170c71 tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1168504896/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.024221 Oct 28 18:05:02.245654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 284/544] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 18:05:02 2022] GET /compute/v2.1/flavors/1168504896/os-flavor-access => generated 21 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:05:02.256197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e4421c9-3b95-42e8-ae56-4a4fe9f73a7a tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.267581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:02.277455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79da82b2-d553-452f-9ea0-cd6bdc2d58ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1309 microversion: 2.1 time: 0.242520 Oct 28 18:05:02.278016 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e4421c9-3b95-42e8-ae56-4a4fe9f73a7a tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1168504896" status: 202 len: 0 microversion: 2.1 time: 0.025466 Oct 28 18:05:02.281544 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 285/545] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:05:02 2022] DELETE /compute/v2.1/flavors/1168504896 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:02.286741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a76d28e2-3320-4af3-86a8-102a9b54f88d tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.294412 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 261/546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:02 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:02.317343 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a76d28e2-3320-4af3-86a8-102a9b54f88d tempest-FlavorsAccessTestJSON-731044953 tempest-FlavorsAccessTestJSON-731044953-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.034038 Oct 28 18:05:02.323197 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 286/547] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:02 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:02.339016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.340031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:02.350328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:02.350913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:02.351418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:02.352418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:02.352683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:02.353217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:02.569391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-810491a5-54f8-4996-a52e-94b6f23b4ea9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de80aaf0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.659431 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-810491a5-54f8-4996-a52e-94b6f23b4ea9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.093925 Oct 28 18:05:02.660068 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 287/548] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:02 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:02.852195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:02.862223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:02.867516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:02.868768 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94ff67a6-f6f5-4cd1-ac78-97af1e575730 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.534049 Oct 28 18:05:02.874824 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 262/549] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:02 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:02.879195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:02.880145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:02.893623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:02.894434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:02.895959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:02.897250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:02.901147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:02.902577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:03.106769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:03.107390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:03.117430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:03.125439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:03.128298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:03.131494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:03.132987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:03.133131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:03.199665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:03.213244 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73fc037d-fca0-44b3-a490-cb5ab9ad7eb0 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1467 microversion: 2.1 time: 0.338148 Oct 28 18:05:03.233812 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 288/550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:02 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1467 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:03.302322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:03.303106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:03.312622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:03.313125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:03.314167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:03.315675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:03.316477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:03.317190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:03.433637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:03.444823 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e286e612-1d2f-47b2-a74c-11c6c708a6ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.343157 Oct 28 18:05:03.446905 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 263/551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:03 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:03.578508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d76c48ff-9369-484c-a0e9-52d0b36370ec req-b026665b-9291-47d4-a4e7-eaf70b97f2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f930e848-f660-4a13-a2a2-a979ccbcbe7e", "name": "network-vif-deleted", "tag": "a41d4e2d-0574-4bcc-b516-174268e798c2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:03.601793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d76c48ff-9369-484c-a0e9-52d0b36370ec req-b026665b-9291-47d4-a4e7-eaf70b97f2e1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:03.603446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d76c48ff-9369-484c-a0e9-52d0b36370ec req-b026665b-9291-47d4-a4e7-eaf70b97f2e1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:03.603972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d76c48ff-9369-484c-a0e9-52d0b36370ec req-b026665b-9291-47d4-a4e7-eaf70b97f2e1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:03.637019 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d76c48ff-9369-484c-a0e9-52d0b36370ec req-b026665b-9291-47d4-a4e7-eaf70b97f2e1 service nova] Creating event network-vif-deleted:a41d4e2d-0574-4bcc-b516-174268e798c2 for instance f930e848-f660-4a13-a2a2-a979ccbcbe7e on n-h2-862404-2 Oct 28 18:05:03.648615 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d76c48ff-9369-484c-a0e9-52d0b36370ec req-b026665b-9291-47d4-a4e7-eaf70b97f2e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074603 Oct 28 18:05:03.649257 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 264/552] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:05:03.676372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b6f77aac-e092-470d-9c72-da8322ebffa4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de7c41f0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:03.780498 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b6f77aac-e092-470d-9c72-da8322ebffa4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.108422 Oct 28 18:05:03.781462 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 265/553] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:03 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:03.831103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:03.846392 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af5877ac-6575-43ba-9641-aa4817a96574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1309 microversion: 2.1 time: 0.547500 Oct 28 18:05:03.848011 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 289/554] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:03 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1309 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:03.900406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:03.901106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:03.911554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:03.912412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:03.913203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:03.914124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:03.914808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:03.915671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:04.238321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:04.238983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:04.247043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:04.252608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:04.254609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:04.255651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:04.258090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:04.259900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:04.290237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:04.306291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:04.311375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:04.315481 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-55d400db-16f8-4b50-903e-3f2b05a2c126 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.418561 Oct 28 18:05:04.318294 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 266/555] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:03 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:04.338712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:04.339953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:04.340617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:04.341095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lazy-loading 'fault' on Instance uuid f930e848-f660-4a13-a2a2-a979ccbcbe7e {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:05:04.482104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:04.484513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:04.501056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:04.506069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:04.507482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:04.513471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:04.517851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:04.518756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:04.618212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:04.633402 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8a9c9c2-e83b-4293-bf1a-11de9fe92e48 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 200 len: 1311 microversion: 2.1 time: 0.397734 Oct 28 18:05:04.649164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 290/556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:04 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:04.665884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-88867f7e-b4c6-438a-9b6f-fabde476f991 req-ec1da418-f0f8-4471-b768-a6a8e01ab2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3ae6b5-7f14-4401-9680-ebcf1756a40c", "name": "network-vif-plugged", "status": "completed", "tag": "49b723c1-8f4b-436a-97df-a9b610186ba2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:04.721753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-88867f7e-b4c6-438a-9b6f-fabde476f991 req-ec1da418-f0f8-4471-b768-a6a8e01ab2fb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:04.728468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-88867f7e-b4c6-438a-9b6f-fabde476f991 req-ec1da418-f0f8-4471-b768-a6a8e01ab2fb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:04.728581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-88867f7e-b4c6-438a-9b6f-fabde476f991 req-ec1da418-f0f8-4471-b768-a6a8e01ab2fb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:04.742275 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-88867f7e-b4c6-438a-9b6f-fabde476f991 req-ec1da418-f0f8-4471-b768-a6a8e01ab2fb service nova] Creating event network-vif-plugged:49b723c1-8f4b-436a-97df-a9b610186ba2 for instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c on n-h2-862404-2 Oct 28 18:05:04.751771 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-88867f7e-b4c6-438a-9b6f-fabde476f991 req-ec1da418-f0f8-4471-b768-a6a8e01ab2fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101072 Oct 28 18:05:04.752594 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 291/557] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:04.799232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a6a8a42-ad1d-45c8-97cc-8f32ea2bde64 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de7af3a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:04.890019 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a6a8a42-ad1d-45c8-97cc-8f32ea2bde64 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.097141 Oct 28 18:05:04.891263 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 292/558] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:04 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:04.899115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:04.900146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:04.907936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:04.908339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:04.909474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:04.909684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:04.910136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:04.910637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:05.106978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:05.117692 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a905f44f-4cd7-494e-b99c-8591ec8ed017 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.644101 Oct 28 18:05:05.119045 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 267/559] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:04 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:05.166068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:05.177399 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ef2c2a2-3a1a-46c0-9693-d17ad60cf49b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1309 microversion: 2.1 time: 0.284787 Oct 28 18:05:05.178307 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 293/560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:04 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:05.359780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:05.361296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:05.384574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:05.384975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:05.388604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:05.391661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:05.392511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:05.393232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:05.663472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:05.665048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: f930e848-f660-4a13-a2a2-a979ccbcbe7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:05.675253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:05.676326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:05.679472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:05.680201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:05.681352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:05.683171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:05.684179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:05.685113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:05.716808 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] HTTP exception thrown: Instance f930e848-f660-4a13-a2a2-a979ccbcbe7e could not be found. Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Request method failure captured: Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e HTTP/1.1 Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmUYmS_3KETypz7DEOufW0D5tHD1c-_5F1Bj6DiDLgweSGgQJsk4I0652C6-EPy1emrfyIk1nVQQq7BVkQZxSgD90qluNGInXnzBZjjAMxfnHYb3qjehQ2tp4-Fd5wDNgbOgJPtgU6AtopCklOOR35Ez6bhKkQqocb2Z_1gOPq7MoU Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: da54e9373f4a4c2589e52ceb91b3ac65 Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1437817349 Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:05:05.725438 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da54e9373f4a4c2589e52ceb91b3ac65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da54e9373f4a4c2589e52ceb91b3ac65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da54e9373f4a4c2589e52ceb91b3ac65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da54e9373f4a4c2589e52ceb91b3ac65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1437817349 Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: da54e9373f4a4c2589e52ceb91b3ac65 Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1437817349 Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdminNegativeTestJSON-1437817349-project Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: fc9ca55f61c2469e85558049ef468a07 Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1437817349-project Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f930e848-f660-4a13-a2a2-a979ccbcbe7e could not be found. Oct 28 18:05:05.726758 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f930e848-f660-4a13-a2a2-a979ccbcbe7e'} Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f930e848-f660-4a13-a2a2-a979ccbcbe7e could not be found. Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:05.727538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f930e848-f660-4a13-a2a2-a979ccbcbe7e could not be found. Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f930e848-f660-4a13-a2a2-a979ccbcbe7e could not be found. Oct 28 18:05:05.728793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:05.734550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Returning 404 to user: Instance f930e848-f660-4a13-a2a2-a979ccbcbe7e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:05.739122 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dfe594cb-8794-4a1e-93c6-873ef041579f tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e" status: 404 len: 111 microversion: 2.1 time: 0.079724 Oct 28 18:05:05.742203 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 294/561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:05 2022] GET /compute/v2.1/servers/f930e848-f660-4a13-a2a2-a979ccbcbe7e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:05:05.761082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:05.766094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:05.791476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:05.793623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:05.796398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:05.798330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:05.798948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:05.801837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:05.852977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:05.870200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:05.871801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:05.873020 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3c1e90fb-d7f8-4c7e-9a6b-d4821f14c1ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.525224 Oct 28 18:05:05.889479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:05:05.889703 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 268/562] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:05 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:05.910962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8acffb17-fd3a-45aa-b3bd-23cda85274b7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de6fff70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:05.991559 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8acffb17-fd3a-45aa-b3bd-23cda85274b7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.087616 Oct 28 18:05:05.992737 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 269/563] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:05 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:06.085484 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d59b84dc-33a6-40ea-89a6-5480dd5e12a1 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 204 len: 0 microversion: 2.1 time: 0.329769 Oct 28 18:05:06.090025 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 295/564] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:05:05 2022] DELETE /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:05:06.093312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:06.100834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:06.101529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:06.116947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:06.117438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:06.117871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:06.118635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:06.119113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:06.119546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:06.149304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:06.150134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:06.158557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:06.159053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:06.159655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:06.160404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:06.160866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:06.161346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:06.332936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:06.341009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:06.345219 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-589d9d63-ed5d-484b-93fe-0324a591ca4d tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1477 microversion: 2.1 time: 0.253655 Oct 28 18:05:06.346376 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 270/565] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:06 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:06.365676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:06.367073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:06.367388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-998dc97d-caf4-4f73-8a18-6dcae1c7949c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.222702 Oct 28 18:05:06.370278 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 296/566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:06 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:06.377524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:06.378440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:06.379181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:06.381475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:06.382127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:06.382754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:06.613036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:06.622951 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f92ed5bc-0ce2-4db9-a021-ace2714b3172 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1309 microversion: 2.1 time: 0.275289 Oct 28 18:05:06.624217 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 271/567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:06 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1309 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:06.902205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:06.903271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:06.910069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:06.910542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:06.910983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:06.912216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:06.912908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:06.913903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:06.920397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:07.007999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c38457cb-b1ac-48b2-bc5a-f411e2041e2a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de772f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:07.086208 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c38457cb-b1ac-48b2-bc5a-f411e2041e2a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.082187 Oct 28 18:05:07.088104 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 272/568] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:07 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:07.114911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:07.128870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:07.130166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:07.131519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8399cd82-c112-4d0b-bd53-184005fd6a4e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.233349 Oct 28 18:05:07.148188 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 297/569] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:06 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:07.378000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:07.379055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:07.393417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:07.395315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:07.395593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:07.397085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:07.397330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:07.398025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:07.400180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:07.400721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:07.406327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:07.407423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:07.408078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:07.409550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:07.410924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:07.411565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:07.691769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:07.709700 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-19248b70-9f34-4983-a25b-9513387594f4 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1477 microversion: 2.1 time: 0.335725 Oct 28 18:05:07.710681 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 273/570] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:07 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:07.742390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:07.743701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:07.759275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:07.759782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:07.760368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:07.765379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:07.766191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:07.766897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:07.836781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:07.846902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2fcc3cb6-e123-4489-a0c7-4972b91f0b5a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.456596 Oct 28 18:05:07.847678 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 298/571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:07 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:07.875314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4f8bea29-1f7f-40ca-b31c-8eefef91a3ba req-92ca8e3f-9219-40a8-a0fb-dd47b9e99afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7e8cea-b2a4-437f-9036-98060f5e182c", "name": "network-vif-plugged", "status": "completed", "tag": "8592cf03-4542-4f98-93b2-7c1f1ab5bbeb"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:07.889382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f8bea29-1f7f-40ca-b31c-8eefef91a3ba req-92ca8e3f-9219-40a8-a0fb-dd47b9e99afe service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:07.891195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f8bea29-1f7f-40ca-b31c-8eefef91a3ba req-92ca8e3f-9219-40a8-a0fb-dd47b9e99afe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:07.897557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f8bea29-1f7f-40ca-b31c-8eefef91a3ba req-92ca8e3f-9219-40a8-a0fb-dd47b9e99afe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:07.921452 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4f8bea29-1f7f-40ca-b31c-8eefef91a3ba req-92ca8e3f-9219-40a8-a0fb-dd47b9e99afe service nova] Creating event network-vif-plugged:8592cf03-4542-4f98-93b2-7c1f1ab5bbeb for instance 0f7e8cea-b2a4-437f-9036-98060f5e182c on n-h1-862404-2 Oct 28 18:05:07.935869 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4f8bea29-1f7f-40ca-b31c-8eefef91a3ba req-92ca8e3f-9219-40a8-a0fb-dd47b9e99afe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073869 Oct 28 18:05:07.940833 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 299/572] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:08.176789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:08.195132 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5900e19-50bd-4623-9fc0-50ae8f1e10ff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1309 microversion: 2.1 time: 0.466567 Oct 28 18:05:08.225612 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 274/573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:07 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1309 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:08.231993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b46b218f-0dfc-4c5f-940c-3475702a3e82 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de73bf70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:08.240678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2b40fae-1839-4afd-8e57-34f0b0035ba7 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-770044663", "id": 2099074877, "os-flavor-access:is_public": "False"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:08.291688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2b40fae-1839-4afd-8e57-34f0b0035ba7 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.347960 Oct 28 18:05:08.293496 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 300/574] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:07 2022] POST /compute/v2.1/flavors => generated 438 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:08.304696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:08.305699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:08.314195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:08.314967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:08.315694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:08.316636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:08.317266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:08.317963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:08.333434 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b46b218f-0dfc-4c5f-940c-3475702a3e82 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.106222 Oct 28 18:05:08.334037 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 275/575] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:08 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:08.341233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c1c53808-fccc-43ed-8f0e-a4ebeeb86d92 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:08.501942 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c1c53808-fccc-43ed-8f0e-a4ebeeb86d92 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2099074877/action" status: 200 len: 97 microversion: 2.1 time: 0.166100 Oct 28 18:05:08.502558 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 276/576] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:08 2022] POST /compute/v2.1/flavors/2099074877/action => generated 97 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:05:08.520145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f4f18a6a-9041-44a5-ab94-b01a6ca7d81a tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:08.560564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:08.580445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:08.582961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:08.588101 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f9b5b92-7db4-47a1-9514-2e74e50d9cb7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1565 microversion: 2.25 time: 0.293172 Oct 28 18:05:08.588959 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 301/577] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:08 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1565 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:08.654619 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f4f18a6a-9041-44a5-ab94-b01a6ca7d81a tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project be5345be84b948da921892faf71ff7c1 combination. Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f4f18a6a-9041-44a5-ab94-b01a6ca7d81a tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Request method failure captured: Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/flavors/2099074877/action HTTP/1.1 Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 67 Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBnSWcr3peY3PlsEtPp5cshhgyXL71X7PhWHvUXUafUuVpmbEUv439-ofyI2V-omn-6NEl7DlmZeMxhiV9-s2sskIck5DVFQkNzhfnWt2VYENFLYSkjJGfyI1PIAwTO9CNySk8htb68r3p20qRZfw66dkVL4D_GHc4imYKnLPhkLWuE Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 51e51bab041f486eab56ee3f36364c95 Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:05:08.676602 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_51e51bab041f486eab56ee3f36364c95", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 51e51bab041f486eab56ee3f36364c95 Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 33d130c6fba748f3866131f433593a9b Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: {"addTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} Oct 28 18:05:08.677937 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: exception: Flavor access already exists for flavor 33 and project be5345be84b948da921892faf71ff7c1 combination. Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '2099074877', 'body': {'addTenantAccess': {'tenant': 'be5345be84b948da921892faf71ff7c1'}}} Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result.read() Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 18:05:08.678667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-be5345be84b948da921892faf71ff7c1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 18:05:08.679730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 18:05:08.681896 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 18:05:08.682930 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result.read() Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-be5345be84b948da921892faf71ff7c1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 18, 5, 8, 643317), 'updated_at': None, 'flavor_id': 33, 'project_id': 'be5345be84b948da921892faf71ff7c1'}] Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:08.686221 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project be5345be84b948da921892faf71ff7c1 combination. Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:08.694375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project be5345be84b948da921892faf71ff7c1 combination. Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:08.696134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:08.698084 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project be5345be84b948da921892faf71ff7c1 combination. Oct 28 18:05:08.698084 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:08.698084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f4f18a6a-9041-44a5-ab94-b01a6ca7d81a tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project be5345be84b948da921892faf71ff7c1 combination. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:08.698084 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f4f18a6a-9041-44a5-ab94-b01a6ca7d81a tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2099074877/action" status: 409 len: 152 microversion: 2.1 time: 0.179728 Oct 28 18:05:08.699575 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 277/578] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:08 2022] POST /compute/v2.1/flavors/2099074877/action => generated 152 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:05:08.701059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-09188f1d-2118-4a1d-8f2a-d46297c6ca25 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:08.742360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:08.743325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:08.753879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:08.757737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:08.758460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:08.760914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:08.762499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:08.764516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:08.842081 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-09188f1d-2118-4a1d-8f2a-d46297c6ca25 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2099074877/action" status: 200 len: 21 microversion: 2.1 time: 0.145784 Oct 28 18:05:08.844959 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 302/579] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:08 2022] POST /compute/v2.1/flavors/2099074877/action => generated 21 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:05:08.853156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a9ec757b-8536-4902-aff3-261840c39bb9 req-2392b6f6-aaa5-4862-b98c-bc80e7b00c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79903379-95d0-4ccc-80bc-92db11a67d3c", "name": "network-vif-deleted", "tag": "4f75b54a-cca9-4e37-896d-e273eed3b2c4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:08.870150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a9ec757b-8536-4902-aff3-261840c39bb9 req-2392b6f6-aaa5-4862-b98c-bc80e7b00c9f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:08.876586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a9ec757b-8536-4902-aff3-261840c39bb9 req-2392b6f6-aaa5-4862-b98c-bc80e7b00c9f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:08.882982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a9ec757b-8536-4902-aff3-261840c39bb9 req-2392b6f6-aaa5-4862-b98c-bc80e7b00c9f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:08.909380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a9ec757b-8536-4902-aff3-261840c39bb9 req-2392b6f6-aaa5-4862-b98c-bc80e7b00c9f service nova] Creating event network-vif-deleted:4f75b54a-cca9-4e37-896d-e273eed3b2c4 for instance 79903379-95d0-4ccc-80bc-92db11a67d3c on n-h1-862404-2 Oct 28 18:05:08.918833 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a9ec757b-8536-4902-aff3-261840c39bb9 req-2392b6f6-aaa5-4862-b98c-bc80e7b00c9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072592 Oct 28 18:05:08.923586 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 303/580] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:08.937219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c318c6b1-db01-4430-ae39-286a0fc97b8a tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:08.983700 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c318c6b1-db01-4430-ae39-286a0fc97b8a tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2099074877" status: 202 len: 0 microversion: 2.1 time: 0.058330 Oct 28 18:05:08.985141 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 304/581] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:05:08 2022] DELETE /compute/v2.1/flavors/2099074877 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:08.991362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:08.992464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:09.000438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:09.001683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:09.002544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:09.003473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:09.004117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:09.004753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:09.202595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:09.215167 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d2461ef-8f8e-4fce-a916-a2ec4f718384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.227862 Oct 28 18:05:09.215860 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 305/582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:08 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:09.221164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c11880f8-d08d-4615-9619-733a9b46600f tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.235604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9ca55f61c2469e85558049ef468a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da54e9373f4a4c2589e52ceb91b3ac65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:09.254190 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c11880f8-d08d-4615-9619-733a9b46600f tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.035706 Oct 28 18:05:09.256741 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 306/583] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:09 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:09.258363 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2d086a0-6ca4-428d-90f1-7176596250c5 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 200 len: 1435 microversion: 2.1 time: 0.521194 Oct 28 18:05:09.271842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.271842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:09.272834 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 278/584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:08 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 1435 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:09.278637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:09.278997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:09.279542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:09.280404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:09.280966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:09.281714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:09.288333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7f3ca32-d668-4431-8424-57ed0e2ca3fb tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-719821551", "id": 1848337454, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:09.326355 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f7f3ca32-d668-4431-8424-57ed0e2ca3fb tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.045697 Oct 28 18:05:09.327594 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 279/585] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:09 2022] POST /compute/v2.1/flavors => generated 437 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:09.341408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e05a1dfa-f815-49ee-a7e9-e91c724c8706 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.349387 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-e05a1dfa-f815-49ee-a7e9-e91c724c8706 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e05a1dfa-f815-49ee-a7e9-e91c724c8706 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Request method failure captured: Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/flavors/1848337454/os-flavor-access HTTP/1.1 Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBnSWcr3peY3PlsEtPp5cshhgyXL71X7PhWHvUXUafUuVpmbEUv439-ofyI2V-omn-6NEl7DlmZeMxhiV9-s2sskIck5DVFQkNzhfnWt2VYENFLYSkjJGfyI1PIAwTO9CNySk8htb68r3p20qRZfw66dkVL4D_GHc4imYKnLPhkLWuE Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 51e51bab041f486eab56ee3f36364c95 Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:05:09.351854 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_51e51bab041f486eab56ee3f36364c95", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 51e51bab041f486eab56ee3f36364c95 Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 33d130c6fba748f3866131f433593a9b Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: exception: Access list not available for public flavors. Oct 28 18:05:09.353171 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'flavor_id': '1848337454'} Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 28 18:05:09.353869 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:09.357487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e05a1dfa-f815-49ee-a7e9-e91c724c8706 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:09.358559 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e05a1dfa-f815-49ee-a7e9-e91c724c8706 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1848337454/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.022877 Oct 28 18:05:09.360943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 280/586] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 18:05:09 2022] GET /compute/v2.1/flavors/1848337454/os-flavor-access => generated 91 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:05:09.366304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6aaeca2c-9493-4a12-a701-8f6b9c2577f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de4ebd30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.422847 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6aaeca2c-9493-4a12-a701-8f6b9c2577f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.060261 Oct 28 18:05:09.424531 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 281/587] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:09 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:09.436958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0641c56-ac6a-4543-bb6d-ac885bb3acd6 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.463489 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e0641c56-ac6a-4543-bb6d-ac885bb3acd6 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1848337454" status: 202 len: 0 microversion: 2.1 time: 0.037658 Oct 28 18:05:09.465633 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 282/588] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:05:09 2022] DELETE /compute/v2.1/flavors/1848337454 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:09.484829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ab6569e-577c-482f-b830-8a895ca2b131 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.508439 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ab6569e-577c-482f-b830-8a895ca2b131 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.038709 Oct 28 18:05:09.509303 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 283/589] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:09 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:09.530133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f46e6208-f5ae-482b-8aae-76f6a5075663 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1429803983", "id": 1419578452, "os-flavor-access:is_public": "False"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:09.540351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:09.556636 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07a1c955-3c26-42f9-b1b8-8ef3c4410e48 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1309 microversion: 2.1 time: 0.298562 Oct 28 18:05:09.557207 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 307/590] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:09 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:09.561783 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f46e6208-f5ae-482b-8aae-76f6a5075663 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.035500 Oct 28 18:05:09.563761 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 284/591] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:09 2022] POST /compute/v2.1/flavors => generated 439 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:09.617591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.619095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:09.638737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:09.639610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:09.640361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:09.641322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:09.641994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:09.642649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:09.838886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce370c01-bdd7-4d9e-bb57-f2882540560a tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:09.843394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce370c01-bdd7-4d9e-bb57-f2882540560a tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '872eae1a599a46cab3aaffe7d867b4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5345be84b948da921892faf71ff7c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce370c01-bdd7-4d9e-bb57-f2882540560a tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] Request method failure captured: Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/flavors/1419578452/action HTTP/1.1 Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 67 Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBnSQzus6fvt01DLGuTh7O-9abTqw8mj7usEi63pK1Y2Ky1MzgpNQMYERX67ltMPlZWeu_GKcts6OUuF4jArFsgHnMlWn05LyB9p43YDYVUxdHIDL2BsbBTuBDzJSyvru1u3ICvyb-09NrZZOxDig66M-WwAP5w969Pp3wQhyaIbeeM Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: be5345be84b948da921892faf71ff7c1 Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-237944206 Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:05:09.847387 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be5345be84b948da921892faf71ff7c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be5345be84b948da921892faf71ff7c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be5345be84b948da921892faf71ff7c1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be5345be84b948da921892faf71ff7c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-237944206 Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: be5345be84b948da921892faf71ff7c1 Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-237944206 Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsAccessNegativeTestJSON-237944206-project Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 872eae1a599a46cab3aaffe7d867b4be Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-237944206-project Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: {"addTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} Oct 28 18:05:09.848705 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '1419578452', 'body': {'addTenantAccess': {'tenant': 'be5345be84b948da921892faf71ff7c1'}}} Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:05:09.849413 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 18:05:09.850495 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:09.855222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce370c01-bdd7-4d9e-bb57-f2882540560a tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:09.864484 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce370c01-bdd7-4d9e-bb57-f2882540560a tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] 10.222.0.16 "POST /compute/v2.1/flavors/1419578452/action" status: 403 len: 130 microversion: 2.1 time: 0.292485 Oct 28 18:05:09.865371 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 308/592] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:09 2022] POST /compute/v2.1/flavors/1419578452/action => generated 130 bytes in 294 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:09.874980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1c7601d7-5c05-4814-b724-f10bc3459ac5 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.893153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:DELETE=10,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:09.931560 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1c7601d7-5c05-4814-b724-f10bc3459ac5 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1419578452" status: 202 len: 0 microversion: 2.1 time: 0.061568 Oct 28 18:05:09.932793 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 309/593] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:05:09 2022] DELETE /compute/v2.1/flavors/1419578452 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:05:09.941314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e17b8fd7-5c29-406d-a192-5451369163f2 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:09.961013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:09.972311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:09.974198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:09.975618 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-898cfecb-e4a8-4f6d-b2c1-10b142e83d95 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1540 microversion: 2.25 time: 0.363298 Oct 28 18:05:09.976692 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 285/594] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:09 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1540 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:09.991921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e17b8fd7-5c29-406d-a192-5451369163f2 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.054431 Oct 28 18:05:09.993195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 310/595] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:09 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:10.018919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7935c20d-053d-4837-9e34-81e0b868e2db tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '.version_select at 0x7f78de4eb820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:10.024507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7935c20d-053d-4837-9e34-81e0b868e2db tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.027859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7935c20d-053d-4837-9e34-81e0b868e2db tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.028483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c2b079d-d8b3-4584-8b1b-3cee412abcdd tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1262104239", "id": 1011516849, "os-flavor-access:is_public": "False"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:10.028768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7935c20d-053d-4837-9e34-81e0b868e2db tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.047545 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7935c20d-053d-4837-9e34-81e0b868e2db tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.038244 Oct 28 18:05:10.049642 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 286/596] 10.222.0.16 () {60 vars in 1184 bytes} [Fri Oct 28 18:05:10 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:10.054953 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c2b079d-d8b3-4584-8b1b-3cee412abcdd tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.036949 Oct 28 18:05:10.055803 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 311/597] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:10 2022] POST /compute/v2.1/flavors => generated 439 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:10.078412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc8f9c4e-043e-4744-936d-338cfda9310e tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:10.081804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:10.087669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:10.107491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.111924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.128602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.129968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.131920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.132873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.260062 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc8f9c4e-043e-4744-936d-338cfda9310e tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1011516849/action" status: 200 len: 97 microversion: 2.1 time: 0.190473 Oct 28 18:05:10.260608 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 312/598] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:10 2022] POST /compute/v2.1/flavors/1011516849/action => generated 97 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:05:10.269815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:10.270437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:10.287796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.287796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.288640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.289455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.289650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.290346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.372883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid 9053ad37-860b-4069-80b5-9657ddb3e53d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:05:10.393794 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ab0aa5f-fcc1-4d34-bea9-0fbcf86efa97 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 2031 microversion: 2.25 time: 0.326215 Oct 28 18:05:10.395025 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 287/599] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:10 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 2031 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:10.400268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8437691-3230-4b3d-8b0f-90ee991ba531 tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:10.404411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d8437691-3230-4b3d-8b0f-90ee991ba531 tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '872eae1a599a46cab3aaffe7d867b4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5345be84b948da921892faf71ff7c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8437691-3230-4b3d-8b0f-90ee991ba531 tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] Request method failure captured: Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/flavors/1011516849/action HTTP/1.1 Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 70 Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBnSQzus6fvt01DLGuTh7O-9abTqw8mj7usEi63pK1Y2Ky1MzgpNQMYERX67ltMPlZWeu_GKcts6OUuF4jArFsgHnMlWn05LyB9p43YDYVUxdHIDL2BsbBTuBDzJSyvru1u3ICvyb-09NrZZOxDig66M-WwAP5w969Pp3wQhyaIbeeM Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: be5345be84b948da921892faf71ff7c1 Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-237944206 Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:05:10.406062 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be5345be84b948da921892faf71ff7c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be5345be84b948da921892faf71ff7c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be5345be84b948da921892faf71ff7c1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be5345be84b948da921892faf71ff7c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-237944206 Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: be5345be84b948da921892faf71ff7c1 Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-237944206 Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FlavorsAccessNegativeTestJSON-237944206-project Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 872eae1a599a46cab3aaffe7d867b4be Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-237944206-project Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: {"removeTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} Oct 28 18:05:10.407584 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1011516849', 'body': {'removeTenantAccess': {'tenant': 'be5345be84b948da921892faf71ff7c1'}}} Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can( Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:05:10.408492 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 18:05:10.409791 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:10.412468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8437691-3230-4b3d-8b0f-90ee991ba531 tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:10.413539 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8437691-3230-4b3d-8b0f-90ee991ba531 tempest-FlavorsAccessNegativeTestJSON-237944206 tempest-FlavorsAccessNegativeTestJSON-237944206-project] 10.222.0.16 "POST /compute/v2.1/flavors/1011516849/action" status: 403 len: 133 microversion: 2.1 time: 0.017421 Oct 28 18:05:10.414602 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 288/600] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:10 2022] POST /compute/v2.1/flavors/1011516849/action => generated 133 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:10.420048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:10.422032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] [instance: 79903379-95d0-4ccc-80bc-92db11a67d3c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:10.437507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.438369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.439053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.444415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.445772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.446715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.462731 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] HTTP exception thrown: Instance 79903379-95d0-4ccc-80bc-92db11a67d3c could not be found. Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Request method failure captured: Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c HTTP/1.1 Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmUYmS_3KETypz7DEOufW0D5tHD1c-_5F1Bj6DiDLgweSGgQJsk4I0652C6-EPy1emrfyIk1nVQQq7BVkQZxSgD90qluNGInXnzBZjjAMxfnHYb3qjehQ2tp4-Fd5wDNgbOgJPtgU6AtopCklOOR35Ez6bhKkQqocb2Z_1gOPq7MoU Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: da54e9373f4a4c2589e52ceb91b3ac65 Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1437817349 Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:05:10.464635 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da54e9373f4a4c2589e52ceb91b3ac65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da54e9373f4a4c2589e52ceb91b3ac65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da54e9373f4a4c2589e52ceb91b3ac65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da54e9373f4a4c2589e52ceb91b3ac65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1437817349 Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: da54e9373f4a4c2589e52ceb91b3ac65 Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1437817349 Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersAdminNegativeTestJSON-1437817349-project Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: fc9ca55f61c2469e85558049ef468a07 Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1437817349-project Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 79903379-95d0-4ccc-80bc-92db11a67d3c could not be found. Oct 28 18:05:10.465987 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '79903379-95d0-4ccc-80bc-92db11a67d3c'} Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79903379-95d0-4ccc-80bc-92db11a67d3c could not be found. Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:10.466703 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79903379-95d0-4ccc-80bc-92db11a67d3c could not be found. Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79903379-95d0-4ccc-80bc-92db11a67d3c could not be found. Oct 28 18:05:10.468917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:05:10.471247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] Returning 404 to user: Instance 79903379-95d0-4ccc-80bc-92db11a67d3c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:10.471247 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-67c61209-914a-4ecf-81d8-ec8e369aaf78 tempest-ServersAdminNegativeTestJSON-1437817349 tempest-ServersAdminNegativeTestJSON-1437817349-project] 10.222.0.16 "GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c" status: 404 len: 111 microversion: 2.1 time: 0.050366 Oct 28 18:05:10.471247 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 289/601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:10 2022] GET /compute/v2.1/servers/79903379-95d0-4ccc-80bc-92db11a67d3c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:10.473304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c9b3fa8-809f-4012-a858-10b391751c25 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "be5345be84b948da921892faf71ff7c1"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:10.477723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:10.493607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61c5cd42-c315-40c0-886c-34247b2c94dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.228651 Oct 28 18:05:10.494525 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 313/602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:10 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:10.510442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-befe4bd8-9b10-4a61-82da-399a995d0b34 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Action: 'create', calling method: .version_select at 0x7f78de798c10>, body: {"keypair": {"name": "tempest-keypair-235563863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8yqVNTtAyQx1y/q+v9TJTvm16ZfX8HVPkCIGM6Z8EwsG31ihy/jYASqEmV8H10U4LLL+b+baTK7HGylgH6bTHxn6mNgE99RDpGyMXPLP+nAmXRNHsPS7F9MsAS69P11A=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:10.548467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-befe4bd8-9b10-4a61-82da-399a995d0b34 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for project 452c29fdc8114bb985893db1a9d29426. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:10.555095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-befe4bd8-9b10-4a61-82da-399a995d0b34 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for user 584b38d4097042999ad262ea77966602 and project 452c29fdc8114bb985893db1a9d29426. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:10.611118 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-befe4bd8-9b10-4a61-82da-399a995d0b34 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.113567 Oct 28 18:05:10.612965 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 314/603] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:05:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 18:05:10.625832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3743c19-69d7-4c8a-b4e7-cf0eb334f430 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de706d30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:10.636779 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c9b3fa8-809f-4012-a858-10b391751c25 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1011516849/action" status: 200 len: 21 microversion: 2.1 time: 0.168580 Oct 28 18:05:10.637382 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 290/604] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 18:05:10 2022] POST /compute/v2.1/flavors/1011516849/action => generated 21 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:05:10.652522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:10.657092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:10.674235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.675206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.677201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.679942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:10.681375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:10.682305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:10.715232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:10.717336 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3743c19-69d7-4c8a-b4e7-cf0eb334f430 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.098676 Oct 28 18:05:10.718520 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 315/605] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:10 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:10.734705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-21f84112-9fbe-45d0-875a-c1448f22e4c6 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:10.791420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-21f84112-9fbe-45d0-875a-c1448f22e4c6 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1011516849" status: 202 len: 0 microversion: 2.1 time: 0.071350 Oct 28 18:05:10.798823 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 316/606] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:05:10 2022] DELETE /compute/v2.1/flavors/1011516849 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:10.823448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4bddc74c-54b1-4f1c-93d2-79cf05712022 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:10.867064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4bddc74c-54b1-4f1c-93d2-79cf05712022 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.065823 Oct 28 18:05:10.880213 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 317/607] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:10 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:10.893837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad2d990f-8ade-4c2f-9b83-9e104cae5698 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1512059414", "id": 129983472, "os-flavor-access:is_public": "False"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:10.913449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:10.924537 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-85c50d32-320a-492b-aa08-9a58cc63f84a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1492 microversion: 2.1 time: 0.281563 Oct 28 18:05:10.925405 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 291/608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:10 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1492 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:10.945221 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad2d990f-8ade-4c2f-9b83-9e104cae5698 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.058540 Oct 28 18:05:10.948469 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 318/609] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:10 2022] POST /compute/v2.1/flavors => generated 436 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:05:10.969179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c414a935-77c9-462e-88a6-e9a919f7f085 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "43be729141b94811b29527b099828903"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:11.394745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:11.395871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:11.408824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:11.411049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:11.413658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:11.415169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:11.418508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:11.420403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:11.467372 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c414a935-77c9-462e-88a6-e9a919f7f085 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] HTTP exception thrown: Flavor access not found for 37 / 43be729141b94811b29527b099828903 combination. Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c414a935-77c9-462e-88a6-e9a919f7f085 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Request method failure captured: Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/flavors/129983472/action HTTP/1.1 Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 70 Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBnSWcr3peY3PlsEtPp5cshhgyXL71X7PhWHvUXUafUuVpmbEUv439-ofyI2V-omn-6NEl7DlmZeMxhiV9-s2sskIck5DVFQkNzhfnWt2VYENFLYSkjJGfyI1PIAwTO9CNySk8htb68r3p20qRZfw66dkVL4D_GHc4imYKnLPhkLWuE Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 51e51bab041f486eab56ee3f36364c95 Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:05:11.471378 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_51e51bab041f486eab56ee3f36364c95", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/51e51bab041f486eab56ee3f36364c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 51e51bab041f486eab56ee3f36364c95 Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-16624923 Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 33d130c6fba748f3866131f433593a9b Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: {"removeTenantAccess": {"tenant": "43be729141b94811b29527b099828903"}} Oct 28 18:05:11.472702 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: exception: Flavor access not found for 37 / 43be729141b94811b29527b099828903 combination. Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '129983472', 'body': {'removeTenantAccess': {'tenant': '43be729141b94811b29527b099828903'}}} Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 28 18:05:11.473414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / 43be729141b94811b29527b099828903 combination. Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / 43be729141b94811b29527b099828903 combination. Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:11.474452 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:11.475584 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:11.475584 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:11.475584 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:11.475584 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:11.475584 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / 43be729141b94811b29527b099828903 combination. Oct 28 18:05:11.475584 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:11.475584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c414a935-77c9-462e-88a6-e9a919f7f085 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Returning 404 to user: Flavor access not found for 37 / 43be729141b94811b29527b099828903 combination. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:11.475584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c414a935-77c9-462e-88a6-e9a919f7f085 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/129983472/action" status: 404 len: 124 microversion: 2.1 time: 0.515497 Oct 28 18:05:11.481284 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 319/610] 10.222.0.16 () {60 vars in 1197 bytes} [Fri Oct 28 18:05:10 2022] POST /compute/v2.1/flavors/129983472/action => generated 124 bytes in 526 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:11.490377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fea89ad9-2529-41b7-b3bb-234e05412538 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:11.541474 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fea89ad9-2529-41b7-b3bb-234e05412538 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/129983472" status: 202 len: 0 microversion: 2.1 time: 0.058936 Oct 28 18:05:11.543525 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 320/611] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:05:11 2022] DELETE /compute/v2.1/flavors/129983472 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:11.549360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:11.550901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:11.563586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:11.564612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:11.565635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:11.566690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:11.567437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:11.568150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:11.684174 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b8f5f6e7-b6c8-4e8f-b0ad-be23a2e2ff56 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1643 microversion: 2.1 time: 0.735312 Oct 28 18:05:11.688997 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 292/612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:10 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1643 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:11.705707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c30e4512-1476-43e7-b7e4-6d23eb399010 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:11.744365 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c30e4512-1476-43e7-b7e4-6d23eb399010 tempest-FlavorsAccessNegativeTestJSON-16624923 tempest-FlavorsAccessNegativeTestJSON-16624923-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.053828 Oct 28 18:05:11.748672 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 293/613] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:11 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:11.786033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:11.787063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:11.798132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:11.799326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:11.801847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:11.803132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:11.806602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:11.808611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:11.811344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:11.822301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-10041e86-f43f-4610-ad7f-864b5395cf9d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.277170 Oct 28 18:05:11.823799 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 321/614] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:11 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:11.832785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5e92db0-2120-4b22-86cf-daaf13759ff3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de7af0d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:11.915033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5e92db0-2120-4b22-86cf-daaf13759ff3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.086048 Oct 28 18:05:11.915607 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 322/615] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:11 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:12.064536 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4326005-93c0-47a6-990a-fe662fe79fcd tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1643 microversion: 2.1 time: 0.291741 Oct 28 18:05:12.068231 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 294/616] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:11 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1643 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:12.098107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a376bcbf-c45f-4235-9144-0809c22642a7 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:12.120374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a376bcbf-c45f-4235-9144-0809c22642a7 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:12.121716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a376bcbf-c45f-4235-9144-0809c22642a7 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:12.122291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a376bcbf-c45f-4235-9144-0809c22642a7 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:12.123930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a376bcbf-c45f-4235-9144-0809c22642a7 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:12.124404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a376bcbf-c45f-4235-9144-0809c22642a7 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:12.125220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a376bcbf-c45f-4235-9144-0809c22642a7 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:12.158373 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a376bcbf-c45f-4235-9144-0809c22642a7 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.069473 Oct 28 18:05:12.159654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 323/617] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:05:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:12.175750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862404-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:12.180400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:12.191338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:12.191850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:12.197073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:12.197828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:12.198296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:12.198772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:12.258449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lazy-loading 'flavor' on Instance uuid 0f7e8cea-b2a4-437f-9036-98060f5e182c {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:05:12.291463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Going to try to live migrate instance to n-h2-862404-2 {{(pid=120679) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:05:12.851063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:12.851964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:12.863452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:12.864360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:12.865656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:12.867575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:12.869025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:12.870109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:13.450880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:13.471527 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a13d883a-9235-4d83-8d61-58de89d87ec4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1475 microversion: 2.1 time: 0.624256 Oct 28 18:05:13.477472 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 324/618] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:12 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:13.499614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d492ab7e-3515-49fc-9598-508bdb63f50e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de6f6430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:13.616219 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d492ab7e-3515-49fc-9598-508bdb63f50e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.132262 Oct 28 18:05:13.626938 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 325/619] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:13 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:14.239535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1307719336", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "b6597dab-3369-40d8-b5f8-eb1a8f5f7d67"}], "security_groups": [{"name": "tempest-securitygroup--36426719"}], "key_name": "tempest-keypair-235563863", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:14.576926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] validate_networks() for [('b6597dab-3369-40d8-b5f8-eb1a8f5f7d67', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:05:14.925387 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-35e189e5-42e0-4729-88a7-9bc51575876c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c/action" status: 202 len: 0 microversion: 2.1 time: 2.754519 Oct 28 18:05:14.926874 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 295/620] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:12 2022] POST /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c/action => generated 0 bytes in 2757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:14.934076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:14.935973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:14.958332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:14.965034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:14.965804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:14.968081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:14.970828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:14.973577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:14.975744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:15.476988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:15.478574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:15.480625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:15.481322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:15.482107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:15.518135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:15.521055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:15.521679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:15.524286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:15.525257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:15.527316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:15.580113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:15.591183 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f41c372-9611-43fd-bc1c-65837c232e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1474 microversion: 2.1 time: 0.660621 Oct 28 18:05:15.592454 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 296/621] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:14 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1474 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:15.601003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a9c7d86d-0c2f-4514-96b7-415bbb245479 req-4bd51324-e4fa-4fcf-9b1d-076ee9fcb89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b3563e-22f8-45f6-88b2-49ead221357d", "name": "network-vif-unplugged", "status": "completed", "tag": "c10ccf0a-9c11-409f-9e38-de38e13aa335"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:15.605617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for project 452c29fdc8114bb985893db1a9d29426. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:15.617995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for user 584b38d4097042999ad262ea77966602 and project 452c29fdc8114bb985893db1a9d29426. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:15.619795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a9c7d86d-0c2f-4514-96b7-415bbb245479 req-4bd51324-e4fa-4fcf-9b1d-076ee9fcb89d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:15.621092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a9c7d86d-0c2f-4514-96b7-415bbb245479 req-4bd51324-e4fa-4fcf-9b1d-076ee9fcb89d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:15.621808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a9c7d86d-0c2f-4514-96b7-415bbb245479 req-4bd51324-e4fa-4fcf-9b1d-076ee9fcb89d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:15.642808 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a9c7d86d-0c2f-4514-96b7-415bbb245479 req-4bd51324-e4fa-4fcf-9b1d-076ee9fcb89d service nova] Creating event network-vif-unplugged:c10ccf0a-9c11-409f-9e38-de38e13aa335 for instance 59b3563e-22f8-45f6-88b2-49ead221357d on n-h2-862404-2 Oct 28 18:05:15.653619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:05:15.658542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:05:15.676895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-a9c7d86d-0c2f-4514-96b7-415bbb245479 req-4bd51324-e4fa-4fcf-9b1d-076ee9fcb89d service nova] Instance 59b3563e-22f8-45f6-88b2-49ead221357d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:05:15.705106 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a9c7d86d-0c2f-4514-96b7-415bbb245479 req-4bd51324-e4fa-4fcf-9b1d-076ee9fcb89d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109921 Oct 28 18:05:15.705730 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 297/622] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:15.714887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfb06a25-14fd-4323-a1d5-ecc15efff29e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de6f1670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:15.769803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7663073f-1b39-42ac-a53f-8d1fdbea372d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 1.537366 Oct 28 18:05:15.780776 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 326/623] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:05:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:05:15.790472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:15.791590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:15.803650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:15.804954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:15.805639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:15.806607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:15.807376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:15.809500 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfb06a25-14fd-4323-a1d5-ecc15efff29e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.102105 Oct 28 18:05:15.812326 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 298/624] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:15 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:15.822996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:15.825213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f9a27b7-1ea9-438c-b14e-96be4c2661be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:15.826200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5f9a27b7-1ea9-438c-b14e-96be4c2661be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:15.937904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f9a27b7-1ea9-438c-b14e-96be4c2661be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:15.951318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f9a27b7-1ea9-438c-b14e-96be4c2661be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:15.956575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f9a27b7-1ea9-438c-b14e-96be4c2661be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:15.957913 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f9a27b7-1ea9-438c-b14e-96be4c2661be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1285 microversion: 2.25 time: 0.142019 Oct 28 18:05:15.962404 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 299/625] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:15 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:16.117102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:16.126311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0c341ad-3796-4224-be89-9035e9ea4de5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.344195 Oct 28 18:05:16.127479 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 327/626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:15 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:16.621378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:16.623457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:16.640620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:16.643601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:16.644395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:16.645354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:16.646168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:16.648933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.038667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-728611258", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": "none"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:17.093280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.104532 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8707728d-2179-4fde-b77c-54a7a0d91cde tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1474 microversion: 2.1 time: 0.490520 Oct 28 18:05:17.113042 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 300/627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:16 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1474 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:17.125097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-535139b2-5ef1-477a-b16c-a381464603a4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de5619d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:17.160262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:17.160998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:17.163167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:17.166685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:17.167391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:17.190488 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-535139b2-5ef1-477a-b16c-a381464603a4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.074723 Oct 28 18:05:17.191756 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 301/628] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:17 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:17.198160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:17.199920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:17.203493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.204218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.207865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.208415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.209373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.209509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.210133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.212062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.213031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.213557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.214158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.216702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.261756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Getting quotas for project 1264633c8b8f469da0808fbfd7d6cf7c. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:17.273332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Getting quotas for user bb412f61570e4a1e8c10480ed9cbaadd and project 1264633c8b8f469da0808fbfd7d6cf7c. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:17.312282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:05:17.315060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:05:17.359419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.374711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.377604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.379126 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-10651850-1480-4a55-a8d2-9d293caf644f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1337 microversion: 2.25 time: 0.185630 Oct 28 18:05:17.397130 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 302/629] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:17 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1337 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:17.402554 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31deef8f-b9ca-456c-9989-8c72b457cbf7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.598592 Oct 28 18:05:17.407781 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 328/630] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 18:05:17.410848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:17.411789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:17.420743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c46cd702-ae22-4a0e-b0fd-c9ab597f5680 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:17.421584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c46cd702-ae22-4a0e-b0fd-c9ab597f5680 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:17.425335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.428310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=80,nova_api:INSERT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:17.431965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.432694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.434472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.435109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.436146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.513612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c46cd702-ae22-4a0e-b0fd-c9ab597f5680 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.523614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c46cd702-ae22-4a0e-b0fd-c9ab597f5680 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.525512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c46cd702-ae22-4a0e-b0fd-c9ab597f5680 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.534307 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c46cd702-ae22-4a0e-b0fd-c9ab597f5680 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1452 microversion: 2.91 time: 0.119310 Oct 28 18:05:17.543896 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 329/631] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:17 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:05:17.762142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-07ade99a-33ca-443d-9397-4e64aad15ff1 req-504e37cf-5d4d-4ce9-9fb9-be95f5071b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59b3563e-22f8-45f6-88b2-49ead221357d", "tag": "c10ccf0a-9c11-409f-9e38-de38e13aa335"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:17.796755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-07ade99a-33ca-443d-9397-4e64aad15ff1 req-504e37cf-5d4d-4ce9-9fb9-be95f5071b04 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.799381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-07ade99a-33ca-443d-9397-4e64aad15ff1 req-504e37cf-5d4d-4ce9-9fb9-be95f5071b04 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.800768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-07ade99a-33ca-443d-9397-4e64aad15ff1 req-504e37cf-5d4d-4ce9-9fb9-be95f5071b04 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.833929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.842963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-07ade99a-33ca-443d-9397-4e64aad15ff1 req-504e37cf-5d4d-4ce9-9fb9-be95f5071b04 service nova] Creating event network-changed:c10ccf0a-9c11-409f-9e38-de38e13aa335 for instance 59b3563e-22f8-45f6-88b2-49ead221357d on n-h2-862404-2 Oct 28 18:05:17.847352 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a7348f19-0cbf-48cc-be28-dc904f4bb35e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.447603 Oct 28 18:05:17.849224 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 303/632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:17 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:17.903858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-07ade99a-33ca-443d-9397-4e64aad15ff1 req-504e37cf-5d4d-4ce9-9fb9-be95f5071b04 service nova] Instance 59b3563e-22f8-45f6-88b2-49ead221357d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:05:17.931322 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-07ade99a-33ca-443d-9397-4e64aad15ff1 req-504e37cf-5d4d-4ce9-9fb9-be95f5071b04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173979 Oct 28 18:05:17.938736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 330/633] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:05:18.132334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:18.133089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:18.157143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.158377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.159519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.161250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.161719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.162148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.218236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0cd91f4-29e0-411d-893b-8367a5997a62 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de71aee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:18.319388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0cd91f4-29e0-411d-893b-8367a5997a62 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.114354 Oct 28 18:05:18.321241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 331/634] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:18 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:18.419763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:18.421552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:18.441273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.442264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.443180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.444467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.445257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.445983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.548034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:18.562000 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5570b7ba-f8e7-422d-8d46-03c28d65caf1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1472 microversion: 2.1 time: 0.432948 Oct 28 18:05:18.563103 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 304/635] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:18 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:18.570290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:18.571199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:18.595944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.596556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.597076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.597878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.598300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:18.602524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.603046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.609510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:18.614694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:18.615856 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6b133ba-cf3d-42f3-94da-508e95393572 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1355 microversion: 2.25 time: 0.210604 Oct 28 18:05:18.627422 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 332/636] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:18 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1355 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:18.840339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:18.867652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:18.872871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:18.873690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:18.876017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:18.883449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.884429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.887525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.888486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.891443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.894400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.897705 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-31de07c7-abd8-4cd1-a426-2327caeaad06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1456 microversion: 2.91 time: 0.331725 Oct 28 18:05:18.899552 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 305/637] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:18 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1456 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:19.237721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:19.248959 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-963b05a2-b56a-4531-8ac1-22830237ea66 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.379017 Oct 28 18:05:19.250108 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 333/638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:18 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:19.337068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f5e8720c-9990-4518-a894-88b9a3161d6b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de734160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:19.391207 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f5e8720c-9990-4518-a894-88b9a3161d6b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.057961 Oct 28 18:05:19.392911 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 306/639] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:19 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:19.596655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:19.597792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:19.614473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:19.617856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:19.619076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:19.620924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:19.622375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:19.622975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:19.743100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-23b29e0d-26d5-4449-9bf3-5cee1f8f9ec8 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1805370847", "ram": 512, "vcpus": 1, "disk": 10, "id": 1060858752, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:19.786430 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-23b29e0d-26d5-4449-9bf3-5cee1f8f9ec8 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.310191 Oct 28 18:05:19.798497 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 334/640] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:19 2022] POST /compute/v2.1/flavors => generated 416 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:19.804816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:19.811344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:19.820685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:19.821300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:19.821972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:19.822765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:19.824433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:19.825190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:19.969219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:19.982067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:19.983972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:19.989643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9102d37e-a635-45ce-ad53-9e4af8646cce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1343 microversion: 2.25 time: 0.188721 Oct 28 18:05:19.999852 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 335/641] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:19 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1343 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:20.232202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c39b0f9-4acf-44fc-afa5-c073743b5e7e tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:20.253051 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5c39b0f9-4acf-44fc-afa5-c073743b5e7e tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] HTTP exception thrown: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c39b0f9-4acf-44fc-afa5-c073743b5e7e tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Request method failure captured: Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/flavors/1060858752/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBneN_J0UWbZNOQy9WHws2Wve2saoB9m2PikVpr6RWFZZBFj2ekwt8r-QSPq0XuiEkYshmKULGk7pWEOridmrtqm1aqYuQISv3BygWD0T9xWG1OzfasC-Io8se-tSnM89RwU3dRp-Szh7vNbKBPefv1kFEjXTcXVn8f4LP1Etwu1bkA Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 5f6b7da9f7b84a8a9f0ead23564c8f51 Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:05:20.257398 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f6b7da9f7b84a8a9f0ead23564c8f51", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 5f6b7da9f7b84a8a9f0ead23564c8f51 Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 33a3c22701e0481291db3b570faba84d Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:20.258793 n-d-862404-2 devstack@n-api.service[120680]: exception: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'flavor_id': '1060858752', 'id': 'hw:cpu_thread_policy'} Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.259459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.260830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.260830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.260830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.260830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:20.260830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:20.260830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. Oct 28 18:05:20.260830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.260830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c39b0f9-4acf-44fc-afa5-c073743b5e7e tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Returning 404 to user: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:20.270574 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c39b0f9-4acf-44fc-afa5-c073743b5e7e tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] 10.222.0.16 "GET /compute/v2.1/flavors/1060858752/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.270129 Oct 28 18:05:20.271209 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 336/642] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:05:19 2022] GET /compute/v2.1/flavors/1060858752/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:20.292687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:20.293311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:20.305006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:20.305666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:20.307587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:20.309299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:20.309918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:20.310548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:20.362116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.370994 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b77db898-2828-4dcd-a1ff-61c5afc3213c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1472 microversion: 2.1 time: 0.778240 Oct 28 18:05:20.373969 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 307/643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:19 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1472 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:20.401924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8f6349d3-ceb8-4d0c-944a-d31aff46936c req-f9031fd6-7c36-443e-bd3e-100be4627277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7e8cea-b2a4-437f-9036-98060f5e182c", "name": "network-vif-unplugged", "status": "completed", "tag": "8592cf03-4542-4f98-93b2-7c1f1ab5bbeb"}, {"name": "network-changed", "server_uuid": "0f7e8cea-b2a4-437f-9036-98060f5e182c", "tag": "8592cf03-4542-4f98-93b2-7c1f1ab5bbeb"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:20.421370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8f6349d3-ceb8-4d0c-944a-d31aff46936c req-f9031fd6-7c36-443e-bd3e-100be4627277 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:20.422623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8f6349d3-ceb8-4d0c-944a-d31aff46936c req-f9031fd6-7c36-443e-bd3e-100be4627277 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:20.425338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8f6349d3-ceb8-4d0c-944a-d31aff46936c req-f9031fd6-7c36-443e-bd3e-100be4627277 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:20.448941 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8f6349d3-ceb8-4d0c-944a-d31aff46936c req-f9031fd6-7c36-443e-bd3e-100be4627277 service nova] Creating event network-vif-unplugged:8592cf03-4542-4f98-93b2-7c1f1ab5bbeb for instance 0f7e8cea-b2a4-437f-9036-98060f5e182c on n-h1-862404-2 Oct 28 18:05:20.451005 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8f6349d3-ceb8-4d0c-944a-d31aff46936c req-f9031fd6-7c36-443e-bd3e-100be4627277 service nova] Creating event network-changed:8592cf03-4542-4f98-93b2-7c1f1ab5bbeb for instance 0f7e8cea-b2a4-437f-9036-98060f5e182c on n-h1-862404-2 Oct 28 18:05:20.457276 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8f6349d3-ceb8-4d0c-944a-d31aff46936c req-f9031fd6-7c36-443e-bd3e-100be4627277 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.065610 Oct 28 18:05:20.458190 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 308/644] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:20.460109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.465432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:20.466152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:20.473507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.474955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.493234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee0230fe-114a-4a45-862c-ec5c184df888 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1504 microversion: 2.91 time: 0.212048 Oct 28 18:05:20.493790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:20.494356 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 337/645] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:20 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:20.509089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:20.513230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:20.514310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:20.514426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-66bb1647-e5f9-44d3-a504-6edbf924b4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:20.515110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:20.515752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:20.518569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-66bb1647-e5f9-44d3-a504-6edbf924b4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '33a3c22701e0481291db3b570faba84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6b7da9f7b84a8a9f0ead23564c8f51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-66bb1647-e5f9-44d3-a504-6edbf924b4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Request method failure captured: Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/flavors/1060858752/os-extra_specs HTTP/1.1 Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 66 Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBneN_J0UWbZNOQy9WHws2Wve2saoB9m2PikVpr6RWFZZBFj2ekwt8r-QSPq0XuiEkYshmKULGk7pWEOridmrtqm1aqYuQISv3BygWD0T9xWG1OzfasC-Io8se-tSnM89RwU3dRp-Szh7vNbKBPefv1kFEjXTcXVn8f4LP1Etwu1bkA Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 5f6b7da9f7b84a8a9f0ead23564c8f51 Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:05:20.525820 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f6b7da9f7b84a8a9f0ead23564c8f51", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 5f6b7da9f7b84a8a9f0ead23564c8f51 Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 33a3c22701e0481291db3b570faba84d Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 28 18:05:20.527741 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'flavor_id': '1060858752', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:05:20.528647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 18:05:20.530015 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.532696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-66bb1647-e5f9-44d3-a504-6edbf924b4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:20.533851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-66bb1647-e5f9-44d3-a504-6edbf924b4e7 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] 10.222.0.16 "POST /compute/v2.1/flavors/1060858752/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.036964 Oct 28 18:05:20.536220 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 338/646] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 18:05:20 2022] POST /compute/v2.1/flavors/1060858752/os-extra_specs => generated 124 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:20.547074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c33b5934-e897-4aac-8e5c-b170725d6ef0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de665430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:20.627629 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c33b5934-e897-4aac-8e5c-b170725d6ef0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.089158 Oct 28 18:05:20.628493 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 339/647] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:20 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:20.645133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-28fefb94-09bb-4895-ba12-9f7941c55e34 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:20.700977 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-28fefb94-09bb-4895-ba12-9f7941c55e34 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1060858752/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059797 Oct 28 18:05:20.702331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 340/648] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 18:05:20 2022] POST /compute/v2.1/flavors/1060858752/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd5edf82-df96-492d-8a73-eb88b5637965 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bd5edf82-df96-492d-8a73-eb88b5637965 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '33a3c22701e0481291db3b570faba84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6b7da9f7b84a8a9f0ead23564c8f51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd5edf82-df96-492d-8a73-eb88b5637965 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Request method failure captured: Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:20.742485 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBneN_J0UWbZNOQy9WHws2Wve2saoB9m2PikVpr6RWFZZBFj2ekwt8r-QSPq0XuiEkYshmKULGk7pWEOridmrtqm1aqYuQISv3BygWD0T9xWG1OzfasC-Io8se-tSnM89RwU3dRp-Szh7vNbKBPefv1kFEjXTcXVn8f4LP1Etwu1bkA Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 5f6b7da9f7b84a8a9f0ead23564c8f51 Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f6b7da9f7b84a8a9f0ead23564c8f51", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 5f6b7da9f7b84a8a9f0ead23564c8f51 Oct 28 18:05:20.743340 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 33a3c22701e0481291db3b570faba84d Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'flavor_id': '1060858752', 'id': 'hw:numa_nodes'} Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:05:20.744229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:05:20.747074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:05:20.767324 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 18:05:20.767324 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.767324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd5edf82-df96-492d-8a73-eb88b5637965 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:20.767324 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd5edf82-df96-492d-8a73-eb88b5637965 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.028630 Oct 28 18:05:20.767324 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 341/649] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:05:20 2022] DELETE /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes => generated 124 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:20.773501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd5bd60a-d0f8-40eb-bfeb-db7142aa2938 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:20.813955 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd5bd60a-d0f8-40eb-bfeb-db7142aa2938 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1060858752/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060829 Oct 28 18:05:20.820133 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 342/650] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 18:05:20 2022] POST /compute/v2.1/flavors/1060858752/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:05:20.826390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65341009-a67f-48f6-b355-3b5c3401f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:20.829916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-65341009-a67f-48f6-b355-3b5c3401f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '33a3c22701e0481291db3b570faba84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6b7da9f7b84a8a9f0ead23564c8f51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65341009-a67f-48f6-b355-3b5c3401f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Request method failure captured: Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 22 Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBneN_J0UWbZNOQy9WHws2Wve2saoB9m2PikVpr6RWFZZBFj2ekwt8r-QSPq0XuiEkYshmKULGk7pWEOridmrtqm1aqYuQISv3BygWD0T9xWG1OzfasC-Io8se-tSnM89RwU3dRp-Szh7vNbKBPefv1kFEjXTcXVn8f4LP1Etwu1bkA Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 5f6b7da9f7b84a8a9f0ead23564c8f51 Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:05:20.832160 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5f6b7da9f7b84a8a9f0ead23564c8f51", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5f6b7da9f7b84a8a9f0ead23564c8f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 5f6b7da9f7b84a8a9f0ead23564c8f51 Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 33a3c22701e0481291db3b570faba84d Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: {"hw:numa_nodes": "1"} Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:20.833417 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'flavor_id': '1060858752', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:05:20.834158 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 18:05:20.835926 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.837593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65341009-a67f-48f6-b355-3b5c3401f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:20.837593 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65341009-a67f-48f6-b355-3b5c3401f8e5 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603 tempest-FlavorsExtraSpecsNegativeTestJSON-1539615603-project] 10.222.0.16 "PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012068 Oct 28 18:05:20.842060 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 343/651] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Oct 28 18:05:20 2022] PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:20.847227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dbea10e0-4b4e-4a88-a5ab-bf8fef64601d tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:20.858676 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-dbea10e0-4b4e-4a88-a5ab-bf8fef64601d tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] HTTP exception thrown: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dbea10e0-4b4e-4a88-a5ab-bf8fef64601d tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Request method failure captured: Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/flavors/1060858752/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBnfACOQp3jZr6DD30VJZGzh0BRb--xJtqYzpeM3b4LDXARMBlFcdXQXkkEGKqV5Qx5VtF9sYYUgJyZIxE7vTbDjttU9NXxR4CCwAtKrcNNw-91ngkKX226wxC5ND-rUkR6YsOxUrePgO5SIUMFAn4NII2X-YpGDFRzMxndapIaqsFQ Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e295e9ec157e45ffba53d9fd420d0f58 Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:05:20.860514 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e295e9ec157e45ffba53d9fd420d0f58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e295e9ec157e45ffba53d9fd420d0f58 Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 305edd364ff942bcabd0d8730acad282 Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:20.862258 n-d-862404-2 devstack@n-api.service[120680]: exception: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'flavor_id': '1060858752', 'id': 'hw:cpu_thread_policy'} Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.863043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.864766 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.864766 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.864766 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.864766 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:20.864766 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:20.864766 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. Oct 28 18:05:20.864766 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.866669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dbea10e0-4b4e-4a88-a5ab-bf8fef64601d tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Returning 404 to user: Flavor 1060858752 has no extra specs with key hw:cpu_thread_policy. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:20.867981 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dbea10e0-4b4e-4a88-a5ab-bf8fef64601d tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1060858752/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.024583 Oct 28 18:05:20.875580 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 344/652] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:05:20 2022] DELETE /compute/v2.1/flavors/1060858752/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:05:20.881347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-090da027-811e-48a1-9af8-d0e850df33c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:20.885415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-090da027-811e-48a1-9af8-d0e850df33c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-090da027-811e-48a1-9af8-d0e850df33c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Request method failure captured: Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 27 Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBnfACOQp3jZr6DD30VJZGzh0BRb--xJtqYzpeM3b4LDXARMBlFcdXQXkkEGKqV5Qx5VtF9sYYUgJyZIxE7vTbDjttU9NXxR4CCwAtKrcNNw-91ngkKX226wxC5ND-rUkR6YsOxUrePgO5SIUMFAn4NII2X-YpGDFRzMxndapIaqsFQ Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e295e9ec157e45ffba53d9fd420d0f58 Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:05:20.888723 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e295e9ec157e45ffba53d9fd420d0f58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e295e9ec157e45ffba53d9fd420d0f58 Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 305edd364ff942bcabd0d8730acad282 Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: {"hw:cpu_policy": "shared"} Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:20.890682 n-d-862404-2 devstack@n-api.service[120680]: exception: Request body and URI mismatch Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'flavor_id': '1060858752', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.891436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.892590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:05:20.892590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:05:20.892590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 28 18:05:20.892590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.893743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-090da027-811e-48a1-9af8-d0e850df33c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:20.895022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-090da027-811e-48a1-9af8-d0e850df33c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017550 Oct 28 18:05:20.901325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.903018 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 345/653] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Oct 28 18:05:20 2022] PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes => generated 73 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:05:20.908783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c04d187-24ff-4737-bba7-21c728a10ddb tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:20.912487 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c14bef55-a238-4f1e-8c27-edeca3743586 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.452971 Oct 28 18:05:20.913087 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 309/654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:20 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c04d187-24ff-4737-bba7-21c728a10ddb tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Request method failure captured: Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 49 Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBnfACOQp3jZr6DD30VJZGzh0BRb--xJtqYzpeM3b4LDXARMBlFcdXQXkkEGKqV5Qx5VtF9sYYUgJyZIxE7vTbDjttU9NXxR4CCwAtKrcNNw-91ngkKX226wxC5ND-rUkR6YsOxUrePgO5SIUMFAn4NII2X-YpGDFRzMxndapIaqsFQ Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e295e9ec157e45ffba53d9fd420d0f58 Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:05:20.925713 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e295e9ec157e45ffba53d9fd420d0f58", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e295e9ec157e45ffba53d9fd420d0f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e295e9ec157e45ffba53d9fd420d0f58 Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 305edd364ff942bcabd0d8730acad282 Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 28 18:05:20.927091 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'flavor_id': '1060858752', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance: Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 28 18:05:20.927780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.929126 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:05:20.930258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:05:20.930258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:05:20.930258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:05:20.930258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:05:20.930258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 18:05:20.930258 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:05:20.930258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c04d187-24ff-4737-bba7-21c728a10ddb tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:05:20.930258 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c04d187-24ff-4737-bba7-21c728a10ddb tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.022693 Oct 28 18:05:20.939752 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 346/655] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Oct 28 18:05:20 2022] PUT /compute/v2.1/flavors/1060858752/os-extra_specs/hw:numa_nodes => generated 117 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:05:20.944674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-daac4e1a-5078-4128-b695-8398bd044361 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.018598 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-daac4e1a-5078-4128-b695-8398bd044361 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1060858752" status: 202 len: 0 microversion: 2.1 time: 0.076999 Oct 28 18:05:21.019844 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 310/656] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:05:20 2022] DELETE /compute/v2.1/flavors/1060858752 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:05:21.030765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.031610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:21.036502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cc236a01-aff1-428e-862d-a9acfaf01ac9 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.060666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.061545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.061696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.062364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.063191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.063626 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cc236a01-aff1-428e-862d-a9acfaf01ac9 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836 tempest-FlavorsExtraSpecsNegativeTestJSON-1487623836-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.037123 Oct 28 18:05:21.064801 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 311/657] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:05:21 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:21.084081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.386334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:21.396574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.397206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:21.399168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:21.401034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:21.403273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82dc8e5c-0d3e-47fa-89e1-7af73e1d85b7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.377967 Oct 28 18:05:21.404810 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 347/658] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:21 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:05:21.408861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.409368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.409813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.418006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.418693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.419154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.533438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.534607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:21.545273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.546901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.547581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.548838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.549520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.550156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.588448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:21.681080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:21.692066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:21.694859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:21.701268 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea4693d0-8bc2-46c7-9282-632fb6656093 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1510 microversion: 2.91 time: 0.177999 Oct 28 18:05:21.702409 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 348/659] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:21 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:21.709476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c357756b-a2a8-4f43-8fbe-d0aca7378ff9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de654550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.795692 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c357756b-a2a8-4f43-8fbe-d0aca7378ff9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1414 microversion: 2.1 time: 0.091080 Oct 28 18:05:21.802398 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 349/660] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:21 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:21.827582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:21.837312 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7f2f448a-4cc6-46a9-ba97-d970242b82ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1469 microversion: 2.1 time: 0.444721 Oct 28 18:05:21.838055 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 312/661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:21 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:21.863602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:21.864712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:21.874165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.874902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.875683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.876529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.877098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.878184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.940235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.941115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:21.950329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.951214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.951837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.953437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.954068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.954663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.984175 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5502c13b-c4d0-4c0d-958b-760adc3af00e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d/action" status: 204 len: 0 microversion: 2.1 time: 0.127059 Oct 28 18:05:21.986140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 350/662] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:21 2022] POST /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d/action => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:05:21.998713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.999777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:22.006734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:22.007525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:22.008352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:22.009685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:22.010261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:22.011591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:22.178134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.187634 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac3d0088-b57f-4dbf-9aaa-b74af46886d3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1469 microversion: 2.1 time: 0.197528 Oct 28 18:05:22.188443 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 351/663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:21 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1469 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:22.307214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.316535 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-54d7291a-a315-4712-bda2-a2067961e786 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.379975 Oct 28 18:05:22.317379 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 313/664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:21 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:22.434199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:22.435505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:22.443744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:22.444410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:22.445062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:22.445838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:22.446444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:22.447026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:22.544777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-28571ce6-f8cb-4c10-8b31-40f0dfa3b99b req-9fe6e9ca-e7f6-4686-9564-e6430add6aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad1f5bd-5eed-4cfa-b39b-09586df2a2fa", "tag": "054624fe-f0fe-4640-8933-f7cf1a970e75"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:22.556839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28571ce6-f8cb-4c10-8b31-40f0dfa3b99b req-9fe6e9ca-e7f6-4686-9564-e6430add6aea service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:22.557558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28571ce6-f8cb-4c10-8b31-40f0dfa3b99b req-9fe6e9ca-e7f6-4686-9564-e6430add6aea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:22.560212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28571ce6-f8cb-4c10-8b31-40f0dfa3b99b req-9fe6e9ca-e7f6-4686-9564-e6430add6aea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:22.569742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:22.824558 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-28571ce6-f8cb-4c10-8b31-40f0dfa3b99b req-9fe6e9ca-e7f6-4686-9564-e6430add6aea service nova] Creating event network-changed:054624fe-f0fe-4640-8933-f7cf1a970e75 for instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa on n-h2-862404-2 Oct 28 18:05:22.831737 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-28571ce6-f8cb-4c10-8b31-40f0dfa3b99b req-9fe6e9ca-e7f6-4686-9564-e6430add6aea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290932 Oct 28 18:05:22.832580 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 314/665] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:22.838196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:22.838748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:22.846678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:22.847176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:22.847899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:22.848838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:22.849299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:22.849895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:22.858799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.868662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.870108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.876604 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec35d76b-e191-4bf3-ac71-f6749c47587b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.449976 Oct 28 18:05:22.891581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 352/666] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:22 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:22.904223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3fb30ba0-8076-40c6-bece-f47123110b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de6658b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:22.946284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.957395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.959102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.964698 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3fb30ba0-8076-40c6-bece-f47123110b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1423 microversion: 2.1 time: 0.071567 Oct 28 18:05:22.965289 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-201a4b2e-eb5b-4206-9d9c-abf9704082c5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1510 microversion: 2.91 time: 0.131451 Oct 28 18:05:22.965813 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 353/667] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:22 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1423 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:22.974976 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 315/668] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:22 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1510 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:22.981253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06dafd55-25a1-4645-a2e7-5cf056b9454e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de561ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:23.034761 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-06dafd55-25a1-4645-a2e7-5cf056b9454e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 200 len: 1423 microversion: 2.1 time: 0.057004 Oct 28 18:05:23.035335 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 316/669] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:05:22 2022] GET /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 1423 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:23.051140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-433dc64b-e929-4f01-b5f4-f9f5e783241a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de71a3a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:23.223344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:23.224033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:23.231205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.231710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.232339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.233478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.233956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.234372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.530521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:23.540914 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0bbd84a5-e433-4e20-9f79-d3831a659b47 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1469 microversion: 2.1 time: 0.331329 Oct 28 18:05:23.541680 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 317/670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:23 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1469 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:23.547487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:23.548315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:23.555050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.555548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.556187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.557047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.557743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.558738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.710886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:23.719620 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3f7999b-4379-499b-a2d3-786317237067 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.176198 Oct 28 18:05:23.720231 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 318/671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:23 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:23.739757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:23.740593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:23.747303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.747840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.748288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.749009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.749475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.749911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.777055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:05:23.780293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-433dc64b-e929-4f01-b5f4-f9f5e783241a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 204 len: 0 microversion: 2.1 time: 0.734386 Oct 28 18:05:23.780867 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 354/672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:23 2022] DELETE /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:05:23.788871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:23.789372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:23.795627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.796205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.796680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.797680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.798182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.798664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.827671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:05:23.889481 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffd5a5b7-5b6c-41cb-b781-9b4934910c50 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 204 len: 0 microversion: 2.1 time: 0.153070 Oct 28 18:05:23.890272 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 319/673] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:05:23 2022] DELETE /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:05:23.913499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:23.914200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:23.920942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.921432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.922056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.922928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.923656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.924117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.981254 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f28b4d3d-1dd6-4306-a792-5881d8f30706 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 204 len: 0 microversion: 2.1 time: 0.195746 Oct 28 18:05:23.982534 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 355/674] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:05:23 2022] DELETE /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:05:24.008030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:24.009006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:24.018531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:24.019024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:24.019460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:24.020983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:24.021447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:24.021876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:24.114333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:24.127402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:24.129054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:24.134311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1376b5eb-c02b-495c-8ecf-e1ee57416d6d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1510 microversion: 2.91 time: 0.132416 Oct 28 18:05:24.136567 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 356/675] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:24 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1510 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:24.143159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1045617379", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "209755473", "adminPass": "***", "networks": [{"uuid": "103c60d9-e6e4-41aa-a693-d527b9d61e57"}], "security_groups": [{"name": "tempest-securitygroup--931329983"}], "key_name": "tempest-keypair-591347395", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:24.186276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:24.195946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:24.197713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:24.201054 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4f5276d5-4007-4553-909e-8babb395641f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.294156 Oct 28 18:05:24.201880 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 320/676] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:23 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:24.213365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2134829154", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "d98ef463-74a4-479c-b632-73800f8bbec7"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:24.276356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] validate_networks() for [('103c60d9-e6e4-41aa-a693-d527b9d61e57', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:05:24.279089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] validate_networks() for [('d98ef463-74a4-479c-b632-73800f8bbec7', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:05:24.824633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:24.825282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:24.826078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:24.826837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:24.827615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:24.841480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:24.841974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:24.842409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:24.843144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:24.843600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:24.844056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:24.867431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:24.880367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for user 46b892cd4bff49b78773d9b78da06bcd and project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:24.900099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:05:24.903378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:05:24.963630 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-39e69b9f-d279-406e-983e-6287fe9d2e1e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760108 Oct 28 18:05:24.971533 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 321/677] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:05:24.971533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-14620cdf-c2ca-4e78-933f-70f06ee1aeab req-9146199d-ebfa-4a41-8910-8779f8b9ede6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b3563e-22f8-45f6-88b2-49ead221357d", "name": "network-vif-plugged", "status": "completed", "tag": "c10ccf0a-9c11-409f-9e38-de38e13aa335"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:24.984879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-14620cdf-c2ca-4e78-933f-70f06ee1aeab req-9146199d-ebfa-4a41-8910-8779f8b9ede6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:24.985650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-14620cdf-c2ca-4e78-933f-70f06ee1aeab req-9146199d-ebfa-4a41-8910-8779f8b9ede6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:24.986086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-14620cdf-c2ca-4e78-933f-70f06ee1aeab req-9146199d-ebfa-4a41-8910-8779f8b9ede6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.002374 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-14620cdf-c2ca-4e78-933f-70f06ee1aeab req-9146199d-ebfa-4a41-8910-8779f8b9ede6 service nova] Creating event network-vif-plugged:c10ccf0a-9c11-409f-9e38-de38e13aa335 for instance 59b3563e-22f8-45f6-88b2-49ead221357d on n-h2-862404-2 Oct 28 18:05:25.009852 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-14620cdf-c2ca-4e78-933f-70f06ee1aeab req-9146199d-ebfa-4a41-8910-8779f8b9ede6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043100 Oct 28 18:05:25.010513 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 322/678] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:25.016559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:25.017480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:25.025351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.026070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.026948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.027910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.028735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.029412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.099068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:25.100206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:25.100876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:25.101461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:25.101937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:25.116707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.117193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.119602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.121982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.124382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.124960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.168902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Getting quotas for project c23cb0ccf6b342ba983516131c90956a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:25.179101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Getting quotas for user 7d8ca12f168244f8a2ee4ee78f6263fc and project c23cb0ccf6b342ba983516131c90956a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:25.198211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:05:25.202046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:05:25.246409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:25.257011 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0c4a1da1-eae0-4557-970b-8436b0ea1a9b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1461 microversion: 2.1 time: 0.244844 Oct 28 18:05:25.258259 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 323/679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:25 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1461 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:25.278913 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0ffcf5d-0c25-4f7a-97e6-3b040b0343f7 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.141028 Oct 28 18:05:25.285786 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 357/680] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:05:25.285935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:25.285935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:25.286086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68a7b6ca-9cba-4c8a-8e45-185fb5ea57f5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:25.286086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68a7b6ca-9cba-4c8a-8e45-185fb5ea57f5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:25.290661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.291345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.292091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.294800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.295353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.296023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.489562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68a7b6ca-9cba-4c8a-8e45-185fb5ea57f5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:25.502622 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68a7b6ca-9cba-4c8a-8e45-185fb5ea57f5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1208 microversion: 2.1 time: 0.221478 Oct 28 18:05:25.503213 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 358/681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:25 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1208 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:25.516854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:25.517493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:25.540393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.540899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.541342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.542661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.543329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.544098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.665128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:25.681605 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-38fbe7f3-6a3e-4f03-b692-4d099df48a3b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.407253 Oct 28 18:05:25.685078 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 324/682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:25 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:25.693493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:25.694384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:25.706710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.707729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.708372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.710537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.711401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.712232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.752051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:25.775709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:25.781570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:25.796566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31aa83ca-3393-400e-b1d1-c50c2a1a6159 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1510 microversion: 2.91 time: 0.287777 Oct 28 18:05:25.797571 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 359/683] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:25 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:25.839994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:25.841034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:25.850059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.851145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.852477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.853475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.855387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.856346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:26.125898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:26.140297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:26.142328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:26.144014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f1dae9c7-ae35-4e52-bc3b-900ab9f4779d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.457816 Oct 28 18:05:26.145418 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 325/684] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:25 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:26.152032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:26.153360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:26.161171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:26.162235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:26.163339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:26.165971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:26.166809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:26.169041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:26.191007 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99c81dba-250f-4b91-93d6-1e77397f10c5 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1612 microversion: 2.1 time: 0.361938 Oct 28 18:05:26.202078 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 360/685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:25 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1612 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:26.236998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47c65dc7-7fb8-4635-91ae-b4304b211d2e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '.version_select at 0x7f78de7af280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:26.242223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47c65dc7-7fb8-4635-91ae-b4304b211d2e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:26.243062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47c65dc7-7fb8-4635-91ae-b4304b211d2e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:26.243995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47c65dc7-7fb8-4635-91ae-b4304b211d2e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:26.260289 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47c65dc7-7fb8-4635-91ae-b4304b211d2e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1559 microversion: 2.1 time: 0.026088 Oct 28 18:05:26.279625 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 361/686] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:05:26 2022] GET /compute/v2.1/os-migrations => generated 1559 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:26.373420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:26.382925 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7961f407-ef56-42bb-923a-a6a5e8d11194 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1258 microversion: 2.1 time: 0.236147 Oct 28 18:05:26.389389 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 326/687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:26 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1258 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:26.460194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-370435707", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:26.471543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:26.526081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:26.527562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:26.537625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:26.538447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:26.538880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:26.540098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:26.552255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:26.552808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:26.556778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:05:26.693449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:26.705409 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4923ccc7-1ad4-40ce-abc6-91b61bc1d88f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1260 microversion: 2.1 time: 0.183046 Oct 28 18:05:26.706745 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 327/688] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:26 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:26.717274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:26.720773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:26.739489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:26.740423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:26.741089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:26.742123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:26.742866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:26.743524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.278862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:27.280033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:27.280981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:27.282590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:27.283733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:27.284427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:27.300916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.301230 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e355e1f9-91d8-4d8a-9b8c-87f4b85e73f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.587947 Oct 28 18:05:27.302111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.302451 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 328/689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:26 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:27.303134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.304242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.305308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.305943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.311169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:27.311972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:27.327389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:27.329222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.330044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.330887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.332257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.333097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.333770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for user 3415953e10c445bfa3dcc5a3335826c8 and project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:27.334147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.351194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:05:27.354354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:05:27.432205 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd11ab49-e8c4-4914-a7f6-b7c9519b51cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977766 Oct 28 18:05:27.434562 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 362/690] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:05:27.446142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:27.446816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:27.457585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.458507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.459170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.460029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.460963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.461888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.463295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:27.477988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:27.483857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:27.512847 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59977ee3-a632-4dda-b600-e4022fc8f9e7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1531 microversion: 2.91 time: 0.206458 Oct 28 18:05:27.517320 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 329/691] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:27 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1531 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:27.552384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:27.554224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:27.562722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.563764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.564703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.565672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.566349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.566996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.020906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:28.034767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:28.038636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:28.041688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd397e1c-1f7b-4744-b9ad-546ef7aa4f72 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.599648 Oct 28 18:05:28.056418 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 363/692] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:27 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:28.094650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-85b2cdeb-3167-4339-b797-6dcf8aaa89cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:28.094990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:28.096925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-85b2cdeb-3167-4339-b797-6dcf8aaa89cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:28.116891 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bd133d5c-c65a-463d-86f7-a851e10a3f51 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1322 microversion: 2.1 time: 0.568966 Oct 28 18:05:28.117756 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 330/693] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:27 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1322 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:28.375488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-85b2cdeb-3167-4339-b797-6dcf8aaa89cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:28.386848 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-85b2cdeb-3167-4339-b797-6dcf8aaa89cd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1212 microversion: 2.1 time: 0.326679 Oct 28 18:05:28.389872 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 364/694] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:28 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1212 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:28.399638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:28.400884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:28.407914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.409067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.409721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.410684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.412181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.412874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.507538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:28.522645 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c114513-bfb1-45dc-a022-6e674e0d6e51 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1266 microversion: 2.1 time: 0.128497 Oct 28 18:05:28.542513 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 365/695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:28 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:28.548371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-476c4a75-1bae-4340-8c56-583309e567be req-cab26020-56cd-407b-a179-707d113f9501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3ae6b5-7f14-4401-9680-ebcf1756a40c", "name": "network-vif-deleted", "tag": "49b723c1-8f4b-436a-97df-a9b610186ba2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:28.561232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-476c4a75-1bae-4340-8c56-583309e567be req-cab26020-56cd-407b-a179-707d113f9501 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.562423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-476c4a75-1bae-4340-8c56-583309e567be req-cab26020-56cd-407b-a179-707d113f9501 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.563268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-476c4a75-1bae-4340-8c56-583309e567be req-cab26020-56cd-407b-a179-707d113f9501 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.576263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:28.577429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:28.577871 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-476c4a75-1bae-4340-8c56-583309e567be req-cab26020-56cd-407b-a179-707d113f9501 service nova] Creating event network-vif-deleted:49b723c1-8f4b-436a-97df-a9b610186ba2 for instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c on n-h2-862404-2 Oct 28 18:05:28.584164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.586509 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-476c4a75-1bae-4340-8c56-583309e567be req-cab26020-56cd-407b-a179-707d113f9501 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041946 Oct 28 18:05:28.587382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.587798 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 366/696] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:28.588200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.589340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.592427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.593125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.596032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:28.598100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:28.608700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.609442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.610089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.610955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.611745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.612791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.006385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lazy-loading 'services' on Instance uuid c9719e5b-0d1e-4037-a570-0258892d87b4 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:05:29.015484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:29.051200 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fdfaae31-3534-404d-a138-2e470b88b94d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1936 microversion: 2.91 time: 0.932206 Oct 28 18:05:29.053905 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 331/697] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:28 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1936 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:29.069533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-169f1ac1-9737-451f-b696-7af581df0fce req-b658b97e-959b-4214-a5cd-5b3291f7cb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8a4193-8c20-48d7-830c-11d97b58e409", "name": "network-vif-deleted", "tag": "0ebbdf8c-307c-4e5c-bb1d-babf5352d450"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:29.093786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-169f1ac1-9737-451f-b696-7af581df0fce req-b658b97e-959b-4214-a5cd-5b3291f7cb1d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.097224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-169f1ac1-9737-451f-b696-7af581df0fce req-b658b97e-959b-4214-a5cd-5b3291f7cb1d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.099676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-169f1ac1-9737-451f-b696-7af581df0fce req-b658b97e-959b-4214-a5cd-5b3291f7cb1d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.121124 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-169f1ac1-9737-451f-b696-7af581df0fce req-b658b97e-959b-4214-a5cd-5b3291f7cb1d service nova] Creating event network-vif-deleted:0ebbdf8c-307c-4e5c-bb1d-babf5352d450 for instance 2e8a4193-8c20-48d7-830c-11d97b58e409 on n-h1-862404-2 Oct 28 18:05:29.139140 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-169f1ac1-9737-451f-b696-7af581df0fce req-b658b97e-959b-4214-a5cd-5b3291f7cb1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082193 Oct 28 18:05:29.140179 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 332/698] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:29.161601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:29.162646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:29.165997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:29.177808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.184475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.185129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.186998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.190293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.190870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.353430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:29.369833 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f523948-545a-419c-bed0-779201ada439 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.780777 Oct 28 18:05:29.376169 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 367/699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:28 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:29.388693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:29.389310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:29.399437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.404071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.404899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.407386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.408060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.408892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.731665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lazy-loading 'services' on Instance uuid c9719e5b-0d1e-4037-a570-0258892d87b4 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:05:29.763085 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9f8a0fc-6024-49ab-b635-7150bb9f48c8 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1936 microversion: 2.91 time: 0.385738 Oct 28 18:05:29.764456 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 368/700] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:29 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1936 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:29.769699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d28c4c5d-de76-414f-b101-27bdef54acc5 req-5cc40a68-5927-47b4-b745-78c7dd1a6913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7e8cea-b2a4-437f-9036-98060f5e182c", "name": "network-vif-plugged", "status": "completed", "tag": "8592cf03-4542-4f98-93b2-7c1f1ab5bbeb"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:29.774250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:29.785583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d28c4c5d-de76-414f-b101-27bdef54acc5 req-5cc40a68-5927-47b4-b745-78c7dd1a6913 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.786291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d28c4c5d-de76-414f-b101-27bdef54acc5 req-5cc40a68-5927-47b4-b745-78c7dd1a6913 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.787462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:29.788360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d28c4c5d-de76-414f-b101-27bdef54acc5 req-5cc40a68-5927-47b4-b745-78c7dd1a6913 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.793648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:29.805292 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c38d84ed-3ee0-4cec-9c09-c975ea9229ee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.663640 Oct 28 18:05:29.812494 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 333/701] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:29 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:29.824619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:29.824619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:29.828680 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d28c4c5d-de76-414f-b101-27bdef54acc5 req-5cc40a68-5927-47b4-b745-78c7dd1a6913 service nova] Creating event network-vif-plugged:8592cf03-4542-4f98-93b2-7c1f1ab5bbeb for instance 0f7e8cea-b2a4-437f-9036-98060f5e182c on n-h1-862404-2 Oct 28 18:05:29.842633 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d28c4c5d-de76-414f-b101-27bdef54acc5 req-5cc40a68-5927-47b4-b745-78c7dd1a6913 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076657 Oct 28 18:05:29.847252 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 369/702] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:29.850772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.853212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.856659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.858714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.859321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.859977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.861826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:29.865685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:29.896036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.897826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.898583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.900686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.908711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.909415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.939945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:30.085337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:30.099205 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08f6f4f5-701c-4f93-941b-9f80a642ae83 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1264 microversion: 2.1 time: 0.250268 Oct 28 18:05:30.100085 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 370/703] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:29 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:30.112735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:30.113571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:30.124927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:30.125760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:30.126379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:30.127245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:30.127882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:30.128805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:30.203207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:30.216205 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7b29aa72-8fd4-4e69-aa2e-c340a46f49b9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1320 microversion: 2.1 time: 0.402265 Oct 28 18:05:30.219887 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 334/704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:29 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:30.237460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-600e4e22-d6c6-4ecf-a98d-cdb9a4751fdf tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:30.246780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-600e4e22-d6c6-4ecf-a98d-cdb9a4751fdf tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:30.247913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-600e4e22-d6c6-4ecf-a98d-cdb9a4751fdf tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:30.248926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-600e4e22-d6c6-4ecf-a98d-cdb9a4751fdf tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:30.251625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-600e4e22-d6c6-4ecf-a98d-cdb9a4751fdf tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:30.252602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-600e4e22-d6c6-4ecf-a98d-cdb9a4751fdf tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:30.252741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-600e4e22-d6c6-4ecf-a98d-cdb9a4751fdf tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:30.341580 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-600e4e22-d6c6-4ecf-a98d-cdb9a4751fdf tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.117995 Oct 28 18:05:30.344183 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 335/705] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 18:05:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:05:30.360034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:30.362563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:30.385655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:30.387418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:30.390352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:30.391149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:30.393214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:30.396349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:30.466986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lazy-loading 'flavor' on Instance uuid c9719e5b-0d1e-4037-a570-0258892d87b4 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:05:31.035434 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-73b12f1d-71ee-46a1-96f3-6ff537d49657 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "POST /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4/action" status: 202 len: 0 microversion: 2.91 time: 0.682668 Oct 28 18:05:31.037600 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 336/706] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:05:30 2022] POST /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:05:31.045947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:31.047162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:31.057530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.058767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.059392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.060430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.061105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.061723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.263269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.278923 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aeedaf12-17c7-4576-81e1-ccd599a2364a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 1.177565 Oct 28 18:05:31.288207 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 371/707] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:30 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:31.295507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:31.296348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:31.303955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.304647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.305247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.306143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.306757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.307361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.693455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.706206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.708139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.711626 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-de51cb53-a1ed-46ef-a02c-6a41cdfc16d3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.420284 Oct 28 18:05:31.720479 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 372/708] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:31 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:31.734142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:31.736583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:31.743559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.744293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.744935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.748238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.748879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.749643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.927992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.939555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.954064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.964831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-132af9ae-047b-4303-be33-ce10de13162d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.242918 Oct 28 18:05:31.966024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.966889 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 373/709] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:31 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:31.972487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:31.973277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:31.983744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.984336 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f198b15e-f3f6-4873-ad15-0954bc673dff tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1502 microversion: 2.1 time: 0.945131 Oct 28 18:05:31.984691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.985305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.986150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.986776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.987364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.993529 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 337/710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:31 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1502 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:32.023344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:32.036302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:32.053901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:32.054426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:32.054866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:32.056448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:32.059912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:32.060708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:32.407401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:32.426293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d0a5f47-35fc-4018-8a2c-b178acc11650 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1270 microversion: 2.1 time: 0.457369 Oct 28 18:05:32.446642 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 374/711] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:31 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1270 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:32.459871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:32.462332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:32.486266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:32.488507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:32.491283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:32.494212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:32.494803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:32.496947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:32.872384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:32.882023 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-24398285-6628-4e68-99ec-3fecf8a43509 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.887106 Oct 28 18:05:32.882627 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 338/712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:31 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:32.910302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:32.917724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:32.928571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:32.929081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:32.929534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:32.930264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:32.930734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:32.931258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.179199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.190638 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8531e53c-7a34-4fb3-b2be-0b4c4695663d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 0.741316 Oct 28 18:05:33.191271 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 375/713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:32 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:33.217981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5e1fd9c7-698a-4d07-94a2-233582019a94 req-20786064-89df-4ba6-a240-1632ca33918e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3474cd55-0481-4698-a73f-f4666dc5164e", "tag": "dd584db5-4cf7-4168-bafd-06d158e73987"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:33.234265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5e1fd9c7-698a-4d07-94a2-233582019a94 req-20786064-89df-4ba6-a240-1632ca33918e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.235051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5e1fd9c7-698a-4d07-94a2-233582019a94 req-20786064-89df-4ba6-a240-1632ca33918e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.235859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5e1fd9c7-698a-4d07-94a2-233582019a94 req-20786064-89df-4ba6-a240-1632ca33918e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.249697 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5e1fd9c7-698a-4d07-94a2-233582019a94 req-20786064-89df-4ba6-a240-1632ca33918e service nova] Creating event network-changed:dd584db5-4cf7-4168-bafd-06d158e73987 for instance 3474cd55-0481-4698-a73f-f4666dc5164e on n-h1-862404-2 Oct 28 18:05:33.264261 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5e1fd9c7-698a-4d07-94a2-233582019a94 req-20786064-89df-4ba6-a240-1632ca33918e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053570 Oct 28 18:05:33.265208 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 376/714] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:33.271295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:33.272681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:33.282438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.283207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.283842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.284881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.286173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.286784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.353986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.366456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.368084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.369802 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4714a001-e268-4179-97f6-803ce13cb726 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.466583 Oct 28 18:05:33.371341 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 339/715] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:32 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:33.377943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:33.378644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:33.385212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.386735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.387587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.388507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.389287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.389862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.434969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.450090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.452032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.461366 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-776ca903-f80b-4880-b52e-cf7cb7bd7845 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.192659 Oct 28 18:05:33.462737 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 377/716] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:33 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:33.469639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:33.470845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:33.492137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.499339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.501673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.504115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.504815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.506582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.858899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.868375 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5325ffbd-48c5-4e3a-acfd-ae8fdc3c9015 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1312 microversion: 2.1 time: 0.404208 Oct 28 18:05:33.880172 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 378/717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:33 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1312 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:33.884069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45140ab7-1673-44dd-a474-9ca325fe6e88"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:33.887484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:33.918281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.919592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.920856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.922893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.924729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.927679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.973600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:33.982584 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c82d8c3-78f8-4b7a-beac-43d489ceb484 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1492 microversion: 2.1 time: 0.609837 Oct 28 18:05:33.999841 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 340/718] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:33 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1492 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:33.999841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:33.999841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:34.013449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.014350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.014919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.018156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.018800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.019353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.426242 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9e0d3398-43f4-4148-993e-eb355ed982fd tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "POST /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555925 Oct 28 18:05:34.434581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 379/719] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:05:33 2022] POST /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:34.441456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84def58f-0c3b-4ac0-af79-2889dce00508 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '.version_select at 0x7f78de6f6040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:34.448596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84def58f-0c3b-4ac0-af79-2889dce00508 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.448596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84def58f-0c3b-4ac0-af79-2889dce00508 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.449315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84def58f-0c3b-4ac0-af79-2889dce00508 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.484706 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84def58f-0c3b-4ac0-af79-2889dce00508 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1559 microversion: 2.1 time: 0.048466 Oct 28 18:05:34.488736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 380/720] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:05:34 2022] GET /compute/v2.1/os-migrations => generated 1559 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:34.501079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:34.502322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:34.537565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.538061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.538495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.539186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.539633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.540310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.568167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:34.583933 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9fae0557-63e1-494a-9729-eca974590bbf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.595893 Oct 28 18:05:34.586897 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 341/721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:33 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:34.596835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:34.599608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:34.610902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.611746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.612697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.613656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.614274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.614864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.857632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:34.868776 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-11c41987-b551-4598-b289-e787c17b58fa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 0.378437 Oct 28 18:05:34.869525 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 381/722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:34 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:34.882426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:34.883073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:34.891575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:34.903206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.908630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.909415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.910673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:34.911691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:34.912490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.041795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:35.051567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:35.053983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:35.061957 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-21662fa0-13fa-4978-91c6-a48801a91b01 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.188208 Oct 28 18:05:35.063287 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 382/723] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:34 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:35.071150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:35.078582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:35.086433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.087231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.087975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.089115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.089799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.090450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.305553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:35.320972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:35.339953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:35.341729 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d769c4e-8e64-4819-828c-793949a44037 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1643 microversion: 2.1 time: 0.276579 Oct 28 18:05:35.343591 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9607c1ed-fdc0-4411-88bd-0ef579931214 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.754952 Oct 28 18:05:35.344088 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 383/724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:35 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1643 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:35.362831 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 342/725] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:34 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:35.368278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-431c7a2b-477e-44b3-b90c-4d8e393c5f19 req-91be4f6d-ca4f-418e-a32a-9bbc60f01265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad1f5bd-5eed-4cfa-b39b-09586df2a2fa", "name": "network-vif-plugged", "status": "completed", "tag": "054624fe-f0fe-4640-8933-f7cf1a970e75"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:35.377940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:35.379013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:35.387642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.389023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.389730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.391586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.392326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.394334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.402198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-431c7a2b-477e-44b3-b90c-4d8e393c5f19 req-91be4f6d-ca4f-418e-a32a-9bbc60f01265 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.403502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-431c7a2b-477e-44b3-b90c-4d8e393c5f19 req-91be4f6d-ca4f-418e-a32a-9bbc60f01265 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.404001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-431c7a2b-477e-44b3-b90c-4d8e393c5f19 req-91be4f6d-ca4f-418e-a32a-9bbc60f01265 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.434105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-431c7a2b-477e-44b3-b90c-4d8e393c5f19 req-91be4f6d-ca4f-418e-a32a-9bbc60f01265 service nova] Creating event network-vif-plugged:054624fe-f0fe-4640-8933-f7cf1a970e75 for instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa on n-h2-862404-2 Oct 28 18:05:35.445552 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-431c7a2b-477e-44b3-b90c-4d8e393c5f19 req-91be4f6d-ca4f-418e-a32a-9bbc60f01265 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099307 Oct 28 18:05:35.451151 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 384/726] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:35.458293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f1385d99-56b5-4809-880d-763079e3e789 req-0903dceb-1cff-4e3f-b44e-f8fced557c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9552def0-8a91-498a-900a-150434e38180", "tag": "f5e0147a-caa4-4d4c-9805-66b3014a3b54"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:35.484320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1385d99-56b5-4809-880d-763079e3e789 req-0903dceb-1cff-4e3f-b44e-f8fced557c4d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.484949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1385d99-56b5-4809-880d-763079e3e789 req-0903dceb-1cff-4e3f-b44e-f8fced557c4d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.485563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1385d99-56b5-4809-880d-763079e3e789 req-0903dceb-1cff-4e3f-b44e-f8fced557c4d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.511298 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f1385d99-56b5-4809-880d-763079e3e789 req-0903dceb-1cff-4e3f-b44e-f8fced557c4d service nova] Creating event network-changed:f5e0147a-caa4-4d4c-9805-66b3014a3b54 for instance 9552def0-8a91-498a-900a-150434e38180 on n-h2-862404-2 Oct 28 18:05:35.518783 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f1385d99-56b5-4809-880d-763079e3e789 req-0903dceb-1cff-4e3f-b44e-f8fced557c4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065507 Oct 28 18:05:35.520323 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 385/727] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:35.528343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e44f61a8-ae4c-4bb9-89f9-e0a26214469e req-9332599c-3636-4b11-b560-18f288b790f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e361a9-879b-4678-84a3-69c90f2b2bed", "tag": "d0e3d28b-5b15-4a23-af02-a09d51459806"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:35.549195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e44f61a8-ae4c-4bb9-89f9-e0a26214469e req-9332599c-3636-4b11-b560-18f288b790f9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.550081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e44f61a8-ae4c-4bb9-89f9-e0a26214469e req-9332599c-3636-4b11-b560-18f288b790f9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.550856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e44f61a8-ae4c-4bb9-89f9-e0a26214469e req-9332599c-3636-4b11-b560-18f288b790f9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.564840 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e44f61a8-ae4c-4bb9-89f9-e0a26214469e req-9332599c-3636-4b11-b560-18f288b790f9 service nova] Creating event network-changed:d0e3d28b-5b15-4a23-af02-a09d51459806 for instance 97e361a9-879b-4678-84a3-69c90f2b2bed on n-h1-862404-2 Oct 28 18:05:35.569809 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e44f61a8-ae4c-4bb9-89f9-e0a26214469e req-9332599c-3636-4b11-b560-18f288b790f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048110 Oct 28 18:05:35.571394 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 386/728] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:35.590933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-277478157", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "93172da3-2cc7-4d23-b5e8-59c944e1e4c4"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:35.654732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] validate_networks() for [('93172da3-2cc7-4d23-b5e8-59c944e1e4c4', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:05:35.804081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:35.814113 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-12cf88ce-a17b-49d8-9ba5-e7d258c1dbc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1312 microversion: 2.1 time: 0.444008 Oct 28 18:05:35.815612 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 343/729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:35 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:35.826581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:35.835581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:35.843255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.844008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.844628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.845412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.846109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.846604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.108437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:36.140827 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c02bd8e3-cc6e-4297-bdc4-0026cd773c8a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.317076 Oct 28 18:05:36.141779 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 344/730] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:35 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:36.153709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:36.171261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:36.189754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:36.190543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:36.191261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:36.191855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:36.192420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:36.196554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.197047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.204389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.205108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=35 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:36.206856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.208236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.208854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.209303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.209680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.210051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.211985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.212441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.214675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.235249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=11 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:36.263946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for project 8253dbe510dd462f974f37fce0a5d990. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:36.280671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for user 12dea4e86fd14c07859b48e22493b9dd and project 8253dbe510dd462f974f37fce0a5d990. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:36.308766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:05:36.311497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:05:36.412156 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee0c411b-ade9-4ff3-997e-8be4acdb6634 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839062 Oct 28 18:05:36.422300 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 387/731] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:05:36.431029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:36.431622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:36.452504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.456793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.457086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.457781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.458255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.458687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.586785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:36.600296 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7d8dfc5-fc1f-418d-9188-80e177572245 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 0.457302 Oct 28 18:05:36.600910 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 345/732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:36 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:36.614617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:36.619322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:36.634581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.635101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.636156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.640507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.641012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.643806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:37.130724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.142818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.147362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.161709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-303e65f5-6f3c-406e-840e-7a22e1446b02 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.738281 Oct 28 18:05:37.162647 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 388/733] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:36 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:37.167349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9837dcb-70c0-486b-b384-ce0e64a182b1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:37.175323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b9837dcb-70c0-486b-b384-ce0e64a182b1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:37.304153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b9837dcb-70c0-486b-b384-ce0e64a182b1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.316561 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b9837dcb-70c0-486b-b384-ce0e64a182b1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1210 microversion: 2.1 time: 0.152610 Oct 28 18:05:37.319771 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 389/734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:37 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1210 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:37.333071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:37.333716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:37.366212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:37.368565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:37.369076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:37.369954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:37.370424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:37.370909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:37.539681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.564105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.566145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.572788 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e25fc0e0-1b32-4c3f-bb60-0a1757310fce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.969487 Oct 28 18:05:37.575191 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 346/735] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:36 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:37.582601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:37.588530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:37.606615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:37.607475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:37.608210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:37.610099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:37.610873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:37.624410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:37.797213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.801829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:37.823863 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5fab0337-da98-4f3b-bca5-463c75dda1af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1312 microversion: 2.1 time: 0.502608 Oct 28 18:05:37.824580 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 390/736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:37 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1312 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:37.852614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:37.853261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:37.875612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:37.876153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:37.876597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:37.877309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:37.877767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:37.878200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:38.257391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:38.269548 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aab0a108-ffd5-41ce-b69f-9ca28f3b182f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 0.443739 Oct 28 18:05:38.271730 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 391/737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:37 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:38.285863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:38.287246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:38.289261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:38.290914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:38.295877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:38.302941 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e844b3ac-12d9-4746-9ae2-5011613f9082 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.726399 Oct 28 18:05:38.304196 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 347/738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:37 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:38.310959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:38.313292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:38.315340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:38.317199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:38.319917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:38.320602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:38.344083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:38.345543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:38.360434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:38.361891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:38.363713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:38.368504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:38.369647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:38.370367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:38.461820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:38.490820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:38.493027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:38.503910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e05e33dd-160d-456c-a4eb-4dca6c62b80b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.229519 Oct 28 18:05:38.519842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 392/739] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:38 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:38.603602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:38.607111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:38.618873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:38.620867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:38.621612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:38.623194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:38.627062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:38.628009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.023522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:39.037001 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a11937b-7145-4190-b7a8-c46e6b8c5f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1262 microversion: 2.1 time: 0.699692 Oct 28 18:05:39.059496 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 348/740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:38 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1262 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:39.081703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:39.085542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:39.110688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.113870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.118058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.121836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.126591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.127055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.348695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:39.361054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:39.362515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:39.363630 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8aa25c8e-2eae-45ff-a3c4-66c222fd9728 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1409 microversion: 2.25 time: 0.766158 Oct 28 18:05:39.374349 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 393/741] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:38 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1409 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:39.383252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:39.385937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:39.407204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.407700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.408170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.408878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.409332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.409752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.644253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:39.652117 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-656065ec-3498-488a-83b0-ac84a356a5cd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 0.276159 Oct 28 18:05:39.653039 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 394/742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:39 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:39.658745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:39.661400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:39.673371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.674275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.675106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.676098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.676785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.677456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.887252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:39.902711 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9304c17d-792f-41ba-822a-427e3c61b346 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1312 microversion: 2.1 time: 0.839730 Oct 28 18:05:39.903548 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 349/743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:39 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1312 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:39.921496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:39.922340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:39.925290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:39.934952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.935462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.936018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.936654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.937029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a25dd1b2-0a84-4651-95bf-371ae9af84f8 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.280865 Oct 28 18:05:39.937164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.937544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.938603 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 395/744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:39 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:40.067084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:40.068031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:40.079705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.080987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.081234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:40.083329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.084214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:40.084663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.085348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:40.099433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:40.101083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:40.123686 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-84d1e993-0283-40e2-bef6-f112b11f02ad tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.218782 Oct 28 18:05:40.124575 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 350/745] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:39 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:40.175803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:40.187564 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29d85afe-7120-437e-8d73-f711773932f8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1268 microversion: 2.1 time: 0.123255 Oct 28 18:05:40.187736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 396/746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:40 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1268 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:40.394710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:40.395325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:40.403023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:40.406447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.407099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.407964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:40.410315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.411336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.411997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:40.678499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:40.679504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:40.691787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.692205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.692639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:40.695184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.696015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.696991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:40.913469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:40.923628 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb6bd3c4-6e79-4381-a4db-d0f67ae80b02 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 0.249525 Oct 28 18:05:40.928021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 397/747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:40 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:40.945500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:40.951109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:40.969049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.969942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.970847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:40.971786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.973505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.974234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.008498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.043996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.053076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.059752 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-01220a4a-1821-4abd-a62a-54529619109a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1604 microversion: 2.25 time: 0.668803 Oct 28 18:05:41.061771 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 351/748] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:40 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1604 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:05:41.073584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:41.075392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:41.093973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.097924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.098676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.103844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.104584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.105318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.313355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.342058 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a87c42a2-3f15-4ca9-8aa6-62babb292960 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1312 microversion: 2.1 time: 0.412279 Oct 28 18:05:41.342667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 398/749] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:40 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1312 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:41.360704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a672894a-1da2-4e6c-b98f-770cc9e3fe1e req-ff8a0e50-2c21-417e-9034-25dcc4116d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9552def0-8a91-498a-900a-150434e38180", "name": "network-vif-plugged", "status": "completed", "tag": "f5e0147a-caa4-4d4c-9805-66b3014a3b54"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:41.388399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a672894a-1da2-4e6c-b98f-770cc9e3fe1e req-ff8a0e50-2c21-417e-9034-25dcc4116d1a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.388901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a672894a-1da2-4e6c-b98f-770cc9e3fe1e req-ff8a0e50-2c21-417e-9034-25dcc4116d1a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.389334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a672894a-1da2-4e6c-b98f-770cc9e3fe1e req-ff8a0e50-2c21-417e-9034-25dcc4116d1a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.407341 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a672894a-1da2-4e6c-b98f-770cc9e3fe1e req-ff8a0e50-2c21-417e-9034-25dcc4116d1a service nova] Creating event network-vif-plugged:f5e0147a-caa4-4d4c-9805-66b3014a3b54 for instance 9552def0-8a91-498a-900a-150434e38180 on n-h2-862404-2 Oct 28 18:05:41.416009 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a672894a-1da2-4e6c-b98f-770cc9e3fe1e req-ff8a0e50-2c21-417e-9034-25dcc4116d1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071937 Oct 28 18:05:41.420348 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 399/750] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:41.434609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:41.435188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:41.442877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.443294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.443739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.444508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.444959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.445388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.496156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.509333 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-99b2a84d-ab91-4aa4-8b85-bd54242fbcd0 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.445570 Oct 28 18:05:41.510139 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 352/751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:41 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:41.517169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:41.518427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:41.530941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.534749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.546366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.552190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.552976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.553731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.558273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c56634c5-6f3c-416c-8749-ca8a20935474 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.136442 Oct 28 18:05:41.561052 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 400/752] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 18:05:41 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:05:41.567577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:41.568265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:41.577137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.577837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.578620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.579502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.580264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.581757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.703698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.719922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.731054 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc11a995-f93a-4a8f-9f84-1b751f91f597 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1268 microversion: 2.1 time: 0.167954 Oct 28 18:05:41.732785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 401/753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:41 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:41.732922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.751659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.761126 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d6534b1-f4e7-4c25-ba18-5ddbc0e7463f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.248178 Oct 28 18:05:41.762611 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 353/754] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:41 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:41.957108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:41.957651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:41.967515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.969471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.971088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.972855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.975444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.976010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.369426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:42.370652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:42.394175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.395280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.396012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.397349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.397980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.401921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.705650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:42.716485 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea13027d-7c47-4322-98e8-f284ba77b0fa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1312 microversion: 2.1 time: 0.351192 Oct 28 18:05:42.720729 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 354/755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:42 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:42.730872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:42.736075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:42.759985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.761014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.761749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.762934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.763667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.764342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.889802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:42.902057 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48a2e9a7-2bd5-423c-8f55-51b65c7e68ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 0.949200 Oct 28 18:05:42.927100 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 402/756] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:41 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:42.937082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:42.940119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:42.955760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.961844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.962914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.966655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.967216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.967728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.110766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:43.128247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cec0ef46-1559-47a0-9067-f550a7433e05 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1268 microversion: 2.1 time: 0.199564 Oct 28 18:05:43.129499 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 403/757] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:42 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1268 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:43.149636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:43.152440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:43.162090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:43.163196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:43.163978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.165317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:43.165983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:43.168624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.189447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:43.233914 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c1952d56-7123-4d39-a44e-6e9c0da10320 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.510423 Oct 28 18:05:43.271289 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 355/758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:42 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:43.330098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:43.347981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:43.351947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:43.366327 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30c5fd9c-ea76-4964-a3c5-a6d9c726c520 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.233206 Oct 28 18:05:43.367203 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 404/759] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:43 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:43.533486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-7a93fb3c-83f5-4172-b4e0-1e178b4ce5ca req-5f6f525a-84a6-4ac9-9c08-7023fe11b58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3474cd55-0481-4698-a73f-f4666dc5164e", "name": "network-vif-plugged", "status": "completed", "tag": "dd584db5-4cf7-4168-bafd-06d158e73987"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:43.568643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7a93fb3c-83f5-4172-b4e0-1e178b4ce5ca req-5f6f525a-84a6-4ac9-9c08-7023fe11b58b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:43.569142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7a93fb3c-83f5-4172-b4e0-1e178b4ce5ca req-5f6f525a-84a6-4ac9-9c08-7023fe11b58b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:43.569574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7a93fb3c-83f5-4172-b4e0-1e178b4ce5ca req-5f6f525a-84a6-4ac9-9c08-7023fe11b58b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.609273 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-7a93fb3c-83f5-4172-b4e0-1e178b4ce5ca req-5f6f525a-84a6-4ac9-9c08-7023fe11b58b service nova] Creating event network-vif-plugged:dd584db5-4cf7-4168-bafd-06d158e73987 for instance 3474cd55-0481-4698-a73f-f4666dc5164e on n-h1-862404-2 Oct 28 18:05:43.629121 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-7a93fb3c-83f5-4172-b4e0-1e178b4ce5ca req-5f6f525a-84a6-4ac9-9c08-7023fe11b58b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102405 Oct 28 18:05:43.631548 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 356/760] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:05:43.743091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:43.744011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:43.757712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:43.760643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:43.763633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.767402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:43.768110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:43.768717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.926428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a580c962-2c3a-447e-943c-12c56c284a96 req-77908293-eea3-4d6f-a377-de79a34e49bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad1f5bd-5eed-4cfa-b39b-09586df2a2fa", "tag": "054624fe-f0fe-4640-8933-f7cf1a970e75"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:43.946480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a580c962-2c3a-447e-943c-12c56c284a96 req-77908293-eea3-4d6f-a377-de79a34e49bf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:43.948635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a580c962-2c3a-447e-943c-12c56c284a96 req-77908293-eea3-4d6f-a377-de79a34e49bf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:43.949307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a580c962-2c3a-447e-943c-12c56c284a96 req-77908293-eea3-4d6f-a377-de79a34e49bf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.984351 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a580c962-2c3a-447e-943c-12c56c284a96 req-77908293-eea3-4d6f-a377-de79a34e49bf service nova] Creating event network-changed:054624fe-f0fe-4640-8933-f7cf1a970e75 for instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa on n-h2-862404-2 Oct 28 18:05:43.989682 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a580c962-2c3a-447e-943c-12c56c284a96 req-77908293-eea3-4d6f-a377-de79a34e49bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067419 Oct 28 18:05:43.993389 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 357/761] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:05:44.020448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:44.026208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:44.044541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.048071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.048735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.049667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.051857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.053546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.232874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:44.244483 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e7f54ac-dbf1-479a-a8e8-24c1acdc8511 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1462 microversion: 2.1 time: 0.505243 Oct 28 18:05:44.249142 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 405/762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:43 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1462 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:44.257071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:44.258206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:44.267496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.268611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.270274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.271621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.272344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.273440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.650505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:44.659914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47243730-ad76-472f-9a87-9d91e21e8fdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.409146 Oct 28 18:05:44.660946 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 406/763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:44 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:44.667571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:44.668790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:44.676575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.677439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.678138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.679112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.679801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.680580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.731625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:44.742444 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-868fd13a-dde6-433a-aea2-05f27517076f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1308 microversion: 2.1 time: 0.747727 Oct 28 18:05:44.748394 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 358/764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:43 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1308 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:44.760619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:44.766003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:44.788500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.789294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.789916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.790805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.791413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.792643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.935492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:44.943544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Old instance type m1.heat2, new instance type m1.heat {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:05:44.959564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:44.960029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:44.960522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:44.960936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:44.961361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:45.039891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:45.072213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b72fc08-f479-4e00-90a2-0addbd5e3f4a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.406999 Oct 28 18:05:45.076048 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 407/765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:44 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:45.091419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:45.096299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:45.116112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.117823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.118628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.135071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.138797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.139487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.178452 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e7c2e0ec-ad8f-4eb3-bc09-a5f5b420d2a6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180/action" status: 202 len: 0 microversion: 2.1 time: 0.428528 Oct 28 18:05:45.183587 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 359/766] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:44 2022] POST /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:45.199495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:45.204337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:45.209420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:45.217894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.221191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.222535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.225118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.228115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.231653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.345877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:45.364985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:45.370794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:45.390518 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75c29cde-0a84-4c65-a707-16871e994583 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.313289 Oct 28 18:05:45.407943 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 408/767] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:45 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:45.690494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:45.691927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:45.704294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.706183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.708432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.712316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.712828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.714120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.002122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:46.022925 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e63bbf35-6b1c-4879-89f7-49734688956d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1471 microversion: 2.1 time: 0.837430 Oct 28 18:05:46.023803 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 360/768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:45 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1471 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:46.045256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:46.046170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:46.072409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:46.073828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:46.075658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.076576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:46.080026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:46.080599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.169849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:46.189811 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e9a0fef4-2ab5-4487-86d1-ce69d671f064 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.503504 Oct 28 18:05:46.190398 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 409/769] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:45 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:46.199514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4f0eaac5-50cd-413e-9c1f-90830367e755 req-c7935498-335c-4486-a7e6-e928a353e5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff5ce91-7082-4c04-92ef-96aa64ec0198", "tag": "08765946-92c3-48db-9dff-7ee1d40f8c0a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:46.243528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:46.248798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f0eaac5-50cd-413e-9c1f-90830367e755 req-c7935498-335c-4486-a7e6-e928a353e5a9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:46.249505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f0eaac5-50cd-413e-9c1f-90830367e755 req-c7935498-335c-4486-a7e6-e928a353e5a9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:46.250862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f0eaac5-50cd-413e-9c1f-90830367e755 req-c7935498-335c-4486-a7e6-e928a353e5a9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.276072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4f0eaac5-50cd-413e-9c1f-90830367e755 req-c7935498-335c-4486-a7e6-e928a353e5a9 service nova] Creating event network-changed:08765946-92c3-48db-9dff-7ee1d40f8c0a for instance aff5ce91-7082-4c04-92ef-96aa64ec0198 on n-h1-862404-2 Oct 28 18:05:46.282295 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4f0eaac5-50cd-413e-9c1f-90830367e755 req-c7935498-335c-4486-a7e6-e928a353e5a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087800 Oct 28 18:05:46.283490 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 410/770] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:46.290237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:46.292079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:46.299071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:46.299771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:46.300438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.301373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:46.302030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:46.302656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.506273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:46.518833 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7e15c6c-ae1f-4152-adf9-d8ca2a180e76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1488 microversion: 2.1 time: 0.475914 Oct 28 18:05:46.519483 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 361/771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:46 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1488 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:46.535729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:46.536683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:46.548080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:46.549250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:46.549903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.550828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:46.551457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:46.551934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.595361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:46.608651 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ee0637f-b0e6-4d95-8213-67b4ae2145f9 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.323693 Oct 28 18:05:46.609260 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 411/772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:46 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:46.644829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58366797-6fc7-4a6c-9c10-85e9d2f6f3e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:46.661144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58366797-6fc7-4a6c-9c10-85e9d2f6f3e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:46.661144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58366797-6fc7-4a6c-9c10-85e9d2f6f3e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:46.668918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58366797-6fc7-4a6c-9c10-85e9d2f6f3e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:46.723239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:46.739075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:46.746334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:46.763125 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c3dbf142-4790-46cb-936f-5b1cffd859f5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.242169 Oct 28 18:05:46.764567 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 362/773] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:46 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:46.842817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-58366797-6fc7-4a6c-9c10-85e9d2f6f3e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:05:47.055366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:47.056515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:47.085861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.086378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.087468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.090116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.090621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.091057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.319130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=7 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:47.335404 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-58366797-6fc7-4a6c-9c10-85e9d2f6f3e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e/action" status: 202 len: 0 microversion: 2.1 time: 0.703969 Oct 28 18:05:47.343019 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 412/774] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:46 2022] POST /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:47.357129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:47.358117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:47.390950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.391584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.392127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.392910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.402436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.403804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:47.430051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.442638 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c55a38f3-a4ab-4a7d-a801-9ce906b4f5f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1471 microversion: 2.1 time: 0.393059 Oct 28 18:05:47.467980 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 363/775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:47 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:47.467980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:47.467980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:47.494748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.495501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.495893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.496622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.497103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.497530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.546881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:47.731181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:47.747145 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97ea0b54-8e4a-4443-8888-eb54b4e33625 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.403083 Oct 28 18:05:47.761846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 413/776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:47 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:47.781856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:47.783333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:47.790994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:47.802679 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c0aa71f7-9f3a-4fbf-a4e9-182e7e7b86ce tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.342165 Oct 28 18:05:47.803345 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 364/777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:47 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:47.804170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.805083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.805701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.806609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.807786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.808585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.813048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3425a90b-7a92-4fde-96fc-dda4c1972059 req-fad217ff-faad-4b34-a745-aca539a3be63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e361a9-879b-4678-84a3-69c90f2b2bed", "name": "network-vif-plugged", "status": "completed", "tag": "d0e3d28b-5b15-4a23-af02-a09d51459806"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:47.828637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3425a90b-7a92-4fde-96fc-dda4c1972059 req-fad217ff-faad-4b34-a745-aca539a3be63 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.829282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3425a90b-7a92-4fde-96fc-dda4c1972059 req-fad217ff-faad-4b34-a745-aca539a3be63 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.829825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3425a90b-7a92-4fde-96fc-dda4c1972059 req-fad217ff-faad-4b34-a745-aca539a3be63 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.841652 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3425a90b-7a92-4fde-96fc-dda4c1972059 req-fad217ff-faad-4b34-a745-aca539a3be63 service nova] Creating event network-vif-plugged:d0e3d28b-5b15-4a23-af02-a09d51459806 for instance 97e361a9-879b-4678-84a3-69c90f2b2bed on n-h1-862404-2 Oct 28 18:05:47.849687 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3425a90b-7a92-4fde-96fc-dda4c1972059 req-fad217ff-faad-4b34-a745-aca539a3be63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044268 Oct 28 18:05:47.851111 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 365/778] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:47.861138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:47.862065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:47.872381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.872954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.873502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.874350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:47.875858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:47.876607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:47.964920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:47.973763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:47.975229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:47.981941 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ada2c855-15ec-41ce-b50f-b7009e91e8fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.129512 Oct 28 18:05:47.982548 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 366/779] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:47 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:48.361575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:48.370441 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9e84f0e5-3b1b-4d88-b65e-548a4cea1328 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.601771 Oct 28 18:05:48.371469 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 414/780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:47 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:48.484234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:48.484779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:48.498171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:48.502193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:48.502823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:48.504570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:48.505208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:48.505643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:48.678563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:48.687800 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d3056e0d-c8b6-4526-b3c1-c8c5910195af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1471 microversion: 2.1 time: 0.208714 Oct 28 18:05:48.688796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 367/781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:48 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:48.774310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:48.775077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:48.784809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:48.785956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:48.786656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:48.787733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:48.788500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:48.789269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:48.832550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:48.833164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:48.839554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:48.840102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:48.840548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:48.841461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:48.842086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:48.842514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:49.055615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:49.090243 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-965dfabd-3590-464e-8120-bdf396ca4d68 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.261579 Oct 28 18:05:49.091399 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 368/782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:48 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:49.099319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:49.105362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:49.106230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:49.108288 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a1739841-8798-4bb9-8a04-41bdbe6a5ce6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.337842 Oct 28 18:05:49.112866 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 415/783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:48 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:49.128803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:49.129313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:49.129756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:49.131946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:49.132683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:49.133279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:49.315457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:49.331293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:49.335335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:49.342351 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-266ad7f2-dbf6-4dfb-acea-663d1e45db1d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.249381 Oct 28 18:05:49.343569 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 369/784] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:49 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:49.394803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:49.395568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:49.407054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:49.409268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:49.410837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:49.411774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:49.412731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:49.413919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:49.621878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:49.632604 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72e34549-b29f-4815-9217-c01a20c970c4 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.241615 Oct 28 18:05:49.634210 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 416/785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:49 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:49.714127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:49.715487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:49.728743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:49.730034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:49.731208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:49.733371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:49.734224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:49.735117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:49.972636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:49.981148 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-85684c42-19fb-4e8a-82be-6337bc6f00d8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1471 microversion: 2.1 time: 0.272454 Oct 28 18:05:49.982069 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 370/786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:49 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:50.115491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:50.116811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:50.124936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:50.125864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:50.126478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:50.127390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:50.127912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:50.128292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:50.140209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:50.140851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:50.158400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:50.158903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:50.159348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:50.160113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:50.160567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:50.161006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:50.328428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:50.339212 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6e328fc6-d403-44b3-b0a1-b4eec089d24f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.206127 Oct 28 18:05:50.340607 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 371/787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:50 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:50.372109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:50.372874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:50.379804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:50.380466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:50.381035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:50.381848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:50.382413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:50.382952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:50.420137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:50.442103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3f565e0-76b6-427f-9162-8f1d371ad6f6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.329473 Oct 28 18:05:50.458093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 417/788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:50 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:50.505437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:50.530643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:50.532937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:50.546196 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5451d3e6-3bb5-4352-8748-cad1be4ef703 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.178697 Oct 28 18:05:50.547151 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 372/789] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:50 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:05:50.663710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:50.670381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:50.679642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:50.681160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:50.681928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:50.682745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:50.683711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:50.684198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.006937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:51.008167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:51.021642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.023613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.026514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.029837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.030583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.031206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.041244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:51.066980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a6e889a-abf6-45fc-9cd4-2dfa2c783263 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1387 microversion: 2.1 time: 0.412693 Oct 28 18:05:51.093143 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 418/790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:50 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1387 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:51.364234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:51.365683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:51.377576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.378088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.378546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.379274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.381558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.385027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.451167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:51.465424 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78feb05e-dfb1-4dd5-9491-f2e8a9f2baf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1471 microversion: 2.1 time: 0.463538 Oct 28 18:05:51.470840 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 373/791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:51 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1471 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:51.487957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:51.488597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:51.495911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:51.509035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.511089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.512138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.513139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.514017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.514679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.653513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:51.664246 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e353d019-9558-4905-8d5d-df103d141903 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.304273 Oct 28 18:05:51.680999 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 419/792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:51 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:51.694096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:51.697658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:51.708382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.709390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.710079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.711073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:51.712226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.713592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.714435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.723621 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d0f22680-5dc7-411f-b27f-67d44abc5efa tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.251598 Oct 28 18:05:51.730925 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 374/793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:51 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:51.738354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:51.742356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:51.756129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.756638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.757092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.757818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.758287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.758724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.767264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-53ff9a85-06f0-4c88-91d9-8b069146721e tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083865 Oct 28 18:05:51.775300 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 420/794] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:05:51 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:51.789833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:51.790426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:51.798033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.798788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.799400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.800460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:51.801146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:51.801806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:51.893422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:51.910773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:51.912216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:51.934356 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e61a0db9-fbf7-4f42-ad3f-cea4b2f4870e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.202205 Oct 28 18:05:51.936231 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 375/795] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:51 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:51.991760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lazy-loading 'services' on Instance uuid 4903a6b7-6be5-4773-8a04-4ba37da9f892 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:05:52.097281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:52.097904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:52.107007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.107744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.108352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.109222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.109673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.110165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.119039 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bdcfa845-5c5c-461a-b291-5efe094b009c tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments/45140ab7-1673-44dd-a474-9ca325fe6e88" status: 202 len: 0 microversion: 2.1 time: 0.338758 Oct 28 18:05:52.123694 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 421/796] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:05:51 2022] DELETE /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments/45140ab7-1673-44dd-a474-9ca325fe6e88 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:52.272811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:52.283609 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e7b8af6e-1448-40b5-b617-7cad4b92995f tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1586 microversion: 2.1 time: 0.191198 Oct 28 18:05:52.296776 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 376/797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:52 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1586 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:52.311415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:52.312284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:52.321066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.321988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.322487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.323856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.324293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.324950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.426138 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-819ee8d3-a00a-4148-bce0-88404150e81a tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120612 Oct 28 18:05:52.426873 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 422/798] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:05:52 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:52.494013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:52.494686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:52.505650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.506546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.507738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.508867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.509498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.510601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.693750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:52.694628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:52.704737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.705224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.705675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.706398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.707124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.707558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.805424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:52.817045 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eeec7c8e-1455-4b43-bdc3-d6d4f62ab77c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.326818 Oct 28 18:05:52.817651 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 377/799] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:52 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:52.844487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:52.845101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:52.860635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.861133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.861575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.864970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.865443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.868070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:53.209520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:53.220530 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d9c201e8-1648-4071-a17f-94bcdfe94784 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.531478 Oct 28 18:05:53.223548 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 423/800] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:52 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:53.236855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:53.237530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:53.252273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:53.263431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:53.265635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:53.266381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:53.267023 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e6082948-95e2-4244-ab11-107622f8373e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.424119 Oct 28 18:05:53.267972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:53.268828 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 378/801] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:52 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:53.269477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:53.271947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:53.311466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:53.533621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:53.555683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:53.565410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:53.580745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdd5d06e-7e7f-49ae-bf42-f8ef5f06f3b1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.356000 Oct 28 18:05:53.584496 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 424/802] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:53 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:53.846091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:53.846835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:53.859084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:53.859773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:53.860316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:53.863396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:53.864055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:53.864618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:54.246622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:54.247255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:54.262680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.264677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.265308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:54.266204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.268208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.268839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:54.285621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:54.295115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-00cdae2c-fc8c-4ecd-900a-372aafdd5158 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.452818 Oct 28 18:05:54.316573 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 379/803] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:53 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:54.328233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:54.331244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:54.348326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.350353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.357300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:54.358922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.359638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.360342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:54.688245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:54.699343 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd40bdea-dd71-4de2-b51c-37ccba1de10b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.456720 Oct 28 18:05:54.741143 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 425/804] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:54 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:54.759488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-83bd6a33-a9a5-4567-85ad-2542eed560b0 req-375c2cf9-7434-455f-bc12-2b897897c945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff5ce91-7082-4c04-92ef-96aa64ec0198", "name": "network-vif-plugged", "status": "completed", "tag": "08765946-92c3-48db-9dff-7ee1d40f8c0a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:54.800594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-83bd6a33-a9a5-4567-85ad-2542eed560b0 req-375c2cf9-7434-455f-bc12-2b897897c945 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.801285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-83bd6a33-a9a5-4567-85ad-2542eed560b0 req-375c2cf9-7434-455f-bc12-2b897897c945 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.801898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-83bd6a33-a9a5-4567-85ad-2542eed560b0 req-375c2cf9-7434-455f-bc12-2b897897c945 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:54.831392 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-83bd6a33-a9a5-4567-85ad-2542eed560b0 req-375c2cf9-7434-455f-bc12-2b897897c945 service nova] Creating event network-vif-plugged:08765946-92c3-48db-9dff-7ee1d40f8c0a for instance aff5ce91-7082-4c04-92ef-96aa64ec0198 on n-h1-862404-2 Oct 28 18:05:54.840428 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-83bd6a33-a9a5-4567-85ad-2542eed560b0 req-375c2cf9-7434-455f-bc12-2b897897c945 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096640 Oct 28 18:05:54.841962 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 426/805] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:54.849110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:54.850994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:54.870201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.883719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.886111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:54.888288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.891246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.892093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.109345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:55.120984 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffd9f399-356f-4252-b7d5-54404fb75d89 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.801776 Oct 28 18:05:55.124895 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 380/806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:54 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:55.147163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:55.148153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:55.162395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:55.167693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:55.168401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.169325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:55.169968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:55.170570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.242427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:55.259566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:55.273652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:55.297350 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b9d71cf6-7b24-4662-8ae1-5ec8b79c334e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.453874 Oct 28 18:05:55.298478 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 427/807] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:54 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:55.311766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5c62f072-8397-4ede-884c-cbef63447129 req-777fe53c-45d8-46dc-9664-1de0e89b32a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e361a9-879b-4678-84a3-69c90f2b2bed", "tag": "d0e3d28b-5b15-4a23-af02-a09d51459806"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:55.330405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c62f072-8397-4ede-884c-cbef63447129 req-777fe53c-45d8-46dc-9664-1de0e89b32a4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:55.330405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c62f072-8397-4ede-884c-cbef63447129 req-777fe53c-45d8-46dc-9664-1de0e89b32a4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:55.330734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c62f072-8397-4ede-884c-cbef63447129 req-777fe53c-45d8-46dc-9664-1de0e89b32a4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.344552 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5c62f072-8397-4ede-884c-cbef63447129 req-777fe53c-45d8-46dc-9664-1de0e89b32a4 service nova] Creating event network-changed:d0e3d28b-5b15-4a23-af02-a09d51459806 for instance 97e361a9-879b-4678-84a3-69c90f2b2bed on n-h1-862404-2 Oct 28 18:05:55.351217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5c62f072-8397-4ede-884c-cbef63447129 req-777fe53c-45d8-46dc-9664-1de0e89b32a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049765 Oct 28 18:05:55.352550 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 428/808] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:55.359871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:55.360668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:55.367877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:55.368510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:55.369157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.370024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:55.370751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:55.371471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.421983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:55.425419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:55.433755 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3fbeff68-23b7-42e4-9660-9d85e18d459b tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1586 microversion: 2.1 time: 0.293093 Oct 28 18:05:55.434357 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 381/809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:55 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1586 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:55.723475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:55.747927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:55.748865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:55.758911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:55.759854 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-634961a0-56a0-4449-bbb5-c34ffdaa3ebd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.401291 Oct 28 18:05:55.760613 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 429/810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:55 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:55.763074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:55.764046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.768138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:55.768635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:55.769082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.978842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:55.988933 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-88fdcf00-4518-4df4-b220-33e6a4ae2469 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1310 microversion: 2.1 time: 0.251034 Oct 28 18:05:55.991032 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 382/811] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:55 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1310 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:56.148222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:56.149105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:56.163015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:56.163699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:56.164302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:56.180652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:56.181466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:56.182198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:56.334891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:56.336030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:56.350541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:56.351401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:56.352113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:56.353076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:56.354352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:56.356017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:56.529042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:56.544433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:56.549576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:56.577218 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f3443a8-b334-4dc9-a8e0-2b000a4b2442 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.237835 Oct 28 18:05:56.578247 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 383/812] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:56 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:56.789778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:56.790644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:56.832934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:56.844190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:56.847721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:56.850850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:56.855385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:56.865930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:57.188579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:57.202343 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba74ae98-2da1-44ce-8266-85b7845acc61 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 1.059229 Oct 28 18:05:57.204956 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 430/813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:56 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:57.211320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:57.211976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:57.241413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:57.241925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:57.242370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:57.243611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:57.244153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:57.244682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:57.403389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:57.412962 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fd0d7a37-94df-42cd-b1e3-f2d802a3e84d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.628742 Oct 28 18:05:57.413566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 384/814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:56 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:57.612269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:57.614120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:57.626035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:57.627012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:57.627633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:57.628842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:57.629472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:57.630094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:57.680707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:57.695267 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33b37b22-7368-43af-ae45-637207c08c4e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1494 microversion: 2.1 time: 0.489095 Oct 28 18:05:57.696219 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 431/815] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:57 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1494 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:57.720715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:57.721676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:57.729292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:57.730373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:57.730978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:57.732048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:57.732700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:57.733609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:57.742133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:57.759080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:57.763796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:57.782236 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a180be2b-2d5b-4f5a-bb8e-c3b590bc7427 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.175205 Oct 28 18:05:57.782870 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 385/816] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:57 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:05:57.996337 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a08ead73-795f-4edc-977f-9708fc42b68f tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1645 microversion: 2.1 time: 0.281144 Oct 28 18:05:57.996933 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 432/817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:57 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1645 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:58.019567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:58.020719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:58.030104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.038050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.038703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.041704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.042636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.045076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.237642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:58.238436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:58.249010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.249656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.250205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.251980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.252222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.253164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.316967 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fc6ec55f-1f1c-4be5-bf66-a3047f455caa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1645 microversion: 2.1 time: 0.301028 Oct 28 18:05:58.317880 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 386/818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:58 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1645 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:58.343589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e3f15ef7-819d-4f96-97bd-44559245f83b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:58.347522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3f15ef7-819d-4f96-97bd-44559245f83b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.348219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3f15ef7-819d-4f96-97bd-44559245f83b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.348826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3f15ef7-819d-4f96-97bd-44559245f83b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.349775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3f15ef7-819d-4f96-97bd-44559245f83b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.350561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3f15ef7-819d-4f96-97bd-44559245f83b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.351156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3f15ef7-819d-4f96-97bd-44559245f83b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.381880 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e3f15ef7-819d-4f96-97bd-44559245f83b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041939 Oct 28 18:05:58.391020 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 387/819] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:05:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:58.403611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:58.404267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:58.412379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.413277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.414022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.414918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.415535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.416929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.451100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:58.460755 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69a5663e-bbd6-403b-a8ab-c4b9de759db5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.233300 Oct 28 18:05:58.461346 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 433/820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:58 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:58.467052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:58.468053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:58.480650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.481718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.482175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.483183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.483607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.484130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.537836 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1723eac6-17fe-424e-90e6-182eb64ef6ee tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198/action" status: 202 len: 0 microversion: 2.1 time: 0.144413 Oct 28 18:05:58.538956 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 388/821] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:58 2022] POST /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:05:58.547976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:58.549595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:58.557802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.558537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.559207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.560486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.560969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.561883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.695231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:58.704617 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-531b52d0-6653-40b2-b839-10a84606d5d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.242071 Oct 28 18:05:58.705480 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 434/822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:58 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:58.817156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:58.818164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:58.829377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.829932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.830543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.831272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.832875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.834274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.890222 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f99bd0f4-bd2e-499e-bc43-79a24deaf0e1 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1650 microversion: 2.1 time: 0.346064 Oct 28 18:05:58.905183 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 389/823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:58 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1650 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:58.975126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:58.988756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:58.991078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:58.997365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ccdd2600-db58-4802-8661-af4ac8197b27 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.186141 Oct 28 18:05:58.998329 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 435/824] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:05:58 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:05:59.484853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:59.485656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:59.492848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:59.493331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:59.494198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:59.494500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:59.494938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:59.495349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:59.730012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:59.731251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:59.738568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:59.741582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:59.742267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:59.743247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:59.744786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:59.745464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:59.746019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:59.756701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:59.765639 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d5c5798-9d9e-4b26-95eb-30ed6530daba tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.285451 Oct 28 18:05:59.766242 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 390/825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:59 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:59.920104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:59.921566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:05:59.924524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:59.931262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:59.932576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:59.933241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:59.934224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:59.934979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a0aacb3-29dc-40d6-b817-597e6081cb8f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.209127 Oct 28 18:05:59.936022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:59.936712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:59.944435 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 436/826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:59 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:00.026643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:00.029521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:00.037254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.038046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.038512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.039227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.039676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.040123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.079809 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a56be818-6763-437c-b08e-9b61b99420d8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059040 Oct 28 18:06:00.081003 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 437/827] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:00 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:06:00.086204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:00.087130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:00.095776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.099048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.100821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.101640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.102972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.108457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.188582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:00.198239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:00.200150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:00.215227 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf9036c8-e4f9-4bdb-bcb8-8cf248ae6695 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.132651 Oct 28 18:06:00.220887 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 438/828] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:00 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:00.222318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:00.225610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:00.232399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.233026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.233559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.234367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.234923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.235458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.276305 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-12299df9-4a03-4123-9b48-7c97a09a1f29 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058067 Oct 28 18:06:00.277269 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 439/829] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:00 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:06:00.324049 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5ab772c2-3c41-45b4-b908-19f502f06fb2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1630 microversion: 2.1 time: 0.410249 Oct 28 18:06:00.325796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 391/830] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:59 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1630 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:00.351678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862404-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:00.354568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:00.360463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.361040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.361553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.362479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.363017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.363292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:00.363596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.363797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:00.373278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.374084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.374750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.375992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.377727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.378537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.447323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:06:00.469316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lazy-loading 'flavor' on Instance uuid aff5ce91-7082-4c04-92ef-96aa64ec0198 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:00.527174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Going to try to live migrate instance to n-h2-862404-2 {{(pid=120680) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:06:00.627043 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04ba8a4e-89a7-4791-a756-944b5defe092 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 204 len: 0 microversion: 2.1 time: 0.269368 Oct 28 18:06:00.628117 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 392/831] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:06:00 2022] DELETE /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:06:00.630673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:00.638003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:00.640718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:00.653840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.657467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.658085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.659954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.662115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.662570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.960304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:00.969174 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e645a424-293d-4074-a503-c0812b59ccc8 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1681 microversion: 2.1 time: 0.336292 Oct 28 18:06:00.970863 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 393/832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:00 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1681 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:00.976920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:00.977812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:00.988342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:00.989179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:00.997314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.999181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:01.001174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:01.003310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:01.229755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:01.237467 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-944647d0-4737-42b8-b8d1-4e107b4f63ab tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.265178 Oct 28 18:06:01.238042 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 394/833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:00 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:01.242996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:01.243643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:01.249590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:01.250070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:01.250500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:01.251188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:01.251638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:01.252152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:01.570807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:01.579018 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e165a7da-2347-4b47-8911-171ec1c250ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.340028 Oct 28 18:06:01.579596 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 395/834] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:01 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:01.584649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:01.585277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:01.591747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:01.592342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:01.592956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:01.593652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:01.594108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:01.594726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:01.616269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:01.664844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:01.673867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:01.675620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:01.681059 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f942eec-01d9-40e2-8746-858e2ee0706a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.100368 Oct 28 18:06:01.681877 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 396/835] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:01 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:01.998064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:01.998669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:02.004717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.005204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.005638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.006334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.006786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.007213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.226282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:02.240872 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ab2243e8-fc0b-46a3-a317-9c7ce7ada5ec tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1681 microversion: 2.1 time: 0.246996 Oct 28 18:06:02.258443 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 397/836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:01 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:02.263521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:02.264161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:02.273242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.273354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.273751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.274501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.275155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.275777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.644599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:02.653147 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f95a5a66-7277-4a5c-8d2b-20763608e837 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.393520 Oct 28 18:06:02.653726 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 398/837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:02 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:02.667684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:02.668494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:02.674975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.675663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.676126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.676823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.677277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.677699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.876283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:02.886336 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cceb9b7c-a8b5-4d67-8d4e-a99c8cb72410 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.231128 Oct 28 18:06:02.886882 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 399/838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:02 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:02.891608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:02.892255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:02.904397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.904912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.905354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.912832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.913403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.913845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:03.006350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:03.018815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:03.020334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:03.032398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7bc7c579-0444-4a5a-b6dd-44db649e3ca4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.144333 Oct 28 18:06:03.033428 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 400/839] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:02 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:03.267667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:03.270210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:03.279950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:03.280596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:03.281131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:03.282047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:03.282712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:03.283206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:03.526887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:03.537206 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-962fe12b-1cd0-42c2-9bc5-3f9496b8fa66 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1681 microversion: 2.1 time: 0.274513 Oct 28 18:06:03.538121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 401/840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:03 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:03.680115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:03.681045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:03.688238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:03.688979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:03.689416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:03.690415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:03.691062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:03.691484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:03.899376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:03.910769 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0bec09cd-ec0b-43d1-af4d-8b3ab4206eac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.235891 Oct 28 18:06:03.924698 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 402/841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:03 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:03.935691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:03.936744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:03.943321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:03.944066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:03.944888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:03.945682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:03.946381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:03.946827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.014435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e12b557c-3262-472e-a9a7-9226ff683f7a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198/action" status: 202 len: 0 microversion: 2.1 time: 3.666554 Oct 28 18:06:04.018168 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 440/842] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:06:00 2022] POST /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198/action => generated 0 bytes in 3671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:06:04.024201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:04.025244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:04.049978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.050510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.050934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.051657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.052153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.052582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.230418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:04.243505 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2f945132-7ee2-4b93-8edf-46aef60ddd33 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.317395 Oct 28 18:06:04.247554 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 403/843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:03 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:04.255776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:04.257675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:04.266015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.266775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:04.267450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.268351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.271169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.272201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.272863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.278377 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a343b05c-fc9b-452a-9ea1-e632d2a0d04b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1504 microversion: 2.1 time: 0.258713 Oct 28 18:06:04.284780 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 441/844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:04 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:04.387203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:04.435939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:04.437631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:04.454454 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2180d3de-44b1-46ed-94be-db07f7c04717 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1558 microversion: 2.91 time: 0.204883 Oct 28 18:06:04.456341 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 404/845] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:04 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:04.471392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e6395c6f-d80c-45ec-9918-e8a99a68b33d req-f0103447-85e6-4bb5-894f-a54373c1bd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4903a6b7-6be5-4773-8a04-4ba37da9f892", "name": "network-vif-deleted", "tag": "ab693c9c-62a7-4740-a0b7-d6103bcfb486"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:04.482967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e6395c6f-d80c-45ec-9918-e8a99a68b33d req-f0103447-85e6-4bb5-894f-a54373c1bd2e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.483805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e6395c6f-d80c-45ec-9918-e8a99a68b33d req-f0103447-85e6-4bb5-894f-a54373c1bd2e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.484759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e6395c6f-d80c-45ec-9918-e8a99a68b33d req-f0103447-85e6-4bb5-894f-a54373c1bd2e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.501419 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e6395c6f-d80c-45ec-9918-e8a99a68b33d req-f0103447-85e6-4bb5-894f-a54373c1bd2e service nova] Creating event network-vif-deleted:ab693c9c-62a7-4740-a0b7-d6103bcfb486 for instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 on n-h2-862404-2 Oct 28 18:06:04.506714 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e6395c6f-d80c-45ec-9918-e8a99a68b33d req-f0103447-85e6-4bb5-894f-a54373c1bd2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039351 Oct 28 18:06:04.508018 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 442/846] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:04.565217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:04.566065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:04.574258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.575052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.575666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.576434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.576893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.577325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.698262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cfefffc1d24ac2baab212eb85a67f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39852f78ac9d456285d7f5adf8c6393a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:04.710672 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-52cf1b86-464d-4ed1-b7ab-3e06cb25d254 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 200 len: 1326 microversion: 2.1 time: 0.153066 Oct 28 18:06:04.722679 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 405/847] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:04 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 1326 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:04.942082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:04.943088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:04.955143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.955643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.957068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.958278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:04.958745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:04.959276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.131338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:05.141168 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-962bd6af-f469-4511-a811-d53402391802 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.204077 Oct 28 18:06:05.141772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 443/848] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:04 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:05.273741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:05.275337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:05.282591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.283088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.283960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.284676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.285138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.285856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.311364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:05.313008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:05.323585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.324121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.324566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.327364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.328056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.328652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.440416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:05.455036 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8cd47bb2-fc9a-4263-b3a8-9350b45d6bc0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.184514 Oct 28 18:06:05.468891 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 406/849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:05 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:05.491468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:05.498196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:05.508671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.509650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.510517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.511506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.512345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.512933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.550842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:05.567506 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fda7bdb5-66d6-4af3-a8e6-4e445833ea83 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1504 microversion: 2.1 time: 0.262117 Oct 28 18:06:05.568650 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 444/850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:05 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:05.659422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:05.669734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:05.671271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:05.677792 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b333bf13-646f-48c4-b29c-3231741ff426 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1558 microversion: 2.91 time: 0.192009 Oct 28 18:06:05.679904 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 407/851] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:05 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:05.735482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:05.736427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:05.743655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.745235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.746057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.746952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.747605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.748290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.770727 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] HTTP exception thrown: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Request method failure captured: Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 HTTP/1.1 Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBliURkGqoV8zKLfX2aZSGFdORr-PTzMBOKH1Y8A_1w4rTWflF-H27ch4GBoSaPQJv85la9Ybax6jLdMyL2Ctwb8jm1y0rvu4u2EkY5VhTJQthLK1PVZ2FLvw1cVX7dZQdiKX3mNyImkEVPZ9PXq1gXNXJtw1Ehv-p55kZvFTcSeg70 Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 39852f78ac9d456285d7f5adf8c6393a Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:06:05.772718 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39852f78ac9d456285d7f5adf8c6393a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 39852f78ac9d456285d7f5adf8c6393a Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachSCSIVolumeTestJSON-742045293-project Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e5cfefffc1d24ac2baab212eb85a67f4 Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-742045293-project Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:05.774347 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4903a6b7-6be5-4773-8a04-4ba37da9f892'} Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:06:05.775364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:05.777742 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:06:05.779074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Returning 404 to user: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:06:05.779074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b300eecd-3d9b-4d95-b940-b051711f7fd0 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 404 len: 111 microversion: 2.1 time: 0.047125 Oct 28 18:06:05.779603 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 445/852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:05 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:06:05.789890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-88a818d7-c031-4f92-b49b-91b957ee8944 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '.version_select at 0x7f78de8f79d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:05.818329 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-88a818d7-c031-4f92-b49b-91b957ee8944 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274057998" status: 202 len: 0 microversion: 2.1 time: 0.033428 Oct 28 18:06:05.818940 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 408/853] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274057998 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:06:05.999061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fc64344b-bfa0-46b9-80ad-0d33f29f0db7 req-955263fb-8c83-4db1-a3e0-7ea67709abcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff5ce91-7082-4c04-92ef-96aa64ec0198", "name": "network-vif-unplugged", "status": "completed", "tag": "08765946-92c3-48db-9dff-7ee1d40f8c0a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:06.022845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fc64344b-bfa0-46b9-80ad-0d33f29f0db7 req-955263fb-8c83-4db1-a3e0-7ea67709abcb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.023314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fc64344b-bfa0-46b9-80ad-0d33f29f0db7 req-955263fb-8c83-4db1-a3e0-7ea67709abcb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.023778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fc64344b-bfa0-46b9-80ad-0d33f29f0db7 req-955263fb-8c83-4db1-a3e0-7ea67709abcb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.044880 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fc64344b-bfa0-46b9-80ad-0d33f29f0db7 req-955263fb-8c83-4db1-a3e0-7ea67709abcb service nova] Creating event network-vif-unplugged:08765946-92c3-48db-9dff-7ee1d40f8c0a for instance aff5ce91-7082-4c04-92ef-96aa64ec0198 on n-h1-862404-2 Oct 28 18:06:06.053137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fc64344b-bfa0-46b9-80ad-0d33f29f0db7 req-955263fb-8c83-4db1-a3e0-7ea67709abcb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057434 Oct 28 18:06:06.054277 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 446/854] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:06.164969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:06.167683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:06.174891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.175543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.176438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.177321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.178027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.178922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.367994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:06.379515 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1099c3bc-4987-4f62-acd3-320e06000744 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.218796 Oct 28 18:06:06.380984 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 409/855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:06 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:06.476529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20e3e053-06ca-4537-b0c4-8aaae5ce4307 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Action: 'update', calling method: .version_select at 0x7f78de95ea60>, body: {"quota_set": {"ram": "5120"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:06.482195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:06.482975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:06.491287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.492911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.493907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.497402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.498203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.498806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.554524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20e3e053-06ca-4537-b0c4-8aaae5ce4307 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.555141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20e3e053-06ca-4537-b0c4-8aaae5ce4307 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.555686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20e3e053-06ca-4537-b0c4-8aaae5ce4307 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.557245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20e3e053-06ca-4537-b0c4-8aaae5ce4307 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.557999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20e3e053-06ca-4537-b0c4-8aaae5ce4307 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.558549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20e3e053-06ca-4537-b0c4-8aaae5ce4307 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.624709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-20e3e053-06ca-4537-b0c4-8aaae5ce4307 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/a8ace3bf4abe454c8fc5f64a17906b54" status: 200 len: 148 microversion: 2.57 time: 0.304551 Oct 28 18:06:06.625862 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 447/856] 10.222.0.16 () {62 vars in 1303 bytes} [Fri Oct 28 18:06:06 2022] PUT /compute/v2.1/os-quota-sets/a8ace3bf4abe454c8fc5f64a17906b54 => generated 148 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:06:06.634382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:06.635371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:06.642882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.643427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.643975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.644869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.645341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.645776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.678212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:06.687470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a7dbefe4-ee29-4cec-870b-f16284df3cb1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.210265 Oct 28 18:06:06.688421 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 410/857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:06 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:06.693797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-44af5160-8973-44c6-b6b1-221120a3201c tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Calling method '.version_select at 0x7f78dec730d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:06.774033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44af5160-8973-44c6-b6b1-221120a3201c tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.774680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44af5160-8973-44c6-b6b1-221120a3201c tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.776756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44af5160-8973-44c6-b6b1-221120a3201c tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.777980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44af5160-8973-44c6-b6b1-221120a3201c tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.778662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44af5160-8973-44c6-b6b1-221120a3201c tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.779300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44af5160-8973-44c6-b6b1-221120a3201c tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.794839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:06.805493 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-44af5160-8973-44c6-b6b1-221120a3201c tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a8ace3bf4abe454c8fc5f64a17906b54/detail" status: 200 len: 463 microversion: 2.57 time: 0.115432 Oct 28 18:06:06.807439 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 411/858] 10.222.0.16 () {60 vars in 1304 bytes} [Fri Oct 28 18:06:06 2022] GET /compute/v2.1/os-quota-sets/a8ace3bf4abe454c8fc5f64a17906b54/detail => generated 463 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:06:06.813109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:06.814000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:06.823360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.824321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.824991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.825702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.826163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.827216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.923202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:06.940243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:06.951804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:06.971143 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3b712976-13c8-4ce6-af89-f8d5fcc72640 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.161924 Oct 28 18:06:06.996847 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 412/859] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:06 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:07.029968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Action: 'update', calling method: .version_select at 0x7f78de4eb670>, body: {"quota_set": {"ram": "2048"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:07.073161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:07.082181 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c4c7cdb-5d77-487a-8dd0-1501c1fa563e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1504 microversion: 2.1 time: 0.454004 Oct 28 18:06:07.089649 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 448/860] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:06 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:07.138989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.139483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.139945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.140670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.141120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.141541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.202798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.203577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.204206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.205087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.205694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.206345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.299842 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-58165271-47da-4a16-9f9e-edfa844c35b2 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/a8ace3bf4abe454c8fc5f64a17906b54?user_id=65c81229e4a44c58b8b4092eaa8f0dd3" status: 200 len: 148 microversion: 2.57 time: 0.273379 Oct 28 18:06:07.300964 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 413/861] 10.222.0.16 () {62 vars in 1384 bytes} [Fri Oct 28 18:06:07 2022] PUT /compute/v2.1/os-quota-sets/a8ace3bf4abe454c8fc5f64a17906b54?user_id=65c81229e4a44c58b8b4092eaa8f0dd3 => generated 148 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:06:07.311705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-49e4afcb-402f-4d42-a915-33955dcca199 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] Calling method '.version_select at 0x7f78de30cb80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:07.407616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:07.409255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:07.437015 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-49e4afcb-402f-4d42-a915-33955dcca199 tempest-QuotasAdminTestV257-828207033 tempest-QuotasAdminTestV257-828207033-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/a8ace3bf4abe454c8fc5f64a17906b54?user_id=65c81229e4a44c58b8b4092eaa8f0dd3" status: 200 len: 190 microversion: 2.57 time: 0.127508 Oct 28 18:06:07.443716 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 449/862] 10.222.0.16 () {60 vars in 1364 bytes} [Fri Oct 28 18:06:07 2022] GET /compute/v2.1/os-quota-sets/a8ace3bf4abe454c8fc5f64a17906b54?user_id=65c81229e4a44c58b8b4092eaa8f0dd3 => generated 190 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:06:07.447193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.451568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.452093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.456170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.458071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.458071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.692418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:07.704603 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2d2bb6f9-db42-49bd-9c4c-3cd8b31828d2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.302293 Oct 28 18:06:07.712381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:07.713426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:07.716670 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 414/863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:07 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:07.748836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.749206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.749651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.750891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.751741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.752087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.001779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:08.010718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:08.011791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:08.027537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71e7de64-762e-422c-a776-56565d332137 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.314995 Oct 28 18:06:08.028414 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 450/864] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:07 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:08.032091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.032757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.033498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.034220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.034674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.035197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.039983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:08.082298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ddf810e4-68ac-41d9-a024-f87c589e2b9e req-de8c08bd-8998-46f4-99c9-2fbbc6eb9e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff5ce91-7082-4c04-92ef-96aa64ec0198", "tag": "08765946-92c3-48db-9dff-7ee1d40f8c0a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:08.125838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ddf810e4-68ac-41d9-a024-f87c589e2b9e req-de8c08bd-8998-46f4-99c9-2fbbc6eb9e15 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.127845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ddf810e4-68ac-41d9-a024-f87c589e2b9e req-de8c08bd-8998-46f4-99c9-2fbbc6eb9e15 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.130499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ddf810e4-68ac-41d9-a024-f87c589e2b9e req-de8c08bd-8998-46f4-99c9-2fbbc6eb9e15 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.170338 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ddf810e4-68ac-41d9-a024-f87c589e2b9e req-de8c08bd-8998-46f4-99c9-2fbbc6eb9e15 service nova] Creating event network-changed:08765946-92c3-48db-9dff-7ee1d40f8c0a for instance aff5ce91-7082-4c04-92ef-96aa64ec0198 on n-h1-862404-2 Oct 28 18:06:08.179144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:08.184573 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ddf810e4-68ac-41d9-a024-f87c589e2b9e req-de8c08bd-8998-46f4-99c9-2fbbc6eb9e15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106082 Oct 28 18:06:08.195969 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 451/865] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:08.200939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:08.202848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:08.210069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:08.210792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:08.219011 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c15180b4-5787-44cd-bf17-f2aa8d8c5c45 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.220611 Oct 28 18:06:08.226875 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 415/866] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:07 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:08.229038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.229741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.230330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.231190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.232467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.233062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.426969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:08.437336 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c79d55da-352f-4919-ae06-61f5fde73da9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1504 microversion: 2.1 time: 0.239768 Oct 28 18:06:08.437936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 452/867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:08 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:08.732828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:08.743853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:08.753265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.753265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.753265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.754892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.755893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.757556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.054325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:09.055531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:09.075942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.076777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.077454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.078334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.078789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.079214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.258992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:09.270216 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be4f3939-d68c-4d5b-89e7-f3f76846ba0e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.220950 Oct 28 18:06:09.271348 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 453/868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:09 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:09.278497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:09.279319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:09.287254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.287986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.290817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.292699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.293615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.294350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.373137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:09.376251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:09.381089 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5af45c1-f758-4d5c-b9e7-a7da7e138699 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.653737 Oct 28 18:06:09.385529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:09.387250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:09.396339 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75849bde-1063-4185-bbcd-783c3f0ea16e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.123490 Oct 28 18:06:09.397916 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 454/869] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:09 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:09.398337 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 416/870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:08 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:09.462352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:09.464641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:09.472015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.472708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.473845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.474830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.475456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.476059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.696107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:09.707845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-46942107-0e7a-40f3-89ba-26b1f8680eb6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1504 microversion: 2.1 time: 0.249737 Oct 28 18:06:09.708764 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 455/871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:09 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:10.297567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:10.298834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:10.310944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.311476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.320050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.320919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.321415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.321869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.414405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:10.415629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:10.434241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.435011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.438059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.438808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.439269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.439696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.606214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:10.617825 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6de11ac3-2f9e-4163-8cd8-8efebe229285 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.324037 Oct 28 18:06:10.618570 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 417/872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:10 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:10.623870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:10.623982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:10.636222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.636835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.637275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.642657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.643513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.646480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.735994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:10.737188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:10.743574 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cfc02b0-e64f-4ad7-a2e3-ce096cf6e8e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.333332 Oct 28 18:06:10.745026 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 456/873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:10 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:10.746633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:10.748247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:10.754539 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-702a0349-64e9-425d-8fd3-0494327fab4d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.134608 Oct 28 18:06:10.767323 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 418/874] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:10 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:10.767683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:10.767683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:10.780317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.780317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.780317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.780317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.780874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.780874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.052129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:11.064016 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-604c301e-6b75-4ee2-b9d2-731ecfcdcaa3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1504 microversion: 2.1 time: 0.316772 Oct 28 18:06:11.065161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 457/875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:10 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:11.645602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:11.646233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:11.668626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:11.669137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:11.669614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.670340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:11.670804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:11.671231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.770785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:11.771411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:11.786604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:11.787025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:11.787474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.788236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:11.790711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:11.794197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.949063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:11.976842 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2755ca7b-70db-4c5d-9043-4f4676992323 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.337204 Oct 28 18:06:11.988960 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 419/876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:11 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:12.004867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:12.005486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:12.022174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:12.022685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:12.030158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:12.035252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:12.035836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:12.036293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:12.177151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:12.213125 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0fc0bb28-3c1b-439f-b288-da1ecf67711b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.442085 Oct 28 18:06:12.213783 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 458/877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:11 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:12.225520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:12.230911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:12.247198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:12.250855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:12.251320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:12.254785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:12.255265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:12.257973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:12.388821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:12.397601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:12.399335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:12.405360 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7ad2903d-a786-4050-979c-e04f9c884adf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.404410 Oct 28 18:06:12.406269 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 420/878] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:11 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:12.575395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:12.596069 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-66c81900-f33a-470d-bb6c-623726dc4ef0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1504 microversion: 2.1 time: 0.379911 Oct 28 18:06:12.596995 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 459/879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:12 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:13.019748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:13.021239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:13.031934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.032697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.033354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.034612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.037296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.038175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.107652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1277721892", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": "none"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:13.184350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:06:13.185310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:06:13.185999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:06:13.186676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:06:13.187316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:06:13.200065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.201327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.202015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.202973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.203648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.204538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.237397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Getting quotas for project 356ee4a9601740a48504914f711c2158. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:13.244843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Getting quotas for user 8393485692fd4cf9b7fde1f618bd6792 and project 356ee4a9601740a48504914f711c2158. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:13.259309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:06:13.262596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:06:13.346101 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f553c79-8064-4663-b2d2-43cfc8b8c40a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.453280 Oct 28 18:06:13.357202 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 421/880] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:06:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:06:13.372332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:13.373492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:13.385403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.386065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.387965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.389017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.389700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.390463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.426324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.437693 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e10e13a3-3cc4-4a51-a4ec-38c9a1ab1cc4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.424902 Oct 28 18:06:13.441241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 460/881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:13 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:13.452437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e08582f-2cf0-494d-b2de-555e42c35933 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:13.455312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e08582f-2cf0-494d-b2de-555e42c35933 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:13.648083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e08582f-2cf0-494d-b2de-555e42c35933 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.659801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e08582f-2cf0-494d-b2de-555e42c35933 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.661678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e08582f-2cf0-494d-b2de-555e42c35933 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.669395 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e08582f-2cf0-494d-b2de-555e42c35933 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "PUT /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1359 microversion: 2.75 time: 0.227053 Oct 28 18:06:13.670317 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 461/882] 10.222.0.16 () {62 vars in 1297 bytes} [Fri Oct 28 18:06:13 2022] PUT /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:13.686409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.693260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:13.696273 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-30353f14-2322-45c6-a277-e485939e7a8c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1498 microversion: 2.1 time: 0.335171 Oct 28 18:06:13.698119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:13.704029 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 422/883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:13 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1498 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:13.708467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.709224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.712266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.713671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.715057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.715762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.725287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:13.726247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:13.739986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.740516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.740958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.742990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.743461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.743911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.748753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:13.777825 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] HTTP exception thrown: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Request method failure captured: Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 HTTP/1.1 Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBliURkGqoV8zKLfX2aZSGFdORr-PTzMBOKH1Y8A_1w4rTWflF-H27ch4GBoSaPQJv85la9Ybax6jLdMyL2Ctwb8jm1y0rvu4u2EkY5VhTJQthLK1PVZ2FLvw1cVX7dZQdiKX3mNyImkEVPZ9PXq1gXNXJtw1Ehv-p55kZvFTcSeg70 Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 39852f78ac9d456285d7f5adf8c6393a Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:06:13.785922 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39852f78ac9d456285d7f5adf8c6393a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 39852f78ac9d456285d7f5adf8c6393a Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachSCSIVolumeTestJSON-742045293-project Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e5cfefffc1d24ac2baab212eb85a67f4 Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-742045293-project Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:13.787272 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '4903a6b7-6be5-4773-8a04-4ba37da9f892'} Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:06:13.788044 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:13.789291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:13.790514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Returning 404 to user: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:06:13.790514 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-06e3dd0d-edad-4d90-938b-550a6aa7f586 tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 404 len: 111 microversion: 2.1 time: 0.077939 Oct 28 18:06:13.792922 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 423/884] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:06:13 2022] DELETE /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:06:13.802066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:13.802725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:13.815280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.815710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.816172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.816880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.817334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.817755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.940227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.964080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.966785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.973625 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b32ad30-b495-443a-b4e0-5fa08ef5539a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.301794 Oct 28 18:06:13.974662 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 462/885] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:13 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:14.004946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73ec85a7-2141-49b1-a96d-f583640668df tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:14.005859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73ec85a7-2141-49b1-a96d-f583640668df tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:14.078646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:14.104170 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8c9829d1-2d76-44c5-a586-3c202a4fe199 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1504 microversion: 2.1 time: 0.293244 Oct 28 18:06:14.105607 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 424/886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:13 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:14.112047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73ec85a7-2141-49b1-a96d-f583640668df tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:14.118537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:14.125324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73ec85a7-2141-49b1-a96d-f583640668df tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:14.128872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] [instance: 4903a6b7-6be5-4773-8a04-4ba37da9f892] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:14.136629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73ec85a7-2141-49b1-a96d-f583640668df tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:14.151635 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73ec85a7-2141-49b1-a96d-f583640668df tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1359 microversion: 2.75 time: 0.158026 Oct 28 18:06:14.153436 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 463/887] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:13 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:14.154406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.154901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.155337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.156074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.156526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.156946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.188704 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] HTTP exception thrown: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Request method failure captured: Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 HTTP/1.1 Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBliURkGqoV8zKLfX2aZSGFdORr-PTzMBOKH1Y8A_1w4rTWflF-H27ch4GBoSaPQJv85la9Ybax6jLdMyL2Ctwb8jm1y0rvu4u2EkY5VhTJQthLK1PVZ2FLvw1cVX7dZQdiKX3mNyImkEVPZ9PXq1gXNXJtw1Ehv-p55kZvFTcSeg70 Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 39852f78ac9d456285d7f5adf8c6393a Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:06:14.190437 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39852f78ac9d456285d7f5adf8c6393a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39852f78ac9d456285d7f5adf8c6393a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 39852f78ac9d456285d7f5adf8c6393a Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-742045293 Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachSCSIVolumeTestJSON-742045293-project Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e5cfefffc1d24ac2baab212eb85a67f4 Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-742045293-project Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:14.191930 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '4903a6b7-6be5-4773-8a04-4ba37da9f892'} Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:06:14.192793 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. Oct 28 18:06:14.193938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:06:14.202529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] Returning 404 to user: Instance 4903a6b7-6be5-4773-8a04-4ba37da9f892 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:06:14.203738 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-53c29f32-00b7-4240-a273-2c8b2513118b tempest-AttachSCSIVolumeTestJSON-742045293 tempest-AttachSCSIVolumeTestJSON-742045293-project] 10.222.0.16 "GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892" status: 404 len: 111 microversion: 2.1 time: 0.095876 Oct 28 18:06:14.204343 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 425/888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:14 2022] GET /compute/v2.1/servers/4903a6b7-6be5-4773-8a04-4ba37da9f892 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:06:14.472792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:14.473549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:14.503275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.503946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.504407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.505219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.508523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.510690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.714188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:14.724070 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40012848-6b5e-4317-9644-4c3c3ea4d63a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.258528 Oct 28 18:06:14.724588 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 464/889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:14 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:14.730653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:14.731488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:14.737633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.738166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.738601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.739301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.739750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.740241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.013406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.014432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:15.032752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.033635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.037522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.038524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.039277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.041771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.101197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:15.114901 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-69f38f83-ef69-4889-858a-7c23b5479254 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 200 len: 1475 microversion: 2.1 time: 0.388704 Oct 28 18:06:15.118435 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 426/890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:14 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 1475 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:15.133564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.135115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:15.151977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.155552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.156232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.157111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.157724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.158788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.208573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:15.219111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:15.221285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:15.226994 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb288b86-af11-431c-a4d4-23999554738a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.220294 Oct 28 18:06:15.254113 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 465/891] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:15.260898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-884205643"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:15.264672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:15.273544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.274506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.277396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.285957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.287528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.290054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.441257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:15.461713 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f7596805-7e82-44bd-9e2a-d1a84f8ce1f3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1479 microversion: 2.1 time: 0.331990 Oct 28 18:06:15.463316 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 427/892] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1479 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:15.474856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.477123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:15.491451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.493111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.493783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.495209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.495986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.496597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.646535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:15.660953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:15.662493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:15.680199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b465888e-3919-449b-bc97-f1f566f7df95 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1411 microversion: 2.75 time: 0.214935 Oct 28 18:06:15.682321 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 428/893] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1411 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:15.682607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aba7c328-9294-4e0b-b049-3d24dc13c604 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e/action" status: 202 len: 0 microversion: 2.1 time: 0.425053 Oct 28 18:06:15.684427 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 466/894] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:06:15 2022] POST /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:06:15.695479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e08a042c-c9f2-466c-9718-df9ab32be4b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de4e5700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.704191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c7f9ff3d-5eb0-4fa6-8a14-c08a3b60d136 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '.version_select at 0x7f78de734820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.709460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7f9ff3d-5eb0-4fa6-8a14-c08a3b60d136 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.709935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7f9ff3d-5eb0-4fa6-8a14-c08a3b60d136 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.710382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7f9ff3d-5eb0-4fa6-8a14-c08a3b60d136 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.734444 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c7f9ff3d-5eb0-4fa6-8a14-c08a3b60d136 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.050131 Oct 28 18:06:15.758040 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 429/895] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:15.771656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.772990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:15.781408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.782579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.783179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.784151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.784763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.785364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.790528 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e08a042c-c9f2-466c-9718-df9ab32be4b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.100189 Oct 28 18:06:15.792034 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 467/896] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:15.808817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.814043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:15.818599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:15.835226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.838984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.839980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.843589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.844326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.844939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:16.025291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:16.029560 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-027447bf-f281-4ad0-a5a2-0517310bf60c tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1630 microversion: 2.1 time: 0.235245 Oct 28 18:06:16.030742 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 468/897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1630 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:16.036108 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7309545a-a66f-4346-914d-3eaebee4baee tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.276883 Oct 28 18:06:16.036887 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 430/898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:16.083727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4978441d-cabf-41b6-b3e1-6f4debbf3c23 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Action: 'create', calling method: .version_select at 0x7f78de314430>, body: {"keypair": {"name": "tempest-keypair-1431406984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC2mnXf8Pcn2f73k0/Cw9US0mZqjfN7cvuw/wG7JmBNVkuH495P3FUk3gbFzh0/K15HDTD6VMkaFmKmF0HYHtSVVQ4GG+tQZ+Sfc06BLjefOKLlwzvNNC6PrE/2aHIVIA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:16.104183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-4978441d-cabf-41b6-b3e1-6f4debbf3c23 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for project 8253dbe510dd462f974f37fce0a5d990. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:16.115829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-4978441d-cabf-41b6-b3e1-6f4debbf3c23 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for user 12dea4e86fd14c07859b48e22493b9dd and project 8253dbe510dd462f974f37fce0a5d990. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:16.154517 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4978441d-cabf-41b6-b3e1-6f4debbf3c23 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076128 Oct 28 18:06:16.172815 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 469/899] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:06:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:16.263612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:16.264298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:16.273045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:16.276586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:16.277248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:16.278161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:16.280528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:16.282264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:16.416516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:16.432985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:16.435033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:16.449385 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8cc6842d-91e3-4185-a9d0-25ba86a48b3f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.190613 Oct 28 18:06:16.453497 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 431/900] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:16 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:16.714037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:16.718585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:16.719225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:16.729890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:16.732135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:16.733240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:16.734625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:16.735238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:16.735867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:16.808384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53b8d8d7-e359-4c1e-aab8-fb40bced5fbb tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de816430>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:16.819223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:16.853133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:16.856253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:16.875721 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7296afcf-9da5-4ccf-9736-1a7bf8f062ef tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1417 microversion: 2.75 time: 0.159899 Oct 28 18:06:16.877067 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 470/901] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:16 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1417 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:16.893176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-53b8d8d7-e359-4c1e-aab8-fb40bced5fbb tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.090417 Oct 28 18:06:16.895078 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 432/902] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:16 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:17.078337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:17.079425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:17.088463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.094287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.095294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.096980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.099837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.100286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.518899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:17.519511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:17.530595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.531465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.532868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.537072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.537757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.538390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.553067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:17.565640 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffbbbe21-d684-4fcb-99df-294808f6c218 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.510164 Oct 28 18:06:17.569698 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 471/903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:17 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:17.667605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:17.676646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:17.678103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:17.693717 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e2436fb-fb7f-4594-970a-8159185c5d3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.179809 Oct 28 18:06:17.707844 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 433/904] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:17 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:17.909014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:17.910322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:17.914758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-47086e34-74bd-45a5-beac-481fffea2e7f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de3169d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:17.927260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.928125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.929015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.930855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.932654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.935023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.995510 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-47086e34-74bd-45a5-beac-481fffea2e7f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.085001 Oct 28 18:06:17.996890 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 434/905] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:17 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:18.178423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:18.202252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:18.205276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:18.214231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ecbbd16-2b9d-414c-b8d7-24d335461582 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1417 microversion: 2.75 time: 0.308884 Oct 28 18:06:18.215618 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 472/906] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:17 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1417 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:18.596385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:18.597234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:18.647087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:18.649918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:18.653585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:18.659345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:18.660267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:18.665563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:18.726141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:18.727116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:18.743733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:18.748281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:18.750359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:18.753201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:18.755903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:18.761391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:18.918119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:18.927997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:18.932087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:18.940484 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3ad4902-56b5-40c6-864d-196c1248f747 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.218530 Oct 28 18:06:18.953522 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 473/907] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:18 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:19.002393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2056065809", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "93172da3-2cc7-4d23-b5e8-59c944e1e4c4"}], "security_groups": [{"name": "tempest-securitygroup--314984857"}], "key_name": "tempest-keypair-1431406984", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:19.194755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] validate_networks() for [('93172da3-2cc7-4d23-b5e8-59c944e1e4c4', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:06:19.236183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:19.249498 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f442f586-7487-483a-90c9-41869561f952 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.657042 Oct 28 18:06:19.251379 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 435/908] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:18 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:19.264191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea33c001-d8ed-449c-a16f-9431d0be6e09 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de816a60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:19.335799 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea33c001-d8ed-449c-a16f-9431d0be6e09 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.081656 Oct 28 18:06:19.340611 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 436/909] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:19 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:19.356278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:19.358951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:19.372597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.373098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.377575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:19.378416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.383947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.384691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:19.424684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:19.591019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:19.607374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:19.608859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:19.624613 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6cd6a3b0-9915-4ae6-839e-7b46bae615f1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1417 microversion: 2.75 time: 0.282406 Oct 28 18:06:19.647133 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 437/910] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:19 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1417 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:19.917237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:06:19.917927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:06:19.918855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:06:19.919430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:06:19.919923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:06:19.930939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.932875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.933659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:19.934973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.935348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.936352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:19.968859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for project 8253dbe510dd462f974f37fce0a5d990. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:19.974446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for user 12dea4e86fd14c07859b48e22493b9dd and project 8253dbe510dd462f974f37fce0a5d990. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:19.975004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:19.975739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:19.989475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:19.992401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:06:19.993718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.996894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:06:19.997607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.998103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:19.999061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.002957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.003451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.126480 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-358920ab-b4b5-4d8e-979d-416f2a83a717 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.128617 Oct 28 18:06:20.128198 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 474/911] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:06:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:06:20.145046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71830fdc-3919-4a0a-802e-e435b506c0f2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:20.147202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71830fdc-3919-4a0a-802e-e435b506c0f2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:20.168273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.180345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.181908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.201419 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-77e5e29c-9833-46e9-b667-3a96aed58ed1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.230497 Oct 28 18:06:20.205204 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 438/912] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:19 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:20.228687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71830fdc-3919-4a0a-802e-e435b506c0f2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.239089 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71830fdc-3919-4a0a-802e-e435b506c0f2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1235 microversion: 2.1 time: 0.103182 Oct 28 18:06:20.241298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 475/913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:20 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1235 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:20.277394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:20.278248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:20.292520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.295550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.296132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.297677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.298888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.300406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.356544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8741d4d-9a3e-4392-9e26-c40f4a302a6f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de31f160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:20.436760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8741d4d-9a3e-4392-9e26-c40f4a302a6f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.084991 Oct 28 18:06:20.438332 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 476/914] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:20 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:20.641152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.655466 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cbd46d3b-d3b2-411e-aead-f9c74dc6ce78 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.384616 Oct 28 18:06:20.656611 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 439/915] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:20 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:20.665766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:20.670922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:20.681210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.682061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.682891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.684411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.684885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.685319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.817472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.828800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.830265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.843534 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca361cea-a0fa-43c2-8a99-872083206264 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1438 microversion: 2.75 time: 0.183400 Oct 28 18:06:20.844174 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 477/916] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:20 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1438 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:20.871549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:20.874572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:20.883284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.884171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.884982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.885993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.886611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.887194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.996389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:06:20.997161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:06:20.997971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:06:20.998636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:06:20.999210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:06:21.116430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:21.124348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.125734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.126419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.127384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.128272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.129100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.238315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:21.242615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:21.270603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.271631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.274343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.275639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.276802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.280868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.282912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.287611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.294585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.308504 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f28f1312-56c0-4666-9657-5a32b3574601 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "POST /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe/action" status: 202 len: 1495 microversion: 2.75 time: 0.436777 Oct 28 18:06:21.309219 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 440/917] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:06:20 2022] POST /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe/action => generated 1495 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 18:06:21.332902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:21.333567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:21.345779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.346315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.348003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.348913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.349383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.349816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.472871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.489508 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fda345fb-0495-4b6c-99e4-eea4e7d237da tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1231 microversion: 2.1 time: 0.176888 Oct 28 18:06:21.499919 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 441/918] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:21 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1231 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:21.500150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.500268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:21.500268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:21.507649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.507649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.509568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.510061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.510499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.511203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.511658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.516353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.524426 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2660eccc-74b7-45d7-9554-bc75a6d16fef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.287470 Oct 28 18:06:21.528219 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 478/919] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:21 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:21.556316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-28c3c1d1-804e-43b0-b172-d2f3b64decf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de31f820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:21.612447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.627917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.629789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.632990 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-28c3c1d1-804e-43b0-b172-d2f3b64decf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.103143 Oct 28 18:06:21.636428 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 479/920] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:21 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:21.651731 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a5e1c94f-baa1-4d24-b031-2ae240adc19b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.160463 Oct 28 18:06:21.664131 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 442/921] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:21 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:21.694999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:21.696348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:21.719451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.721854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.722460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.725680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.729943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.730854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.972220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.979143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c079bd57-26e8-40e9-84bf-b1fca8c457a1 req-8e141f36-e8a4-476a-8a19-3d78515fbcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3474cd55-0481-4698-a73f-f4666dc5164e", "name": "network-vif-plugged", "status": "completed", "tag": "dd584db5-4cf7-4168-bafd-06d158e73987"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:21.989287 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4f0de53-5ce3-4e7c-8e7b-a0961798abfe tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.309150 Oct 28 18:06:21.989947 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 480/922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:21 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:21.990082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c079bd57-26e8-40e9-84bf-b1fca8c457a1 req-8e141f36-e8a4-476a-8a19-3d78515fbcb3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.000672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c079bd57-26e8-40e9-84bf-b1fca8c457a1 req-8e141f36-e8a4-476a-8a19-3d78515fbcb3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.001291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c079bd57-26e8-40e9-84bf-b1fca8c457a1 req-8e141f36-e8a4-476a-8a19-3d78515fbcb3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.020701 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c079bd57-26e8-40e9-84bf-b1fca8c457a1 req-8e141f36-e8a4-476a-8a19-3d78515fbcb3 service nova] Creating event network-vif-plugged:dd584db5-4cf7-4168-bafd-06d158e73987 for instance 3474cd55-0481-4698-a73f-f4666dc5164e on n-h1-862404-2 Oct 28 18:06:22.028804 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c079bd57-26e8-40e9-84bf-b1fca8c457a1 req-8e141f36-e8a4-476a-8a19-3d78515fbcb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054064 Oct 28 18:06:22.029760 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 443/923] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:22.516347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:22.516966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:22.533252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.534028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.534644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.535522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.536168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.536751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.559366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:22.560684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:22.576135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.576845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.577448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.578352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.584610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.585338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.651776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:22.665526 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ee16a6d-e9c4-49ad-83ba-a7849509cc08 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1293 microversion: 2.1 time: 0.153143 Oct 28 18:06:22.667411 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 481/924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:22 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:22.672881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec996de4-3a30-4eaa-8dff-965ab6772e4c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2bd310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:22.744875 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec996de4-3a30-4eaa-8dff-965ab6772e4c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.075471 Oct 28 18:06:22.745726 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 482/925] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:22 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:22.761486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:22.762484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:22.786704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:22.794504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.797826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.798702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.800434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.804482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.805766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.867969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:22.870670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:22.878545 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23349a68-c3a8-44cb-bc52-3b187f82c03f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.327203 Oct 28 18:06:22.879183 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 444/926] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:22 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:22.984865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:23.002484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:23.005334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:23.017710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:23.018341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:23.031268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:23.031700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:23.032881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:23.033928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:23.034644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:23.035218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:23.058911 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ece24f5e-5b4a-45fe-9a14-6813b2b26210 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.298652 Oct 28 18:06:23.065223 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 483/927] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:22 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:23.219432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=11 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:23.252363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=20 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:23.358705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:23.398875 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e20bc464-7052-4cbc-8efd-f3fb2d2c9237 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.387822 Oct 28 18:06:23.418472 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 445/928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:23 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:23.693657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:23.694940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:23.716149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:23.716974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:23.718074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:23.719516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:23.720988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:23.721666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:23.766824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e8be8e4d-da1d-4084-b77f-ac8d25753cb6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2abc10>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:23.846584 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e8be8e4d-da1d-4084-b77f-ac8d25753cb6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.089495 Oct 28 18:06:23.855606 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 446/929] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:23 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:23.909063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:23.910002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:23.928194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:23.930615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:23.932810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:23.933796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:23.941452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:23.942095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:24.008622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.018834 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f00937f3-8450-4ffe-8d36-c4a076e2fe7a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.329947 Oct 28 18:06:24.024785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 484/930] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:23 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:24.079115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.089240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.090732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.094905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:24.095529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:24.101143 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ce18f57-1795-4099-96f9-ca7a69f4e86f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.197407 Oct 28 18:06:24.105588 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 447/931] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:23 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:24.105768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:24.106237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:24.106745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:24.107578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:24.115956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:24.116468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:24.170800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:24.235686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.246836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.253049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.261524 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ddf2022-4f1f-4e9e-b2ce-a65b2bd7c9f2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.170774 Oct 28 18:06:24.263903 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 485/932] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:24 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:24.429383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:24.430254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:24.441803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:24.442528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:24.445698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:24.446595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:24.448947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:24.449506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:24.804497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.813930 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a69e3c63-f4b9-45ed-a86e-7ba431818a8e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1476 microversion: 2.1 time: 0.388572 Oct 28 18:06:24.814534 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 448/933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:24 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1476 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:24.863178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c453dedf-85a4-452b-958d-b2db12031784 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2bd700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:24.955215 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c453dedf-85a4-452b-958d-b2db12031784 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.096810 Oct 28 18:06:24.957762 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 486/934] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:24 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:25.049597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:25.050233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:25.061614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.062278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.062729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.063454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.065443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.066120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.139779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:25.141362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:25.156702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.157523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.160498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.161806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.162932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.165235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.271386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.288786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.305036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.315469 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38574572-faa9-45aa-ae15-a05a4a155734 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1535 microversion: 2.91 time: 0.183674 Oct 28 18:06:25.317285 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 487/935] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:25 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1535 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:25.323764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:25.324654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:25.332567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.333307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.333890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.334756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.335388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.336001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.434717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.446252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.448923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.460490 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cfdbfd78-f87a-4657-9ec1-03215b83b804 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.140873 Oct 28 18:06:25.462078 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 488/936] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:25 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:25.814427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.840258 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fc382f25-da8e-434f-b0f9-f7be76e16db5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.785499 Oct 28 18:06:25.841554 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 449/937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:25 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:25.841973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:25.843852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:25.855909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.856499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.856962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.857694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.862039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.862597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.973587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d185ce3f-8470-4047-87e3-1b1bbe1d0ddf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2d73a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:26.042215 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d185ce3f-8470-4047-87e3-1b1bbe1d0ddf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.073615 Oct 28 18:06:26.043664 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 450/938] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:25 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:26.089913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5644b7ec-a977-4e94-b034-0b2a8fe305e9 req-57a2d329-abf0-4922-b4ab-03beb48f00ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0", "tag": "3fb4b6a0-8291-4a9c-b539-9a95bb69a89d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:26.118178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5644b7ec-a977-4e94-b034-0b2a8fe305e9 req-57a2d329-abf0-4922-b4ab-03beb48f00ed service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.120136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5644b7ec-a977-4e94-b034-0b2a8fe305e9 req-57a2d329-abf0-4922-b4ab-03beb48f00ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.121122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5644b7ec-a977-4e94-b034-0b2a8fe305e9 req-57a2d329-abf0-4922-b4ab-03beb48f00ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.142213 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5644b7ec-a977-4e94-b034-0b2a8fe305e9 req-57a2d329-abf0-4922-b4ab-03beb48f00ed service nova] Creating event network-changed:3fb4b6a0-8291-4a9c-b539-9a95bb69a89d for instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 on n-h1-862404-2 Oct 28 18:06:26.154733 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5644b7ec-a977-4e94-b034-0b2a8fe305e9 req-57a2d329-abf0-4922-b4ab-03beb48f00ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066332 Oct 28 18:06:26.156176 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 451/939] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:26.235857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:26.244315 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6e9bbf6-766d-45ce-96a2-b89cdb5577dc tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1475 microversion: 2.1 time: 0.409485 Oct 28 18:06:26.260366 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 489/940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:25 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:26.349501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:26.350499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:26.364916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.365755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.366427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.367371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.368076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.369368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.496645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:26.497572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:26.507280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.510915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.511676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.514326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.515055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.517048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.600344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:26.614386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:26.624543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:26.633017 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f8613b72-8938-4563-83b7-d3aecb1b833c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1535 microversion: 2.91 time: 0.288112 Oct 28 18:06:26.640200 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 452/941] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:26 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1535 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:26.716096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:26.727006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:26.731915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:26.743298 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56b759c8-9cc9-4e94-b40e-df27135c515f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.253851 Oct 28 18:06:26.766350 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 490/942] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:26 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:26.878866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:26.879494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:26.900671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.903745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.904505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.906652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.907938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.908471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.062600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b9dce85-82dd-411e-8191-7be4fa365fb9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de30c8b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:27.169586 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b9dce85-82dd-411e-8191-7be4fa365fb9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.113178 Oct 28 18:06:27.171867 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 491/943] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:27 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:27.275907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:27.278086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:27.286318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.287076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.287684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.288679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.289302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.290015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.516493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:27.526984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-10940aaa-dbd9-4c83-8c94-fa3edfa1ee3f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1475 microversion: 2.1 time: 0.256156 Oct 28 18:06:27.528636 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 492/944] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:27 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1475 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:27.562071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:27.569774 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b27bab78-8347-4dce-9789-4f88c0bef29b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.699732 Oct 28 18:06:27.591233 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 453/945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:26 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:27.665265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:27.667062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:27.677274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.677861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.678367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.679280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.679918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.680500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.777629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:27.781055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:27.781589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:27.786999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:27.788698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.789594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:27.790345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.792693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.794059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.794754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.795407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.795780 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43f2143e-201e-4f3a-8306-6ef97e831c4f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1538 microversion: 2.91 time: 0.134822 Oct 28 18:06:27.807851 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 493/946] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:27 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1538 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:27.827345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:27.830247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:27.858603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.860451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.862235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.863240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.865036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.865934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.970179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:27.999730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862404-2". {{(pid=120680) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 28 18:06:27.999985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:28.003192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:28.019627 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f3a8a49-9586-462f-b4cc-83dae2680070 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.242290 Oct 28 18:06:28.021598 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 454/947] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:27 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:28.135144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2ce070c-2f52-4bb0-abcb-0b112dd201e5 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4/action" status: 202 len: 0 microversion: 2.91 time: 0.311888 Oct 28 18:06:28.136674 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 494/948] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:06:27 2022] POST /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:06:28.144265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:28.146521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:28.157058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:28.158445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:28.159047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:28.159948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:28.161076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:28.161659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:28.167005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:28.191333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3eb23a37-0aef-401d-a1fc-822ab0d72239 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de30c820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:28.291213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3eb23a37-0aef-401d-a1fc-822ab0d72239 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.105305 Oct 28 18:06:28.296029 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 495/949] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:28 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:28.297454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:28.306635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:28.308113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:28.316988 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b008824a-f72e-45cb-bb0a-0b652d8d7563 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1486 microversion: 2.91 time: 0.176119 Oct 28 18:06:28.336138 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 455/950] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:28 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1486 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:28.558862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:28.559688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:28.569116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:28.575716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:28.576254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:28.576703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:28.577429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:28.577919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:28.580706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:28.605977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:28.606812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:28.639537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:28.643356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:28.644270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:28.646934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:28.649480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:28.650225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:28.859212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:28.870768 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67dee21c-d76c-4393-a8f9-b2a60575e47f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1473 microversion: 2.1 time: 0.316918 Oct 28 18:06:28.871576 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 496/951] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:28 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1473 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:28.914299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:28.925760 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a048f779-c269-43d4-95d9-b13a7e98afe3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.330382 Oct 28 18:06:28.946908 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 456/952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:28 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:29.036447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8cbbbd4f-ef20-4f6f-910a-bd4830190adb req-0d3c1e7e-b550-452a-853d-709e86480fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9552def0-8a91-498a-900a-150434e38180", "name": "network-vif-unplugged", "status": "completed", "tag": "f5e0147a-caa4-4d4c-9805-66b3014a3b54"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:29.052149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:29.052902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:29.063671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.066468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8cbbbd4f-ef20-4f6f-910a-bd4830190adb req-0d3c1e7e-b550-452a-853d-709e86480fff service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.066950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8cbbbd4f-ef20-4f6f-910a-bd4830190adb req-0d3c1e7e-b550-452a-853d-709e86480fff service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.067376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8cbbbd4f-ef20-4f6f-910a-bd4830190adb req-0d3c1e7e-b550-452a-853d-709e86480fff service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.068483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.069223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.070877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.080725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.081417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.113941 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8cbbbd4f-ef20-4f6f-910a-bd4830190adb req-0d3c1e7e-b550-452a-853d-709e86480fff service nova] Creating event network-vif-unplugged:f5e0147a-caa4-4d4c-9805-66b3014a3b54 for instance 9552def0-8a91-498a-900a-150434e38180 on n-h2-862404-2 Oct 28 18:06:29.134659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-8cbbbd4f-ef20-4f6f-910a-bd4830190adb req-0d3c1e7e-b550-452a-853d-709e86480fff service nova] Instance 9552def0-8a91-498a-900a-150434e38180 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:06:29.148609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8cbbbd4f-ef20-4f6f-910a-bd4830190adb req-0d3c1e7e-b550-452a-853d-709e86480fff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116939 Oct 28 18:06:29.149463 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 497/953] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:29.211401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:29.220797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:29.223448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:29.230789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5083de31-c2b3-40d5-8bdd-4c4a4c8c80f6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.182508 Oct 28 18:06:29.231696 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 457/954] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:29 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:29.310764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5efb3da1-c395-4498-8698-aab189f9aea4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de31f670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:29.348996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:29.349625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:29.356630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.357121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.358525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.359950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.360603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.361199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.366491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5efb3da1-c395-4498-8698-aab189f9aea4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.060411 Oct 28 18:06:29.369637 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 498/955] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:29 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:29.459657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:29.471596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:29.473066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:29.478915 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cb19b75e-2e5f-4b99-8632-bdf79793b5ef tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1486 microversion: 2.91 time: 0.134877 Oct 28 18:06:29.479884 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 458/956] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:29 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1486 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:29.896247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:29.897003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:29.903772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.904308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.904815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.905684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.906154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.906593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.953446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:29.955899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:29.957945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:29.970328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.972313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.973188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.974192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.974887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.975551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:30.136504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.148449 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-166a7ca0-6769-47da-81cd-adfb285a4069 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1473 microversion: 2.1 time: 0.255437 Oct 28 18:06:30.150607 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 499/957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:29 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:30.261345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:30.261983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:30.265186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=28 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:30.279226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:30.279734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:30.281385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:30.283740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:30.285355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:30.286155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:30.392754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.408292 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-58fa6d38-8d26-48f3-8ce3-d502a5beccbe tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.452983 Oct 28 18:06:30.411846 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 459/958] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:29 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:30.419419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.422714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e793c97a-3628-4a6e-9254-38efbce625ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2d7430>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:30.438234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.442596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.452199 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-70617f63-a82e-424d-8ff7-95a2d9f8a9ac tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.196904 Oct 28 18:06:30.457075 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 500/959] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:30 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:30.510259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:30.510926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:30.524057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:30.524606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:30.525609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:30.526358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:30.526811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:30.541275 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e793c97a-3628-4a6e-9254-38efbce625ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.127967 Oct 28 18:06:30.541864 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 460/960] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:30 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:30.550409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:30.747052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.766281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.768226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.778287 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fcaacfbd-2901-462a-9a83-70a176cc76ae tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1488 microversion: 2.91 time: 0.271950 Oct 28 18:06:30.782663 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 501/961] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:30 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1488 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:31.180298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:31.182234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:31.195444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.200975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.202005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.204878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.206532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.207512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.438380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:31.440004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:31.454542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.458678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.460036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.461004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.461685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.462390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.650967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:31.652785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:31.664029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-407c051a-8e0d-42e9-9145-a1ea8d4dd091 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.224944 Oct 28 18:06:31.666498 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 502/962] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:31 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:31.672031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:31.672906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:31.676721 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fbb5d6a2-5a00-4638-9756-2d452268be93 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1470 microversion: 2.1 time: 0.501739 Oct 28 18:06:31.682730 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 461/963] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:31 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1470 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:31.691171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.700539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.701293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.702417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.703194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a8e6fab9-e3cf-46e4-9e59-44200085597d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de4eb700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:31.706474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.712193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.794079 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a8e6fab9-e3cf-46e4-9e59-44200085597d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1413 microversion: 2.1 time: 0.109926 Oct 28 18:06:31.810197 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 462/964] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:31 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:31.836819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:31.852932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:31.865130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.872061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.875028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.878501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.879584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.882012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.890544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:31.900374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:31.903684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:31.909823 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d9905a13-1c16-440a-a9c0-17a2268123b5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.241766 Oct 28 18:06:31.911353 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 503/965] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:31 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:31.916309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:31.917176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:31.936068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.937625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.938353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.939857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.941257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.941922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:32.020468 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-01165510-5df5-4c64-9291-b796146d300c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180/action" status: 204 len: 0 microversion: 2.1 time: 0.208017 Oct 28 18:06:32.027537 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 463/966] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:06:31 2022] POST /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180/action => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:06:32.036352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:32.047140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:32.048437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:32.049020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:32.050772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:32.071962 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd05aca6-4fbc-42bc-8890-b21be940b6b4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.145100 Oct 28 18:06:32.071962 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 504/967] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:31 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:32.098419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:32.100465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:32.101205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:32.104901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:32.105635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:32.106401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:32.690227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:32.691998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:32.709739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:32.711352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:32.715774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:32.719719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:32.722300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:32.722973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:32.734823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:32.744848 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b80fbd33-6409-45d6-89f5-ebe75ebb767e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1470 microversion: 2.1 time: 0.715891 Oct 28 18:06:32.745440 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 464/968] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:32 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1470 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:32.745748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:32.817923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffe45d06-0422-4e0d-8200-2e2e85286804 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2d7820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:33.415230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:33.426865 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-57fa0758-05c0-446f-97c6-6a94b01f8e0e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.737852 Oct 28 18:06:33.427722 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 505/969] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:32 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:33.447706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:33.459179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:33.474087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:33.479459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:33.484087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:33.488707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:33.496578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:33.498737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:33.741209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:33.763152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:33.767367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:33.791529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-182550b5-2453-4735-a621-67a8c71b935f tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.362510 Oct 28 18:06:33.803488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 506/970] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:33 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:33.824077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:33.832783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:33.862817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:33.866027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:33.869559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:33.872823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:33.891804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:33.892519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:34.088976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:34.104851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:34.109377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:34.126855 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6cbc1ed-5b8e-400a-bf7c-33d6eb00856c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.320523 Oct 28 18:06:34.129852 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 507/971] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:33 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:34.154742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:34.164231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:34.207452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:34.209953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:34.213140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:34.215180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:34.218767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:34.221040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:34.638289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:34.656019 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae25bcc1-ce9e-4529-a9b0-20686c141f45 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1470 microversion: 2.1 time: 0.522651 Oct 28 18:06:34.657965 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 508/972] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:34 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1470 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:34.676250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:34.677448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:34.701025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:34.710068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:34.710897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:34.711933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:34.712712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:34.713574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.098760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:35.113437 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2edb124b-c9c9-4431-b6a6-00a164523a82 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.449305 Oct 28 18:06:35.117865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 509/973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:34 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:35.136423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:35.137879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:35.153395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.153908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.160601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.165985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.166520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.166975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.355190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:35.376386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:35.380183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:35.409468 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68a1ac3a-3664-4529-9dc3-f1c714a7a87a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.281476 Oct 28 18:06:35.414258 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 510/974] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:35 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:35.426628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:35.427254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:35.448326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.448819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.449325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.451345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.451860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.452873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.600879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:35.621988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:35.626036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:35.642737 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1c8ce834-0b4d-4d8d-b5f0-801995f583b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.227304 Oct 28 18:06:35.644067 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 511/975] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:35 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:35.657488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5db20de5-7ced-43a2-941d-3cb1f909fe03 req-f322e9b0-dab8-46db-9a99-13573db55a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0", "name": "network-vif-plugged", "status": "completed", "tag": "3fb4b6a0-8291-4a9c-b539-9a95bb69a89d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:35.693882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5db20de5-7ced-43a2-941d-3cb1f909fe03 req-f322e9b0-dab8-46db-9a99-13573db55a20 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.694449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5db20de5-7ced-43a2-941d-3cb1f909fe03 req-f322e9b0-dab8-46db-9a99-13573db55a20 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.694808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5db20de5-7ced-43a2-941d-3cb1f909fe03 req-f322e9b0-dab8-46db-9a99-13573db55a20 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.727629 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5db20de5-7ced-43a2-941d-3cb1f909fe03 req-f322e9b0-dab8-46db-9a99-13573db55a20 service nova] Creating event network-vif-plugged:3fb4b6a0-8291-4a9c-b539-9a95bb69a89d for instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 on n-h1-862404-2 Oct 28 18:06:35.743162 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5db20de5-7ced-43a2-941d-3cb1f909fe03 req-f322e9b0-dab8-46db-9a99-13573db55a20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095447 Oct 28 18:06:35.744877 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 512/976] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:35.782128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:35.786542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:35.817116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.824000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.824486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.829356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.835436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.838398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:36.215700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:36.249029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6aa4c1e-d54b-443c-bd93-d2cc171ea150 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1462 microversion: 2.1 time: 0.502646 Oct 28 18:06:36.253638 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 513/977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:35 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1462 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:36.268699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:36.273050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:36.285033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:36.285033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:36.285033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:36.285033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:36.285403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:36.285684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:36.826711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:36.836006 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1949c5bc-9b68-43ac-9540-36195d44c5fb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1360 microversion: 2.1 time: 0.580871 Oct 28 18:06:36.840027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 514/978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:36 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1360 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:36.870082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:36.871169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:36.881917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:36.886598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:36.887430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:36.888440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:36.889123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:36.893416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:37.161815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:37.170666 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6ba772f-0b7e-4cad-b37d-f178276ab155 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1462 microversion: 2.1 time: 0.314905 Oct 28 18:06:37.184863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 515/979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:36 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1462 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:37.184863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:37.184863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:37.200423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:37.200423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:37.200423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:37.200423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:37.200905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:37.200905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:37.717428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:37.726938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:37.729273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:37.754060 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95bac389-97e3-4968-9023-830b11ef22c6 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.578417 Oct 28 18:06:37.760620 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 516/980] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:37 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:37.771340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:37.771994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:37.790059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:37.790982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:37.791478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:37.792321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:37.792793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:37.796628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:37.996984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:38.015751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:38.020810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:38.045306 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-066c8f88-92f8-4941-97cf-77822747a4e5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.283049 Oct 28 18:06:38.050235 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 517/981] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:37 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:38.094245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b786cecd-0f5b-4627-a4b7-b43ca3ef468c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'create', calling method: .version_select at 0x7f78de368310>, body: {"keypair": {"name": "tempest-keypair-1990892983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa/nCBTUwyrJrdvQtVLPTvpYGwh+nvHxOMSS/41mgrVku5aJQjjnx1Fjgdekg+jLYygYtijRzMWABp98o3plWtT1mHAo4pWSiITwPtnsPP8PPZlMxt83fx0JiQGpE5b0A=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:38.150932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b786cecd-0f5b-4627-a4b7-b43ca3ef468c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for project a7811accf3d64bc290bc90a33952b51f. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:38.165343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b786cecd-0f5b-4627-a4b7-b43ca3ef468c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for user 3415953e10c445bfa3dcc5a3335826c8 and project a7811accf3d64bc290bc90a33952b51f. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:38.224452 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b786cecd-0f5b-4627-a4b7-b43ca3ef468c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156467 Oct 28 18:06:38.226365 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 518/982] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:06:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:38.239261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:38.240394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:38.258742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:38.259892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:38.263844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:38.265731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:38.266449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:38.267109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:38.768304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:38.782103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99287b34-e886-48f6-84db-83aa494b260f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1543 microversion: 2.1 time: 0.554123 Oct 28 18:06:38.789385 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 519/983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:38 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1543 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:38.802802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9e5aebf0-a1c4-4bf6-9000-5f614ac5414a req-d60003b8-e91f-4361-bff6-cd1b940fc3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9552def0-8a91-498a-900a-150434e38180", "name": "network-vif-plugged", "status": "completed", "tag": "f5e0147a-caa4-4d4c-9805-66b3014a3b54"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:38.872684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9e5aebf0-a1c4-4bf6-9000-5f614ac5414a req-d60003b8-e91f-4361-bff6-cd1b940fc3ca service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:38.875491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9e5aebf0-a1c4-4bf6-9000-5f614ac5414a req-d60003b8-e91f-4361-bff6-cd1b940fc3ca service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:38.878603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9e5aebf0-a1c4-4bf6-9000-5f614ac5414a req-d60003b8-e91f-4361-bff6-cd1b940fc3ca service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:38.926656 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9e5aebf0-a1c4-4bf6-9000-5f614ac5414a req-d60003b8-e91f-4361-bff6-cd1b940fc3ca service nova] Creating event network-vif-plugged:f5e0147a-caa4-4d4c-9805-66b3014a3b54 for instance 9552def0-8a91-498a-900a-150434e38180 on n-h2-862404-2 Oct 28 18:06:38.939315 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9e5aebf0-a1c4-4bf6-9000-5f614ac5414a req-d60003b8-e91f-4361-bff6-cd1b940fc3ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144827 Oct 28 18:06:38.944184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 520/984] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:38.957125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:38.959453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:38.976046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:38.976820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:38.977434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:38.978564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:38.980418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:38.981058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:39.835128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid dad1f5bd-5eed-4cfa-b39b-09586df2a2fa {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:39.873392 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c47014ed-f4fa-4a10-ab61-3d6c9971409d tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 2342 microversion: 2.25 time: 0.927646 Oct 28 18:06:39.879453 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 521/985] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:38 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 2342 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:39.893094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:39.893939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:39.906139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:39.910077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:39.912446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:39.926514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:39.928646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:39.929093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.175240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:40.194254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:40.197958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:40.248410 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1d382cc9-b37c-4880-a11f-0c7ef117eab1 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.367098 Oct 28 18:06:40.264063 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 522/986] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:39 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:40.285530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:40.285974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:40.292776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:40.293276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:40.293820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.294419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:40.295511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:40.295511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.478698 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a0ba3dcf-a527-4d92-8adf-60c1e5bc0745 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.212732 Oct 28 18:06:40.488464 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 523/987] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:06:40 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:40.495977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:40.496610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:40.521731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:40.522665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:40.523297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.524245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:40.527708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:40.533096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.621890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:41.179014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:41.204404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:41.207177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:41.234673 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3a5a222-3e43-4090-8e22-ba2c42bb6852 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.744970 Oct 28 18:06:41.270988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 524/988] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:40 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:41.284306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cde61064-3491-4fff-bdb7-81f43ef9078a tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:41.294912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cde61064-3491-4fff-bdb7-81f43ef9078a tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.308602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cde61064-3491-4fff-bdb7-81f43ef9078a tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.309226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cde61064-3491-4fff-bdb7-81f43ef9078a tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.310185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cde61064-3491-4fff-bdb7-81f43ef9078a tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.310771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cde61064-3491-4fff-bdb7-81f43ef9078a tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.312565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cde61064-3491-4fff-bdb7-81f43ef9078a tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.404752 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cde61064-3491-4fff-bdb7-81f43ef9078a tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.132139 Oct 28 18:06:41.405565 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 525/989] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 18:06:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:06:41.429715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:41.430490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:41.461051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.462744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.463439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.464600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.465178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.465731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.592739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:41.602736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:41.617071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:41.623878 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7996329d-8819-49b5-a554-5bf143478681 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.215555 Oct 28 18:06:41.625174 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 526/990] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:41 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:42.095923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=68 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:42.277028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:42.278778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:42.292722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:42.293546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:42.294395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:42.295373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:42.299163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:42.299928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:42.744212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:42.756446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:42.788868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:42.795479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:42.807714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:42.812117 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13073e63-1115-497e-a6de-377338fd6101 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.539275 Oct 28 18:06:42.816574 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 527/991] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:42 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:42.829879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:42.833426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:42.855981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:42.861909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:42.866858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:42.872291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:42.876641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:42.877734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.112615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:43.129753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:43.167665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:43.202424 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00719dba-67e6-45e8-ab5b-455f5bd08340 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.380593 Oct 28 18:06:43.208960 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 528/992] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:42 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:43.637022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c56feae-d03d-4f52-8b36-67ce4cd67a9e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '.version_select at 0x7f78de2ee9d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:43.641801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c56feae-d03d-4f52-8b36-67ce4cd67a9e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.642474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c56feae-d03d-4f52-8b36-67ce4cd67a9e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.645000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c56feae-d03d-4f52-8b36-67ce4cd67a9e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.677985 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c56feae-d03d-4f52-8b36-67ce4cd67a9e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.047071 Oct 28 18:06:43.679498 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 529/993] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:06:43 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:43.713952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef46c9b6-86c0-4d3c-afd9-20dcdd8da8fb tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:43.723689 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef46c9b6-86c0-4d3c-afd9-20dcdd8da8fb tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014006 Oct 28 18:06:43.738449 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 530/994] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:06:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:43.746922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84f76020-6a6b-41bf-8e83-508971a6b8d0 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-725570611", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:43.858559 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84f76020-6a6b-41bf-8e83-508971a6b8d0 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.118754 Oct 28 18:06:43.859698 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 531/995] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Oct 28 18:06:43 2022] POST /compute/v2.1/flavors => generated 498 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:43.865587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:43.867616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:43.879467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.880527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.881230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.882202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.883061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.884915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.980689 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffe45d06-0422-4e0d-8200-2e2e85286804 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1422 microversion: 2.1 time: 11.169320 Oct 28 18:06:43.991904 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 465/996] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:32 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1422 bytes in 11181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:44.017174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9272dd34-e545-43f8-af7e-b4f4887b142e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:44.049581 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9272dd34-e545-43f8-af7e-b4f4887b142e tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.056305 Oct 28 18:06:44.053735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:44.075999 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 466/997] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 18:06:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:06:44.085456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:44.087916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:44.098079 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-18a444c6-0745-492a-9527-461b34a186d6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.236800 Oct 28 18:06:44.099259 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 532/998] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:43 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:44.099768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-54ba96bd-53c3-451e-a8ec-c5b743f67cb3 req-c38ba333-d8e2-4ca9-adbc-235e51067317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0", "tag": "3fb4b6a0-8291-4a9c-b539-9a95bb69a89d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:44.108270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf7f1eaa-73b6-4a2e-93a6-bdf617002051 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2ec550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:44.141092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-54ba96bd-53c3-451e-a8ec-c5b743f67cb3 req-c38ba333-d8e2-4ca9-adbc-235e51067317 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:44.141583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-54ba96bd-53c3-451e-a8ec-c5b743f67cb3 req-c38ba333-d8e2-4ca9-adbc-235e51067317 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:44.142106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-54ba96bd-53c3-451e-a8ec-c5b743f67cb3 req-c38ba333-d8e2-4ca9-adbc-235e51067317 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:44.200045 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-54ba96bd-53c3-451e-a8ec-c5b743f67cb3 req-c38ba333-d8e2-4ca9-adbc-235e51067317 service nova] Creating event network-changed:3fb4b6a0-8291-4a9c-b539-9a95bb69a89d for instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 on n-h1-862404-2 Oct 28 18:06:44.211974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf7f1eaa-73b6-4a2e-93a6-bdf617002051 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 200 len: 1422 microversion: 2.1 time: 0.109307 Oct 28 18:06:44.213023 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 533/999] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:06:44 2022] GET /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:44.242045 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-54ba96bd-53c3-451e-a8ec-c5b743f67cb3 req-c38ba333-d8e2-4ca9-adbc-235e51067317 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164486 Oct 28 18:06:44.249113 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 467/1000] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:44.276685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3b2b387e-8659-4347-b894-01688d3dc13a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2ab4c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:44.605274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a37b7c7-9d18-4dbc-acff-f6be07161d75 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Action: 'create', calling method: .version_select at 0x7f78de30c790>, body: {"pool": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:45.544812 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3b2b387e-8659-4347-b894-01688d3dc13a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 204 len: 0 microversion: 2.1 time: 1.292507 Oct 28 18:06:45.545391 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 468/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:44 2022] DELETE /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 0 bytes in 1294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:06:45.550139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:45.550884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:45.559788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:45.560664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:45.561894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:45.563986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:45.564949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:45.565607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:45.777338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:45.812606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:45.816083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:45.825157 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-95c1f296-f674-43dd-af12-7baacb11b27a tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.278312 Oct 28 18:06:45.832582 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 469/1002] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:45 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:45.841012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1704435978", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "3bcd6be5-6765-4bdd-8de6-8fda7a01dd25"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:45.999218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:06:46.509860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:06:46.510616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:06:46.511207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:06:46.511694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:06:46.512373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:06:46.525365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.526482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.527086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.528064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.528720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.529675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.560915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:46.568164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for user 3415953e10c445bfa3dcc5a3335826c8 and project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:46.584497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:06:46.587555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:06:46.651160 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c7d0bf5-b312-43e0-bce7-b7fd8bedee2a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817340 Oct 28 18:06:46.652205 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 470/1003] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:06:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:06:46.657072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:46.658024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:46.668143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.669203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.669879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.670842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.671594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.672331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.763529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:46.773291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:46.776061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:46.788651 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e6f7f5d-9e32-4d7b-86ee-3afbe8d7e403 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.135342 Oct 28 18:06:46.789637 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 471/1004] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:46 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:46.798031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:46.799233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:46.818990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.819927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.822080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.825784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.826554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.827345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.893443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:06:47.097849 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fa38183c-ed3e-4bb6-9129-9000c6af64bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 204 len: 0 microversion: 2.1 time: 0.304410 Oct 28 18:06:47.109046 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 472/1005] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:06:46 2022] DELETE /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:06:47.137187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "239ac63a-8b32-4455-841a-fb1ddd85f7bd", "device": "/dev/xvdb"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:47.158425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:47.177857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.180343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.183023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.183846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.184344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.184782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.612064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a37b7c7-9d18-4dbc-acff-f6be07161d75 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.395810 Oct 28 18:06:47.621298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 534/1006] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:06:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:47.626615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:47.629373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:47.650361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.651449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.652158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.653112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.653789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.654462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.809896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:47.821211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-321ff1d9-c908-4e30-8dc7-bd5d8d283076 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1283 microversion: 2.1 time: 0.198261 Oct 28 18:06:47.823442 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 535/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:47 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:47.829929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:47.830869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:47.844148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.845359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.846480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.847766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.849245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.854087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.934843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:47.945721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:47.948709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:47.955755 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f7212e7-da46-405e-ac6e-fd368e0ec0a2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.130818 Oct 28 18:06:47.956795 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 536/1008] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:47 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:47.962833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-459003410", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "d98ef463-74a4-479c-b632-73800f8bbec7"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:48.033731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] validate_networks() for [('d98ef463-74a4-479c-b632-73800f8bbec7', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:06:48.189879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:48.473174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:06:48.473597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:06:48.474467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:06:48.474901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:06:48.475311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:06:48.485899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.486393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.486818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.487574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.488051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.488659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.500503 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffa3467b-a275-43c6-be5f-1752b19c09cc tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "POST /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.388314 Oct 28 18:06:48.501651 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 473/1009] 10.222.0.16 () {62 vars in 1364 bytes} [Fri Oct 28 18:06:47 2022] POST /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 194 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:06:48.509015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-628d1fad-c4fb-4210-b972-63e3df106669 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Action: 'create', calling method: .version_select at 0x7f78de248ee0>, body: {"pool": null} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:48.509946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:48.516535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for user 46b892cd4bff49b78773d9b78da06bcd and project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:48.531345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:06:48.534096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:06:48.605535 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b36854ea-7726-4c0e-87a7-190e71d3bd69 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647272 Oct 28 18:06:48.606517 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 537/1010] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:06:48.612014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:48.613261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:48.625539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.626290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.626822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.631413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.633001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.634006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.737380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:48.747420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:48.749486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:48.758740 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a51a1ac-0c54-470c-8eb3-45382afb55fc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.151087 Oct 28 18:06:48.759713 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 538/1011] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:48 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:48.764632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ca6ff144-1e08-4781-b479-98d14885cc24 req-c3fab52d-5efa-40a9-93b3-50906862c470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3474cd55-0481-4698-a73f-f4666dc5164e", "name": "network-vif-unplugged", "status": "completed", "tag": "dd584db5-4cf7-4168-bafd-06d158e73987"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:48.803321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ca6ff144-1e08-4781-b479-98d14885cc24 req-c3fab52d-5efa-40a9-93b3-50906862c470 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.804256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ca6ff144-1e08-4781-b479-98d14885cc24 req-c3fab52d-5efa-40a9-93b3-50906862c470 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.804903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ca6ff144-1e08-4781-b479-98d14885cc24 req-c3fab52d-5efa-40a9-93b3-50906862c470 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.823170 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ca6ff144-1e08-4781-b479-98d14885cc24 req-c3fab52d-5efa-40a9-93b3-50906862c470 service nova] Creating event network-vif-unplugged:dd584db5-4cf7-4168-bafd-06d158e73987 for instance 3474cd55-0481-4698-a73f-f4666dc5164e on n-h1-862404-2 Oct 28 18:06:48.833320 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ca6ff144-1e08-4781-b479-98d14885cc24 req-c3fab52d-5efa-40a9-93b3-50906862c470 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072280 Oct 28 18:06:48.834313 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 539/1012] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:48.843448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d98f76a-1dce-4ef5-b30c-04ee6bc6f824 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:48.844264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d98f76a-1dce-4ef5-b30c-04ee6bc6f824 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:48.934712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d98f76a-1dce-4ef5-b30c-04ee6bc6f824 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:48.945550 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d98f76a-1dce-4ef5-b30c-04ee6bc6f824 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1207 microversion: 2.1 time: 0.106582 Oct 28 18:06:48.959842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 540/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:48 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1207 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:48.959842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:48.959842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:48.963720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.964672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.965347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.966284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.966958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.968155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.059674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.074869 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e3aa396d-43f4-4569-993f-e8069457573f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1331 microversion: 2.1 time: 0.126321 Oct 28 18:06:49.075806 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 541/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:48 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:49.080580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:49.081382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:49.097149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.097653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.098668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.099676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.100387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.101080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.202138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.213429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.215197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.220785 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ae9a500-719c-4ef9-a7b6-e6ceff9ee9b0 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.143757 Oct 28 18:06:49.221717 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 542/1015] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:49 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:49.798470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:49.799154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:49.810232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.810775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.811291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.812093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.812549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.812973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.891393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.900847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.902812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.909487 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-423b7d37-c388-4047-a17f-406fe80d9ffb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.118065 Oct 28 18:06:49.910268 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 543/1016] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:49 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:49.976156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:49.976724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:49.983279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.983766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.984232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.984931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.985379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.985802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:50.086544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:50.098457 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d5df558-ca33-419c-8b23-99dc91c07729 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1259 microversion: 2.1 time: 0.127396 Oct 28 18:06:50.099190 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 544/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:49 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1259 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:50.117529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:50.119861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:50.128066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:50.128894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:50.129633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:50.130568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:50.131305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:50.132002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:50.224903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:50.235784 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d07cf62-5b98-4816-87a9-ee0b5ec44bd8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1337 microversion: 2.1 time: 0.135258 Oct 28 18:06:50.236412 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 545/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:50 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1337 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:50.257833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:50.258461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:50.266020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:50.266503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:50.267133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:50.268083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:50.268690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:50.269272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:50.615884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:50.627325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:50.628811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:50.651138 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13f23e70-7a15-44f1-b02d-fbb26b827915 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.397375 Oct 28 18:06:50.663843 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 546/1019] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:50 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:50.663843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-33698275-0359-4f7d-9cb2-58888fae8583 req-821d24cf-93dc-48f8-a0de-52b2a5c0461a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3474cd55-0481-4698-a73f-f4666dc5164e", "name": "network-vif-deleted", "tag": "dd584db5-4cf7-4168-bafd-06d158e73987"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:50.675507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-33698275-0359-4f7d-9cb2-58888fae8583 req-821d24cf-93dc-48f8-a0de-52b2a5c0461a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:50.675507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-33698275-0359-4f7d-9cb2-58888fae8583 req-821d24cf-93dc-48f8-a0de-52b2a5c0461a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:50.675507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-33698275-0359-4f7d-9cb2-58888fae8583 req-821d24cf-93dc-48f8-a0de-52b2a5c0461a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:50.692637 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-33698275-0359-4f7d-9cb2-58888fae8583 req-821d24cf-93dc-48f8-a0de-52b2a5c0461a service nova] Creating event network-vif-deleted:dd584db5-4cf7-4168-bafd-06d158e73987 for instance 3474cd55-0481-4698-a73f-f4666dc5164e on n-h1-862404-2 Oct 28 18:06:50.699590 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-33698275-0359-4f7d-9cb2-58888fae8583 req-821d24cf-93dc-48f8-a0de-52b2a5c0461a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045815 Oct 28 18:06:50.700687 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 547/1020] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:50.941364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:50.943045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:50.982293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:50.983158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.001286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.006416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.009563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.010139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.204782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:51.228482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:51.235335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:51.250142 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a116529c-4577-4f47-98bb-12e991399095 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.315667 Oct 28 18:06:51.272249 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 548/1021] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:50 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:51.284316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:51.285053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:51.300408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.302305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.304919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.313884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.314466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.314919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.318085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:51.486960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:51.514462 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0975e6f7-c5c5-4779-b2cd-666520741e46 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1259 microversion: 2.1 time: 0.234967 Oct 28 18:06:51.515179 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 549/1022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:51 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:51.522458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:51.523037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:51.540024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.540751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.541524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.542726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.543528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.556362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.886444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:51.900565 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b7ce7c7-890f-4599-a6e1-c452207eb614 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.382380 Oct 28 18:06:51.901901 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 550/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:51 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:51.910044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:51.910864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:51.933792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.936328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.939169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.940300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.942156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.943277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.034739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:52.050520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:52.051992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:52.063138 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3dc2fb5b-eef3-4875-8994-30f9bf69447e tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.159719 Oct 28 18:06:52.076572 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 551/1024] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:51 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:52.291080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:52.292005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:52.303828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.304246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.304944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.306570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.308070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.308732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.373451 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-628d1fad-c4fb-4210-b972-63e3df106669 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.870109 Oct 28 18:06:52.375551 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 474/1025] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:06:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:52.387647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6fb9dd1a-b0af-42f6-9794-2e94d6891c70 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Action: 'create', calling method: .version_select at 0x7f78de274e50>, body: {"pool": null} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:52.389372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:52.400686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:52.403117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:52.409778 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c08ac955-4080-46eb-8a26-14292a8ed4e6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1531 microversion: 2.91 time: 0.123057 Oct 28 18:06:52.425155 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 552/1026] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:52 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1531 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:52.441990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:52.442921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:52.450177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.450882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.451502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.452484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.453596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.453763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.560788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lazy-loading 'services' on Instance uuid c9719e5b-0d1e-4037-a570-0258892d87b4 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:52.587358 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44cbcc90-79cd-4e74-9843-bce718829c08 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1936 microversion: 2.91 time: 0.150249 Oct 28 18:06:52.596542 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 553/1027] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:52 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1936 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:52.596542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:52.596542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:52.601013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.603392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.604041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.604921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.605543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.606133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.711481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:52.721546 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0724585c-02cf-487e-9865-0f9efafcef72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1265 microversion: 2.1 time: 0.131855 Oct 28 18:06:52.722398 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 554/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:52 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:52.728341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:52.729371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:52.744513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.744752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.745747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.746940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.747593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.748028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.779897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lazy-loading 'flavor' on Instance uuid c9719e5b-0d1e-4037-a570-0258892d87b4 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:53.109868 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81b434a1-f881-4d98-a135-75511f05b396 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "POST /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4/action" status: 202 len: 0 microversion: 2.91 time: 0.385802 Oct 28 18:06:53.110719 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 555/1029] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:06:52 2022] POST /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:06:53.117290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:53.118529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:53.127477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.128160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.128605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.129526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.129989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.130559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.382520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:53.398102 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb4ee5a2-609a-4ce4-bbb8-5d740a6e92c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.285322 Oct 28 18:06:53.400961 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 556/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:53 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:53.410248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:53.411425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:53.422796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.423807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.424544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.425546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.426221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.427250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.608398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:53.623271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:53.625922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:53.638382 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47aae043-3603-43ac-a47c-c0142e2f463b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1447 microversion: 2.75 time: 0.234636 Oct 28 18:06:53.653958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 557/1031] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:53 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1447 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:53.658562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:53.665373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:53.674686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.676337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.677040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.678146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.679517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.680405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.801231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:53.813327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:53.816505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:53.824591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:53.827849 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-587fc569-1323-412c-9937-0d62809ca594 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.173112 Oct 28 18:06:53.829490 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 558/1032] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:53 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:53.835101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-39ef070d-9575-41f4-b3f3-6a51a6ef8586 req-f2b5e9e1-1ff0-49ae-b1e7-0af357afd734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65bf4b2-0082-4097-a88a-84e3cd5c45d6", "tag": "7a6ab836-9960-49fe-ab6f-64227a64a52a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:53.852842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-39ef070d-9575-41f4-b3f3-6a51a6ef8586 req-f2b5e9e1-1ff0-49ae-b1e7-0af357afd734 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.853795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-39ef070d-9575-41f4-b3f3-6a51a6ef8586 req-f2b5e9e1-1ff0-49ae-b1e7-0af357afd734 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.854335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-39ef070d-9575-41f4-b3f3-6a51a6ef8586 req-f2b5e9e1-1ff0-49ae-b1e7-0af357afd734 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.872695 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-39ef070d-9575-41f4-b3f3-6a51a6ef8586 req-f2b5e9e1-1ff0-49ae-b1e7-0af357afd734 service nova] Creating event network-changed:7a6ab836-9960-49fe-ab6f-64227a64a52a for instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 on n-h1-862404-2 Oct 28 18:06:53.878372 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-39ef070d-9575-41f4-b3f3-6a51a6ef8586 req-f2b5e9e1-1ff0-49ae-b1e7-0af357afd734 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047576 Oct 28 18:06:53.879745 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 559/1033] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:53.887029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:53.888018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:53.896717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.897430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.898104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.899091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.899903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.900692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.206680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.232532 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3eb5c845-4141-4a18-909c-e8e22eb7152c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.349485 Oct 28 18:06:54.233933 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 560/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:53 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:54.383797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-82c02e58-5fc9-41df-922b-81f9315d60b9 req-3e216b6d-b49f-433b-8c6f-d9183e0f99fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d8c7646-a0a7-45ab-b60e-a55d373908d7", "tag": "381f2aeb-2625-4058-8a62-a7ad141a703d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:54.412935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-82c02e58-5fc9-41df-922b-81f9315d60b9 req-3e216b6d-b49f-433b-8c6f-d9183e0f99fa service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.414413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-82c02e58-5fc9-41df-922b-81f9315d60b9 req-3e216b6d-b49f-433b-8c6f-d9183e0f99fa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.417838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-82c02e58-5fc9-41df-922b-81f9315d60b9 req-3e216b6d-b49f-433b-8c6f-d9183e0f99fa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.442353 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-82c02e58-5fc9-41df-922b-81f9315d60b9 req-3e216b6d-b49f-433b-8c6f-d9183e0f99fa service nova] Creating event network-changed:381f2aeb-2625-4058-8a62-a7ad141a703d for instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 on n-h2-862404-2 Oct 28 18:06:54.447802 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-82c02e58-5fc9-41df-922b-81f9315d60b9 req-3e216b6d-b49f-433b-8c6f-d9183e0f99fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068856 Oct 28 18:06:54.455615 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 561/1035] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:54.462572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:54.463424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:54.471191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.471510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.471980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.472696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.473159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.473593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.622703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.631194 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d07e24c-c655-4c17-80a9-b449efd98234 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.174310 Oct 28 18:06:54.632110 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 562/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:54 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:54.668370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:54.668989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:54.674965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.675450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.675909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.676606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.677060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.677485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.753418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6fb9dd1a-b0af-42f6-9794-2e94d6891c70 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.369640 Oct 28 18:06:54.754288 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 475/1037] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:06:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:54.768541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c682a41-42c5-448b-897b-49f093ec167d tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Action: 'create', calling method: .version_select at 0x7f78de262280>, body: {"pool": null} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:54.772850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.782448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.784239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.789885 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c2f6c66a-9320-44fe-b2c1-e3c26a3e717b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1453 microversion: 2.75 time: 0.125943 Oct 28 18:06:54.790666 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 563/1038] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:54 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:54.861260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:54.862506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:54.879368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.879962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.880412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.881261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.881591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.882020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.968333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.971768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:54.980414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.982201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.988297 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3aa8e56-a272-463a-8ce5-fc78efbcad9c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.132874 Oct 28 18:06:55.005128 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 564/1039] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:54 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:55.260747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:55.262135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:55.269052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.270391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.271055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.272094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.272757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.273685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.479846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:55.488746 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-377a2222-375d-4a9d-8b57-6e8e36a2eee2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.232828 Oct 28 18:06:55.489827 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 565/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:55 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:55.654954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:55.655671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:55.662555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.663051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.663488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.664286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.664748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.665206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.810184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:55.819975 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6ea2d03-71fa-4650-97e4-192b6c94fa03 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.168853 Oct 28 18:06:55.820741 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 566/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:55 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:55.828246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:55.829012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:55.835722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.836399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.837928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.838870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.839395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.839924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.916348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:55.926461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:55.927978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:55.936865 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-733f6b90-6c33-46bc-af59-f9f6112a816b tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1453 microversion: 2.75 time: 0.113506 Oct 28 18:06:55.938410 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 567/1042] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:55 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:56.018778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:56.019914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:56.025778 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c682a41-42c5-448b-897b-49f093ec167d tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.261692 Oct 28 18:06:56.026382 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 476/1043] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:06:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:56.029689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:56.030186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:56.030624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:56.031321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:56.031775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:56.032220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:56.038436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1224f6ec-a509-48d0-bbd7-8a38b28fc2ba tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Calling method '.version_select at 0x7f78de2744c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:56.123408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:56.131677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:56.133172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:56.138485 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b2c6b63-708f-40bd-969e-c75917559dc5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.123827 Oct 28 18:06:56.139068 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 568/1044] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:56 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:56.220138 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1224f6ec-a509-48d0-bbd7-8a38b28fc2ba tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/d1fddc19-5571-4dfb-98dc-44dba7cc48f3" status: 200 len: 141 microversion: 2.1 time: 0.185299 Oct 28 18:06:56.221411 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 477/1045] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:06:56 2022] GET /compute/v2.1/os-floating-ips/d1fddc19-5571-4dfb-98dc-44dba7cc48f3 => generated 141 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:56.236478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-98d7f6ec-1338-4f62-bfa4-33acd29552e6 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Calling method '.version_select at 0x7f78de25c1f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:56.518516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:56.519339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:56.528109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:56.528758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:56.529306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:56.530176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:56.530883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:56.531419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:56.554708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:56.578570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:56.788211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:56.796551 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0bad788e-957c-497c-b25a-57ee533f09bf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.286544 Oct 28 18:06:56.797127 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 478/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:56 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:56.844412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:56.845019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:56.851343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:56.852069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:56.852593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:56.853627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:56.854087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:56.854516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.063316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.073641 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e2320817-9d69-4233-a8e8-0bd4ee2ddf6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.233012 Oct 28 18:06:57.078731 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 479/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:56 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:57.083556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.084408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:57.092314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.095877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.096696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.097633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.098249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.098856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.163911 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-98d7f6ec-1338-4f62-bfa4-33acd29552e6 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d1fddc19-5571-4dfb-98dc-44dba7cc48f3" status: 202 len: 0 microversion: 2.1 time: 0.933061 Oct 28 18:06:57.165772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 569/1048] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:06:56 2022] DELETE /compute/v2.1/os-floating-ips/d1fddc19-5571-4dfb-98dc-44dba7cc48f3 => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:06:57.172242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.173242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:57.177107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.180705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.181437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.182062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.183160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.183785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.184589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.187724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.192982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.200022 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-81266830-4949-45d4-8235-02e596208379 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1438 microversion: 2.75 time: 0.121577 Oct 28 18:06:57.201074 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 480/1049] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:57 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:57.206203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-107490a0-cf66-41f1-9c53-6d38f4c4623d tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Calling method '.version_select at 0x7f78de262700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.262054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.274181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.280928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.292072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77f33dd0-3754-4bb6-b7e3-90a81500d98f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.124083 Oct 28 18:06:57.294933 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 570/1050] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:57 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:57.421852 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-107490a0-cf66-41f1-9c53-6d38f4c4623d tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.219332 Oct 28 18:06:57.422428 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 481/1051] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 18:06:57 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:06:57.425021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:57.428166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:57.433634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-315d398e-db81-43ff-bb70-cd3488daa001 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Calling method '.version_select at 0x7f78de1f8c10>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.434939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.435608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.436231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.437135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.437596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.438217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.520402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:06:57.520859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:06:57.521322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:06:57.521721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:06:57.522130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:06:57.589178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:57.595124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.595610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.596075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.596771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.597225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.597645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.650201 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-315d398e-db81-43ff-bb70-cd3488daa001 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.220877 Oct 28 18:06:57.651294 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 482/1052] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:06:57 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:57.665042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8472b163-56ad-44c4-a2cd-0078c569e82f tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Calling method '.version_select at 0x7f78de2274c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.677365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:57.694699 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2fffdb1-7e12-4bcb-a95c-9cc72d24933d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe/action" status: 202 len: 1942 microversion: 2.75 time: 0.398560 Oct 28 18:06:57.695339 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 571/1053] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:06:57 2022] POST /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe/action => generated 1942 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 18:06:57.721024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.721648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:57.728333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.728828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.729269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.729969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.730438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.730869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.805022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:57.823103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d6e12b1-0f42-4b3f-a87e-5dc6aef63ad8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.105717 Oct 28 18:06:57.823697 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 572/1054] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:57 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:57.830045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.830886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:57.838274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.838766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.839196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.839917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.840397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.840824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.976840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.985435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f39985a-c6aa-484c-81d7-198b11f67cf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.159096 Oct 28 18:06:57.986031 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 573/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:57 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:58.097389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:58.098015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:58.105827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:58.106341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:58.106756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:58.107476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:58.107995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:58.108385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:58.268093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:58.293436 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-204af435-94ef-4058-8af5-0d86b136b32f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.194203 Oct 28 18:06:58.294117 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 574/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:58 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:58.323908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:58.324881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:58.340742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:58.341472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:58.342338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:58.343291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:58.343968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:58.344596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:58.420931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:58.431310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:58.433984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:58.456282 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-819578f2-a677-4ad5-8ac1-a8365d6089de tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.136960 Oct 28 18:06:58.472716 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 575/1057] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:58 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:58.744243 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8472b163-56ad-44c4-a2cd-0078c569e82f tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/55835bc0-f5bb-4f95-82f1-c0ceb8e518a1" status: 202 len: 0 microversion: 2.1 time: 1.082787 Oct 28 18:06:58.744932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 483/1058] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:06:57 2022] DELETE /compute/v2.1/os-floating-ips/55835bc0-f5bb-4f95-82f1-c0ceb8e518a1 => generated 0 bytes in 1084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:06:58.752938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ddb2cbe4-f779-4aca-abd9-3d50700f9152 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Calling method '.version_select at 0x7f78de1e5f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:58.758134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:58.850436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:58.851209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:58.857473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:58.858895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:58.859192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:58.860397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:58.860972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:58.861609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:58.939448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:58.945111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:58.967684 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cdedd022-d8b4-4d9d-8bb9-85ecc92a111f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.120937 Oct 28 18:06:58.979840 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 484/1059] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:58 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:06:59.009552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:59.010179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:59.016582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.017323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.017941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:59.018823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.019509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.019974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:59.164364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:59.172668 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7076931c-b194-42d4-9edb-450f7a4519a6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.167230 Oct 28 18:06:59.173323 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 485/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:59 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:59.317081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:59.317701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:59.324600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.325095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.325542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:59.326262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.326728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.327286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:59.464592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:59.472472 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-35ab4719-e1a9-4fd8-a804-56f60c1c82c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.159279 Oct 28 18:06:59.473228 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 486/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:59 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:59.483397 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ddb2cbe4-f779-4aca-abd9-3d50700f9152 tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/20f2d2be-30aa-4cde-85a4-c61bb22e1c33" status: 202 len: 0 microversion: 2.1 time: 0.734244 Oct 28 18:06:59.484783 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 576/1062] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:06:58 2022] DELETE /compute/v2.1/os-floating-ips/20f2d2be-30aa-4cde-85a4-c61bb22e1c33 => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:06:59.493257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc1eeab5-fd8d-41a9-8bfc-6e15285d31bf tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] Calling method '.version_select at 0x7f78de1e5550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:59.498812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:59.499379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:06:59.512084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.512084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.512084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:59.512084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.512445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.512445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:59.574995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:59.584618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:59.586450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:59.592089 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cbee28e5-a126-46f1-8a27-b9397b5dceb9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.105719 Oct 28 18:06:59.592669 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 487/1063] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:59 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:06:59.999915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:00.000566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:00.006421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.006904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.007342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.008064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.008564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.008994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.082695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:00.098821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2db0eba1-f5ac-4d4a-b7af-f36114d73482 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.102560 Oct 28 18:07:00.099410 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 488/1064] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:06:59 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:00.196325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:00.197080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:00.203133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.203626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.204099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.204809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.205270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.205701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.210042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:00.347081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:00.355687 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d5300e4-bb12-414e-9dfc-5568c52789de tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.163281 Oct 28 18:07:00.356619 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 489/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:00 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:00.452910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a2f76b1a-b832-4a0a-b8d7-2365fff74734 req-179062b7-4b41-484d-acf1-0b6f62d1a94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65bf4b2-0082-4097-a88a-84e3cd5c45d6", "name": "network-vif-plugged", "status": "completed", "tag": "7a6ab836-9960-49fe-ab6f-64227a64a52a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:00.464586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a2f76b1a-b832-4a0a-b8d7-2365fff74734 req-179062b7-4b41-484d-acf1-0b6f62d1a94a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.465144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a2f76b1a-b832-4a0a-b8d7-2365fff74734 req-179062b7-4b41-484d-acf1-0b6f62d1a94a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.465653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a2f76b1a-b832-4a0a-b8d7-2365fff74734 req-179062b7-4b41-484d-acf1-0b6f62d1a94a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.478579 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a2f76b1a-b832-4a0a-b8d7-2365fff74734 req-179062b7-4b41-484d-acf1-0b6f62d1a94a service nova] Creating event network-vif-plugged:7a6ab836-9960-49fe-ab6f-64227a64a52a for instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 on n-h1-862404-2 Oct 28 18:07:00.483073 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc1eeab5-fd8d-41a9-8bfc-6e15285d31bf tempest-FloatingIPDetailsTestJSON-1103593862 tempest-FloatingIPDetailsTestJSON-1103593862-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/5b5b6594-e169-4a14-89cd-5c2fe6867e8a" status: 202 len: 0 microversion: 2.1 time: 0.994117 Oct 28 18:07:00.483572 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a2f76b1a-b832-4a0a-b8d7-2365fff74734 req-179062b7-4b41-484d-acf1-0b6f62d1a94a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034872 Oct 28 18:07:00.484252 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 577/1066] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:06:59 2022] DELETE /compute/v2.1/os-floating-ips/5b5b6594-e169-4a14-89cd-5c2fe6867e8a => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:07:00.484714 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 490/1067] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:00.498503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:00.499226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:00.505556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.506060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.506568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.507290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.507751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.508212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.621894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:00.622539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:00.631422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.631954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.632613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.634497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:00.635233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:00.635675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.730883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:00.732453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:00.739877 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8d1198c2-0d87-4c94-8178-a0f2ccc8a456 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.247543 Oct 28 18:07:00.740658 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 491/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:00 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:00.741015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:00.742496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:00.749078 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6816ccb5-9ef9-44db-bc9d-283516f00830 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.131809 Oct 28 18:07:00.750319 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 578/1069] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:00 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:01.128050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:01.129581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:01.138837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.139704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.140253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.141385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.141880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.142610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.219808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:01.237557 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a4562720-ade2-49b1-98e7-bc5c267d36dc tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.113341 Oct 28 18:07:01.238023 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 492/1070] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:01 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:01.378732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:01.379282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:01.386558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.387080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.387515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.388244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.388701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.389121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.659440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:01.678566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f913962-e707-4db5-9a02-c24dc46e9c11 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.303718 Oct 28 18:07:01.679488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 579/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:01 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:01.763845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:01.764561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:01.773967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.778657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.778844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:01.779359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.779572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:01.782641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.783367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.784030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.787155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.796561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.797285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.798215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.798682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.799126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.906860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:01.915953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:01.917859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:01.923658 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5cff597-5e87-4a72-943a-e622ea3f3df4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.150488 Oct 28 18:07:01.924931 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 580/1072] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:01 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:01.980744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:01.995486 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfd5e43d-4a87-4b3e-b6b1-1b10bb95dede tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1379 microversion: 2.1 time: 0.235498 Oct 28 18:07:01.997472 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 493/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:01 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1379 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:02.265833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:02.266442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:02.273117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:02.273892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:02.274954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:02.275865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:02.276474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:02.277163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:02.314318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:02.406252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:02.427463 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8388238-2bd8-4c4a-b3d0-90c488cf614b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.165355 Oct 28 18:07:02.428679 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 581/1074] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:02 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:02.704866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:02.705490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:02.716850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:02.717965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:02.719159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:02.720174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:02.720910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:02.721691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:02.889167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:02.890357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:02.906374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:02.906873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:02.907312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:02.908061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:02.908516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:02.908946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:02.997042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:03.009562 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c77792ee-0a95-4dd7-877f-879cb0fb0b41 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.307812 Oct 28 18:07:03.010899 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 494/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:02 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:03.017872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:03.019159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:03.027661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.028644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.029248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.030143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.030756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.031503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.111484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:03.123280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:03.125331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:03.131346 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79684f6e-72fb-49cc-abf5-8b0d62ad4e16 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.118663 Oct 28 18:07:03.132934 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 495/1076] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:03 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:03.144166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:03.145017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:03.156067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.156823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.157443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.158308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.158930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.159516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.222978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid dad1f5bd-5eed-4cfa-b39b-09586df2a2fa {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:03.246212 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb17db4e-e554-4a19-ba56-a8f44fe59904 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 2420 microversion: 2.25 time: 0.359416 Oct 28 18:07:03.247560 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 582/1077] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:02 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 2420 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:03.277352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862404-2", "block_migration": "auto"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:03.280922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:03.291856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.296476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.299011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.300802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.303432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.305765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.361612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'flavor' on Instance uuid dad1f5bd-5eed-4cfa-b39b-09586df2a2fa {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:03.402705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:03.409171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Going to try to live migrate instance to n-h1-862404-2 {{(pid=120680) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:07:03.414949 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c1460d71-6aa1-4ff2-84be-1af385cfa777 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1528 microversion: 2.1 time: 0.280428 Oct 28 18:07:03.429606 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 496/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:03 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1528 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:03.436217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a3c59e37-576e-4e53-87ef-e56f4bf0d3ff req-aaa0a556-8419-4d0f-aeba-cca92376f6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d8c7646-a0a7-45ab-b60e-a55d373908d7", "name": "network-vif-plugged", "status": "completed", "tag": "381f2aeb-2625-4058-8a62-a7ad141a703d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:03.448505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a3c59e37-576e-4e53-87ef-e56f4bf0d3ff req-aaa0a556-8419-4d0f-aeba-cca92376f6d6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.449291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a3c59e37-576e-4e53-87ef-e56f4bf0d3ff req-aaa0a556-8419-4d0f-aeba-cca92376f6d6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.450109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a3c59e37-576e-4e53-87ef-e56f4bf0d3ff req-aaa0a556-8419-4d0f-aeba-cca92376f6d6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.466709 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a3c59e37-576e-4e53-87ef-e56f4bf0d3ff req-aaa0a556-8419-4d0f-aeba-cca92376f6d6 service nova] Creating event network-vif-plugged:381f2aeb-2625-4058-8a62-a7ad141a703d for instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 on n-h2-862404-2 Oct 28 18:07:03.475980 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a3c59e37-576e-4e53-87ef-e56f4bf0d3ff req-aaa0a556-8419-4d0f-aeba-cca92376f6d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047771 Oct 28 18:07:03.476979 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 497/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:03.492441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:03.496348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:03.509746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.512458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.514464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.515436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.520653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.521113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.699080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:03.707481 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-606e1be0-57d8-4b66-aee4-4d777e952a1a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1528 microversion: 2.1 time: 0.227000 Oct 28 18:07:03.708566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 498/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:03 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1528 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:03.713292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:03.713900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:03.720173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.720608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.721048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.721745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.722204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.722628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.841528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:03.866232 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5dd1197-db18-484e-89a7-c8ca4668c50e tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.155999 Oct 28 18:07:03.867132 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 499/1081] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:03 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:03.875089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-472c030f-3719-4228-9bf3-5e586b5d353a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:03.898535 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-472c030f-3719-4228-9bf3-5e586b5d353a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/3bcd6be5-6765-4bdd-8de6-8fda7a01dd25" status: 202 len: 0 microversion: 2.1 time: 0.028726 Oct 28 18:07:03.906070 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 500/1082] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:03 2022] DELETE /compute/v2.1/flavors/3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:07:03.916376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0621de25-405e-430e-9c6d-d817ac9fb433 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:03.945820 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0621de25-405e-430e-9c6d-d817ac9fb433 tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.035419 Oct 28 18:07:03.946517 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 501/1083] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:07:03 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:03.967079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:03.969568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:03.972947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:03.979208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.979915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.980434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.981206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.981662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.982086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.020484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:04.027169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Old instance type tempest-test_resize_flavor_-725570611, new instance type m1.heat {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:07:04.035480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:07:04.036057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:07:04.041281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:07:04.041697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:07:04.042111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:07:04.116781 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4668376-2566-465e-ab2f-92d73032955d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6/action" status: 202 len: 0 microversion: 2.1 time: 0.153867 Oct 28 18:07:04.122407 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 502/1084] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:07:03 2022] POST /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:07:04.129861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:04.130203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:04.143668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.144384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.144797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.145542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.145994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.146432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.507686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:04.518770 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1b6bb14-3d18-48ac-b4cb-3161f5017204 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1307 microversion: 2.1 time: 0.394430 Oct 28 18:07:04.521319 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 503/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:04 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:04.528199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:04.532030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:04.545835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.548570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.550357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.552153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.552701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.553509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.823315 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92753926-8b28-4fbd-95d7-567b2f39d8f5 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/action" status: 202 len: 0 microversion: 2.25 time: 1.551608 Oct 28 18:07:04.824093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 583/1086] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:07:03 2022] POST /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/action => generated 0 bytes in 1553 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:07:04.829276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:04.830134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:04.839591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.840175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.840684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.841542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.842066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.842619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.855245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:04.862938 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6e3f335d-cb06-4688-b61f-9dc6dc6ec99c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1537 microversion: 2.1 time: 0.338906 Oct 28 18:07:04.864847 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 504/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:04 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1537 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:04.871307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:04.871971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:04.880413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.881152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.881789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.882509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.883172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.884206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.917096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:04.928720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:04.931577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:04.939801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e20ef53f-7d22-4d8c-8d36-34cc6a1fd4b9 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.114425 Oct 28 18:07:04.940998 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 584/1088] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:04 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:04.945582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:04.947061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:04.953969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.954866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.955616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:04.956476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:04.957369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:04.957943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.058391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:05.079037 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef5d54c8-8615-4e17-a032-8db401c76582 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.136822 Oct 28 18:07:05.080019 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 585/1089] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:04 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:05.191066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:05.206607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:05.209156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:05.210470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3d31c5b0-0941-4f0f-b0bb-c2486b3ddb25 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.344668 Oct 28 18:07:05.228279 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 505/1090] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:04 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:05.547290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:05.548195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:05.557421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.558435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.559145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.560284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.561037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.561855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.768371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:05.778323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c53ddbf5-6df4-46d8-a055-cfd3b20862cf tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1487 microversion: 2.1 time: 0.235057 Oct 28 18:07:05.792557 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 586/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:05 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1487 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:05.802078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:05.802609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:05.816519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.817467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.818090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.818978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.819584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.820181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.854370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lazy-loading 'flavor' on Instance uuid 9d8c7646-a0a7-45ab-b60e-a55d373908d7 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:05.873447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:05.887971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:05.888731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:05.895244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.895978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.896413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.897455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.898093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.898526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.929789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4fc2051-7ecd-4570-a425-83bed81bff9c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7/action" status: 202 len: 0 microversion: 2.1 time: 0.131027 Oct 28 18:07:05.930790 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 506/1092] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:07:05 2022] POST /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:07:05.940833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:05.941536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:05.948781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.949283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.949724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.950438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.950886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.951511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.076828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.085756 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03542b71-1cd4-49a4-adc9-2052f48f2fb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1537 microversion: 2.1 time: 0.201578 Oct 28 18:07:06.096290 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 587/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:05 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:06.096290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:06.096290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:06.101315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.101804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.103215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.104148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.104772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.105374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.181429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.191353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.193049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.199603 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c0b8667-2735-4a1d-b4b2-65743b5f4a7f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.111405 Oct 28 18:07:06.200525 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 588/1094] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:06 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:06.205638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:06.206410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:06.214171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.214935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.215710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.216733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.217482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.218529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.287158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.296613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:06.296808 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d2ee180f-540b-427c-81e7-eea8fa4680b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1495 microversion: 2.1 time: 0.360821 Oct 28 18:07:06.305119 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 507/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:05 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1495 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:06.313887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:06.314807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:06.315544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56470504-a77d-495b-89e2-d954f000c14a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.113736 Oct 28 18:07:06.316625 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 589/1096] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:06 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:06.324674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.325320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.326024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.326930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.327637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.328187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.499467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.508531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.512273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.512273 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-67606d45-7eff-4bbf-812d-a36c27ec58ea tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.203229 Oct 28 18:07:06.512273 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 508/1097] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:06 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:07.109747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:07.110371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:07.118197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.118995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.119684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.120531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.121070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.121573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.231372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:07.232637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:07.240679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.241176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.241610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.242324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.243318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.243745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.311839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:07.323005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:07.324581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:07.330648 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3f058d0b-584f-4267-94cb-cf07f6eb161d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.103752 Oct 28 18:07:07.331248 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 509/1098] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:07 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:07.337618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:07.338254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:07.353401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.353906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.354864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.355633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.356119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.356593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.376963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:07.386519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3a2540b-59f6-4a20-b7ac-46930d315b6f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.280946 Oct 28 18:07:07.388108 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 590/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:07 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:07.406186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:07.407198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:07.423520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.424321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.425137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.426209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.426672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.427102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.519704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:07.540675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:07.543356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be34414e-d9d9-4447-8c7b-54e66d009b4d tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.153867 Oct 28 18:07:07.544519 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 591/1100] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:07 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:07.550797 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3c31b31c-1a54-48e1-a01f-ad851f2c51b3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 200 len: 1478 microversion: 2.1 time: 0.217679 Oct 28 18:07:07.551765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:07.552770 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 510/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:07 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 1478 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:07.554202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:07.557816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:07.562710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.563489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.564866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.565887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.567171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.567858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.589742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1063439569"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:07.592469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:07.599252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.600030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.600729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.601857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.602642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.603344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.811748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:07.822442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:07.828432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:07.829652 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da1a96ce-5881-4fab-9bcf-df5aaf5a3c9e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.283570 Oct 28 18:07:07.830225 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 592/1102] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:07 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:07.896972 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f7da7b6-dac3-4489-a56c-dbfb63e53d72 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7/action" status: 202 len: 0 microversion: 2.1 time: 0.311313 Oct 28 18:07:07.897776 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 511/1103] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:07:07 2022] POST /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 28 18:07:07.909279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c96e564-3fff-4996-b6fc-7eb3280052e8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de1e55e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:07.975080 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c96e564-3fff-4996-b6fc-7eb3280052e8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.070292 Oct 28 18:07:07.985042 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 593/1104] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:07 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:08.361941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:08.363613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:08.374472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:08.375058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:08.376357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.377781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:08.378611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:08.379943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.412162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:08.414393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:08.425849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:08.426585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:08.427022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.427751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:08.428392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:08.428831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.511231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:08.525357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:08.530169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:08.548950 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45ef41dd-7180-43ce-938c-69fb7cdd9bdf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.186020 Oct 28 18:07:08.550626 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 512/1105] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:08 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:08.591289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:08.592068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:08.601534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:08.602077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:08.605774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.606616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:08.607087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:08.607666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.675645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:08.686420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1de65f0c-a2b9-43f5-898b-5e83207b312e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.279366 Oct 28 18:07:08.688988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 594/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:08 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:08.728257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:08.750938 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43ae18d1-3197-4659-8cfc-51558a290c0f tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.160662 Oct 28 18:07:08.776274 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 513/1107] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:08 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:08.856671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:08.864683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:08.876659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:08.877156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:08.877654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.878493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:08.878959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:08.879472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.898323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:08.992014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09ae0b6a-6649-40f3-95f9-2e7df92ece12 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de1f8820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:09.074686 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09ae0b6a-6649-40f3-95f9-2e7df92ece12 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.087227 Oct 28 18:07:09.087138 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 514/1108] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:08 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:09.138212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:09.157632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:09.159483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:09.160944 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-62585965-d05a-4d26-b317-88ca30e0f26d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.308828 Oct 28 18:07:09.162082 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 595/1109] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:08 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:09.577994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:09.579288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:09.591297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.593107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.593760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.594711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.595350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.596120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.716215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:09.717387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:09.724866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.725638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.726250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.727691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.728729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.729386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.797178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:09.806947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:09.812478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:09.826187 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-327b8471-bb4e-4127-8289-1597e9c31e4b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.253045 Oct 28 18:07:09.828883 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 515/1110] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:09 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:09.855769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:09.856420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:09.863740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.864603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.865498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.866392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.867010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.867440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.922564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:09.933810 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-718565d9-4df1-420a-a746-9a897aa7e06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.224444 Oct 28 18:07:09.935319 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 596/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:09 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:09.996469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:10.047049 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a186d33a-5ae2-436f-bdeb-d17d29c20139 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.216498 Oct 28 18:07:10.050206 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 516/1112] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:09 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:10.093480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-025396ed-3643-49f3-ba07-7faa326ecad4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de1924c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:10.156708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-025396ed-3643-49f3-ba07-7faa326ecad4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.066953 Oct 28 18:07:10.161900 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 597/1113] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:10 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:10.192232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:10.193260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:10.205281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.205910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.206457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.208829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.209459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.210182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.266496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:10.267231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:10.280925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.281715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.282826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.283723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.284899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.285526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.318080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:07:10.467299 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3bbd39e-f1cc-4cb0-a062-9d0ef8f93cfe tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 204 len: 0 microversion: 2.1 time: 0.204348 Oct 28 18:07:10.468862 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 598/1114] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:10 2022] DELETE /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:10.491014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:10.495645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:10.505958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.506532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.506973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.507900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.509070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.509503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.517662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:10.529822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:10.531416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:10.532752 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5398141-9075-44ba-aa87-f6805cdfeac6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.344858 Oct 28 18:07:10.536668 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 517/1115] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:10 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:10.753102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:10.767871 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87affaff-41c8-4984-b8f4-662dce928119 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1711 microversion: 2.1 time: 0.294253 Oct 28 18:07:10.770918 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 599/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:10 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1711 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:10.857420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:10.858053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:10.871623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.872157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.875771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.876713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.877344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.877937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.954326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:10.962542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:10.963300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:10.975807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:10.976506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.977424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.977590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:10.978273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.979188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.980434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.981073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.995654 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b4d37026-91a4-4222-8e0b-505e83146ece tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.142819 Oct 28 18:07:11.011853 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 518/1117] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:10 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:11.081109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:11.081723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:11.094947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.095461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.095938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.096676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.097125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.097564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.270732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:11.278249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:11.280120 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cb20db82-6b8c-43d8-b2db-d2856f4a6f79 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.323323 Oct 28 18:07:11.282364 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 600/1118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:10 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:11.295170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8215f8a-64eb-4202-983a-dfb2d6f9abf9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0eedc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:11.324836 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff7d6256-9208-476f-af68-9de9dc7bcd58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.247318 Oct 28 18:07:11.334105 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 519/1119] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:11 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:11.381855 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8215f8a-64eb-4202-983a-dfb2d6f9abf9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.095073 Oct 28 18:07:11.385527 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 601/1120] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:11 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:11.568328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:11.568705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:11.593580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.593989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.594433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.595156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.595610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.596063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.796271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:11.797033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:11.813723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.814492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.816513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.817514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.820278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.821519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.966984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:11.972383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:11.980936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:11.984686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:11.986180 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3ffbfbab-539d-478d-9f2b-177b9070ece1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.422253 Oct 28 18:07:11.987317 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 520/1121] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:11 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:12.037659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:12.038642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:12.064850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:12.066411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:12.068223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:12.073025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:12.074840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:12.086643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:12.314790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:12.328577 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cc69ea8-4504-49f8-ac3d-de37b2080594 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1711 microversion: 2.1 time: 0.537299 Oct 28 18:07:12.333429 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 602/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:11 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1711 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:12.348451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:12.350610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:12.371589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:12.372421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:12.373078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:12.374029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:12.376053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:12.376885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.114445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:13.129815 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-779a8cc7-c0d2-486d-ade1-b3080dc2d1f1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.792044 Oct 28 18:07:13.135228 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 603/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:12 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:13.142741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:13.143553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:13.166948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.168104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.176582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.177579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.178210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.178793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.203931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:13.219803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:13.221681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:13.238043 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dcabf81f-2300-458d-b581-9cd13586819f tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 1.211079 Oct 28 18:07:13.246390 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 521/1124] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:12 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:13.277636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bc43c0bf-965a-4126-a027-c6fe0ca0383c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de267ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:13.374678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:13.415653 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bc43c0bf-965a-4126-a027-c6fe0ca0383c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.143054 Oct 28 18:07:13.416414 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 522/1125] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:13 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:13.431380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a9d7ad5-8a8f-4308-95a0-6c30d6dfde58 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.293414 Oct 28 18:07:13.432584 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 604/1126] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:13 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:13.438112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:13.439471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:13.446465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.447236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.447872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.448736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.449374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.449953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.455555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:13.462488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:13.490460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.492111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.493524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.497545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.500430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.501866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.599387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:13.615100 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80879073-394b-47a9-92c6-d23159ab2632 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1644 microversion: 2.1 time: 0.181169 Oct 28 18:07:13.617784 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 605/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:13 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1644 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:14.005919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1536878420", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "c36cbffa-a0c0-4bdf-bdca-7ec3fa5b33e3"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:14.160110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] validate_networks() for [('c36cbffa-a0c0-4bdf-bdca-7ec3fa5b33e3', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:07:14.290448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:14.303587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:14.305620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:14.307145 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-38be68bf-3809-4088-b484-bcbf4825de52 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.886229 Oct 28 18:07:14.308466 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 523/1128] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:13 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:14.332922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-de153fcc-b253-477a-a45b-7432331514b5 req-ed4f9fb4-eb78-456b-997b-c189931ce1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d8c7646-a0a7-45ab-b60e-a55d373908d7", "name": "network-vif-plugged", "status": "completed", "tag": "381f2aeb-2625-4058-8a62-a7ad141a703d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:14.348370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de153fcc-b253-477a-a45b-7432331514b5 req-ed4f9fb4-eb78-456b-997b-c189931ce1cc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.349906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de153fcc-b253-477a-a45b-7432331514b5 req-ed4f9fb4-eb78-456b-997b-c189931ce1cc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.350651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de153fcc-b253-477a-a45b-7432331514b5 req-ed4f9fb4-eb78-456b-997b-c189931ce1cc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:14.365995 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-de153fcc-b253-477a-a45b-7432331514b5 req-ed4f9fb4-eb78-456b-997b-c189931ce1cc service nova] Creating event network-vif-plugged:381f2aeb-2625-4058-8a62-a7ad141a703d for instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 on n-h2-862404-2 Oct 28 18:07:14.393464 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-de153fcc-b253-477a-a45b-7432331514b5 req-ed4f9fb4-eb78-456b-997b-c189931ce1cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064187 Oct 28 18:07:14.396625 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 524/1129] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:14.413000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:14.415205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:14.429161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.435747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.438156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:14.439192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.440778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.444447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:14.690203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:14.700411 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-203deb0f-8ba6-409f-991e-1a7b2342343a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.302201 Oct 28 18:07:14.704245 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 525/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:14 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:14.712810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-38c643f8-ef73-437d-987f-f917bbc5fb64 req-8ba3f90e-e31f-4316-838f-fc4d8e224ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e361a9-879b-4678-84a3-69c90f2b2bed", "name": "network-vif-deleted", "tag": "d0e3d28b-5b15-4a23-af02-a09d51459806"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:14.776119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-38c643f8-ef73-437d-987f-f917bbc5fb64 req-8ba3f90e-e31f-4316-838f-fc4d8e224ade service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.779571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-38c643f8-ef73-437d-987f-f917bbc5fb64 req-8ba3f90e-e31f-4316-838f-fc4d8e224ade service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.787298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-38c643f8-ef73-437d-987f-f917bbc5fb64 req-8ba3f90e-e31f-4316-838f-fc4d8e224ade service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:14.820036 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-38c643f8-ef73-437d-987f-f917bbc5fb64 req-8ba3f90e-e31f-4316-838f-fc4d8e224ade service nova] Creating event network-vif-deleted:d0e3d28b-5b15-4a23-af02-a09d51459806 for instance 97e361a9-879b-4678-84a3-69c90f2b2bed on n-h1-862404-2 Oct 28 18:07:14.839607 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-38c643f8-ef73-437d-987f-f917bbc5fb64 req-8ba3f90e-e31f-4316-838f-fc4d8e224ade service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133373 Oct 28 18:07:14.844517 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 526/1131] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:14.875300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:14.876617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:14.884837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.885666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.886265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:14.887151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.887834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.890669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.018545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:15.030260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:15.031615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:15.040381 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-780a1099-c10a-4119-9985-c5029521f620 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.192544 Oct 28 18:07:15.041171 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 527/1132] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:14 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:15.049462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfafbb6e-808e-4bba-b014-898fac8cdb77 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de279820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:15.151519 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfafbb6e-808e-4bba-b014-898fac8cdb77 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.101771 Oct 28 18:07:15.152434 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 528/1133] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:15 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:15.167176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:15.167952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:15.174864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.175371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.175834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.176625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.177087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.179914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.306847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:15.331934 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-77a26725-c93b-4622-a60f-52e319f4a697 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.169379 Oct 28 18:07:15.333589 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 529/1134] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:15 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:15.354492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:15.355397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:15.370770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.372852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.373388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.379107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.380355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.383209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.445113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.448212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.448987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.450141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lazy-loading 'fault' on Instance uuid 97e361a9-879b-4678-84a3-69c90f2b2bed {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:15.524680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ca12f168244f8a2ee4ee78f6263fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23cb0ccf6b342ba983516131c90956a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:15.543635 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74f2ff7e-d6a0-4afd-9a01-854beebc42e3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 200 len: 1352 microversion: 2.1 time: 0.208716 Oct 28 18:07:15.544266 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 530/1135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:15 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 1352 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:15.549635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:15.555605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:15.585873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.586920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.588579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.591632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.593478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.594492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.661372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:07:15.661942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:07:15.662443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:07:15.662895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:07:15.663891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:07:15.686247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.686749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.687198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.697548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.704222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.704998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.747578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Getting quotas for project 58e02d11d4c64d8989eaec758233f04f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:07:15.771610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Getting quotas for user 4245221a863a4ba7969c508342e27fdc and project 58e02d11d4c64d8989eaec758233f04f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:07:15.805704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:07:15.808731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:07:15.827750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:15.842520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:15.844070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:15.845443 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-498898cc-3b68-4289-9353-33974dd8ff87 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.300160 Oct 28 18:07:15.846246 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 531/1136] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:15 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:15.850682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:15.851341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:15.863259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.864081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.864714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.866005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.866635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.867173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.874887 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe974482-98ef-468c-8bd5-fd20f83d8141 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.214513 Oct 28 18:07:15.875882 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 606/1137] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:07:15.894126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ebd124ce-7ef4-456d-b4e4-e6cad4824b60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:15.896934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ebd124ce-7ef4-456d-b4e4-e6cad4824b60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:16.002989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ebd124ce-7ef4-456d-b4e4-e6cad4824b60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:16.012984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ebd124ce-7ef4-456d-b4e4-e6cad4824b60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1225 microversion: 2.1 time: 0.127421 Oct 28 18:07:16.015978 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 607/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:15 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:16.078482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.079152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:16.090076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.090797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.091417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.092631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.093267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.094383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.181391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:16.194850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:16.200817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:16.210041 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f12d81a-ccfa-45d3-8725-e6a50700a1b5 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.136317 Oct 28 18:07:16.211965 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 608/1139] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:16 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:16.217819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9240d43f-d02c-4dd6-bab9-dda53145a5bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de104820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.277048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:16.286627 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-95175d48-9a0c-4817-8314-0834d1f3f278 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.439523 Oct 28 18:07:16.287557 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 532/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:15 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:16.298164 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9240d43f-d02c-4dd6-bab9-dda53145a5bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.084809 Oct 28 18:07:16.306063 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 609/1141] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:16 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:16.369582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.371020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:16.381943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.382446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.382892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.383884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.384357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.384797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.513521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:16.544112 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-30d44efb-cab6-419f-a2a0-8145986b907a tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.179908 Oct 28 18:07:16.545294 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 533/1142] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:16 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:16.568863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.569494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:16.582602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.583210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.583664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.584426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.584893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.585325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.622730 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] HTTP exception thrown: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Request method failure captured: Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed HTTP/1.1 Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlj5-5H6hVWSdX9zO00XLuGaZlswLb4TywKUUxLRrISOjuCNxOwEYrJC1_iUoCDa21ItZzd3k4NbBIX926OwUtIxUgwlZCeQ8IeZCRJle5KLhuiASbdmu_jNARyEGGaOM1Y7zoAWdmFsCxfXjkHd_CG01qNgVuF4O7mthv5eQhnVWU Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:16.625156 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c23cb0ccf6b342ba983516131c90956a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7d8ca12f168244f8a2ee4ee78f6263fc Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:16.626566 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '97e361a9-879b-4678-84a3-69c90f2b2bed'} Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:16.627388 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:16.628712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.631699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Returning 404 to user: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:16.634725 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-235de330-19ee-48c4-9a0a-d0b730ce60bf tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 404 len: 111 microversion: 2.1 time: 0.070015 Oct 28 18:07:16.644426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.645042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:16.649923 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 610/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:16 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:16.651688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.652476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.653145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.654081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.654765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.655416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.672230 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] HTTP exception thrown: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Request method failure captured: Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 HTTP/1.1 Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlj5-5H6hVWSdX9zO00XLuGaZlswLb4TywKUUxLRrISOjuCNxOwEYrJC1_iUoCDa21ItZzd3k4NbBIX926OwUtIxUgwlZCeQ8IeZCRJle5KLhuiASbdmu_jNARyEGGaOM1Y7zoAWdmFsCxfXjkHd_CG01qNgVuF4O7mthv5eQhnVWU Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:07:16.674196 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c23cb0ccf6b342ba983516131c90956a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 7d8ca12f168244f8a2ee4ee78f6263fc Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.676944 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '2e8a4193-8c20-48d7-830c-11d97b58e409'} Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:16.677881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.679375 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.681539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Returning 404 to user: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:16.681539 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eb95ee62-e27a-4127-9576-0bd924339995 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 404 len: 111 microversion: 2.1 time: 0.036868 Oct 28 18:07:16.688992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.689753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:16.694444 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 534/1144] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:16 2022] DELETE /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:16.696878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.697487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.698136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.698956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.699599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.700149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.725797 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] HTTP exception thrown: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Request method failure captured: Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 HTTP/1.1 Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlj5-5H6hVWSdX9zO00XLuGaZlswLb4TywKUUxLRrISOjuCNxOwEYrJC1_iUoCDa21ItZzd3k4NbBIX926OwUtIxUgwlZCeQ8IeZCRJle5KLhuiASbdmu_jNARyEGGaOM1Y7zoAWdmFsCxfXjkHd_CG01qNgVuF4O7mthv5eQhnVWU Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:16.728351 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c23cb0ccf6b342ba983516131c90956a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7d8ca12f168244f8a2ee4ee78f6263fc Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.730207 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2e8a4193-8c20-48d7-830c-11d97b58e409'} Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:16.731202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:16.732888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:16.734854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Returning 404 to user: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:16.735168 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-372a0019-b956-4f37-a535-c25e8af31f7c tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 404 len: 111 microversion: 2.1 time: 0.049540 Oct 28 18:07:16.736418 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 611/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:16 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:16.749935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8f6a471-34f3-4f8c-bdbf-5af47bbea687 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '.version_select at 0x7f78de19a5e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.796689 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8f6a471-34f3-4f8c-bdbf-5af47bbea687 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591347395" status: 202 len: 0 microversion: 2.1 time: 0.055203 Oct 28 18:07:16.798047 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 535/1146] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591347395 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:07:16.874864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.875962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:16.884410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.885306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.885985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.887063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.887784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.888534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.036585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:17.037775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:17.052909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.056556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.057155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.074125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.075929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.078567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.131600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.141758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.151133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.157599 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8750e92-c651-4559-beb7-68f328552a3f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.287458 Oct 28 18:07:17.169383 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 612/1147] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:16 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:17.243839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:17.244767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:17.257590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.259506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.261682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.262591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.266818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.267438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.291290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.302290 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c79e8e32-cd5d-4567-8291-7c22a6817039 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1221 microversion: 2.1 time: 0.271048 Oct 28 18:07:17.303991 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 536/1148] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:17 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:17.329441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:17.330315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:17.340834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.341874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.344068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.345198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.346216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.348634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.429953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.441382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.444819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.461080 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cfbbbcbe-b4ba-46ad-9a82-8ef3c9a35dc3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.219962 Oct 28 18:07:17.462221 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 613/1149] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:17 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:17.473893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-27f2c4c8-83fa-405c-b94e-e1cbbebaa99a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de158af0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:17.571654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-27f2c4c8-83fa-405c-b94e-e1cbbebaa99a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.108235 Oct 28 18:07:17.581710 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 614/1150] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:17 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:17.588247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:17.589175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:17.596457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.597439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.598109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.599333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.600096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.600771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.601493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.612305 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7a75e276-a9bf-4ae5-a4ac-f61bb23ae1db tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.299232 Oct 28 18:07:17.612905 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 537/1151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:17 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:17.730883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:17.776884 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af208da9-082f-46bb-9012-00fc3541d31b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.192960 Oct 28 18:07:17.778756 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 615/1152] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:17 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:18.131366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-55f806a9-1779-4cee-9c9d-701727823e18 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.146399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:18.157365 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-55f806a9-1779-4cee-9c9d-701727823e18 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/956165666" status: 202 len: 0 microversion: 2.1 time: 0.042269 Oct 28 18:07:18.158607 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 538/1153] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:07:18 2022] DELETE /compute/v2.1/flavors/956165666 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:07:18.168424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e10667ec-5a17-4d4c-bac6-bb44d772c8db tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.193097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.194018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:18.201519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.202246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.204456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.206424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.207999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.208682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.214098 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e10667ec-5a17-4d4c-bac6-bb44d772c8db tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.050681 Oct 28 18:07:18.223872 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 616/1154] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:18.244046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6be94929-5edd-4a7a-8180-1b24a0445bb4 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.291699 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6be94929-5edd-4a7a-8180-1b24a0445bb4 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/209755473" status: 202 len: 0 microversion: 2.1 time: 0.052394 Oct 28 18:07:18.293011 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 617/1155] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:07:18 2022] DELETE /compute/v2.1/flavors/209755473 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:07:18.304380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7131d3fa-4be8-4716-9232-2aeea8667427 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.348348 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7131d3fa-4be8-4716-9232-2aeea8667427 tempest-ServersWithSpecificFlavorTestJSON-1027186520 tempest-ServersWithSpecificFlavorTestJSON-1027186520-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050756 Oct 28 18:07:18.349032 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 618/1156] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:18.371876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.371876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:18.379022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.379525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.380095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.380826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.381348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.381785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.459457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:18.466053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:18.468361 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95e4e6ff-7f61-47e1-822f-8b1e032c598f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1283 microversion: 2.1 time: 0.118192 Oct 28 18:07:18.470138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 619/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1283 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:18.475168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.475676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:18.483425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.484223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.484925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.485962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.486587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.487188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.504300 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] HTTP exception thrown: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Request method failure captured: Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed HTTP/1.1 Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlj5-5H6hVWSdX9zO00XLuGaZlswLb4TywKUUxLRrISOjuCNxOwEYrJC1_iUoCDa21ItZzd3k4NbBIX926OwUtIxUgwlZCeQ8IeZCRJle5KLhuiASbdmu_jNARyEGGaOM1Y7zoAWdmFsCxfXjkHd_CG01qNgVuF4O7mthv5eQhnVWU Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:18.506217 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c23cb0ccf6b342ba983516131c90956a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7d8ca12f168244f8a2ee4ee78f6263fc Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.508637 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '97e361a9-879b-4678-84a3-69c90f2b2bed'} Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:18.509690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.511242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.513872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Returning 404 to user: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:18.514921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-70fb05cc-28e7-4e3b-b967-56a481426902 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 404 len: 111 microversion: 2.1 time: 0.043850 Oct 28 18:07:18.516019 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 620/1158] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:18 2022] DELETE /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:18.521541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.522441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:18.529542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.530296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.530938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.531900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.532530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.533123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.581114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:18.595465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:18.597845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:18.601761 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a4d107a-9e92-446f-9337-6b722303f618 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.417845 Oct 28 18:07:18.602932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 539/1159] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:18.614843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.616490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 97e361a9-879b-4678-84a3-69c90f2b2bed] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:18.630857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.637051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.637799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.638557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.639035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.639466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.640735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:18.667279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:18.669239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:18.674417 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] HTTP exception thrown: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.675248 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ffc557a-c203-4e26-9acc-b250f8fc0a80 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.157861 Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Request method failure captured: Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed HTTP/1.1 Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlj5-5H6hVWSdX9zO00XLuGaZlswLb4TywKUUxLRrISOjuCNxOwEYrJC1_iUoCDa21ItZzd3k4NbBIX926OwUtIxUgwlZCeQ8IeZCRJle5KLhuiASbdmu_jNARyEGGaOM1Y7zoAWdmFsCxfXjkHd_CG01qNgVuF4O7mthv5eQhnVWU Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:07:18.676044 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c23cb0ccf6b342ba983516131c90956a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 7d8ca12f168244f8a2ee4ee78f6263fc Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.677437 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '97e361a9-879b-4678-84a3-69c90f2b2bed'} Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:18.678199 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. Oct 28 18:07:18.679419 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.681493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Returning 404 to user: Instance 97e361a9-879b-4678-84a3-69c90f2b2bed could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:18.681493 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7f2edc03-1998-4f2b-9682-214d93f7fb94 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed" status: 404 len: 111 microversion: 2.1 time: 0.073431 Oct 28 18:07:18.685344 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 621/1161] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:18.685498 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 540/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/servers/97e361a9-879b-4678-84a3-69c90f2b2bed => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:18.691636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.693481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:18.705205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58670fec-ffb2-4726-b48b-28a40a134182 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de1588b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.711310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.718949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.719642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.720673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.721325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.721931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.761955 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-58670fec-ffb2-4726-b48b-28a40a134182 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.075471 Oct 28 18:07:18.770195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 622/1162] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:18.771987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.781205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:18.791564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.796333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.797038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.797807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.798286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.798724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.826575 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] HTTP exception thrown: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Request method failure captured: Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 HTTP/1.1 Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlj5-5H6hVWSdX9zO00XLuGaZlswLb4TywKUUxLRrISOjuCNxOwEYrJC1_iUoCDa21ItZzd3k4NbBIX926OwUtIxUgwlZCeQ8IeZCRJle5KLhuiASbdmu_jNARyEGGaOM1Y7zoAWdmFsCxfXjkHd_CG01qNgVuF4O7mthv5eQhnVWU Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:18.828541 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c23cb0ccf6b342ba983516131c90956a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7d8ca12f168244f8a2ee4ee78f6263fc Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:18.830352 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2e8a4193-8c20-48d7-830c-11d97b58e409'} Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:18.831284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:18.833021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.834506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Returning 404 to user: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:18.834506 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-721cf19f-a96b-484e-80aa-04161c2607a3 tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 404 len: 111 microversion: 2.1 time: 0.066425 Oct 28 18:07:18.834506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 623/1163] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:18 2022] DELETE /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:18.839864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.839864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:18.860878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.861308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.861756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.862482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.862946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.864106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.986870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:19.009934 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-17825bbd-b0ac-475a-b4ae-0564744de060 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.176404 Oct 28 18:07:19.010890 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 624/1164] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:19.024977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:19.025617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] [instance: 2e8a4193-8c20-48d7-830c-11d97b58e409] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:19.051218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.056340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.057086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.058111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.058783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.059381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.080143 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] HTTP exception thrown: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Request method failure captured: Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 HTTP/1.1 Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlj5-5H6hVWSdX9zO00XLuGaZlswLb4TywKUUxLRrISOjuCNxOwEYrJC1_iUoCDa21ItZzd3k4NbBIX926OwUtIxUgwlZCeQ8IeZCRJle5KLhuiASbdmu_jNARyEGGaOM1Y7zoAWdmFsCxfXjkHd_CG01qNgVuF4O7mthv5eQhnVWU Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:19.082396 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c23cb0ccf6b342ba983516131c90956a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c23cb0ccf6b342ba983516131c90956a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c23cb0ccf6b342ba983516131c90956a Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477 Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7d8ca12f168244f8a2ee4ee78f6263fc Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-222170477-project Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:19.083992 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2e8a4193-8c20-48d7-830c-11d97b58e409'} Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:19.084928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. Oct 28 18:07:19.086365 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:19.089072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] Returning 404 to user: Instance 2e8a4193-8c20-48d7-830c-11d97b58e409 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:19.090530 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d8d60c8-92fb-4a0e-9eb9-766eee924d5d tempest-ServersWithSpecificFlavorTestJSON-222170477 tempest-ServersWithSpecificFlavorTestJSON-222170477-project] 10.222.0.16 "GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409" status: 404 len: 111 microversion: 2.1 time: 0.078585 Oct 28 18:07:19.099848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 625/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:19 2022] GET /compute/v2.1/servers/2e8a4193-8c20-48d7-830c-11d97b58e409 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:19.190462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:19.255802 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7b6d2797-7dca-4fd8-95e6-fc791b6b659b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.569313 Oct 28 18:07:19.257686 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 541/1166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:19.493855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:19.494684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:19.510311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.510912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.511425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.512346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.512866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.513332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.633201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:19.634384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:19.642482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.643312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.643970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.644893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.646637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.647885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.873765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:19.884890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:19.886862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:19.888342 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a830ce4-a4eb-444f-af6a-ad8607aebbcf tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.260509 Oct 28 18:07:19.904225 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 542/1167] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:19 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:19.913472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:19.915265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:19.922256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.923099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.923727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.924885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.925510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.926107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.932332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:19.962924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:19.976239 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-274dad1a-d7ef-48d6-a84a-87ea5aa9893b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.481999 Oct 28 18:07:19.977436 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 626/1168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:19 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:19.989350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cfe01d8-a428-4b71-a2de-b7ce80ec65e5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de153b80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:20.032593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:20.049744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:20.053419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:20.081353 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0881ab12-ab2c-4af9-9926-c13d67ea9f10 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.173127 Oct 28 18:07:20.083417 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 543/1169] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:19 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:20.090074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:20.090919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:20.093001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cfe01d8-a428-4b71-a2de-b7ce80ec65e5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.113705 Oct 28 18:07:20.094357 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 627/1170] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:19 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:20.106362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:20.107138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:20.107742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:20.108697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:20.109163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:20.109591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:20.191954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:20.218714 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-778a6044-efdf-4ef9-8650-a6c57069d934 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.133978 Oct 28 18:07:20.220058 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 544/1171] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:20 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:20.286300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:20.287872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:20.298828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:20.300037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:20.301111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:20.302055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:20.302722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:20.303354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:20.517848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:20.526687 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71b7e2d3-e569-49c7-b8ce-b21ca63e4eda tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.247826 Oct 28 18:07:20.529712 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 628/1172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:20 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:20.918467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:20.919072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:20.927001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:20.932653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:20.938788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:20.939517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:20.941855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:20.942303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.005506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:21.006130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:21.018079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.018586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.019555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.020302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.024742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.025287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.286805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:21.303513 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d7cd2ae-8b54-4c30-9bfd-4340a47fb406 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.304350 Oct 28 18:07:21.304200 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 629/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:20 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:21.314888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32ef6737-6070-47ef-8407-31ec7bcfdbf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de16c0d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:21.332571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:21.348740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:21.350566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:21.351944 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae6736c3-44c9-452e-85ed-41bcadc9c6f0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.437235 Oct 28 18:07:21.359152 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 545/1174] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:20 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:21.364111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:21.368902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:21.398505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.399997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.403743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.403991 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32ef6737-6070-47ef-8407-31ec7bcfdbf1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.098698 Oct 28 18:07:21.404924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.405486 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 630/1175] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:21 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:21.408866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.409597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.414457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:21.420535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:21.422865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:21.436847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.437632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.438238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.440109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.441835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.446704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.606060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:21.634375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:21.638220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:21.653689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:21.669948 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11d85102-5c9b-4fef-a002-e4505d9e64ba tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.309274 Oct 28 18:07:21.676515 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a8ed556-e0a1-4103-85e7-28c4a738ccfe tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.269956 Oct 28 18:07:21.685381 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 546/1176] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:21 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:21.703540 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 631/1177] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:21 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:21.712484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:21.713091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6960fa20-c9e0-4dd1-a8a3-a2e53df8187c req-a7bdc464-44bf-451e-b0f1-f9ce870ef0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a33011c5-4735-4b59-856a-cac6b6f10d49", "tag": "d6ee0267-9ec4-44bc-8516-33cdd18c19b5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:21.713239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:21.735543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6960fa20-c9e0-4dd1-a8a3-a2e53df8187c req-a7bdc464-44bf-451e-b0f1-f9ce870ef0f3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.736459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6960fa20-c9e0-4dd1-a8a3-a2e53df8187c req-a7bdc464-44bf-451e-b0f1-f9ce870ef0f3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.737106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6960fa20-c9e0-4dd1-a8a3-a2e53df8187c req-a7bdc464-44bf-451e-b0f1-f9ce870ef0f3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.740122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.740623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.745034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.746224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.746876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.747477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.759939 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6960fa20-c9e0-4dd1-a8a3-a2e53df8187c req-a7bdc464-44bf-451e-b0f1-f9ce870ef0f3 service nova] Creating event network-changed:d6ee0267-9ec4-44bc-8516-33cdd18c19b5 for instance a33011c5-4735-4b59-856a-cac6b6f10d49 on n-h1-862404-2 Oct 28 18:07:21.771618 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6960fa20-c9e0-4dd1-a8a3-a2e53df8187c req-a7bdc464-44bf-451e-b0f1-f9ce870ef0f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066332 Oct 28 18:07:21.772580 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 632/1178] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:22.330515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:22.332425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:22.352721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.353520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.354141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.355037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.355674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.356304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.386016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:22.406358 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-615f238c-c29b-414f-b50b-37a7d9a46c36 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.692990 Oct 28 18:07:22.408755 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 547/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:21 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:22.426504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:22.427254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:22.442485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.443338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.447417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.448513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.449394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.450026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.616988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:22.627716 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e17e1cf3-7c11-43f5-a1f7-c6989c382642 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.301453 Oct 28 18:07:22.633308 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 633/1180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:22 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:22.651506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ea4fa7e-d74b-49fa-ae87-dd3670128c32 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de104670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:22.758767 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ea4fa7e-d74b-49fa-ae87-dd3670128c32 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.123820 Oct 28 18:07:22.759348 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 634/1181] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:22 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:22.774646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:22.775646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:22.797849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.798346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.799050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.800038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.800860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.801526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.932149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:22.934721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:22.942606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:22.945955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:22.952196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:22.954638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:22.956548 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c03426d3-d950-491d-8fa6-81edf71e2e85 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.195287 Oct 28 18:07:22.957401 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e920a112-003a-483a-af6b-6c3c40240a35 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.546023 Oct 28 18:07:22.959085 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 635/1182] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:22 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:22.968733 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 548/1183] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:22 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:22.972351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:22.973235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:22.990943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.991808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.993140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.994163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.994797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.995242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.174632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:23.221093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5eff2a2-0e96-4965-85b9-1c76efed84e8 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.260644 Oct 28 18:07:23.240137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 636/1184] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:22 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:23.437046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:23.438366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:23.445167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.446804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.447628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.448568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.449273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.449898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.656716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:23.657351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:23.670345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.670852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.671456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.672321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.672860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.673356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.681374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:23.691173 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad0a62ba-7085-4a54-8dfd-f64aaaf4badd tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.258419 Oct 28 18:07:23.698808 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 549/1185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:23 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:23.776935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-137eae9f-99af-4fdb-9ad4-79132c925796 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de262e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:23.852499 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-137eae9f-99af-4fdb-9ad4-79132c925796 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.068185 Oct 28 18:07:23.853314 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 550/1186] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:23 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:23.904841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0d9fad63-9da9-41fc-a17e-6d6834abd86e req-7e5d6f2a-7957-4c3e-9a68-9ab26685fd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad1f5bd-5eed-4cfa-b39b-09586df2a2fa", "name": "network-vif-unplugged", "status": "completed", "tag": "054624fe-f0fe-4640-8933-f7cf1a970e75"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:23.926011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0d9fad63-9da9-41fc-a17e-6d6834abd86e req-7e5d6f2a-7957-4c3e-9a68-9ab26685fd0f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.927856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0d9fad63-9da9-41fc-a17e-6d6834abd86e req-7e5d6f2a-7957-4c3e-9a68-9ab26685fd0f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.928742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0d9fad63-9da9-41fc-a17e-6d6834abd86e req-7e5d6f2a-7957-4c3e-9a68-9ab26685fd0f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.947533 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0d9fad63-9da9-41fc-a17e-6d6834abd86e req-7e5d6f2a-7957-4c3e-9a68-9ab26685fd0f service nova] Creating event network-vif-unplugged:054624fe-f0fe-4640-8933-f7cf1a970e75 for instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa on n-h2-862404-2 Oct 28 18:07:23.955343 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0d9fad63-9da9-41fc-a17e-6d6834abd86e req-7e5d6f2a-7957-4c3e-9a68-9ab26685fd0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054702 Oct 28 18:07:23.957506 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 551/1187] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:23.989278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:23.989998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:23.999055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.999561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.019742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.021159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.021761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.023107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.135882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:24.161786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:24.169168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:24.175195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:24.184631 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3ab973e0-0da9-45a4-8855-8f507b9a7fd8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1558 microversion: 2.91 time: 0.200286 Oct 28 18:07:24.186605 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-788239a9-8d46-43a4-b7e6-ebf2adfa9e2a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.532482 Oct 28 18:07:24.187692 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 637/1188] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:23 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:24.195052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:24.196645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:24.202829 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 552/1189] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:23 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:24.214238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.216039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.216039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.216616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.222146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.222540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.257532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:24.259194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:24.269556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.270340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.270979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.272144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.273433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.276871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.368868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:24.389078 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b5ad53a5-588b-45df-aab5-c9ac629424ff tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1929 microversion: 2.75 time: 0.138345 Oct 28 18:07:24.390277 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 553/1190] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:24 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1929 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:24.460029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:24.472615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:24.474480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:24.475857 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5d65d4c-5626-4b0c-a392-8ea4dacdc54a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.286932 Oct 28 18:07:24.477465 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 638/1191] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:24 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:24.722507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:24.723752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:24.738959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.739452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.739923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.740857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.741503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.742090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.870888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0bf9e54c-88b2-43db-9daf-8b6089ddc087 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de144e50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:24.936231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0bf9e54c-88b2-43db-9daf-8b6089ddc087 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.069532 Oct 28 18:07:24.947176 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 639/1192] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:24 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:25.195707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:25.207628 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-010994bf-198f-4d66-9141-b98f2fc26b5b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.488356 Oct 28 18:07:25.214407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:25.215316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:25.219886 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 554/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:24 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:25.234972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:25.235518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:25.244806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.245307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.245934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.246840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.247907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.252421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.261640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.262602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.263300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.264625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.266308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.267370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.386910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:25.400943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:25.408708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:25.415676 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-970d8105-ad94-4721-a2a1-b7d098ee1ffd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1558 microversion: 2.91 time: 0.194235 Oct 28 18:07:25.416594 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 555/1194] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:25 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1558 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:25.421609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:25.422467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:25.428866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.429610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.430361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.431230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.431852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.432423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.526125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:25.539559 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ebf6af79-1878-417a-8fc3-f1f113ac0396 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.329458 Oct 28 18:07:25.544628 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 640/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:25 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:25.553633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:25.556066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:25.572619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.573133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.573579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.574304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.574757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.575197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.631803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:25.656567 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-07511e00-ec19-4029-86e2-a6b95590be79 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1935 microversion: 2.75 time: 0.238732 Oct 28 18:07:25.657816 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 556/1196] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:25 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1935 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:25.728278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:25.766013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:25.778721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:25.783186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:25.788908 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-230ac161-f359-4d8b-a620-36687faa8d57 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.240525 Oct 28 18:07:25.790515 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 641/1197] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:25 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:25.975181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de0b837f-0cc1-4cbc-b788-a8b8a13e3acc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de19ac10>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:25.980177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f5128aa9-be6c-4184-b9fe-afd79297ae72 req-d10dac0c-2928-421e-8376-5afd5b7ffd34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad1f5bd-5eed-4cfa-b39b-09586df2a2fa", "tag": "054624fe-f0fe-4640-8933-f7cf1a970e75"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:26.005657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5128aa9-be6c-4184-b9fe-afd79297ae72 req-d10dac0c-2928-421e-8376-5afd5b7ffd34 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.009406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5128aa9-be6c-4184-b9fe-afd79297ae72 req-d10dac0c-2928-421e-8376-5afd5b7ffd34 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.010677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5128aa9-be6c-4184-b9fe-afd79297ae72 req-d10dac0c-2928-421e-8376-5afd5b7ffd34 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.023244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:26.046311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f5128aa9-be6c-4184-b9fe-afd79297ae72 req-d10dac0c-2928-421e-8376-5afd5b7ffd34 service nova] Creating event network-changed:054624fe-f0fe-4640-8933-f7cf1a970e75 for instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa on n-h2-862404-2 Oct 28 18:07:26.050540 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de0b837f-0cc1-4cbc-b788-a8b8a13e3acc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.090419 Oct 28 18:07:26.051314 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 557/1198] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:25 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:26.062797 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f5128aa9-be6c-4184-b9fe-afd79297ae72 req-d10dac0c-2928-421e-8376-5afd5b7ffd34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086670 Oct 28 18:07:26.063642 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 642/1199] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:26.239065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:26.239690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:26.259108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.259705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.260597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.261693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.262263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.262695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.451259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:26.452196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:26.460858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.464280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.468483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.469341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.469897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.470409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.521492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:26.530702 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42a3fee2-0c70-44e6-8b87-139798d5ccc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.295512 Oct 28 18:07:26.540909 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 558/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:26 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:26.576078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:26.577447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:26.587418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:26.589792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:26.597357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.598204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.599658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.599805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:26.602087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.603414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.604149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.607022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:26.627629 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-367bc627-d733-43f4-8c07-875b386a557d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1558 microversion: 2.91 time: 0.180920 Oct 28 18:07:26.631244 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 643/1201] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:26 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:26.699366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:26.700013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:26.712511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.715172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.716036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.720768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.721698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.722310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.895509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:26.935460 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-632c4fb5-7a67-422b-aeae-56378d5c424b tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1935 microversion: 2.75 time: 0.244722 Oct 28 18:07:26.938798 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 644/1202] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:26 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1935 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:26.948967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:26.949912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:26.958409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.959258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.959989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.960994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.961677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.962333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:27.004666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:27.014288 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5352e069-4f0d-4465-9d82-b8089f90a2d6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.447968 Oct 28 18:07:27.028450 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 559/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:26 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:27.096950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6e6599ed-a23b-4cbd-8955-1ba98ac9dd3a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de248f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:27.224816 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6e6599ed-a23b-4cbd-8955-1ba98ac9dd3a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1440 microversion: 2.1 time: 0.135520 Oct 28 18:07:27.230984 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 560/1204] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:27 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1440 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:27.411312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:27.423645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:27.425679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:27.427580 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e302c20e-3c9c-4bd7-8f00-370beaf9d247 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.486891 Oct 28 18:07:27.428534 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 645/1205] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:26 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:27.562513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:27.563126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:27.573972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:27.574480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:27.574918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:27.584407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:27.584911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:27.585397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:27.664131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:27.664996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:27.675459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:27.682805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:27.683995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:27.685346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:27.686031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:27.686683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:27.778120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:27.795069 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ca147d7d-1875-40a0-bb40-553274e374d4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.236370 Oct 28 18:07:27.795875 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 561/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:27 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:27.829358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:27.840313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:27.842587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:27.849425 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8211e460-6369-411c-884c-32cd9db7f02e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.192230 Oct 28 18:07:27.850665 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 646/1207] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:27 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:27.970661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:27.971577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:27.978799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:27.979880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:27.979880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:27.981261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:27.981261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:27.981523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:28.003408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:28.049436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:28.051171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:28.067305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:28.084878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:28.085479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:28.086918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:28.090396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:28.090964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:28.113869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:28.176090 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e622f310-60b5-4a3d-8e08-4f4f201efd32 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1935 microversion: 2.75 time: 0.205425 Oct 28 18:07:28.177119 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 562/1208] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:27 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1935 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:28.256435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a90a10db-8b95-419c-a538-8c8d816d351a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de267ca0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:28.544571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:28.553716 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36463b49-1645-4375-9766-03ef36166da4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.519670 Oct 28 18:07:28.557113 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 647/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:28 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:28.563587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:28.575776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:28.582473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:28.586882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:28.587579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:28.588515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:28.589137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:28.600589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:29.104026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:29.129376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:29.134128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:29.144670 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e67da8c0-379f-4396-aefe-322b6bac161d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.586076 Oct 28 18:07:29.146071 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 648/1210] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:28 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:29.162595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:29.182774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:29.192021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:29.192823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:29.193437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:29.194919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:29.196151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:29.199503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:29.623976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:29.633914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5cbbf48-8a50-4a2b-8da8-2a66063974ba tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.486054 Oct 28 18:07:29.639309 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 649/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:29 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:29.644670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:29.645523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:29.686574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:29.687498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:29.688241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:29.689966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:29.690736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:29.691430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:29.877612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:29.894466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:29.946362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:29.946362 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d627ff1-826f-41bc-896f-29891bc76e2e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.268846 Oct 28 18:07:29.946362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 650/1212] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:29 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:29.946362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:29.947997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:29.947997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:29.947997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:29.947997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:29.948346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:29.948346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:29.948346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:30.986435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] Lazy-loading 'services' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:31.021091 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e875fcea-9d97-4f4b-ba9b-96c6996b45d1 tempest-ServersAdmin275Test-1659788906 tempest-ServersAdmin275Test-1659788906-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1920 microversion: 2.75 time: 1.108364 Oct 28 18:07:31.036518 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 651/1213] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:29 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1920 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:31.055267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:31.056019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:31.078017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.078891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.079514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.081037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.081664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.082518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.297595 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a90a10db-8b95-419c-a538-8c8d816d351a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1449 microversion: 2.1 time: 3.039840 Oct 28 18:07:31.298991 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 563/1214] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:28 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1449 bytes in 3047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:31.313584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:31.314554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:31.327314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.329296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.330030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.330833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.331297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.332001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.495676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:31.503495 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ceaa9ff7-59e1-4e3c-a08e-247d470edc60 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.466003 Oct 28 18:07:31.505765 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 652/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:31 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:31.511553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:31.512189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:31.524573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.527649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.528324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.529813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.530237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.530804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.552373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:31.565797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:31.568340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:31.570972 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-31320cbf-3158-4191-bb66-a41f2bcc0430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.260606 Oct 28 18:07:31.572769 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 564/1216] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:31 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:31.580823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:31.581746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:31.589717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.590573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.591253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.592251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.592971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.593621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.716732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:31.726180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:31.728693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:31.734495 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40319d99-e3bc-409c-ac99-0af5c1c8c0a1 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.160491 Oct 28 18:07:31.735353 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 565/1217] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:31 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:31.740131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:31.740891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:31.748783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.749585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.750252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.751168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.751867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.753178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.801017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:07:31.840647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:31.849576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-224bd404-8b11-44c8-992d-9eaa56d422f0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.342158 Oct 28 18:07:31.854138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 653/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:31 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:31.874364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b99c0252-44e2-474b-a6a0-51dc5036b770 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de116f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:31.932529 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0ba8c337-315f-4a1d-b6f3-d474fc7233d5 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 204 len: 0 microversion: 2.75 time: 0.195180 Oct 28 18:07:31.938566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 566/1219] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:07:31 2022] DELETE /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:07:31.945297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:31.946457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:31.962118 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b99c0252-44e2-474b-a6a0-51dc5036b770 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 200 len: 1449 microversion: 2.1 time: 0.105469 Oct 28 18:07:31.964251 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 654/1220] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:07:31 2022] GET /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 1449 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:31.970795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.972367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.973052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.974034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.974686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.975300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.983949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50a4cc79-6a36-4e73-94b0-b5395b971a45 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0fddc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:32.109778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:32.121943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:32.123446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:32.137177 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6277a0ff-296b-47b0-b994-e05d950583d2 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1444 microversion: 2.75 time: 0.197158 Oct 28 18:07:32.151923 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 567/1221] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:31 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1444 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:32.531635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:32.532959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:32.545260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:32.545514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:32.545958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:32.546694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:32.547251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:32.548381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:32.833148 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50a4cc79-6a36-4e73-94b0-b5395b971a45 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 204 len: 0 microversion: 2.1 time: 0.853862 Oct 28 18:07:32.833877 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 655/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:31 2022] DELETE /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:32.839564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:32.840972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:32.848978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:32.849940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:32.850803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:32.852759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:32.853658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:32.854449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.018222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.050905 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-be4c8d33-c5ce-43eb-b56b-35f3aa8716d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.518193 Oct 28 18:07:33.050905 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 568/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:32 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:33.056035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9f945697-3d20-40df-a628-9ceadf75e3e7 req-4a296f5c-4f5d-4c01-861d-bd6a4b32bb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33011c5-4735-4b59-856a-cac6b6f10d49", "name": "network-vif-plugged", "status": "completed", "tag": "d6ee0267-9ec4-44bc-8516-33cdd18c19b5"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:33.138314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9f945697-3d20-40df-a628-9ceadf75e3e7 req-4a296f5c-4f5d-4c01-861d-bd6a4b32bb3b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.138809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9f945697-3d20-40df-a628-9ceadf75e3e7 req-4a296f5c-4f5d-4c01-861d-bd6a4b32bb3b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.139249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9f945697-3d20-40df-a628-9ceadf75e3e7 req-4a296f5c-4f5d-4c01-861d-bd6a4b32bb3b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.165969 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9f945697-3d20-40df-a628-9ceadf75e3e7 req-4a296f5c-4f5d-4c01-861d-bd6a4b32bb3b service nova] Creating event network-vif-plugged:d6ee0267-9ec4-44bc-8516-33cdd18c19b5 for instance a33011c5-4735-4b59-856a-cac6b6f10d49 on n-h1-862404-2 Oct 28 18:07:33.175986 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9f945697-3d20-40df-a628-9ceadf75e3e7 req-4a296f5c-4f5d-4c01-861d-bd6a4b32bb3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130885 Oct 28 18:07:33.178576 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 569/1224] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:33.185447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:33.186115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:33.201604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.204031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.204733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.206243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.208207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.208876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.209505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.235224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.247249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.251267 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d249a34-0e5f-4254-a647-ccd7b89ab4d8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.416154 Oct 28 18:07:33.278201 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 656/1225] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:32 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:33.285074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:33.285684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:33.292734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.293519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.294153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.295090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.295750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.296442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.347933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:07:33.387843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.397677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.402873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.421577 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7d529bb-cb06-4944-8c1b-ac8bac177401 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.240710 Oct 28 18:07:33.422547 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 570/1226] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:33 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:33.428329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:33.429299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:33.437930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.438436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.438940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.439944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.440403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.440857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.514378 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50ace1d1-1e46-4ef7-aaa3-1b974fe3e87b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 204 len: 0 microversion: 2.1 time: 0.233370 Oct 28 18:07:33.515166 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 657/1227] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:33 2022] DELETE /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:33.525554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:33.526561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:33.534331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.535237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.535898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.536940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:33.537601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:33.538196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.622744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.634574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.636571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.643076 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a59934ee-163d-454f-abbc-c1d8e44e31d4 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1444 microversion: 2.75 time: 0.123050 Oct 28 18:07:33.644185 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 658/1228] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:33 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1444 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:33.718551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-562771370", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "d98ef463-74a4-479c-b632-73800f8bbec7"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:33.801106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] validate_networks() for [('d98ef463-74a4-479c-b632-73800f8bbec7', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:07:33.875613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:33.892557 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94d41aa7-a5bc-4098-a904-bfc13b69a73f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.468852 Oct 28 18:07:33.908439 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 571/1229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:33 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:34.077679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:34.078382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:34.094269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.095579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.099548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.100415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.100985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.102513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.333397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.343832 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dec28d4b-2d67-4d6b-90c1-87a2ed22a544 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1325 microversion: 2.1 time: 0.270524 Oct 28 18:07:34.344770 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 572/1230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:34 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:34.349767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:34.350383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:34.365291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.368217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.370924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.371978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.372651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.375000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.437488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:07:34.438626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:07:34.439177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:07:34.439793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:07:34.440514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:07:34.453244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.453856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.454574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.455405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.455961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.456457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.475942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:07:34.482924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for user 46b892cd4bff49b78773d9b78da06bcd and project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:07:34.497277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:07:34.500054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:07:34.571495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.580904 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd7916c8-18d8-422c-8c31-6277c2f5cfb5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866612 Oct 28 18:07:34.588947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.588947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.588947 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a4dfe288-a0e0-4926-9196-ca8a4177a746 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.239511 Oct 28 18:07:34.589297 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 573/1231] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:34 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:34.590268 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 659/1232] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:07:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:07:34.595252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2ae52d4-0b0f-4563-a5ad-8f934e7c3de9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:34.595601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:34.596367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:34.596755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2ae52d4-0b0f-4563-a5ad-8f934e7c3de9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:34.603375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.603893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.604334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.605048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.606805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.607728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.683394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b2ae52d4-0b0f-4563-a5ad-8f934e7c3de9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.692518 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2ae52d4-0b0f-4563-a5ad-8f934e7c3de9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1207 microversion: 2.1 time: 0.100870 Oct 28 18:07:34.709508 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 660/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:34 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1207 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:34.713915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.717086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:34.719504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:34.729078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.730328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.730737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.731728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.732405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.733049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.734593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.741336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.760628 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5ed883ce-24e6-4c75-b0a1-87fdf87ec8cf tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.173784 Oct 28 18:07:34.761233 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 574/1234] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:34 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:34.840871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.843164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:34.852069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.854267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:34.861014 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0387531c-f564-40b2-a864-cae1f1e15e58 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1444 microversion: 2.75 time: 0.150291 Oct 28 18:07:34.888790 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 661/1235] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:34 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1444 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:34.918330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:34.918964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:34.925862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.926313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.926756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.927617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.928109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.928606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.185232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:35.195648 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4488874-ad71-465f-9e90-d50074ec3d77 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.283092 Oct 28 18:07:35.197262 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 575/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:34 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:35.368509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:35.368867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:35.382103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.383159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.383600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.388819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.396630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.402536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c9782fdb-f866-4d14-8f74-c9ea458eb63a req-2b6f8687-9229-4f03-a87c-d9396e897f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d8c7646-a0a7-45ab-b60e-a55d373908d7", "name": "network-vif-unplugged", "status": "completed", "tag": "381f2aeb-2625-4058-8a62-a7ad141a703d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:35.408488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.416858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:35.423177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c9782fdb-f866-4d14-8f74-c9ea458eb63a req-2b6f8687-9229-4f03-a87c-d9396e897f5c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.424576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c9782fdb-f866-4d14-8f74-c9ea458eb63a req-2b6f8687-9229-4f03-a87c-d9396e897f5c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.436526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c9782fdb-f866-4d14-8f74-c9ea458eb63a req-2b6f8687-9229-4f03-a87c-d9396e897f5c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.451191 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c9782fdb-f866-4d14-8f74-c9ea458eb63a req-2b6f8687-9229-4f03-a87c-d9396e897f5c service nova] Creating event network-vif-unplugged:381f2aeb-2625-4058-8a62-a7ad141a703d for instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 on n-h2-862404-2 Oct 28 18:07:35.468815 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c9782fdb-f866-4d14-8f74-c9ea458eb63a req-2b6f8687-9229-4f03-a87c-d9396e897f5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070273 Oct 28 18:07:35.469985 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 576/1237] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:35.617689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:35.625509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:35.641873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.644318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.645861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.646843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.652399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.653055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.659774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:35.670217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f88dde6-5665-47e6-ac29-464e7b9daa96 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 0.306355 Oct 28 18:07:35.688086 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 662/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:35 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:35.695713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:35.696769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:35.718131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.721467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.722238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.723201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.727998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.730452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.866712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:35.877286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:35.886288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:35.891513 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c5e7f83c-1ab1-45c5-afde-d34f23fe4a0e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.280237 Oct 28 18:07:35.892586 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 577/1239] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:35 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:35.906365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:35.915780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:35.920853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.924698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.927886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.929085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.930973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.932325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.073080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.081803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4401c50-f578-4e48-a7e8-259997623e56 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 0.389975 Oct 28 18:07:36.083159 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 663/1240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:35 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:36.090077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:36.090696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:36.094561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:36.101291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.101291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.103627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.103627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.104131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.104675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.208897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.223651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.227728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.235538 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e544678-72ae-4776-a781-cfcf89038547 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.151226 Oct 28 18:07:36.236876 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 664/1241] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:36 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:36.243334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:36.244902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:36.251187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.251801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.252507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.253323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.253913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.254442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.300649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.301293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.302415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.303269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lazy-loading 'fault' on Instance uuid dfd77bc5-215c-4777-8abf-d54f1db10ebe {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:36.349314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.357150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.358576 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-29a6b38f-a330-45ae-9809-d4c90affeeb3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1259 microversion: 2.1 time: 0.463696 Oct 28 18:07:36.371748 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 578/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:35 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1259 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:36.383707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.386586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8393485692fd4cf9b7fde1f618bd6792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356ee4a9601740a48504914f711c2158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.393013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eee3a38e-1215-4cf9-9a81-c4398224ef55 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1541252050", "metadata": {"": ""}}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:36.393758 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d1e39ad-27d9-4fe8-9f98-29dc2e157b88 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 200 len: 1449 microversion: 2.75 time: 0.155136 Oct 28 18:07:36.401748 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 665/1243] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:36 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 1449 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:36.412308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:36.412308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eee3a38e-1215-4cf9-9a81-c4398224ef55 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action HTTP/1.1 Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 107 Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:07:36.427586 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1541252050", "metadata": {"": ""}}} Oct 28 18:07:36.429088 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'a33011c5-4735-4b59-856a-cac6b6f10d49', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1541252050', 'metadata': {'': ''}}}} Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'': ''} Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:36.430545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:36.432158 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:36.433575 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:36.433575 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:36.433575 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:07:36.433575 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:07:36.433575 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:07:36.433575 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:36.435063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eee3a38e-1215-4cf9-9a81-c4398224ef55 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:36.436628 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eee3a38e-1215-4cf9-9a81-c4398224ef55 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action" status: 400 len: 170 microversion: 2.1 time: 0.062331 Oct 28 18:07:36.440135 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 579/1244] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 18:07:36 2022] POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action => generated 170 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:07:36.445412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.446108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.446942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.448725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.449207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.449647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.452228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:36.457503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:36.473895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.485875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.487470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.490392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.491870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.494759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.559491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:36.806017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:36.816619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-538006eb-a141-42c7-9a1c-ccab63e692b7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.418063 Oct 28 18:07:36.818473 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 666/1245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:36 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:36.930834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:36.932079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:36.947539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.950919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.954286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.955474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:36.959099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:36.959769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.205647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.221723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.223855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.226408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c17d292-eeb7-4a3d-8f17-3251ff92f3bb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.300506 Oct 28 18:07:37.228287 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 667/1246] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:36 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:37.269936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:37.272337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:37.288922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.290336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.290729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.291563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.292269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.292775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.324874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.344323 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96465007-40b9-43ca-b561-1e2c6e0b7417 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 0.899388 Oct 28 18:07:37.347972 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 580/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:36 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:37.376387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:37.377249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:37.397559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.399901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.401324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.403725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.404429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.405559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.478831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.516863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.521925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.542086 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29c79e2a-19e8-45c7-b5e7-f18295ae7ad4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.276624 Oct 28 18:07:37.545558 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 668/1248] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:37 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:37.561274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:37.565391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:37.590218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.595182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.595858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.600871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.602348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.602955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.737285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.747179 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59344e89-307d-4df2-93a5-dd963134f70f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1265 microversion: 2.1 time: 0.200296 Oct 28 18:07:37.760067 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 669/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:37 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:37.769611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:37.770230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] [instance: dfd77bc5-215c-4777-8abf-d54f1db10ebe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:37.793412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:37.797577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.798144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.798588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.799301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.800056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.803570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.806595 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-deb46803-f5ec-400d-b8b4-e63d5605a4de tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 0.434301 Oct 28 18:07:37.809153 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 581/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:37 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:37.834990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-554cd367-2978-44a1-9d1b-ab6b23b7804d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1566009229", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:37.835579 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] HTTP exception thrown: Instance dfd77bc5-215c-4777-8abf-d54f1db10ebe could not be found. Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-554cd367-2978-44a1-9d1b-ab6b23b7804d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action HTTP/1.1 Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 619 Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:07:37.847238 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:07:37.848734 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:07:37.849362 n-d-862404-2 devstack@n-api.service[120679]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1566009229", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 28 18:07:37.849362 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:07:37.849362 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'a33011c5-4735-4b59-856a-cac6b6f10d49', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1566009229', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 18:07:37.849597 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:37.850269 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.851363 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:37.854157 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:37.854157 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:37.854157 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:07:37.854157 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:07:37.854157 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:07:37.854157 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Request method failure captured: Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe HTTP/1.1 Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBoTX36MePeJLr0jdWWv0umXopMO7ha6_M37bRmJbwpQaP9PljfxKiQAxAGwOXgBEEhfZd343zKurojdBdvIbWusxyCRG_qUvZGjGqv2zcPNSd0XSgcgJKHTQ7jYyFUzWrTgZPI2CmwW6T_zPo9FMQ5-GQj37l3hU3qXqGpYIaOwTyI Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.75 Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 356ee4a9601740a48504914f711c2158 Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdmin275Test-503684885 Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:37.855916 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/356ee4a9601740a48504914f711c2158"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/356ee4a9601740a48504914f711c2158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_356ee4a9601740a48504914f711c2158", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/356ee4a9601740a48504914f711c2158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdmin275Test-503684885 Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 356ee4a9601740a48504914f711c2158 Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdmin275Test-503684885 Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdmin275Test-503684885-project Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 8393485692fd4cf9b7fde1f618bd6792 Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdmin275Test-503684885-project Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance dfd77bc5-215c-4777-8abf-d54f1db10ebe could not be found. Oct 28 18:07:37.858956 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'dfd77bc5-215c-4777-8abf-d54f1db10ebe'} Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd77bc5-215c-4777-8abf-d54f1db10ebe could not be found. Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:37.861093 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd77bc5-215c-4777-8abf-d54f1db10ebe could not be found. Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd77bc5-215c-4777-8abf-d54f1db10ebe could not be found. Oct 28 18:07:37.869312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:37.872802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] Returning 404 to user: Instance dfd77bc5-215c-4777-8abf-d54f1db10ebe could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:37.872802 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8295a93-cd74-4144-8c69-269a9467b197 tempest-ServersAdmin275Test-503684885 tempest-ServersAdmin275Test-503684885-project] 10.222.0.16 "GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe" status: 404 len: 111 microversion: 2.75 time: 0.098873 Oct 28 18:07:37.873110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-554cd367-2978-44a1-9d1b-ab6b23b7804d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:37.873110 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-554cd367-2978-44a1-9d1b-ab6b23b7804d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action" status: 400 len: 938 microversion: 2.1 time: 0.032169 Oct 28 18:07:37.873472 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 670/1251] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:37 2022] GET /compute/v2.1/servers/dfd77bc5-215c-4777-8abf-d54f1db10ebe => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:07:37.873472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:37.873472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:37.875032 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 582/1252] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 18:07:37 2022] POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action => generated 938 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:07:37.880429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:37.881460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:37.890466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.891218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.891621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.892852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.893387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.893851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.894754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.894889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.895569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.896195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.896728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.897293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.317990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:38.327491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-164ee9e2-9176-499b-ad60-eb92048f4626 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1542 microversion: 2.1 time: 0.462604 Oct 28 18:07:38.339049 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 671/1253] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:37 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1542 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:38.352094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f5846faa-e778-4379-8829-49e224a80dfc req-fef55ed8-177f-4aec-8569-98fee13a2672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d8c7646-a0a7-45ab-b60e-a55d373908d7", "name": "network-vif-deleted", "tag": "381f2aeb-2625-4058-8a62-a7ad141a703d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:38.373621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5846faa-e778-4379-8829-49e224a80dfc req-fef55ed8-177f-4aec-8569-98fee13a2672 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.376341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5846faa-e778-4379-8829-49e224a80dfc req-fef55ed8-177f-4aec-8569-98fee13a2672 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.376795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5846faa-e778-4379-8829-49e224a80dfc req-fef55ed8-177f-4aec-8569-98fee13a2672 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.396117 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f5846faa-e778-4379-8829-49e224a80dfc req-fef55ed8-177f-4aec-8569-98fee13a2672 service nova] Creating event network-vif-deleted:381f2aeb-2625-4058-8a62-a7ad141a703d for instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 on n-h2-862404-2 Oct 28 18:07:38.409100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:38.412332 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f5846faa-e778-4379-8829-49e224a80dfc req-fef55ed8-177f-4aec-8569-98fee13a2672 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071850 Oct 28 18:07:38.417470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f4598a6-5a5d-4827-9671-012621357484 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 0.541115 Oct 28 18:07:38.424151 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 672/1254] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:38.424925 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 583/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:37 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:38.437681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:38.447799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:38.453630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:38.461464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:38.469625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.470264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.472522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.473230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.474168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.475471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.476077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.476964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.477433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.480971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.481782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.482010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.924894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:38.942916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:38.946791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:38.950465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba051a56-dcff-4ea3-9d19-d2b0212c29a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.522972 Oct 28 18:07:38.952162 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 673/1256] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:38 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:38.962518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:38.965471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:38.980162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.981058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.983068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.985126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.986669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.987238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:39.153518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:39.165993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:39.170102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:39.181453 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c386bb43-fcc5-48ba-a049-3af754e8e4a6 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.227897 Oct 28 18:07:39.197209 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 674/1257] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:38 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:39.224637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:39.228194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:39.238679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:39.239158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:39.239607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:39.241763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:39.243200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:39.243655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:39.432494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:39.458073 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7d312984-c102-47db-a8e5-ba6ae8aee752 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1265 microversion: 2.1 time: 0.256677 Oct 28 18:07:39.459977 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 675/1258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:39 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:39.484117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:39.485131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:39.541271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:39.542046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:39.542682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:39.545804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:39.547294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:39.548802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:39.570534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:39.583012 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b0c7816b-932e-4f89-8556-ddea006eaa9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 1.132234 Oct 28 18:07:39.583832 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 584/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:38 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:39.964373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f598a48-32e4-439f-af44-4adeccab7b0b tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-452243342", "ram": 512, "vcpus": 1, "disk": 10, "id": 1652469282, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:40.026014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f598a48-32e4-439f-af44-4adeccab7b0b tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.441119 Oct 28 18:07:40.037996 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 585/1260] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:07:39 2022] POST /compute/v2.1/flavors => generated 415 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:40.046298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c467827-1ec7-48c8-bd25-74518d10da9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c467827-1ec7-48c8-bd25-74518d10da9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action HTTP/1.1 Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 285 Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:07:40.052130 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:07:40.053832 n-d-862404-2 devstack@n-api.service[120679]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'a33011c5-4735-4b59-856a-cac6b6f10d49', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:07:40.055625 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:07:40.056545 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:07:40.059345 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:07:40.060520 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:07:40.060520 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:40.060698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:40.062681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c467827-1ec7-48c8-bd25-74518d10da9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:40.063713 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3c467827-1ec7-48c8-bd25-74518d10da9f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action" status: 400 len: 619 microversion: 2.1 time: 0.023023 Oct 28 18:07:40.064568 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 586/1261] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 18:07:40 2022] POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:07:40.069223 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ccb3da4-b480-4196-a59f-b78941cce118 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1541 microversion: 2.1 time: 0.604682 Oct 28 18:07:40.069844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 676/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:39 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1541 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:40.073540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:40.074392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:40.082659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d07327a1-a338-4ea3-aa11-0e4f2acc3ffa tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:40.083864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:40.084557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:40.103192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:40.104083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:40.104572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:40.105014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:40.135087 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d07327a1-a338-4ea3-aa11-0e4f2acc3ffa tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1652469282/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062324 Oct 28 18:07:40.135701 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 677/1263] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 18:07:40 2022] POST /compute/v2.1/flavors/1652469282/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:40.145335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:40.145905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:40.186736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:40.187291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:40.187747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:40.188522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:40.188986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:40.189414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:40.663550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:40.679979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df52bcab-553c-4d57-a300-36a40ee4d4dc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 0.538628 Oct 28 18:07:40.682093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 678/1264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:40 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:41.104756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77b89647-0b3b-45f7-a5da-48540d61565f tempest-FlavorsExtraSpecsTestJSON-1117259241 tempest-FlavorsExtraSpecsTestJSON-1117259241-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:41.118138 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77b89647-0b3b-45f7-a5da-48540d61565f tempest-FlavorsExtraSpecsTestJSON-1117259241 tempest-FlavorsExtraSpecsTestJSON-1117259241-project] 10.222.0.16 "GET /compute/v2.1/flavors/1652469282/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.424125 Oct 28 18:07:41.119505 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 679/1265] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 18:07:40 2022] GET /compute/v2.1/flavors/1652469282/os-extra_specs => generated 66 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:41.124852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:41.125747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:41.134467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.135337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.136131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.137109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.137790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.138682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.144149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:41.158665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:41.161288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:41.165268 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e7bff6e5-9b03-451f-9d38-0f16b3aaa107 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 1.099549 Oct 28 18:07:41.165854 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 587/1266] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:40 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:41.180387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:41.181286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:41.209654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.210249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.211773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.212693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.213880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.214864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.360146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:41.363169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:41.374419 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d44fe898-1931-48af-aad2-8a829142b492 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1265 microversion: 2.1 time: 0.207316 Oct 28 18:07:41.375327 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 588/1267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:41 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:41.380108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:41.380918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:41.381046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:41.383284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:41.388694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.389387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.390021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.390901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.391516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.391776 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6189b072-9f5f-4d19-a4a4-53fc5958ca5e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.270891 Oct 28 18:07:41.392283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.400535 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 680/1268] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:41 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:41.415767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:41.416678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:41.428641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.429438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.430167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.431054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.433415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.440616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.468438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:41.825478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:41.835262 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-15f0950a-419d-4dfb-a3ff-23d6783600d8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 0.458757 Oct 28 18:07:41.853108 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 589/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:41 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:41.853108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d3e06fc6-b82f-4b8d-b7c8-0b87775374dd tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:41.920027 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d3e06fc6-b82f-4b8d-b7c8-0b87775374dd tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1652469282/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078705 Oct 28 18:07:41.932246 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 590/1270] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 18:07:41 2022] POST /compute/v2.1/flavors/1652469282/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:41.937437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-686495134"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:41.943505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:41.965770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.966274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.966719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.967451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.967943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.968380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.340803 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d62a254-b002-472d-97a6-e03f29a75acf tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action" status: 202 len: 0 microversion: 2.1 time: 0.401835 Oct 28 18:07:42.342561 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 591/1271] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:07:41 2022] POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:07:42.351484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17d20ab5-e2d6-4832-91c2-f90b4c92fd87 tempest-FlavorsExtraSpecsTestJSON-1117259241 tempest-FlavorsExtraSpecsTestJSON-1117259241-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:42.365608 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17d20ab5-e2d6-4832-91c2-f90b4c92fd87 tempest-FlavorsExtraSpecsTestJSON-1117259241 tempest-FlavorsExtraSpecsTestJSON-1117259241-project] 10.222.0.16 "GET /compute/v2.1/flavors/1652469282/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.021451 Oct 28 18:07:42.375192 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 592/1272] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:07:42 2022] GET /compute/v2.1/flavors/1652469282/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:42.380554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:42.381609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:42.388671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.389728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.390277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.391487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.393218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.393218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.488987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:42.502831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c946b4a-fab7-41ab-a58f-a00a17b5e4af tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1541 microversion: 2.1 time: 1.100963 Oct 28 18:07:42.504674 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 681/1273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:41 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1541 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:42.514212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-308017746"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:42.516992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:42.525451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.526305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.527283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.529087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.531175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.532650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.576281 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Cannot 'createImage' instance a33011c5-4735-4b59-856a-cac6b6f10d49 while it is in task_state image_snapshot_pending Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action HTTP/1.1 Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 84 Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:42.578373 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-308017746"}} Oct 28 18:07:42.579723 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot 'createImage' instance a33011c5-4735-4b59-856a-cac6b6f10d49 while it is in task_state image_snapshot_pending Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'a33011c5-4735-4b59-856a-cac6b6f10d49', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-308017746'}}} Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:42.580936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance a33011c5-4735-4b59-856a-cac6b6f10d49 while it is in task_state image_snapshot_pending Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance a33011c5-4735-4b59-856a-cac6b6f10d49 while it is in task_state image_snapshot_pending Oct 28 18:07:42.583068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:42.590485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 409 to user: Cannot 'createImage' instance a33011c5-4735-4b59-856a-cac6b6f10d49 while it is in task_state image_snapshot_pending {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:42.591750 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1a348690-9f08-4128-8b0f-31aebb02567d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action" status: 409 len: 167 microversion: 2.1 time: 0.085703 Oct 28 18:07:42.593085 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 682/1274] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:07:42 2022] POST /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49/action => generated 167 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:07:42.603526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c02efd2-d6e0-4565-8de6-3185ca2b2d36 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:42.646665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c02efd2-d6e0-4565-8de6-3185ca2b2d36 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1652469282/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052081 Oct 28 18:07:42.653382 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 683/1275] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 18:07:42 2022] POST /compute/v2.1/flavors/1652469282/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:42.659874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:42.661941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:42.671639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.672308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.673665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.675519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.676291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.677478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.874034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:42.885488 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45fe67d7-af56-4ab5-bdda-d3ca16871ce6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.230340 Oct 28 18:07:42.886240 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 684/1276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:42 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:42.900546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:42.900546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:42.900765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:42.900906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.900906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.901270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.902676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.903372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.904596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.907037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:42.908518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:42.909775 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-39784f96-dbb3-4e60-9bed-ff1b8b69aa0f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.533111 Oct 28 18:07:42.910265 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 593/1277] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:42 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:42.925669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6bc77760-70b9-466a-81bb-3c956f8262ff tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '.version_select at 0x7f78de1e7550>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.052749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:43.073754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:43.075455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:43.094615 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fdd8aca8-4894-4df5-9795-1e94e78d175e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.207133 Oct 28 18:07:43.115849 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 685/1278] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:42 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:43.132096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da21d065-c111-4546-b203-f265d7780ba1 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.146587 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da21d065-c111-4546-b203-f265d7780ba1 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1652469282/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048651 Oct 28 18:07:43.155310 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 686/1279] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 18:07:43 2022] GET /compute/v2.1/flavors/1652469282/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:43.173754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0663be66-8c44-4431-889b-4ba78bb40a9d req-9f647d48-e4f0-4b51-aae9-49f0dde955e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65bf4b2-0082-4097-a88a-84e3cd5c45d6", "name": "network-vif-unplugged", "status": "completed", "tag": "7a6ab836-9960-49fe-ab6f-64227a64a52a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:43.221006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0663be66-8c44-4431-889b-4ba78bb40a9d req-9f647d48-e4f0-4b51-aae9-49f0dde955e6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.225507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0663be66-8c44-4431-889b-4ba78bb40a9d req-9f647d48-e4f0-4b51-aae9-49f0dde955e6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.232109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0663be66-8c44-4431-889b-4ba78bb40a9d req-9f647d48-e4f0-4b51-aae9-49f0dde955e6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.262536 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0663be66-8c44-4431-889b-4ba78bb40a9d req-9f647d48-e4f0-4b51-aae9-49f0dde955e6 service nova] Creating event network-vif-unplugged:7a6ab836-9960-49fe-ab6f-64227a64a52a for instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 on n-h1-862404-2 Oct 28 18:07:43.269243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-0663be66-8c44-4431-889b-4ba78bb40a9d req-9f647d48-e4f0-4b51-aae9-49f0dde955e6 service nova] Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:07:43.284400 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6bc77760-70b9-466a-81bb-3c956f8262ff tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/images/26e40373-9620-4e1c-b740-b9904a091021" status: 204 len: 0 microversion: 2.1 time: 0.363374 Oct 28 18:07:43.286310 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 594/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:42 2022] DELETE /compute/v2.1/images/26e40373-9620-4e1c-b740-b9904a091021 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:43.288245 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0663be66-8c44-4431-889b-4ba78bb40a9d req-9f647d48-e4f0-4b51-aae9-49f0dde955e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127971 Oct 28 18:07:43.294920 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 687/1281] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:43.300722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.301611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:43.301872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da72d5db-52f1-4f5b-8fd4-7c4e5eba9272 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:43.308776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.309782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.310645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.312649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.313027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.313907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.370691 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-da72d5db-52f1-4f5b-8fd4-7c4e5eba9272 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1652469282/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.080183 Oct 28 18:07:43.376519 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 595/1282] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Oct 28 18:07:43 2022] PUT /compute/v2.1/flavors/1652469282/os-extra_specs/hw:numa_nodes => generated 22 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:43.381687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed135bd1-f800-42ee-ad6d-91ea00396729 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.393026 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed135bd1-f800-42ee-ad6d-91ea00396729 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1652469282/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015062 Oct 28 18:07:43.399585 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 596/1283] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 18:07:43 2022] GET /compute/v2.1/flavors/1652469282/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:43.405504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3d374c63-0064-40f2-9a98-44c9a9459ce9 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.485315 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3d374c63-0064-40f2-9a98-44c9a9459ce9 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1652469282/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.083575 Oct 28 18:07:43.493201 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 597/1284] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:07:43 2022] DELETE /compute/v2.1/flavors/1652469282/os-extra_specs/hw:numa_nodes => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:07:43.505581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d34254c2-9a2b-4bd8-8321-d64576fedae8 req-e8545473-0b8c-4568-8e63-72e830220726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739ffed6-e9db-4597-b1f1-ccc8bec1de12", "tag": "de1e8806-6a85-4b08-9fea-7dd69598ef6a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:43.520484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d34254c2-9a2b-4bd8-8321-d64576fedae8 req-e8545473-0b8c-4568-8e63-72e830220726 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.521140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d34254c2-9a2b-4bd8-8321-d64576fedae8 req-e8545473-0b8c-4568-8e63-72e830220726 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.521789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d34254c2-9a2b-4bd8-8321-d64576fedae8 req-e8545473-0b8c-4568-8e63-72e830220726 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.552409 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d34254c2-9a2b-4bd8-8321-d64576fedae8 req-e8545473-0b8c-4568-8e63-72e830220726 service nova] Creating event network-changed:de1e8806-6a85-4b08-9fea-7dd69598ef6a for instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 on n-h1-862404-2 Oct 28 18:07:43.563330 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d34254c2-9a2b-4bd8-8321-d64576fedae8 req-e8545473-0b8c-4568-8e63-72e830220726 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067269 Oct 28 18:07:43.564869 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 598/1285] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:43.577158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-efde51ba-28eb-420e-8820-02af195ca871 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.600625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:43.611262 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-efde51ba-28eb-420e-8820-02af195ca871 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1652469282/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.041993 Oct 28 18:07:43.613563 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 599/1286] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:07:43 2022] DELETE /compute/v2.1/flavors/1652469282/os-extra_specs/hw:cpu_policy => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:07:43.615306 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-14ae3825-352f-4790-94ef-54bc6494eabe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1541 microversion: 2.1 time: 0.318164 Oct 28 18:07:43.622349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.624199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:43.628563 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 688/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:43 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1541 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:43.631977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.633330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.634140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.634999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.635611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.636356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.640470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-216af548-01ff-49a6-aeae-2402b86a3e32 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.653554 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-216af548-01ff-49a6-aeae-2402b86a3e32 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1652469282/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023814 Oct 28 18:07:43.654137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 689/1288] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 18:07:43 2022] GET /compute/v2.1/flavors/1652469282/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:07:43.668693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4bc2fc71-07a9-4243-a3e6-7a5a6cceb966 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.703499 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4bc2fc71-07a9-4243-a3e6-7a5a6cceb966 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1652469282" status: 202 len: 0 microversion: 2.1 time: 0.038260 Oct 28 18:07:43.704823 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 690/1289] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:07:43 2022] DELETE /compute/v2.1/flavors/1652469282 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:07:43.719090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b594ce1-9982-4605-a003-4a9d947745c1 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.754013 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b594ce1-9982-4605-a003-4a9d947745c1 tempest-FlavorsExtraSpecsTestJSON-746464946 tempest-FlavorsExtraSpecsTestJSON-746464946-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044518 Oct 28 18:07:43.756409 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 691/1290] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:07:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:43.825178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:43.834863 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-942bd872-a3ce-48db-bba2-d7010a2d270b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1473 microversion: 2.1 time: 0.219223 Oct 28 18:07:43.837171 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 600/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:43 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1473 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:43.916984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.917849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:43.925655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.926489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.927203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.928198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.928871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.930120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.938073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:43.938945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:43.948855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.949349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.950323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:43.952217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:43.952897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:43.953476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.184512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:44.196838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:44.197717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:44.199641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:44.201177 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb61db70-1e06-42bc-849e-3a91e0b3420d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.267838 Oct 28 18:07:44.201959 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 601/1292] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:43 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:44.228418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:44.228977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:44.236696 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a0a6742-02b0-4ce0-9399-d686307d217d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.327909 Oct 28 18:07:44.237411 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 692/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:43 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:44.238545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:44.239075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:44.248037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.248037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:44.248037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:44.248037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.359932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:44.371360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:44.377052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:44.384356 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3fa4800-79f3-46a4-9a23-90118b38d8df tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.181266 Oct 28 18:07:44.385499 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 602/1294] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:44 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:44.646233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:44.647011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:44.651420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:44.663517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:44.663924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:44.664991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.666584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:44.667279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:44.670589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.702918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:44.862577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:44.863259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:44.872165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:44.872914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:44.873605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:44.874553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.875783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:44.876451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:44.878369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.880403 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d25814fc-721a-4ed2-aa35-79c2024749d9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1541 microversion: 2.1 time: 0.237965 Oct 28 18:07:44.896198 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 693/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:44 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1541 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:45.227688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.228343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:45.242453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.247319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.247780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.247987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:45.248547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.249012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.249435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.261719 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b6f872b5-57e7-4ef2-9dea-1781a61b4762 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1473 microversion: 2.1 time: 0.404074 Oct 28 18:07:45.276631 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 603/1296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:44 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1473 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:45.283853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.284671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:45.296346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.300908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.301809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.302691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.306098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.306994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.721302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:45.731117 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-87ce3b3e-b77f-4743-85b0-beac1fc6c798 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.452955 Oct 28 18:07:45.745826 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 604/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:45.745918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:45.771733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:45.773811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:45.775504 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dda8dc98-4dc4-4bd7-b180-3dc37e26bbee tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.552830 Oct 28 18:07:45.778610 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 694/1298] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:07:45.783861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.784905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:45.792281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:45.794651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.795976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.796312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.797536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.798222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.798917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.949864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:45.987863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:45.987863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:45.988413 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bef8bc25-6384-4a6f-84ec-094e9dd31aeb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.208242 Oct 28 18:07:45.992921 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 695/1299] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:46.006215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:46.006839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:46.017723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.018521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.019145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.020076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.020693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.021400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.284042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1738821819", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:46.381115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:46.382020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:07:46.390920 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-798dc335-48aa-40e2-aa30-c55028d17f23 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1533 microversion: 2.1 time: 0.388587 Oct 28 18:07:46.392222 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 696/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1533 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:46.399617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:46.400627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:46.408817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.409477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.410231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.411082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.411702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.412287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.780733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:46.796617 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-421502a3-cb2c-4a03-a75a-0f19d804d2df tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1470 microversion: 2.1 time: 0.402657 Oct 28 18:07:46.797703 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 697/1301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:46 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1470 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:46.802851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:46.803470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:46.813096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.813592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.818813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.821465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.822905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.824448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.831837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:07:46.832600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:07:46.832949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:07:46.833347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:07:46.833952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:07:46.848309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.849087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.849675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.850591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.851225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.851884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.873830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Getting quotas for project d00cb9b0750e4c1ab9c18f48e6f6ee1c. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:07:46.879333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Getting quotas for user 74503ec6cd3b4167ad0cf66ae6d78422 and project d00cb9b0750e4c1ab9c18f48e6f6ee1c. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:07:46.893899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:07:46.896558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:07:46.953715 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-591d9a96-d328-4e8a-808c-26c760153eed tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.196687 Oct 28 18:07:46.957936 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 605/1302] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:07:46.963144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:46.964061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:46.974389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.006424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.006424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.006424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.012167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.012957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.099421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.109521 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d118b8a2-8f3e-47b6-b95f-817e49bdb55a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.310755 Oct 28 18:07:47.110120 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 698/1303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:46 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:47.115971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:47.115971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:47.122944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.123427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.123893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.124722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.125352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.125938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.170725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.171946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.172546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.173771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.174452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.175108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.220894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:07:47.227708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for user 3415953e10c445bfa3dcc5a3335826c8 and project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:07:47.301668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.312272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.314279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.315736 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3dd6f3c3-3682-40e6-bd1e-3574b6ec3169 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.356631 Oct 28 18:07:47.316324 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 606/1304] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:46 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:47.325585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-18d58690-352b-4933-aa91-77a19679401a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:47.326491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-18d58690-352b-4933-aa91-77a19679401a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:47.329356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:47.401937 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c3fefbc-72cc-4508-9059-69e709024e5c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6/action" status: 202 len: 0 microversion: 2.1 time: 0.290146 Oct 28 18:07:47.402908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 699/1305] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:07:47 2022] POST /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:07:47.408970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:47.409150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:47.416186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.416685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.417146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.417845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.418302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.419122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.419571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-18d58690-352b-4933-aa91-77a19679401a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.426394 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-18d58690-352b-4933-aa91-77a19679401a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1214 microversion: 2.1 time: 0.108413 Oct 28 18:07:47.426974 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 607/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:47 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:47.440025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:47.448079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:47.448715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:47.463387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.464092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.464675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.465512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.466031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.466524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.471444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:47.520710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.533063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.535252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.542694 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-077ebddf-cca0-49dd-8089-3467db3df1d2 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1553 microversion: 2.91 time: 0.138460 Oct 28 18:07:47.544543 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 700/1307] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:47 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1553 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:47.549427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:47.550043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:47.557380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.557873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.558309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.559009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:47.559465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:47.560172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.636111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.646387 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86c56032-ae1d-4c8c-949a-a287c855ffc9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1469 microversion: 2.1 time: 0.204046 Oct 28 18:07:47.647405 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 608/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:47 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:47.724732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:47.734537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c7f15f5d-8d45-4024-99fe-0726d7417674 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1533 microversion: 2.1 time: 0.188763 Oct 28 18:07:47.735137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 701/1309] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:47 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1533 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:48.134201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.134826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:48.141209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.141694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.142133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.142832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.143292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.143722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.277330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.285624 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eabc8e26-741e-4709-8ee0-1c17ff3fe065 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.155357 Oct 28 18:07:48.286194 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 609/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:48.344685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.345328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:48.352068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.352706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.353143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.353846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.354299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.354723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.454495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.456414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:48.464855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.465347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.466189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.467042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.467514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.468670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.495466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.506019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.507925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.509357 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-37d1bbc1-6c55-4388-ab53-ce362e92a919 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.168588 Oct 28 18:07:48.510027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 702/1311] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:48.539616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.547230 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e10308e7-2afa-4d7e-afb8-be7ad7bbac44 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1266 microversion: 2.1 time: 0.097578 Oct 28 18:07:48.547866 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 610/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:48.575753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.576398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:48.582622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.583116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.583560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.584395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.584882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.585314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.651026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.659183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.660676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.667717 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-668280c9-0271-414b-8fbb-94501ff37454 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1535 microversion: 2.91 time: 0.095837 Oct 28 18:07:48.668344 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 703/1313] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1535 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:48.676635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.677265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:48.683426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.683958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.684409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.685100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.685558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.685992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.743806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Calling method '.version_select at 0x7f78de1e7c10>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.745824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.746313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.746784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.762715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.763203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.763644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.774146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.774747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.775181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.781148 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-460f5e20-61b7-4704-9059-a0d4d088767f tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.157833 Oct 28 18:07:48.781737 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 611/1314] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:48.786337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.787040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:48.793683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.794177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.794615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.795325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.795784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.796240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.828071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.836849 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-391d66c8-7b49-4b31-a5ea-7b605da0a8d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1469 microversion: 2.1 time: 0.167519 Oct 28 18:07:48.837450 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 704/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:48.843220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Calling method '.version_select at 0x7f78de0d25e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.845192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.845674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.846104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.866530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.869187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.869840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.902974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.903530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.904064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.910215 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd0a8d8a-e3db-4053-98c5-8fa21a0d0091 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-862404-2/servers" status: 200 len: 591 microversion: 2.1 time: 0.071800 Oct 28 18:07:48.910941 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 705/1316] 10.222.0.16 () {58 vars in 1212 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-862404-2/servers => generated 591 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:48.922936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Calling method '.version_select at 0x7f78de077040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.924724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.925205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.925639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.939315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.939794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.940261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.950695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.951172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.951606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.951981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:48.957711 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ccddd71-1a52-49ca-9675-c8743ad1d8f2 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.038220 Oct 28 18:07:48.958312 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 706/1317] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:48.960176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d9df619-c40f-42e7-82ef-62fa6fce5eb8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1533 microversion: 2.1 time: 0.177451 Oct 28 18:07:48.961479 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 612/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1533 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:48.968788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4aabb01a-8fc8-44b5-9c1b-605e6d9a3418 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Calling method '.version_select at 0x7f78de1920d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.970482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aabb01a-8fc8-44b5-9c1b-605e6d9a3418 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.970958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aabb01a-8fc8-44b5-9c1b-605e6d9a3418 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.971386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aabb01a-8fc8-44b5-9c1b-605e6d9a3418 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.983360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aabb01a-8fc8-44b5-9c1b-605e6d9a3418 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.983888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aabb01a-8fc8-44b5-9c1b-605e6d9a3418 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.984331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aabb01a-8fc8-44b5-9c1b-605e6d9a3418 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.990213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4aabb01a-8fc8-44b5-9c1b-605e6d9a3418 tempest-HypervisorAdminUnderV252Test-1779552618 tempest-HypervisorAdminUnderV252Test-1779552618-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-862404-2/search" status: 200 len: 104 microversion: 2.1 time: 0.024853 Oct 28 18:07:48.995461 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 707/1319] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-862404-2/search => generated 104 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:49.309648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:49.310961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:49.317263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.317939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.318638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.319075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.319544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.319978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.335187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-961f7178-32e8-41f9-ace1-dbd4258633ba req-5dc3b527-9a68-407e-9c0e-49e9fe775ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65bf4b2-0082-4097-a88a-84e3cd5c45d6", "name": "network-vif-plugged", "status": "completed", "tag": "7a6ab836-9960-49fe-ab6f-64227a64a52a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:49.345772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-961f7178-32e8-41f9-ace1-dbd4258633ba req-5dc3b527-9a68-407e-9c0e-49e9fe775ae0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.346987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-961f7178-32e8-41f9-ace1-dbd4258633ba req-5dc3b527-9a68-407e-9c0e-49e9fe775ae0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.347680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-961f7178-32e8-41f9-ace1-dbd4258633ba req-5dc3b527-9a68-407e-9c0e-49e9fe775ae0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.363651 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-961f7178-32e8-41f9-ace1-dbd4258633ba req-5dc3b527-9a68-407e-9c0e-49e9fe775ae0 service nova] Creating event network-vif-plugged:7a6ab836-9960-49fe-ab6f-64227a64a52a for instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 on n-h1-862404-2 Oct 28 18:07:49.383590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-961f7178-32e8-41f9-ace1-dbd4258633ba req-5dc3b527-9a68-407e-9c0e-49e9fe775ae0 service nova] Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:07:49.394820 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-961f7178-32e8-41f9-ace1-dbd4258633ba req-5dc3b527-9a68-407e-9c0e-49e9fe775ae0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063394 Oct 28 18:07:49.396027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 708/1320] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:49.536524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:49.537237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:49.547239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.548632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.549428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.550754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.551668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.552463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.659873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:49.673557 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c910f029-0e80-4904-a475-4c79cd420e9d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.367181 Oct 28 18:07:49.675743 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 613/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:49 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:49.681731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:49.682490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:49.690583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.691280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.691841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.693008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.693570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.694211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.771523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:49.781141 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a1624c8b-7390-4d14-a948-1981ee4560fc tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1266 microversion: 2.1 time: 0.104352 Oct 28 18:07:49.782262 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 614/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:49 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:49.787380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:49.789283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:49.795094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:49.797033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.797731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.798362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.799409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.800073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.800670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.811867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:49.821670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:49.823076 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f09222d2-05e8-4712-9ee8-7d3f7237b534 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1811 microversion: 2.25 time: 0.291031 Oct 28 18:07:49.831081 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 709/1323] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:49 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1811 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:49.859374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:49.860227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:49.866396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.867687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.868458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.869232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.869899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.870398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.876461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:49.888855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:49.890951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:49.896759 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6fd15038-0a70-475e-998a-95732b8c39a8 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1538 microversion: 2.91 time: 0.113339 Oct 28 18:07:49.897343 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 615/1324] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:49 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1538 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:49.924534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862404-2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:49.927730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:49.935446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.935955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.936698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.937582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.938189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.938753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.999743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862404-2". {{(pid=120679) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 28 18:07:50.022774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:50.031319 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be0d42e5-e653-456c-a36f-554b2ca65216 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1469 microversion: 2.1 time: 0.175663 Oct 28 18:07:50.032254 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 710/1325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:49 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:50.042072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:50.042072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:50.044710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.045209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.045971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.046925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.047545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.048396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.103122 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cb35aedc-18c2-4519-bbcb-a7333bf94389 tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4/action" status: 202 len: 0 microversion: 2.91 time: 0.179680 Oct 28 18:07:50.107506 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 616/1326] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:07:49 2022] POST /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:07:50.128435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:50.129392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:50.154701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.155420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.155713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.157153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.159021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.159506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.324963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:50.343963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:50.345447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:50.351006 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1d2ddbef-e051-4af8-abe5-fbff4781b226 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1546 microversion: 2.91 time: 0.238402 Oct 28 18:07:50.368272 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 617/1327] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:50 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:50.474935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:50.484609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a092d9f9-aa53-4b5a-b73b-6431c639bc33 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1533 microversion: 2.1 time: 0.450829 Oct 28 18:07:50.501015 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 711/1328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:50 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1533 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:50.702153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:50.702702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:50.712150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.712649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.713635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.714531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.715154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.715743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.809919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:50.811761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:50.824656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.825395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.826449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.827398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.828666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.829390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.075270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.076024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.087551 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d6957712-5665-47c3-a0f8-8363fd17e3ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.389138 Oct 28 18:07:51.093033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6579b99-c38a-40af-8f95-f91ca2fcc5da tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1272 microversion: 2.1 time: 0.290763 Oct 28 18:07:51.093958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 712/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:50 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:51.098585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:51.100219 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 618/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:50 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:51.102293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:51.112589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:51.113208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:51.116962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.120466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.121027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.121724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.123521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.124092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.124539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.125316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.127654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.128414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.128881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.129305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.371422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.384873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.388355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.392035 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ed73a96-e0fb-491c-9a39-1b23d11f1d1d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1801 microversion: 2.25 time: 0.297030 Oct 28 18:07:51.394639 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 713/1331] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:51 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1801 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:51.408703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:51.409596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:51.423474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.436179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.436980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.438131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.439136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.439767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.555992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.568692 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a6bb43ef-c641-40bf-9318-e54adce908c8 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1469 microversion: 2.1 time: 0.467095 Oct 28 18:07:51.569601 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 619/1332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:51 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1469 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:51.579495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1f17a76d-0562-4e32-a75a-0f54f8e9cda9 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '.version_select at 0x7f78de1e7430>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:51.587584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f17a76d-0562-4e32-a75a-0f54f8e9cda9 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.596965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.601436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f17a76d-0562-4e32-a75a-0f54f8e9cda9 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.608139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f17a76d-0562-4e32-a75a-0f54f8e9cda9 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.611094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.617814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.635349 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1f17a76d-0562-4e32-a75a-0f54f8e9cda9 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3626 microversion: 2.25 time: 0.063512 Oct 28 18:07:51.635786 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c89a6c40-f886-45b5-b12e-16c492e546d4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1488 microversion: 2.91 time: 0.237295 Oct 28 18:07:51.636494 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 620/1333] 10.222.0.16 () {60 vars in 1184 bytes} [Fri Oct 28 18:07:51 2022] GET /compute/v2.1/os-migrations => generated 3626 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:51.638359 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 714/1334] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:51 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1488 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:51.641987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:51.642600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:51.661479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:51.663662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:51.664363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.665262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.665880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.668659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.670162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.671317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.678661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.681824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.683406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.684486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.687337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.687877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.890667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:51.901381 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8fcbf663-9547-417d-adcc-9c459afa09ac tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1539 microversion: 2.1 time: 0.263027 Oct 28 18:07:51.902789 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 621/1335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:51 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1539 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:52.075626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid dad1f5bd-5eed-4cfa-b39b-09586df2a2fa {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:52.096194 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1026f392-3bbc-4c10-8eb1-06fd90bea55b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 2420 microversion: 2.25 time: 0.446765 Oct 28 18:07:52.097378 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 715/1336] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:51 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 2420 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:52.124936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:52.125641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:52.134865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.136241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.136817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.138078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.139118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.139248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:52.139777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.139927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:52.146183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.146683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.147310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.148434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.149536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.150147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.425944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid dad1f5bd-5eed-4cfa-b39b-09586df2a2fa {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:52.464481 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50f8cc16-ff0c-4999-af9d-51f0c140facb tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 2420 microversion: 2.25 time: 0.344095 Oct 28 18:07:52.465408 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 622/1337] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:52 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 2420 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:52.470552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:52.471367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:52.488628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.492009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.494569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.497920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.498636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.499247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.746282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:52.750670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:52.757631 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5b0fb2c7-3baa-42ca-a9a8-310c87c5f393 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.290816 Oct 28 18:07:52.758621 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 623/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:52 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:52.764032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:52.764960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:52.771592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.772403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.773304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.774500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.775062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.775701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.861201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:52.873652 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b923006-d05b-4d94-b882-ecdb4eb6df5e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1314 microversion: 2.1 time: 0.743045 Oct 28 18:07:52.874495 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 716/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:52 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:52.881124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:52.881835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:52.888665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.890101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.890702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.891585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.892371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.893061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.898008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:53.000192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:53.014890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lazy-loading 'services' on Instance uuid dad1f5bd-5eed-4cfa-b39b-09586df2a2fa {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:53.021925 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cb4985f7-ca46-4dce-b957-78cbb325d3ed tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1469 microversion: 2.1 time: 0.261567 Oct 28 18:07:53.022529 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 624/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:52 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1469 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:53.039701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.040509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:53.048295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.048931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.049383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.050101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.050562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.050989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.131734 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-410b91fa-92f7-4b73-b567-7d0b6927f430 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments/239ac63a-8b32-4455-841a-fb1ddd85f7bd" status: 202 len: 0 microversion: 2.25 time: 0.255102 Oct 28 18:07:53.133090 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 717/1341] 10.222.0.16 () {60 vars in 1457 bytes} [Fri Oct 28 18:07:52 2022] DELETE /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments/239ac63a-8b32-4455-841a-fb1ddd85f7bd => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:53.147147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.149615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:53.156822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.161498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:53.165075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.165621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.166562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.167281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.168138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.181600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:53.183345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:53.194168 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d701ab92-ece8-4513-aec7-2ad415261c3c tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.161887 Oct 28 18:07:53.197538 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 625/1342] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:53.203739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.209119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:53.219885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.220643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.221338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.222099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.222977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.228864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.274656 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d235920d-2b45-4e07-afaf-ce68894f4e31 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075348 Oct 28 18:07:53.275245 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 626/1343] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:07:53.404668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:53.412712 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7294c17-3645-4c03-88c9-26d082be40e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1539 microversion: 2.1 time: 0.278479 Oct 28 18:07:53.424344 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 718/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:53.551691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-42923669-a97a-477c-bd57-1bc64ffecff4 req-b1d1b06e-d3c7-400e-a6f2-eb029dfebb47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c77d0b67-005c-4da8-a83d-9b7494165b4f", "tag": "9d6e94af-3d9f-4c5b-bac7-1c4f7d4d00f9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:53.563554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42923669-a97a-477c-bd57-1bc64ffecff4 req-b1d1b06e-d3c7-400e-a6f2-eb029dfebb47 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.564310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42923669-a97a-477c-bd57-1bc64ffecff4 req-b1d1b06e-d3c7-400e-a6f2-eb029dfebb47 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.564929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42923669-a97a-477c-bd57-1bc64ffecff4 req-b1d1b06e-d3c7-400e-a6f2-eb029dfebb47 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.578748 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-42923669-a97a-477c-bd57-1bc64ffecff4 req-b1d1b06e-d3c7-400e-a6f2-eb029dfebb47 service nova] Creating event network-changed:9d6e94af-3d9f-4c5b-bac7-1c4f7d4d00f9 for instance c77d0b67-005c-4da8-a83d-9b7494165b4f on n-h2-862404-2 Oct 28 18:07:53.583828 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-42923669-a97a-477c-bd57-1bc64ffecff4 req-b1d1b06e-d3c7-400e-a6f2-eb029dfebb47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035876 Oct 28 18:07:53.584461 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 719/1345] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:53.636158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Calling method '.version_select at 0x7f78e256a3a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.637929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.638492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.638885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.653978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.654473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.654914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.665517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.666005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.667522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.672414 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-efabca22-6856-4d03-8787-636efde64bf9 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.188869 Oct 28 18:07:53.672996 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 627/1346] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:53.782765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.784137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:53.785215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a783c059-44ee-4265-be4c-7c18f576f4ce tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] Calling method '.version_select at 0x7f78de0d2dc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.787116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a783c059-44ee-4265-be4c-7c18f576f4ce tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '6984c6b8693c4f4aaacdd0c22559a05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a8efbab1c4f328044a588d759e2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a783c059-44ee-4265-be4c-7c18f576f4ce tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] Request method failure captured: Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-hypervisors/n-h1-862404-2/search HTTP/1.1 Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBp4dyxecT9gWummdFmOx0UORcVt-lu9Oh67Qutm6tj45lGDLglKFQs1Wp5Liys1YRthYuYE2WB0gK0Onp_jybLowrHdChNIGXH-FJDvHSmiK0jLcFWJyicZS4fUUjE8XS9EiMYo3V6iFkzcUG-orOxS869_40fae41GZTmG2SzoFY0 Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 871a8efbab1c4f328044a588d759e2d9 Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-685118397 Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:53.789829 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a8efbab1c4f328044a588d759e2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a8efbab1c4f328044a588d759e2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a8efbab1c4f328044a588d759e2d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a8efbab1c4f328044a588d759e2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-685118397 Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 871a8efbab1c4f328044a588d759e2d9 Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-685118397 Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-685118397-project Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 6984c6b8693c4f4aaacdd0c22559a05c Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-685118397-project Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 18:07:53.791531 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'n-h1-862404-2'} Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:07:53.792533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 18:07:53.794712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.796222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a783c059-44ee-4265-be4c-7c18f576f4ce tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:53.796222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a783c059-44ee-4265-be4c-7c18f576f4ce tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-862404-2/search" status: 403 len: 117 microversion: 2.1 time: 0.110899 Oct 28 18:07:53.796222 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 720/1347] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/os-hypervisors/n-h1-862404-2/search => generated 117 bytes in 113 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:07:53.797855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.798444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.798962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.799854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.800380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.800880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.801680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c92dc723-850b-46e9-bfa3-089b8576f6b2 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Calling method '.version_select at 0x7f78de0bd1f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.803411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c92dc723-850b-46e9-bfa3-089b8576f6b2 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.803926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c92dc723-850b-46e9-bfa3-089b8576f6b2 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.804442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c92dc723-850b-46e9-bfa3-089b8576f6b2 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.811042 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c92dc723-850b-46e9-bfa3-089b8576f6b2 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c92dc723-850b-46e9-bfa3-089b8576f6b2 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Request method failure captured: Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBp5kc1HgXKyUrwFUZhjgW9NYtMLNaBUvrva29pzv5r9_nCNEcMouDcVZVHo9gdCeVwY4kPIcQj-jB4N7Gj5_UJ4U7UhMjPSzG_5qPxvrIUcwy1N08tYNkLGt2UJTwtO7vCXViHHHOYBQFoTaJGm6Yu_lrVN7AuvncMdPj8UD5JfqLk Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 46ddc0df3c4f4d7cb6ce8add8597230f Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498209076 Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:07:53.812401 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ddc0df3c4f4d7cb6ce8add8597230f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ddc0df3c4f4d7cb6ce8add8597230f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ddc0df3c4f4d7cb6ce8add8597230f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ddc0df3c4f4d7cb6ce8add8597230f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1498209076 Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 46ddc0df3c4f4d7cb6ce8add8597230f Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498209076 Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 15032601b9294fe78ce2d40fde2ad8b3 Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 18:07:53.815339 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:53.816928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:53.818180 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:53.818180 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:53.818180 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:53.818180 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 18:07:53.818180 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.818180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c92dc723-850b-46e9-bfa3-089b8576f6b2 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:53.818180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c92dc723-850b-46e9-bfa3-089b8576f6b2 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.016058 Oct 28 18:07:53.818180 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 721/1348] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:07:53.823492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Calling method '.version_select at 0x7f78de077160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.825871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.826010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.826539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.844147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.844796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.845341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.857067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.857742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.858294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.864556 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0dadc55a-2bbd-4646-bc81-65f41d1d92f7 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.044583 Oct 28 18:07:53.867850 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 722/1349] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:53.878428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40217795-23fb-41c4-a17a-e1451b858284 tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] Calling method '.version_select at 0x7f78de0d2d30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.880962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-40217795-23fb-41c4-a17a-e1451b858284 tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '6984c6b8693c4f4aaacdd0c22559a05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871a8efbab1c4f328044a588d759e2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40217795-23fb-41c4-a17a-e1451b858284 tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] Request method failure captured: Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBp4dyxecT9gWummdFmOx0UORcVt-lu9Oh67Qutm6tj45lGDLglKFQs1Wp5Liys1YRthYuYE2WB0gK0Onp_jybLowrHdChNIGXH-FJDvHSmiK0jLcFWJyicZS4fUUjE8XS9EiMYo3V6iFkzcUG-orOxS869_40fae41GZTmG2SzoFY0 Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 871a8efbab1c4f328044a588d759e2d9 Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-685118397 Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:07:53.883354 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a8efbab1c4f328044a588d759e2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/871a8efbab1c4f328044a588d759e2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_871a8efbab1c4f328044a588d759e2d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/871a8efbab1c4f328044a588d759e2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-685118397 Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 871a8efbab1c4f328044a588d759e2d9 Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-685118397 Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-685118397-project Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 6984c6b8693c4f4aaacdd0c22559a05c Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-685118397-project Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 18:07:53.884703 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '1'} Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:07:53.885465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 18:07:53.886578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.889059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40217795-23fb-41c4-a17a-e1451b858284 tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:53.890120 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40217795-23fb-41c4-a17a-e1451b858284 tempest-HypervisorAdminNegativeUnderV252Test-685118397 tempest-HypervisorAdminNegativeUnderV252Test-685118397-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015519 Oct 28 18:07:53.892643 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 723/1350] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:53.898074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.899086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:53.906383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.907195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.907870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.908820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.909490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.910152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.952989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:53.961354 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bdbb70a5-21b2-4928-8c78-dfcc029b3eb8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.183213 Oct 28 18:07:53.962155 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 628/1351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:53.971320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c63f56a-12f6-456c-8dad-e5aa9a158059 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Calling method '.version_select at 0x7f78de19a1f0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.973072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c63f56a-12f6-456c-8dad-e5aa9a158059 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.973594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c63f56a-12f6-456c-8dad-e5aa9a158059 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.974058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c63f56a-12f6-456c-8dad-e5aa9a158059 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.983693 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4c63f56a-12f6-456c-8dad-e5aa9a158059 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] HTTP exception thrown: No hypervisor matching 'abf1f3fb-09da-4002-a400-93270581327d' could be found. Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c63f56a-12f6-456c-8dad-e5aa9a158059 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Request method failure captured: Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-hypervisors/abf1f3fb-09da-4002-a400-93270581327d/servers HTTP/1.1 Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBp5kc1HgXKyUrwFUZhjgW9NYtMLNaBUvrva29pzv5r9_nCNEcMouDcVZVHo9gdCeVwY4kPIcQj-jB4N7Gj5_UJ4U7UhMjPSzG_5qPxvrIUcwy1N08tYNkLGt2UJTwtO7vCXViHHHOYBQFoTaJGm6Yu_lrVN7AuvncMdPj8UD5JfqLk Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 46ddc0df3c4f4d7cb6ce8add8597230f Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498209076 Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:07:53.985188 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ddc0df3c4f4d7cb6ce8add8597230f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ddc0df3c4f4d7cb6ce8add8597230f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ddc0df3c4f4d7cb6ce8add8597230f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ddc0df3c4f4d7cb6ce8add8597230f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1498209076 Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 46ddc0df3c4f4d7cb6ce8add8597230f Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498209076 Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 15032601b9294fe78ce2d40fde2ad8b3 Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: exception: No hypervisor matching 'abf1f3fb-09da-4002-a400-93270581327d' could be found. Oct 28 18:07:53.986721 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'abf1f3fb-09da-4002-a400-93270581327d'} Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'abf1f3fb-09da-4002-a400-93270581327d' could be found. Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.987668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'abf1f3fb-09da-4002-a400-93270581327d' could be found. Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c63f56a-12f6-456c-8dad-e5aa9a158059 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] Returning 404 to user: No hypervisor matching 'abf1f3fb-09da-4002-a400-93270581327d' could be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c63f56a-12f6-456c-8dad-e5aa9a158059 tempest-HypervisorAdminNegativeUnderV252Test-1498209076 tempest-HypervisorAdminNegativeUnderV252Test-1498209076-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/abf1f3fb-09da-4002-a400-93270581327d/servers" status: 404 len: 123 microversion: 2.1 time: 0.023488 Oct 28 18:07:53.989840 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 629/1352] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/os-hypervisors/abf1f3fb-09da-4002-a400-93270581327d/servers => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:54.045347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:54.045978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:54.053217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.053710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.054962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.056563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.058355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.059220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.113844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:54.132103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-819a4933-bd0a-4275-b000-72265edfea3c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1314 microversion: 2.1 time: 0.237829 Oct 28 18:07:54.135392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 724/1353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:54.221475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:54.227032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:54.227654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:54.230721 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-02d47354-79d4-46dd-a794-ae441805135f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1469 microversion: 2.1 time: 0.189074 Oct 28 18:07:54.231446 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 630/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:54 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:54.233699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.234362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.234954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.235791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.236407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.236945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.290240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:54.293937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:54.300849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.301518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.302232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.302953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.303541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.304094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.306264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:54.321699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:54.323097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:54.328369 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87b813ae-a04b-4801-9414-8da106da1e7a tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.105776 Oct 28 18:07:54.329075 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 725/1355] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:54 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:54.336453 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-da8931b6-ad33-4c61-896a-16ddc8b2a93d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051987 Oct 28 18:07:54.337409 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 631/1356] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:07:54 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:07:54.437542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:54.438388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:54.444488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.445451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.446123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.447034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.447950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.449129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.620637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:54.630682 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4fef9373-5fe2-4b0a-9409-d7aef52d2ebe tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1539 microversion: 2.1 time: 0.196721 Oct 28 18:07:54.633131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 726/1357] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:54 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:54.936065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0a591bd6-8468-4538-b1a6-396a857ce481 req-0026078d-e1f2-4f1f-b506-34404f4925d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33011c5-4735-4b59-856a-cac6b6f10d49", "name": "network-vif-plugged", "status": "completed", "tag": "d6ee0267-9ec4-44bc-8516-33cdd18c19b5"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:54.969829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0a591bd6-8468-4538-b1a6-396a857ce481 req-0026078d-e1f2-4f1f-b506-34404f4925d0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:54.970318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0a591bd6-8468-4538-b1a6-396a857ce481 req-0026078d-e1f2-4f1f-b506-34404f4925d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:54.970752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0a591bd6-8468-4538-b1a6-396a857ce481 req-0026078d-e1f2-4f1f-b506-34404f4925d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:54.987178 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0a591bd6-8468-4538-b1a6-396a857ce481 req-0026078d-e1f2-4f1f-b506-34404f4925d0 service nova] Creating event network-vif-plugged:d6ee0267-9ec4-44bc-8516-33cdd18c19b5 for instance a33011c5-4735-4b59-856a-cac6b6f10d49 on n-h1-862404-2 Oct 28 18:07:54.987415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:54.988222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:55.002269 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0a591bd6-8468-4538-b1a6-396a857ce481 req-0026078d-e1f2-4f1f-b506-34404f4925d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071869 Oct 28 18:07:55.005159 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 632/1358] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:55.040009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.040536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.040990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.048190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.048712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.049169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.159841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:55.161660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:55.181340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.181848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.182293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.183970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.184440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.184875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.603781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:55.624907 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a4cf5bc1-f54a-431f-b4bf-9ee4b13d409c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1314 microversion: 2.1 time: 0.470452 Oct 28 18:07:55.625537 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 633/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:55 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:55.644177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:55.645195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:55.659453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.659991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.660432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.661228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.662099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.662699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.943951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:55.958505 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ee7c911-48f4-419f-af1e-8d984217df2e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.976338 Oct 28 18:07:55.960754 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 727/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:54 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:55.972039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:55.975519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:55.983336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:56.006321 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b6e5a6dc-2bfb-45a3-8ded-f5a93de72ab2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1469 microversion: 2.1 time: 0.374964 Oct 28 18:07:56.009598 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 634/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:55 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1469 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:56.012574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.016056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.018971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.023031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.026756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:56.027387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:56.028103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.028641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.046201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.046700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.081281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.082703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.085560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.098301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.172722 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6bdf2b0-f97a-486a-b4dd-857a573904e0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.209122 Oct 28 18:07:56.188765 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 728/1362] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:07:55 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:07:56.200972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:56.207460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:56.239529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.240295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.240948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.242701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.243445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.245280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.269905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:56.281599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:56.285756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:56.298560 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-717df1aa-8cbc-46f6-9d04-53a3af4ea2cd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.287662 Oct 28 18:07:56.300187 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 635/1363] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:56 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:56.653204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:56.653825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:56.671309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.671832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.672276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.673004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.673573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.674007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.678734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:56.694228 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-acf8ad38-3bba-4bc6-b521-5fce101d9791 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1534 microversion: 2.1 time: 0.504037 Oct 28 18:07:56.716732 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 729/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:56 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1534 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:56.864135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:56.908329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:56.922785 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-893b4b51-c57d-48a7-bcb2-48053e7760f6 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1314 microversion: 2.1 time: 0.273302 Oct 28 18:07:56.923861 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 636/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:56 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:56.985871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:56.986697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:56.999132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.999636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.002242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.003270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.012324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.013018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.023409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-49617bfb-4a20-492f-b07c-01dc6a98f925 req-64a09d0c-91ce-4a9f-8d3a-83a293ec98bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739ffed6-e9db-4597-b1f1-ccc8bec1de12", "name": "network-vif-plugged", "status": "completed", "tag": "de1e8806-6a85-4b08-9fea-7dd69598ef6a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:57.053697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-49617bfb-4a20-492f-b07c-01dc6a98f925 req-64a09d0c-91ce-4a9f-8d3a-83a293ec98bc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.054760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-49617bfb-4a20-492f-b07c-01dc6a98f925 req-64a09d0c-91ce-4a9f-8d3a-83a293ec98bc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.056072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-49617bfb-4a20-492f-b07c-01dc6a98f925 req-64a09d0c-91ce-4a9f-8d3a-83a293ec98bc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.100851 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-49617bfb-4a20-492f-b07c-01dc6a98f925 req-64a09d0c-91ce-4a9f-8d3a-83a293ec98bc service nova] Creating event network-vif-plugged:de1e8806-6a85-4b08-9fea-7dd69598ef6a for instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 on n-h1-862404-2 Oct 28 18:07:57.108427 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-49617bfb-4a20-492f-b07c-01dc6a98f925 req-64a09d0c-91ce-4a9f-8d3a-83a293ec98bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089050 Oct 28 18:07:57.110380 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 637/1366] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:57.130229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:57.132241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:57.157452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.162598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.164510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.165435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.166465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.168462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.206473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:57.393428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:57.417169 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5a26454-c4f8-47d5-9b72-87eec1fe0710 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.436245 Oct 28 18:07:57.421377 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 730/1367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:56 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:57.423599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:57.431413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:57.434935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:57.449597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.450977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.452194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.455751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.457163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.458133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.481341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:57.494297 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b59d2dbe-0d3e-47e9-aea7-8fe29c14f56d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.376645 Oct 28 18:07:57.494890 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 638/1368] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:57 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:57.506259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:57.513113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:57.535301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.540372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.540934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.545236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.548432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.552002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:58.034230 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0da6f15a-882c-4fce-b974-f0cb7b279a6a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.611351 Oct 28 18:07:58.034866 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 731/1369] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:07:57 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:07:58.065885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:58.066706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:58.110536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:58.111149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:58.111590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:58.118072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:58.129975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:58.135772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:58.324587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:58.341405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:58.346518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:58.373068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1a48023d-39da-48a8-a6d5-c98bc737d8cc tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.875137 Oct 28 18:07:58.387986 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 639/1370] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:07:57 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:07:58.387986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:58.406071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:58.434265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:58.434640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:58.434888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:58.435226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:58.441034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:58.444103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:58.445920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:58.447011 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2b89e7f-18ef-4887-bf99-5ad5de1dffb9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1521 microversion: 2.1 time: 0.410151 Oct 28 18:07:58.447728 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 732/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:58 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:58.453252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:58.461290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:58.465328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:58.480332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:58.482883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:58.484098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:58.485608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:58.487518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:58.488857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.050593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:59.057590 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9953e4ae-c786-4ea0-a180-e0de3a7faf1e tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1812 microversion: 2.1 time: 0.603410 Oct 28 18:07:59.061428 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 733/1372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:58 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1812 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:59.083419 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-adabf966-35d7-4776-80f6-6d8ec9d72083 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1314 microversion: 2.1 time: 0.703078 Oct 28 18:07:59.083612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:59.083612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:59.086422 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 640/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:58 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:59.091469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:59.094373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:59.103984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.104737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.105355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.106230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.106924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.107527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.115984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.118498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.118966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.123291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.127554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.129851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.148418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:07:59.235057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:59.304972 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f2732f26-3655-489c-bfce-4a915bded69f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 204 len: 0 microversion: 2.1 time: 0.216771 Oct 28 18:07:59.306662 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 641/1374] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:59 2022] DELETE /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:59.315764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:59.317818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:59.327059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.327779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.328214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.328885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.329353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.329821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.490614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:59.504678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c794cd5-92a7-4d88-a119-b6a19f81e31d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.439364 Oct 28 18:07:59.506461 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 734/1375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:59 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:59.517531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:59.527007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:59.538955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.544114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.545234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.547584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.550434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.550927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.625430 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91c15398-709b-401f-9360-f60a2cb86b74 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113596 Oct 28 18:07:59.626063 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 735/1376] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:07:59 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:07:59.642554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b77eff2a-9162-4efa-abaa-8cca48842e72 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:59.646335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b77eff2a-9162-4efa-abaa-8cca48842e72 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.646836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b77eff2a-9162-4efa-abaa-8cca48842e72 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.647277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b77eff2a-9162-4efa-abaa-8cca48842e72 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.648965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b77eff2a-9162-4efa-abaa-8cca48842e72 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.649800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b77eff2a-9162-4efa-abaa-8cca48842e72 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.650439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b77eff2a-9162-4efa-abaa-8cca48842e72 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.718422 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b77eff2a-9162-4efa-abaa-8cca48842e72 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.080132 Oct 28 18:07:59.719317 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 736/1377] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:07:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:59.738953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a4038752-2f6a-46d4-a61e-3152f9fe10e7 req-579dcd65-1fb4-4a77-a72f-bb337be19764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65bf4b2-0082-4097-a88a-84e3cd5c45d6", "name": "network-vif-unplugged", "status": "completed", "tag": "7a6ab836-9960-49fe-ab6f-64227a64a52a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:59.765219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a4038752-2f6a-46d4-a61e-3152f9fe10e7 req-579dcd65-1fb4-4a77-a72f-bb337be19764 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.765708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a4038752-2f6a-46d4-a61e-3152f9fe10e7 req-579dcd65-1fb4-4a77-a72f-bb337be19764 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.766143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a4038752-2f6a-46d4-a61e-3152f9fe10e7 req-579dcd65-1fb4-4a77-a72f-bb337be19764 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.805300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:59.820229 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a4038752-2f6a-46d4-a61e-3152f9fe10e7 req-579dcd65-1fb4-4a77-a72f-bb337be19764 service nova] Creating event network-vif-unplugged:7a6ab836-9960-49fe-ab6f-64227a64a52a for instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 on n-h1-862404-2 Oct 28 18:07:59.848267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-a4038752-2f6a-46d4-a61e-3152f9fe10e7 req-579dcd65-1fb4-4a77-a72f-bb337be19764 service nova] Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:07:59.877059 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a4038752-2f6a-46d4-a61e-3152f9fe10e7 req-579dcd65-1fb4-4a77-a72f-bb337be19764 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156500 Oct 28 18:07:59.879025 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 737/1378] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:59.900069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:59.900788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:07:59.932158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.932705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.933159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:59.938896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:59.939239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:59.939689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.262863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:00.271170 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbf3cea9-7c2a-4633-b560-d6a2d9d1dcef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1527 microversion: 2.1 time: 0.388876 Oct 28 18:08:00.271763 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 738/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:59 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1527 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:00.301132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:00.312991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:00.331094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.331598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.338352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.339218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.342739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.343197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.410533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:00.429029 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-619f81ea-07a4-465c-baa7-3980e8ddf60d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 1.120193 Oct 28 18:08:00.429859 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 642/1380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:59 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:00.460827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:00.471398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:00.473581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:00.480813 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0496be55-25dc-49a8-a1f9-256e49a01bf3 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.207978 Oct 28 18:08:00.481393 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 739/1381] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:00 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:00.486367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:00.487049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:00.494973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.495687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.496184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.496912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.497536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.497982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.645203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-175c21db-a3bf-4b81-92df-402dc0fc8fb5 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Action: 'update', calling method: .version_select at 0x7f78e253eca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:00.667014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:00.675767 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38de063c-1336-474d-8c93-5ab47a589377 tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1314 microversion: 2.1 time: 0.193322 Oct 28 18:08:00.689249 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 740/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:00 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:00.699206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:00.700013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:00.706276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.706773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.707477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.708232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.709567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.710771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.763965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175c21db-a3bf-4b81-92df-402dc0fc8fb5 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.764704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175c21db-a3bf-4b81-92df-402dc0fc8fb5 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.765309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175c21db-a3bf-4b81-92df-402dc0fc8fb5 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.766859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175c21db-a3bf-4b81-92df-402dc0fc8fb5 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.767508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175c21db-a3bf-4b81-92df-402dc0fc8fb5 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.768254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175c21db-a3bf-4b81-92df-402dc0fc8fb5 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.798696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:00.847233 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-175c21db-a3bf-4b81-92df-402dc0fc8fb5 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/f35d8b09cd18440bb77e17823c8da20f" status: 200 len: 240 microversion: 2.36 time: 0.406160 Oct 28 18:08:00.851192 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 643/1383] 10.222.0.16 () {62 vars in 1303 bytes} [Fri Oct 28 18:08:00 2022] PUT /compute/v2.1/os-quota-sets/f35d8b09cd18440bb77e17823c8da20f => generated 240 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:00.863064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:00.869907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:00.888234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.888868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.889321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.890054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:00.891550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:00.904710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:00.962616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:00.976681 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76a0cdc1-8a9e-4b2d-bec5-c708c4fec51f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.285252 Oct 28 18:08:00.977612 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 741/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:00 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:00.982144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b401e3d2-65b0-43ac-95e5-45610fb20819 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Calling method '.version_select at 0x7f78de0379d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:00.994827 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ef6496bc-9b58-44d5-af12-da9e607b59ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140742 Oct 28 18:08:01.023517 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 644/1385] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:08:00 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:01.143877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b401e3d2-65b0-43ac-95e5-45610fb20819 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.144678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b401e3d2-65b0-43ac-95e5-45610fb20819 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.145294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b401e3d2-65b0-43ac-95e5-45610fb20819 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.146232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b401e3d2-65b0-43ac-95e5-45610fb20819 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.146850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b401e3d2-65b0-43ac-95e5-45610fb20819 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.147434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b401e3d2-65b0-43ac-95e5-45610fb20819 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.187247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b401e3d2-65b0-43ac-95e5-45610fb20819 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f35d8b09cd18440bb77e17823c8da20f/detail" status: 200 len: 672 microversion: 2.36 time: 0.208203 Oct 28 18:08:01.187650 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 742/1386] 10.222.0.16 () {60 vars in 1304 bytes} [Fri Oct 28 18:08:00 2022] GET /compute/v2.1/os-quota-sets/f35d8b09cd18440bb77e17823c8da20f/detail => generated 672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:01.298666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:01.299271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:01.312298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.312863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.313327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.314185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.314876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.315319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.402381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Action: 'update', calling method: .version_select at 0x7f78de037940>, body: {"quota_set": {"ram": "2048"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:01.571534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.575852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.575852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.576695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.576814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.577222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.654664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:01.664569 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f1a0f4f6-90ec-4137-91dd-d5a5192c6b2f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1527 microversion: 2.1 time: 0.369919 Oct 28 18:08:01.670255 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 645/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:01 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1527 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:01.681447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.682273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.682933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.683298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:01.684291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.685203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:01.687788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.688567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.698931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.702853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.703444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.704991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.705920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.707064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.857450 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67e1ab77-1ff8-4829-a2de-f71631836fe8 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/f35d8b09cd18440bb77e17823c8da20f?user_id=8ed2bbd42af0483eb757fa50678e2323" status: 200 len: 240 microversion: 2.36 time: 0.460178 Oct 28 18:08:01.864585 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 743/1388] 10.222.0.16 () {62 vars in 1384 bytes} [Fri Oct 28 18:08:01 2022] PUT /compute/v2.1/os-quota-sets/f35d8b09cd18440bb77e17823c8da20f?user_id=8ed2bbd42af0483eb757fa50678e2323 => generated 240 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:01.869471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:01.886832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:01.896452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.908345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.908345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.908641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.909048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.912140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.035062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:02.043747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:02.045370 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e43538ac-2407-4aa4-a66e-c2a570e0b6de tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.372874 Oct 28 18:08:02.045976 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 646/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:01 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:02.055096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:02.057419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:02.072541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:02.073264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:02.078757 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b924687-9d1d-4705-87e6-3e69a41fd91e tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.213710 Oct 28 18:08:02.088006 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 744/1390] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:01 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:02.099697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-416f4047-7297-4a28-9e1a-88c20e8f1106 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] Calling method '.version_select at 0x7f78de0375e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:02.099921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.099921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.099921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.099921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.100268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.100268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.290672 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-416f4047-7297-4a28-9e1a-88c20e8f1106 tempest-QuotasAdminTestV236-383537609 tempest-QuotasAdminTestV236-383537609-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/f35d8b09cd18440bb77e17823c8da20f?user_id=8ed2bbd42af0483eb757fa50678e2323" status: 200 len: 282 microversion: 2.36 time: 0.205128 Oct 28 18:08:02.291206 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 745/1391] 10.222.0.16 () {60 vars in 1364 bytes} [Fri Oct 28 18:08:02 2022] GET /compute/v2.1/os-quota-sets/f35d8b09cd18440bb77e17823c8da20f?user_id=8ed2bbd42af0483eb757fa50678e2323 => generated 282 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:02.319960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-284046af-f8be-4605-b838-571e99285bd9 req-049a8834-5018-4b8d-ad8f-fd91c0180df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c77d0b67-005c-4da8-a83d-9b7494165b4f", "name": "network-vif-plugged", "status": "completed", "tag": "9d6e94af-3d9f-4c5b-bac7-1c4f7d4d00f9"}, {"server_uuid": "a33011c5-4735-4b59-856a-cac6b6f10d49", "name": "network-vif-unplugged", "status": "completed", "tag": "d6ee0267-9ec4-44bc-8516-33cdd18c19b5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:02.357070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-284046af-f8be-4605-b838-571e99285bd9 req-049a8834-5018-4b8d-ad8f-fd91c0180df7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.360867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-284046af-f8be-4605-b838-571e99285bd9 req-049a8834-5018-4b8d-ad8f-fd91c0180df7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.362161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-284046af-f8be-4605-b838-571e99285bd9 req-049a8834-5018-4b8d-ad8f-fd91c0180df7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.400562 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-284046af-f8be-4605-b838-571e99285bd9 req-049a8834-5018-4b8d-ad8f-fd91c0180df7 service nova] Creating event network-vif-plugged:9d6e94af-3d9f-4c5b-bac7-1c4f7d4d00f9 for instance c77d0b67-005c-4da8-a83d-9b7494165b4f on n-h2-862404-2 Oct 28 18:08:02.403176 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-284046af-f8be-4605-b838-571e99285bd9 req-049a8834-5018-4b8d-ad8f-fd91c0180df7 service nova] Creating event network-vif-unplugged:d6ee0267-9ec4-44bc-8516-33cdd18c19b5 for instance a33011c5-4735-4b59-856a-cac6b6f10d49 on n-h1-862404-2 Oct 28 18:08:02.441132 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-284046af-f8be-4605-b838-571e99285bd9 req-049a8834-5018-4b8d-ad8f-fd91c0180df7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.145604 Oct 28 18:08:02.450173 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 746/1392] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:02.455306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:02.467653 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4b1248e-6bce-4255-b61b-d3b32f60ab4a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1314 microversion: 2.1 time: 0.416416 Oct 28 18:08:02.470321 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 647/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:02 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:02.475556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:02.478913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:02.492332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.493137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.493814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.494981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.495727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.496432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.512445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:02.513441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:02.528447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.531436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.533565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.536498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.537249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.538516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.588125 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e4fdbfb-9843-41ac-93ea-92f4d0e2733b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111592 Oct 28 18:08:02.588801 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 648/1394] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:08:02 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:02.606298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4653a318-4162-49ce-8ba9-7f963a8548e3", "device": "/dev/xvdb"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:02.609112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:02.623874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.624389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.624835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.625590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.626058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.626490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.857894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:02.867043 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c785a21-4693-44df-85ae-7b1afbad184e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.414752 Oct 28 18:08:02.867851 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 747/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:02 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:02.873440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:02.874018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:02.880422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.880923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.881388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.882647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:02.883353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:02.883867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.060375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:03.070467 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f9d51f8-da6f-423f-b9c0-f76fb524835e tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1527 microversion: 2.1 time: 0.201218 Oct 28 18:08:03.077982 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 748/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:02 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1527 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:03.077982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:03.077982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:03.087761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.088384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.088834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.089719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.090499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.090935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.242771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:03.251477 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f48a3ef-1e99-473c-a3cd-c1e98ffc19ae tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.179717 Oct 28 18:08:03.252369 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 749/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:03 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:03.267961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:03.268696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:03.276157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.276880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.277499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.278316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.278990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.279534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.357831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:03.367307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:03.369435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:03.374643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee4ac40d-2aa4-4cc2-ac90-55521059cebd tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.120937 Oct 28 18:08:03.376021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 750/1398] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:03 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:03.493449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:03.494060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:03.501631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.502140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.502595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.503311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.503769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.504698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.651420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:03.661001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f8ca95c-578d-4bc5-a20b-bca994e69e4c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1314 microversion: 2.1 time: 0.172241 Oct 28 18:08:03.661588 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 751/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:03 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:03.668912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:03.671175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:03.677425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.677916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.678371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.679177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.679805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.680258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.724607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa443238-0245-4d3b-90f0-2cb483096e98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061978 Oct 28 18:08:03.725408 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 752/1400] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:08:03 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:03.897119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:03.898639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:03.905530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.906310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.906897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:03.907774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:03.908438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:03.911829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.087183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:04.097808 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e5918dd-be46-415a-9779-9c16143edaff tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1307 microversion: 2.1 time: 0.204509 Oct 28 18:08:04.099780 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 753/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:03 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:04.106438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:04.107692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:04.114421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:04.115141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:04.115734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.117726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:04.118186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:04.118613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.332475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:04.342454 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f1663fa0-09ec-4332-b61a-3e5d5e72b04f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1527 microversion: 2.1 time: 0.241414 Oct 28 18:08:04.343266 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 754/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:04 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1527 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:04.358137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:04.359648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:04.369146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:04.370554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:04.373386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.381487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:04.385230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:04.385938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.588796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:04.597743 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26bcf7e3-4895-45a8-b602-2625d67ecf8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.243637 Oct 28 18:08:04.598760 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 755/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:04 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:04.606768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:04.607407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:04.614380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:04.615098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:04.615715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.617315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:04.620434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:04.620954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.645032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:04.737912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:04.753624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:04.755188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:04.761234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffdb7152-76bc-4dc9-83fe-fbbeaab0e49b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.161406 Oct 28 18:08:04.761969 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 756/1404] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:04 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:04.781463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:04.785089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:04.794200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:04.794673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:04.795166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.796216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:04.796930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:04.797363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:04.985073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:04.994067 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd51959c-7082-41f2-9fe0-118f3bb8ae3e tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1463 microversion: 2.1 time: 0.221157 Oct 28 18:08:04.994973 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 757/1405] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:04 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1463 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:05.000079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:05.002692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:05.025998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.026501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.026949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.027673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.028163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.028601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.078688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2583edf8-6dfa-4f35-8d61-62aa11fa92a1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082566 Oct 28 18:08:05.079520 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 758/1406] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:08:04 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:05.317367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-432f483a-b432-488d-bcf1-2859cf1f3a65 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Calling method '.version_select at 0x7f78de0d10d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:05.330381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-432f483a-b432-488d-bcf1-2859cf1f3a65 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.330946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-432f483a-b432-488d-bcf1-2859cf1f3a65 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.331576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-432f483a-b432-488d-bcf1-2859cf1f3a65 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.360159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-432f483a-b432-488d-bcf1-2859cf1f3a65 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.363568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-432f483a-b432-488d-bcf1-2859cf1f3a65 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.366885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-432f483a-b432-488d-bcf1-2859cf1f3a65 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.404784 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-432f483a-b432-488d-bcf1-2859cf1f3a65 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/d00cb9b0750e4c1ab9c18f48e6f6ee1c?start=2022-10-27T18%3A08%3A05.013764&end=2022-10-29T18%3A08%3A05.013764" status: 200 len: 699 microversion: 2.1 time: 0.324350 Oct 28 18:08:05.405299 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 759/1407] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Oct 28 18:08:05 2022] GET /compute/v2.1/os-simple-tenant-usage/d00cb9b0750e4c1ab9c18f48e6f6ee1c?start=2022-10-27T18%3A08%3A05.013764&end=2022-10-29T18%3A08%3A05.013764 => generated 699 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:05.409726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:05.410332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:05.417307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.417814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.418558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.419610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.420556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.421235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.618147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:05.628405 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e64be44d-02d0-43b9-81a9-34b97d6648f7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 200 len: 1488 microversion: 2.1 time: 0.222061 Oct 28 18:08:05.632731 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 760/1408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:05 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 1488 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:05.646536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:05.647236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:05.658039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.658524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.658981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.660071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.660499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.660935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.862920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:05.871529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b68acad6-ca2f-4b8c-b29c-19ac5c410370 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1527 microversion: 2.1 time: 0.237711 Oct 28 18:08:05.872171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 761/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:05 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1527 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:05.888087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ce3951e-f7e8-4518-a1e0-5479218fcfde tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '.version_select at 0x7f78de0d1820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:05.906342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ce3951e-f7e8-4518-a1e0-5479218fcfde tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.906836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ce3951e-f7e8-4518-a1e0-5479218fcfde tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.907325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ce3951e-f7e8-4518-a1e0-5479218fcfde tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.917887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ce3951e-f7e8-4518-a1e0-5479218fcfde tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.918545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ce3951e-f7e8-4518-a1e0-5479218fcfde tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.918998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ce3951e-f7e8-4518-a1e0-5479218fcfde tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.949227 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ce3951e-f7e8-4518-a1e0-5479218fcfde tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/d00cb9b0750e4c1ab9c18f48e6f6ee1c?start=2022-10-27T18%3A08%3A05.013764&end=2022-10-29T18%3A08%3A05.013764" status: 200 len: 695 microversion: 2.1 time: 0.075897 Oct 28 18:08:05.950138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 762/1410] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Oct 28 18:08:05 2022] GET /compute/v2.1/os-simple-tenant-usage/d00cb9b0750e4c1ab9c18f48e6f6ee1c?start=2022-10-27T18%3A08%3A05.013764&end=2022-10-29T18%3A08%3A05.013764 => generated 695 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:05.961352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:05.963874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:05.969888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:05.976615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.977386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.977835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:05.978855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:05.979007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:05.981427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.173024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:06.182297 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6201b300-e42b-4dec-a156-aa14ff68c949 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.231125 Oct 28 18:08:06.182891 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 763/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:05 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:06.187845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-109480117"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:06.190319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:06.196319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:06.196808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:06.197245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.197948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:06.198403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:06.198830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.435761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1afce270-5598-4f62-9ece-25c9925bda7d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12/action" status: 202 len: 0 microversion: 2.1 time: 0.251550 Oct 28 18:08:06.436379 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 764/1412] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:08:06 2022] POST /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:08:06.449794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:06.450619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:06.457121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:06.457877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:06.458318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.459027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:06.459484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:06.460467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.533865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:06.543004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:06.544551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:06.550311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c449f97-f349-4efa-b82f-eead45001027 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.112407 Oct 28 18:08:06.559917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 765/1413] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:06 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:06.559917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-128e64e6-a5c5-4af8-9d84-28597ec44059 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Calling method '.version_select at 0x7f78de0ee040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:06.567964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-128e64e6-a5c5-4af8-9d84-28597ec44059 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:06.568445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-128e64e6-a5c5-4af8-9d84-28597ec44059 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:06.568874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-128e64e6-a5c5-4af8-9d84-28597ec44059 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.587112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-128e64e6-a5c5-4af8-9d84-28597ec44059 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:06.587595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-128e64e6-a5c5-4af8-9d84-28597ec44059 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:06.588054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-128e64e6-a5c5-4af8-9d84-28597ec44059 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.647413 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-128e64e6-a5c5-4af8-9d84-28597ec44059 tempest-TenantUsagesTestJSON-1713227472 tempest-TenantUsagesTestJSON-1713227472-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T18%3A08%3A05.013764&end=2022-10-29T18%3A08%3A05.013764&detailed=1" status: 200 len: 13503 microversion: 2.1 time: 0.095424 Oct 28 18:08:06.648706 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 766/1414] 10.222.0.16 () {58 vars in 1335 bytes} [Fri Oct 28 18:08:06 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T18%3A08%3A05.013764&end=2022-10-29T18%3A08%3A05.013764&detailed=1 => generated 13503 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:06.654161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:06.656379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:06.663018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:06.664143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:06.664595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.665300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:06.665757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:06.666188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:06.696878 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e497edf1-d609-498d-acff-fb744aa9b074 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.046370 Oct 28 18:08:06.697630 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 767/1415] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:08:06 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:06.878455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91f714ba-99d9-44e6-af05-e74e3e4340a3 tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] Action: 'create', calling method: .version_select at 0x7f78de0e2af0>, body: {"security_group": {"name": "tempest-securitygroup-1771971717", "description": "tempest-description-209448422"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:07.190211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91f714ba-99d9-44e6-af05-e74e3e4340a3 tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.490853 Oct 28 18:08:07.190959 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 768/1416] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:08:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:07.203843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-972f073b-98b2-42ca-b796-79739c6a791d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0ee790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:07.252056 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-972f073b-98b2-42ca-b796-79739c6a791d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.060028 Oct 28 18:08:07.253025 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 769/1417] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:07 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:07.258240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:07.258759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:07.265064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:07.265556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:07.266038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:07.266857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:07.267340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:07.267808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:07.295396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:08:07.373172 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2873ceb5-03a3-46c6-8164-60e3509b241f tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 204 len: 0 microversion: 2.1 time: 0.118762 Oct 28 18:08:07.377003 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 770/1418] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:08:07 2022] DELETE /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:08:07.384211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:07.384924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:07.391082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:07.391572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:07.392115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:07.392804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:07.393255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:07.393677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:07.528998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:07.536742 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3936333a-0720-4362-a148-608768c7727a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1527 microversion: 2.1 time: 0.158309 Oct 28 18:08:07.537316 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 771/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:07 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1527 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:07.541844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e25416f-3e3b-481b-918e-1e5c7a45e2b6 tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] Action: 'create', calling method: .version_select at 0x7f78de114670>, body: {"security_group": {"name": "tempest-securitygroup-1491059442", "description": "tempest-description-1818326713"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:07.682415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e25416f-3e3b-481b-918e-1e5c7a45e2b6 tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.143956 Oct 28 18:08:07.691065 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 772/1420] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:08:07 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:07.691065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:07.691065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:07.697313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:07.697810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:07.698259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:07.698967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:07.699425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:07.699893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:07.834468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:07.843074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-752cfd52-d252-43f1-8c1e-22ae775baeb4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.158409 Oct 28 18:08:07.843653 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 773/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:07 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:07.848059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:07.848657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:07.854155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:07.854629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:07.855060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:07.855739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:07.856215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:07.856640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:07.986825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74503ec6cd3b4167ad0cf66ae6d78422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00cb9b0750e4c1ab9c18f48e6f6ee1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:07.995012 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38f23b16-139d-4ad8-97b6-8a40637b1c9a tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 200 len: 1469 microversion: 2.1 time: 0.150396 Oct 28 18:08:07.995680 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 774/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:07 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:08.000387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:08.000740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:08.006401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:08.007549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:08.008028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:08.008844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:08.009317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:08.009775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:08.014072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:08.080923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:08.089845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:08.091299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:08.096049 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-114f4a88-9279-4a0b-bc7d-3d5d5a8f925d tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.099347 Oct 28 18:08:08.096620 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 775/1423] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:07 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:08.149462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f2cc551-0ba3-49bc-b698-054eebe2690b tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] Action: 'create', calling method: .version_select at 0x7f78de0fd9d0>, body: {"security_group": {"name": "tempest-securitygroup-2033191758", "description": "tempest-description-453594026"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:08.382368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f2cc551-0ba3-49bc-b698-054eebe2690b tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.284589 Oct 28 18:08:08.383592 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 776/1424] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:08:08 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:08.388949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:08.391392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:08.397427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:08.397930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:08.398362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:08.399055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:08.399502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:08.399952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:08.429970 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d0e431c-e055-415d-8e20-3e040cd8ffb2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.045132 Oct 28 18:08:08.430525 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 777/1425] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:08:08 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:08.434817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-956ebf03-c44a-400f-8326-c6d2a5999546 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de148b80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:08.479103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-956ebf03-c44a-400f-8326-c6d2a5999546 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.047581 Oct 28 18:08:08.479672 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 778/1426] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:08 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:08.483988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90de9133-d38f-48b4-9a3a-3a98bfbf307f tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] Action: 'create', calling method: .version_select at 0x7f78de0e20d0>, body: {"security_group": {"name": "tempest-securitygroup-495850686", "description": "tempest-description-1692256350"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:08.614327 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90de9133-d38f-48b4-9a3a-3a98bfbf307f tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.133533 Oct 28 18:08:08.614936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 779/1427] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:08:08 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:08.622196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:08.622196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:08.627580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:08.628097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:08.628540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:08.629242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:08.629695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:08.630141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:08.761007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:08.768700 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31e9a697-b56e-4a6b-b917-a3b15c1d55a4 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1527 microversion: 2.1 time: 0.152594 Oct 28 18:08:08.769267 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 780/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:08 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:08.774400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-74e2f266-7b8a-4ee9-92f4-33ab8415a352 tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] Calling method '.version_select at 0x7f78de0ee0d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:10.686823 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-74e2f266-7b8a-4ee9-92f4-33ab8415a352 tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12295 microversion: 2.1 time: 1.916485 Oct 28 18:08:10.687441 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 781/1429] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 18:08:08 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12295 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:10.692133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:10.692750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:10.699157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:10.699644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:10.700119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:10.700816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:10.701268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:10.701698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:10.780996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:10.830252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:10.838950 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad806504-4022-47ef-84e0-17bb6a1902f4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.150464 Oct 28 18:08:10.839524 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 782/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:10 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:10.841117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:10.844826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:10.845439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] [instance: c77d0b67-005c-4da8-a83d-9b7494165b4f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:10.851247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:10.851740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:10.852212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:10.852915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:10.853373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:10.853799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:10.867682 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] HTTP exception thrown: Instance c77d0b67-005c-4da8-a83d-9b7494165b4f could not be found. Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Request method failure captured: Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f HTTP/1.1 Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBpvq33zeapDTbXiWF6x0FNeT6jwcBEf_oCeK4yKZmwaxU7wStWjNI_5iBuJKnpHu9uaylxobvaaTCjK9szTdRaY4rgN7cct_rcCB9KM2asLQ2fV4yYc9Z-GlFqBpbDE4bGbSAnw3AW_fUesQxXa8KJrhxz_k8N8aU-XFLVZgoPUSQ4 Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: d00cb9b0750e4c1ab9c18f48e6f6ee1c Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TenantUsagesTestJSON-150105225 Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:08:10.869371 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00cb9b0750e4c1ab9c18f48e6f6ee1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00cb9b0750e4c1ab9c18f48e6f6ee1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00cb9b0750e4c1ab9c18f48e6f6ee1c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00cb9b0750e4c1ab9c18f48e6f6ee1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TenantUsagesTestJSON-150105225 Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: d00cb9b0750e4c1ab9c18f48e6f6ee1c Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TenantUsagesTestJSON-150105225 Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TenantUsagesTestJSON-150105225-project Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 74503ec6cd3b4167ad0cf66ae6d78422 Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TenantUsagesTestJSON-150105225-project Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance c77d0b67-005c-4da8-a83d-9b7494165b4f could not be found. Oct 28 18:08:10.871058 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'c77d0b67-005c-4da8-a83d-9b7494165b4f'} Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c77d0b67-005c-4da8-a83d-9b7494165b4f could not be found. Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:10.872087 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c77d0b67-005c-4da8-a83d-9b7494165b4f could not be found. Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c77d0b67-005c-4da8-a83d-9b7494165b4f could not be found. Oct 28 18:08:10.873689 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:10.875161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] Returning 404 to user: Instance c77d0b67-005c-4da8-a83d-9b7494165b4f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:10.875161 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ffec1e3-485a-4567-be76-f4f6853d633c tempest-TenantUsagesTestJSON-150105225 tempest-TenantUsagesTestJSON-150105225-project] 10.222.0.16 "GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f" status: 404 len: 111 microversion: 2.1 time: 0.030238 Oct 28 18:08:10.875161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 783/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:10 2022] GET /compute/v2.1/servers/c77d0b67-005c-4da8-a83d-9b7494165b4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:10.877912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:10.878520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:10.884941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:10.885428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:10.885864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:10.886559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:10.887014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:10.887445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:10.959069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:10.967155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:10.968626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:10.973465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ace05715-f688-436f-8839-1a749a70495b tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.101303 Oct 28 18:08:10.974035 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 784/1432] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:10 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:11.088415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:11.090832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:11.096853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.097410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.097920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:11.098688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.099242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.099753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:11.130737 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1332f470-71c3-4954-9346-7cc6921454b4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.155628 Oct 28 18:08:11.131576 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 785/1433] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:08:10 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:08:11.137126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-765eed60-2578-40b5-9c1c-e30b208ff6f5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de1485e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:11.181844 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-765eed60-2578-40b5-9c1c-e30b208ff6f5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.048351 Oct 28 18:08:11.182425 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 786/1434] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:11 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:11.187020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ed6a47a2-ed51-4fe2-99ce-1bb010b4b086 req-794fb9ca-9415-4e92-82c1-b38e1103d630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c77d0b67-005c-4da8-a83d-9b7494165b4f", "name": "network-vif-deleted", "tag": "9d6e94af-3d9f-4c5b-bac7-1c4f7d4d00f9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:11.198070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed6a47a2-ed51-4fe2-99ce-1bb010b4b086 req-794fb9ca-9415-4e92-82c1-b38e1103d630 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.198554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed6a47a2-ed51-4fe2-99ce-1bb010b4b086 req-794fb9ca-9415-4e92-82c1-b38e1103d630 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.198981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed6a47a2-ed51-4fe2-99ce-1bb010b4b086 req-794fb9ca-9415-4e92-82c1-b38e1103d630 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:11.209627 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ed6a47a2-ed51-4fe2-99ce-1bb010b4b086 req-794fb9ca-9415-4e92-82c1-b38e1103d630 service nova] Creating event network-vif-deleted:9d6e94af-3d9f-4c5b-bac7-1c4f7d4d00f9 for instance c77d0b67-005c-4da8-a83d-9b7494165b4f on n-h2-862404-2 Oct 28 18:08:11.215597 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ed6a47a2-ed51-4fe2-99ce-1bb010b4b086 req-794fb9ca-9415-4e92-82c1-b38e1103d630 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032049 Oct 28 18:08:11.216861 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 787/1435] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:11.221370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:11.222071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:11.228572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.229057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.229492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:11.230190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.230648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.231073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:11.399450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:11.408131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05104d2a-ab13-46ac-9230-57eac7da24b1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1527 microversion: 2.1 time: 0.190505 Oct 28 18:08:11.408722 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 788/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:11 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1527 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:11.414609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c32fb249-dff1-4e94-803f-06ab600f761f tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] Calling method '.version_select at 0x7f78de0fd4c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:11.826751 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c32fb249-dff1-4e94-803f-06ab600f761f tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.416379 Oct 28 18:08:11.827371 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 789/1437] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 18:08:11 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:11.843295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e0f22bc-22b9-48e4-bafe-205fde87ea95 tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] Calling method '.version_select at 0x7f78de21b160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:11.860349 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9ac61f6-e5d9-4da7-be50-5975f907c20a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "POST /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.258202 Oct 28 18:08:11.868113 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 649/1438] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:08:02 2022] POST /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments => generated 194 bytes in 9267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:11.874287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:11.875622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:11.884528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.885477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.886109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:11.887344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.888011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.888588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.112081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:12.121162 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-60a371b0-dab7-4d7e-b480-8307af6c613e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.251240 Oct 28 18:08:12.138004 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 650/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:11 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:12.143907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:12.144527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:12.151217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.151709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.152189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.152896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.153352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.153991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.242049 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e0f22bc-22b9-48e4-bafe-205fde87ea95 tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/108a8814-8a45-4acf-ad9f-b01f4201b540" status: 202 len: 0 microversion: 2.1 time: 0.401875 Oct 28 18:08:12.243506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 790/1440] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:08:11 2022] DELETE /compute/v2.1/os-security-groups/108a8814-8a45-4acf-ad9f-b01f4201b540 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:08:12.250412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:12.254585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:12.273591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.274597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.275248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.277502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.278226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.278878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.289097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=18 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:12.292286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:12.301958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:12.305166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:12.312647 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9391c3cf-6f28-444f-a954-b36b72d2bba4 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.175366 Oct 28 18:08:12.326957 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6f3f7fe-b097-4227-ad43-c9cca73fa984 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.081893 Oct 28 18:08:12.327950 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 791/1441] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:08:12 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:12.328909 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 651/1442] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:12 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:12.340603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-27650126-6c1b-4251-8f61-2a5c35c8dcdb tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] Calling method '.version_select at 0x7f78de259700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:12.346151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2626a571-833b-42f2-b043-98840c4f2c53 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de21bee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:12.440002 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2626a571-833b-42f2-b043-98840c4f2c53 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.109713 Oct 28 18:08:12.448710 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 792/1443] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:12 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:12.640086 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-27650126-6c1b-4251-8f61-2a5c35c8dcdb tempest-SecurityGroupsTestAdminJSON-2122625418 tempest-SecurityGroupsTestAdminJSON-2122625418-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/95a7895a-f365-43f2-a4e1-cb57b98e47f3" status: 202 len: 0 microversion: 2.1 time: 0.309974 Oct 28 18:08:12.641446 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 652/1444] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:08:12 2022] DELETE /compute/v2.1/os-security-groups/95a7895a-f365-43f2-a4e1-cb57b98e47f3 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:08:12.647767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:12.649180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:12.655244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.655959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.656595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.657643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.658270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.658856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.750251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:12.759082 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-068de6be-5f85-4364-98ae-8e8c5f87d44a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1485 microversion: 2.1 time: 0.115812 Oct 28 18:08:12.760507 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 653/1445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:12 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1485 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:12.765614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c53e1da-11ef-42f5-b28b-920a9bd49333 tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] Calling method '.version_select at 0x7f78e2521160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:12.881294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-eb72caa4-2766-4df5-8f4b-4af7fad0fe45 req-8180aee6-3717-4e10-95d6-3a74ccae3982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33011c5-4735-4b59-856a-cac6b6f10d49", "name": "network-vif-deleted", "tag": "d6ee0267-9ec4-44bc-8516-33cdd18c19b5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:12.894704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb72caa4-2766-4df5-8f4b-4af7fad0fe45 req-8180aee6-3717-4e10-95d6-3a74ccae3982 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.895518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb72caa4-2766-4df5-8f4b-4af7fad0fe45 req-8180aee6-3717-4e10-95d6-3a74ccae3982 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.896430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb72caa4-2766-4df5-8f4b-4af7fad0fe45 req-8180aee6-3717-4e10-95d6-3a74ccae3982 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.910346 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-eb72caa4-2766-4df5-8f4b-4af7fad0fe45 req-8180aee6-3717-4e10-95d6-3a74ccae3982 service nova] Creating event network-vif-deleted:d6ee0267-9ec4-44bc-8516-33cdd18c19b5 for instance a33011c5-4735-4b59-856a-cac6b6f10d49 on n-h1-862404-2 Oct 28 18:08:12.917831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-eb72caa4-2766-4df5-8f4b-4af7fad0fe45 req-8180aee6-3717-4e10-95d6-3a74ccae3982 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.466207 Oct 28 18:08:12.919236 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 793/1446] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:13.025395 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c53e1da-11ef-42f5-b28b-920a9bd49333 tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/835cb2e3-bc34-4fe1-9235-5c6e67e7d7d2" status: 202 len: 0 microversion: 2.1 time: 0.262835 Oct 28 18:08:13.026331 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 654/1447] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:08:12 2022] DELETE /compute/v2.1/os-security-groups/835cb2e3-bc34-4fe1-9235-5c6e67e7d7d2 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:08:13.035978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71d6c27b-380a-46d8-8362-202e65744e77 tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] Calling method '.version_select at 0x7f78de0fd1f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:13.146750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:13.160730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:13.170682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:13.171720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:13.172371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:13.173263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:13.173894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:13.174489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:13.291559 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71d6c27b-380a-46d8-8362-202e65744e77 tempest-SecurityGroupsTestAdminJSON-565888574 tempest-SecurityGroupsTestAdminJSON-565888574-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/561a1b97-3b65-471b-a34f-bcf4c42275d7" status: 202 len: 0 microversion: 2.1 time: 0.260858 Oct 28 18:08:13.292685 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 794/1448] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:08:13 2022] DELETE /compute/v2.1/os-security-groups/561a1b97-3b65-471b-a34f-bcf4c42275d7 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:08:13.346076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:13.346919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:13.358146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:13.359773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:13.361167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:13.364080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:13.364836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:13.366792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:13.375045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:13.383073 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9cd6656a-cce3-4a2e-b17a-46661f1a09aa tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.240184 Oct 28 18:08:13.400544 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 655/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:13 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:13.463556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:13.474727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:13.475311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9e912f6a-e525-400f-94dd-7c8e08d5d4d7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2599d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:13.476113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:13.482781 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6b5853b-479b-4f38-b23f-65e3a3ad1478 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.140428 Oct 28 18:08:13.484028 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 795/1450] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:13 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:08:13.545117 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9e912f6a-e525-400f-94dd-7c8e08d5d4d7 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.074692 Oct 28 18:08:13.547003 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 656/1451] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:13 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:13.785369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:13.786350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:13.795230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:13.796164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:13.797335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:13.798848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:13.799988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:13.801017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:13.899113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:13.910443 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-284cb481-cd03-4e4f-a02d-0ebfa4c70ee7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1485 microversion: 2.1 time: 0.129142 Oct 28 18:08:13.911289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 796/1452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:13 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1485 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:14.407263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:14.408530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:14.416178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.416970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.417579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.418609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.419082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.419679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.533615 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-41b81269-d79d-43fb-92bc-8e4d09ec6499 tempest-TenantUsagesNegativeTestJSON-1727244162 tempest-TenantUsagesNegativeTestJSON-1727244162-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T18%3A08%3A14.336062&end=2022-10-29T18%3A08%3A14.336062" status: 404 len: 112 microversion: - time: 0.193968 Oct 28 18:08:14.537708 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 657/1453] 10.222.0.16 () {58 vars in 1316 bytes} [Fri Oct 28 18:08:14 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T18%3A08%3A14.336062&end=2022-10-29T18%3A08%3A14.336062 => generated 112 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 18:08:14.545047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:14.547489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:14.555794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.556644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.557097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.558097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.558565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.559002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.617731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:14.626724 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6039e53-06c8-47c9-966f-3f9ea1d111cb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.223362 Oct 28 18:08:14.627319 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 797/1454] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:14 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:14.634702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6182ae09-3af6-479a-9b8d-53344c38bd4f tempest-TenantUsagesNegativeTestJSON-1727244162 tempest-TenantUsagesNegativeTestJSON-1727244162-project-admin] Calling method '.version_select at 0x7f78de0d1280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:14.639969 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6182ae09-3af6-479a-9b8d-53344c38bd4f tempest-TenantUsagesNegativeTestJSON-1727244162 tempest-TenantUsagesNegativeTestJSON-1727244162-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 28 18:08:14.653534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6182ae09-3af6-479a-9b8d-53344c38bd4f tempest-TenantUsagesNegativeTestJSON-1727244162 tempest-TenantUsagesNegativeTestJSON-1727244162-project-admin] Request method failure captured: Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-simple-tenant-usage/b91ccf71922040e394f1ca0f6286413d?start=2022-10-29T18%3A08%3A14.336062&end=2022-10-27T18%3A08%3A14.336062 HTTP/1.1 Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBqOGBwZf0rF8FsPZkYOK4Z9CF-DilcwJV8NHLxsQW-_8l10kisaO2srtXfgisILxkCffPKkFxYrHNeL5RZ_S9ENKxtHXjHAeIC5m6D2WW2Me4NUJqEW5-uC_j0HuW2ZDhallB4ndMEJYADJZZubiX9dj-e6jfMBuK72UKgRyRuLAOA Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 0036b0e65c1e4e469be662e9559ae80b Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1727244162 Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:08:14.654808 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0036b0e65c1e4e469be662e9559ae80b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0036b0e65c1e4e469be662e9559ae80b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0036b0e65c1e4e469be662e9559ae80b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0036b0e65c1e4e469be662e9559ae80b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1727244162 Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 0036b0e65c1e4e469be662e9559ae80b Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1727244162 Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TenantUsagesNegativeTestJSON-1727244162-project-admin Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5b6fc5f7e8c34f4b9e9c6403687c23de Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1727244162-project-admin Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid start time. The start time cannot occur after the end time. Oct 28 18:08:14.656210 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'b91ccf71922040e394f1ca0f6286413d'} Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 18:08:14.656987 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 28 18:08:14.658260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:14.660274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6182ae09-3af6-479a-9b8d-53344c38bd4f tempest-TenantUsagesNegativeTestJSON-1727244162 tempest-TenantUsagesNegativeTestJSON-1727244162-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:14.662195 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6182ae09-3af6-479a-9b8d-53344c38bd4f tempest-TenantUsagesNegativeTestJSON-1727244162 tempest-TenantUsagesNegativeTestJSON-1727244162-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/b91ccf71922040e394f1ca0f6286413d?start=2022-10-29T18%3A08%3A14.336062&end=2022-10-27T18%3A08%3A14.336062" status: 400 len: 111 microversion: 2.1 time: 0.033102 Oct 28 18:08:14.667535 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 798/1455] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Oct 28 18:08:14 2022] GET /compute/v2.1/os-simple-tenant-usage/b91ccf71922040e394f1ca0f6286413d?start=2022-10-29T18%3A08%3A14.336062&end=2022-10-27T18%3A08%3A14.336062 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:08:14.667730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:14.667730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:14.670169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1216094-38e9-4ca4-8bcc-0621f639f73d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de21b280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:14.677006 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-423f8a6d-12ed-4d3c-8b3c-8709740539aa tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.136596 Oct 28 18:08:14.681709 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 658/1456] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:14 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:14.749822 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d1216094-38e9-4ca4-8bcc-0621f639f73d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.085610 Oct 28 18:08:14.750733 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 799/1457] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:14 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:14.937033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:14.939553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:14.949744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.950619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.951057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.951775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.952264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.952895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.953827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6390440e-2316-42b1-9d7e-d539d8ac2b0a tempest-TenantUsagesNegativeTestJSON-859023490 tempest-TenantUsagesNegativeTestJSON-859023490-project] Calling method '.version_select at 0x7f78de262f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:14.960697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6390440e-2316-42b1-9d7e-d539d8ac2b0a tempest-TenantUsagesNegativeTestJSON-859023490 tempest-TenantUsagesNegativeTestJSON-859023490-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8d3a12d863b9410caea8064be0cbf3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91ccf71922040e394f1ca0f6286413d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6390440e-2316-42b1-9d7e-d539d8ac2b0a tempest-TenantUsagesNegativeTestJSON-859023490 tempest-TenantUsagesNegativeTestJSON-859023490-project] Request method failure captured: Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T18%3A08%3A14.336062&end=2022-10-29T18%3A08%3A14.336062&detailed=1 HTTP/1.1 Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBqNk9ChC9FIwuHgCdU8bT4abMD69lTpGUTn5EeQDzg8Xy-wexRKFbofRVQ-uluze_fn2DrerKLDqm1reux-ml8TFLPDYZWai0GdP1oIj27VhuDOVjuKZmdFwXbQ-djJLmSEAVawyHPFAgrGaKByvgkWCkmgy6ZQU-vo5trXLbXjPRc Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: b91ccf71922040e394f1ca0f6286413d Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-859023490 Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:08:14.963333 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b91ccf71922040e394f1ca0f6286413d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b91ccf71922040e394f1ca0f6286413d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b91ccf71922040e394f1ca0f6286413d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b91ccf71922040e394f1ca0f6286413d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-859023490 Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: b91ccf71922040e394f1ca0f6286413d Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-859023490 Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TenantUsagesNegativeTestJSON-859023490-project Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8d3a12d863b9410caea8064be0cbf3b0 Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-859023490-project Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: action_args: {} Oct 28 18:08:14.965047 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:08:14.966229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:08:14.967667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:08:14.969095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 18:08:14.969095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:08:14.970026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6390440e-2316-42b1-9d7e-d539d8ac2b0a tempest-TenantUsagesNegativeTestJSON-859023490 tempest-TenantUsagesNegativeTestJSON-859023490-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:14.971233 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6390440e-2316-42b1-9d7e-d539d8ac2b0a tempest-TenantUsagesNegativeTestJSON-859023490 tempest-TenantUsagesNegativeTestJSON-859023490-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T18%3A08%3A14.336062&end=2022-10-29T18%3A08%3A14.336062&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.286356 Oct 28 18:08:14.972875 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 659/1458] 10.222.0.16 () {58 vars in 1335 bytes} [Fri Oct 28 18:08:14 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T18%3A08%3A14.336062&end=2022-10-29T18%3A08%3A14.336062&detailed=1 => generated 123 bytes in 288 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:15.031808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:15.041200 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2cd43486-1404-40e0-b2d8-360e88e9fab1 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1310 microversion: 2.1 time: 0.109502 Oct 28 18:08:15.041786 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 800/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:14 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1310 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:15.652315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:15.653877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:15.662503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:15.663088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:15.663654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:15.664404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:15.664873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:15.665500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:15.708994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:15.709909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:15.722076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:15.722983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:15.723744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:15.724743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:15.726054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:15.726779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:15.810157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:15.820507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:15.822716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:15.830551 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eedc2097-6e96-41b3-9a78-c3dc491f59ec tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.125663 Oct 28 18:08:15.831759 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 801/1460] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:15 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:08:15.852287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a359ec02-5c48-4ce4-b1bb-d99f159b1b1b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0e24c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:15.909401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:15.918568 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cafe7799-6b80-4469-a900-874f5853f72b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.270035 Oct 28 18:08:15.919005 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a359ec02-5c48-4ce4-b1bb-d99f159b1b1b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.084755 Oct 28 18:08:15.920039 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 660/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:15 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:15.929425 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 802/1462] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:15 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:16.067087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:16.067717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:16.074002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:16.074517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:16.075518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:16.075656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:16.076117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:16.076541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:16.151575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:16.160563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:16.164002 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a9994266-c3d7-4ddf-aeab-cd1451c0270a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1310 microversion: 2.1 time: 0.100054 Oct 28 18:08:16.172480 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 661/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:16 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:16.858827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=15 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:16.863474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:16.865513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:16.873602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:16.874374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:16.875139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:16.876075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:16.876704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:16.877310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:16.948939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:16.950115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:16.965253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:16.970337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:16.971035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:16.972024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:16.972496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:16.972925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:16.976909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:16.987154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:16.988680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:16.995355 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eed5a463-4bcc-4d5d-baa8-08db6f5a1f41 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.137805 Oct 28 18:08:17.005074 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 803/1464] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:16 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:17.018021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20cde168-f113-4f71-9145-5a230531a66b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de148f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:17.103672 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-20cde168-f113-4f71-9145-5a230531a66b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.097009 Oct 28 18:08:17.104570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 804/1465] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:17 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:17.189116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:17.202783 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f53f03a6-0c80-45ba-8bea-99918fcc33f2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.262665 Oct 28 18:08:17.204057 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 662/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:16 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:17.209367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:17.211053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:17.217888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:17.218665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:17.219284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:17.220017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:17.220494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:17.220919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:17.295048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:17.307021 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-daeaac30-146e-44c1-9f1a-10371c537200 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1310 microversion: 2.1 time: 0.101690 Oct 28 18:08:17.308886 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 663/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:17 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:17.443546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-107423339", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:17.570310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:08:17.861004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:08:17.862256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:08:17.863411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:08:17.864047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:08:17.865145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:08:17.877269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:17.877757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:17.878200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:17.878936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:17.879406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:17.879858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:17.905039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Getting quotas for project c8fadc9d55a142758e254642e1e23fad. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:17.911784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Getting quotas for user 5b492838053d4f7896216ae780f1dbb2 and project c8fadc9d55a142758e254642e1e23fad. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:17.929324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:08:17.932314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:08:18.015180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d0e345d-b343-489a-857e-6c317985f65f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909459 Oct 28 18:08:18.023772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 805/1468] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:08:18.025266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:18.025886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:18.030141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f988f7c-cf65-44ef-9ded-259c35d513f7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:18.031376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f988f7c-cf65-44ef-9ded-259c35d513f7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:18.035625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.036524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.037155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.038258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.038867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.039450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.104353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f988f7c-cf65-44ef-9ded-259c35d513f7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:18.120654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f988f7c-cf65-44ef-9ded-259c35d513f7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1222 microversion: 2.1 time: 0.093693 Oct 28 18:08:18.122889 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 806/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:18 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:18.150150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf411d0c-c954-43a9-a46a-67945471b774 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de25ca60>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:18.225750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:18.245185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:18.248485 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf411d0c-c954-43a9-a46a-67945471b774 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.108044 Oct 28 18:08:18.249515 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 807/1470] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:18 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:18.254825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:18.255638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:18.262661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:18.265537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.266040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.266489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.267725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.268362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.268802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.285618 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-81d3159a-1171-4800-8771-06401bb0ec06 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.264723 Oct 28 18:08:18.288796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 664/1471] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:18 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:18.330343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:18.331126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:18.341977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.342777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.343554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.344531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.345520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.346108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.392404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.393187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.393908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.394452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lazy-loading 'fault' on Instance uuid a33011c5-4735-4b59-856a-cac6b6f10d49 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:08:18.486134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:18.499159 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4c8b05f-b928-44ef-b3e4-5618265df252 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1315 microversion: 2.1 time: 0.173194 Oct 28 18:08:18.500584 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 665/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:18 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:19.146175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:19.148445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:19.164900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.171476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.171963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.172779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.179401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.180141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.237593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:19.249295 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e09f7e01-de3a-48a1-8ea6-819a13a2dc54 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1535 microversion: 2.1 time: 0.998559 Oct 28 18:08:19.249892 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 808/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:18 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1535 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:19.265086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81dc37f9-835b-4bd5-84dd-b9f6df9b2719 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0fd3a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:19.341322 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81dc37f9-835b-4bd5-84dd-b9f6df9b2719 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.079898 Oct 28 18:08:19.356310 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 809/1474] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:19 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:19.362697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:19.364218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:19.372979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.374077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.374774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.375720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.376399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.377051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.422492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:19.436288 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c011e86-364c-440b-a68d-82f9436bffd3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1226 microversion: 2.1 time: 0.290110 Oct 28 18:08:19.452457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:19.453630 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 666/1475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:19 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1226 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:19.526009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:19.526732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:19.538487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.539116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.539662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.540420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.542590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.544186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.559718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:19.595450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:19.595450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:19.621368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b075fac-19dd-4163-a008-4942a0c8a494 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.263301 Oct 28 18:08:19.627559 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 810/1476] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:19 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:19.704780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.707192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.709914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.712410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lazy-loading 'fault' on Instance uuid a33011c5-4735-4b59-856a-cac6b6f10d49 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:08:19.816065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:19.840314 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-930cf920-fc56-4d30-91ce-95682a4e4071 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 200 len: 1315 microversion: 2.1 time: 0.318427 Oct 28 18:08:19.843353 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 667/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:19 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:20.074710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-bd2a6bfe-593c-47ea-a7dc-130dd91253ea req-55bf7c7f-891a-4480-b7fd-83155bcf78b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739ffed6-e9db-4597-b1f1-ccc8bec1de12", "name": "network-vif-plugged", "status": "completed", "tag": "de1e8806-6a85-4b08-9fea-7dd69598ef6a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:20.100449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bd2a6bfe-593c-47ea-a7dc-130dd91253ea req-55bf7c7f-891a-4480-b7fd-83155bcf78b1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.104915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bd2a6bfe-593c-47ea-a7dc-130dd91253ea req-55bf7c7f-891a-4480-b7fd-83155bcf78b1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.105568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bd2a6bfe-593c-47ea-a7dc-130dd91253ea req-55bf7c7f-891a-4480-b7fd-83155bcf78b1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.135908 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-bd2a6bfe-593c-47ea-a7dc-130dd91253ea req-55bf7c7f-891a-4480-b7fd-83155bcf78b1 service nova] Creating event network-vif-plugged:de1e8806-6a85-4b08-9fea-7dd69598ef6a for instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 on n-h1-862404-2 Oct 28 18:08:20.153519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-bd2a6bfe-593c-47ea-a7dc-130dd91253ea req-55bf7c7f-891a-4480-b7fd-83155bcf78b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083825 Oct 28 18:08:20.154150 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 811/1478] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:20.279743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:20.284647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:20.299477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.300018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.301875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.307276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.309089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.313164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.360068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84e60655-b08d-4fe5-a1f2-016f3740ae71 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0d1550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:20.700660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:20.711132 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-97c6c9b9-9291-4457-b63b-ceeeba836bef tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1528 microversion: 2.1 time: 0.438083 Oct 28 18:08:20.713048 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 668/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:20 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1528 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:20.720014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:20.720839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:20.728812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.729671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.731072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.732373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.733055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.734221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.821779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:20.837897 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2ac5a94b-f829-4803-8add-8ecfb598e454 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1292 microversion: 2.1 time: 0.123219 Oct 28 18:08:20.839437 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 669/1480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:20 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1292 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:20.845057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:20.846246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:20.853210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.853979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.854596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.856599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.857236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.857840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.963217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:20.976507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:20.983002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:20.997338 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2165b882-4756-4009-a67a-bb63afabebe7 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1544 microversion: 2.91 time: 0.156541 Oct 28 18:08:20.998389 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 670/1481] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:20 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1544 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:21.008371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:21.009081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:21.023730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:21.027784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:21.028754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:21.030401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:21.031124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:21.032012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:21.094519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84e60655-b08d-4fe5-a1f2-016f3740ae71 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.739707 Oct 28 18:08:21.095107 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 812/1482] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:20 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:21.108796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:21.109539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:21.127404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:21.130362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:21.139452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:21.142055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:21.142740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:21.143190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:21.177863 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 HTTP/1.1 Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:08:21.180813 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:08:21.182223 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'a33011c5-4735-4b59-856a-cac6b6f10d49'} Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:21.183012 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:08:21.184514 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.188881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:21.189971 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ccf3ee8-42f5-471e-96db-bd87cf829bf7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 404 len: 111 microversion: 2.1 time: 0.093960 Oct 28 18:08:21.201423 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 813/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:21 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:21.212962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0eafbfb7-409e-4c06-ab65-2ff8a2997e0f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'create', calling method: .version_select at 0x7f78de0eedc0>, body: {"keypair": {"name": "tempest-keypair-7591635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErt1K2pNM9rw//HmMk/Z0twV5M8mM1KIFs4nMIoNQ59Aj7GpvNGAEtoobplGiqJLr+81qeOrU6GmKtNI5VYMPeyIo3rI8rOkfGQPnp3ELW+vdfOTS++DeUYxSSgfmkk+w=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:21.229943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:21.252461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0eafbfb7-409e-4c06-ab65-2ff8a2997e0f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Getting quotas for project 58e02d11d4c64d8989eaec758233f04f. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:21.269106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0eafbfb7-409e-4c06-ab65-2ff8a2997e0f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Getting quotas for user 4245221a863a4ba7969c508342e27fdc and project 58e02d11d4c64d8989eaec758233f04f. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:21.326046 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0eafbfb7-409e-4c06-ab65-2ff8a2997e0f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.122903 Oct 28 18:08:21.333429 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 814/1484] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:08:21 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:21.359615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:21.369817 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-35846104-a178-4054-ba8e-454107bde3d9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1528 microversion: 2.1 time: 0.370243 Oct 28 18:08:21.370422 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 671/1485] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:20 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1528 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:21.395300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f074947-af35-4fd3-83ca-5b2b57c4c5bd tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:21.407783 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6f074947-af35-4fd3-83ca-5b2b57c4c5bd tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] HTTP exception thrown: Flavor 3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 could not be found. Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f074947-af35-4fd3-83ca-5b2b57c4c5bd tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Request method failure captured: Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/flavors/3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 HTTP/1.1 Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmjeXGHYDQJ5bGMbk0SE17C3C76Bhb75YFYRHgmc0E0OFJsxGdxOx9G0yzFaL2I2RFejo5hGOID-AnekqD2qR7uYJpzRAjwh-Ua3x6BvzvIpL1bJvrK-R4KZKljHeQsER7HmTMKNoqTSUIsHDyFE2pwVNjVjGqaHD2CVzGWnoZPQLk Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: bd0e70f015684fc1be169e373d94762c Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MigrationsAdminTest-1192529000 Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:08:21.417360 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd0e70f015684fc1be169e373d94762c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd0e70f015684fc1be169e373d94762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd0e70f015684fc1be169e373d94762c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd0e70f015684fc1be169e373d94762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MigrationsAdminTest-1192529000 Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: bd0e70f015684fc1be169e373d94762c Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MigrationsAdminTest-1192529000 Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MigrationsAdminTest-1192529000-project-admin Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 71b476f967ce43ffba2db93cf8280563 Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MigrationsAdminTest-1192529000-project-admin Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: exception: Flavor 3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 could not be found. Oct 28 18:08:21.419177 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '3bcd6be5-6765-4bdd-8de6-8fda7a01dd25'} Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 could not be found. Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:21.420177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 could not be found. Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 could not be found. Oct 28 18:08:21.421758 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:21.424676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f074947-af35-4fd3-83ca-5b2b57c4c5bd tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Returning 404 to user: Flavor 3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:21.425792 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f074947-af35-4fd3-83ca-5b2b57c4c5bd tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/3bcd6be5-6765-4bdd-8de6-8fda7a01dd25" status: 404 len: 109 microversion: 2.1 time: 0.035063 Oct 28 18:08:21.427627 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 815/1486] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:08:21 2022] DELETE /compute/v2.1/flavors/3bcd6be5-6765-4bdd-8de6-8fda7a01dd25 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:21.649454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1887142752", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:21.737673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:08:21.867241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:21.868206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:21.881386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:21.882849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:21.883456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:21.884241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:21.884713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:21.893619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.142860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:22.181950 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e5621ef-33b1-47d4-9809-17b0fdee40a4 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1280 microversion: 2.1 time: 0.317708 Oct 28 18:08:22.185093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 816/1487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:21 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:22.200424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:22.201673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:22.220932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.227131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.229704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.230979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.235092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.240758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.412090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:22.439644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:22.446476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:22.461875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:08:22.462825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:08:22.463472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:08:22.465257 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8682316-8858-4407-a80f-5a42be2d3b67 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1531 microversion: 2.91 time: 0.278839 Oct 28 18:08:22.468093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:08:22.468775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:08:22.483982 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 817/1488] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:22 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1531 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:22.489574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.492167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.494693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.497115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.508221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.511647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.517657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d50727db-9535-4093-a320-70a9062f3738 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de25d820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:22.567656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:22.577613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Getting quotas for user 3415953e10c445bfa3dcc5a3335826c8 and project a7811accf3d64bc290bc90a33952b51f. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:22.591007 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d50727db-9535-4093-a320-70a9062f3738 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.097594 Oct 28 18:08:22.591924 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 818/1489] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:22 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:22.598278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:22.599291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:22.613448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:08:22.620494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.622833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.623185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:08:22.625374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.626387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.628710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.629345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.786503 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c517e2c9-0169-4616-b4f1-0d239c34e998 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.135629 Oct 28 18:08:22.796561 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 672/1490] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:08:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:08:22.809044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de2373fe-bbac-42bc-b4d4-ba42372f00fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:22.830942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-de2373fe-bbac-42bc-b4d4-ba42372f00fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:22.939401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-de2373fe-bbac-42bc-b4d4-ba42372f00fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:22.948527 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de2373fe-bbac-42bc-b4d4-ba42372f00fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1213 microversion: 2.1 time: 0.148915 Oct 28 18:08:22.949117 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 673/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:22 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:23.104157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] Lazy-loading 'services' on Instance uuid c9719e5b-0d1e-4037-a570-0258892d87b4 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:08:23.166367 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db8f01f5-8ab1-4e2a-b197-69fdf740064d tempest-UnshelveToHostMultiNodesTest-938910519 tempest-UnshelveToHostMultiNodesTest-938910519-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1936 microversion: 2.91 time: 0.573178 Oct 28 18:08:23.172979 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 819/1492] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:22 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1936 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:23.212016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:23.212672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:23.237107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:23.237415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:23.241293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.241795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.247708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.248444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.251557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.255230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.266247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.267345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.275043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.276375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.281941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.282461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.413534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:08:23.629576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f991d0b9-ae1a-4787-8eca-9e1bdc29e424 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 204 len: 0 microversion: 2.91 time: 0.397715 Oct 28 18:08:23.630463 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 820/1493] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:08:23 2022] DELETE /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:08:23.639860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-df2e0b35-90fb-4c5c-a52d-e0b5fe5ff752 req-51449bb9-44aa-4307-8de5-e004d74b5b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65bf4b2-0082-4097-a88a-84e3cd5c45d6", "name": "network-vif-plugged", "status": "completed", "tag": "7a6ab836-9960-49fe-ab6f-64227a64a52a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:23.662527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-df2e0b35-90fb-4c5c-a52d-e0b5fe5ff752 req-51449bb9-44aa-4307-8de5-e004d74b5b0e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.670547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-df2e0b35-90fb-4c5c-a52d-e0b5fe5ff752 req-51449bb9-44aa-4307-8de5-e004d74b5b0e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.671250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-df2e0b35-90fb-4c5c-a52d-e0b5fe5ff752 req-51449bb9-44aa-4307-8de5-e004d74b5b0e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.721392 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-df2e0b35-90fb-4c5c-a52d-e0b5fe5ff752 req-51449bb9-44aa-4307-8de5-e004d74b5b0e service nova] Creating event network-vif-plugged:7a6ab836-9960-49fe-ab6f-64227a64a52a for instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 on n-h1-862404-2 Oct 28 18:08:23.729859 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-df2e0b35-90fb-4c5c-a52d-e0b5fe5ff752 req-51449bb9-44aa-4307-8de5-e004d74b5b0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097621 Oct 28 18:08:23.730494 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 821/1494] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:23.744791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d41634ba-f2ca-475f-8e01-56e093c0f5e8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de25d550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:24.388665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:24.419306 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4b240639-041c-49a2-8b88-62f32ffce935 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 1.212331 Oct 28 18:08:24.422723 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 674/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:23 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:24.454461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:24.455488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:24.501719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:24.502892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:24.508368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:24.509494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:24.510279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:24.510921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:24.867272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:24.886818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:24.893710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:24.914143 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-363b4c56-dc99-40a6-bd72-734a12b17726 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.485780 Oct 28 18:08:24.917269 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 675/1496] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:24 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:24.928518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:24.930698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:24.958828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:24.963512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:24.964251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:24.966220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:24.970181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:24.970849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.118293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:25.133339 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-76bb7d3e-4140-45b6-bb3f-130838b5f07f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1265 microversion: 2.1 time: 0.211231 Oct 28 18:08:25.138131 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 676/1497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:24 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:25.448965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:25.450459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:25.480245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.492149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.492713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.493501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.494005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.494427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:26.108279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:26.129727 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3f5cc387-aaa5-4691-a8c2-256d571daf06 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 0.675142 Oct 28 18:08:26.144665 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 677/1498] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:25 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:26.154096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:26.155287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:26.170039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:26.170915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:26.171622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:26.172662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:26.173400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:26.175426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:26.372351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:26.417129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:26.430680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb412f61570e4a1e8c10480ed9cbaadd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1264633c8b8f469da0808fbfd7d6cf7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:26.451070 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a9b8d32-d57e-4c77-b793-2c10d28358fb tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 200 len: 1537 microversion: 2.91 time: 0.304651 Oct 28 18:08:26.453300 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 678/1499] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:26 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 1537 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:26.463996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:26.464631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:26.473087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:26.489459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:26.491584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:26.493820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:26.494581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:26.495060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:26.495506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:26.572490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:26.760996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:26.780415 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2c9cf1fa-6012-4c66-9f9d-37c9e8bcb0a5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1271 microversion: 2.1 time: 0.325079 Oct 28 18:08:26.780415 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 679/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:26 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:27.158919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:27.160920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:27.167589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:27.188565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:27.189036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:27.190670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:27.191404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:27.192056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:27.739549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:27.749793 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-41ef3046-a33e-4043-8bcb-338fe40a59d2 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 0.595023 Oct 28 18:08:27.757454 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 680/1501] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:27 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:27.775595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-423164349", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:27.891433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:31.290112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:32.538753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:32.934705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] validate_networks() for [('c36cbffa-a0c0-4bdf-bdca-7ec3fa5b33e3', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:08:32.937107 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d41634ba-f2ca-475f-8e01-56e093c0f5e8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 9.194998 Oct 28 18:08:32.940216 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 822/1502] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:23 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 9202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:32.946151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:32.950920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:32.951632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] [instance: c9719e5b-0d1e-4037-a570-0258892d87b4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:32.967328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:32.983054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:32.983760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:32.988903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:32.989400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:32.989841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:33.026396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] HTTP exception thrown: Instance c9719e5b-0d1e-4037-a570-0258892d87b4 could not be found. Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Request method failure captured: Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 HTTP/1.1 Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBnb4DdkcQQCi7OVQ_KtzMZJqDzlH4mBTN0YW8cKEcS33X7T2PMWKJmdbkoX_xgZkFDOnyPRmwdq02Mu0jT-4LjJDNwDpLkdoyWyaHvUChsUTEALPnDk4aoE4v-iY1PM8rw1OtgV6VM3Yb0WZLj4kBYwRO_PURD3-tsoGIuXbvs1nRQ Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.91 Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1264633c8b8f469da0808fbfd7d6cf7c Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-853147353 Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:08:33.031558 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1264633c8b8f469da0808fbfd7d6cf7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1264633c8b8f469da0808fbfd7d6cf7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1264633c8b8f469da0808fbfd7d6cf7c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1264633c8b8f469da0808fbfd7d6cf7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-853147353 Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1264633c8b8f469da0808fbfd7d6cf7c Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-853147353 Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-UnshelveToHostMultiNodesTest-853147353-project Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: bb412f61570e4a1e8c10480ed9cbaadd Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-853147353-project Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance c9719e5b-0d1e-4037-a570-0258892d87b4 could not be found. Oct 28 18:08:33.033207 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'c9719e5b-0d1e-4037-a570-0258892d87b4'} Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9719e5b-0d1e-4037-a570-0258892d87b4 could not be found. Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:33.034156 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9719e5b-0d1e-4037-a570-0258892d87b4 could not be found. Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9719e5b-0d1e-4037-a570-0258892d87b4 could not be found. Oct 28 18:08:33.038406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:33.041922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] Returning 404 to user: Instance c9719e5b-0d1e-4037-a570-0258892d87b4 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:33.041922 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0c9157e-7071-4414-9740-06e16c95ce44 tempest-UnshelveToHostMultiNodesTest-853147353 tempest-UnshelveToHostMultiNodesTest-853147353-project] 10.222.0.16 "GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4" status: 404 len: 111 microversion: 2.91 time: 0.091775 Oct 28 18:08:33.041922 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 823/1503] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:32 2022] GET /compute/v2.1/servers/c9719e5b-0d1e-4037-a570-0258892d87b4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:08:33.441760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3c39be61-c633-4753-8984-101a78aff1b2 req-b676dd53-441d-427a-b027-c47e319070c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc23b85-91a3-4035-8cfe-4888d1c6772d", "tag": "7773cd41-38e3-4274-94a3-cc76cc4305a9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:33.469673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3c39be61-c633-4753-8984-101a78aff1b2 req-b676dd53-441d-427a-b027-c47e319070c9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:33.470549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3c39be61-c633-4753-8984-101a78aff1b2 req-b676dd53-441d-427a-b027-c47e319070c9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:33.472087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3c39be61-c633-4753-8984-101a78aff1b2 req-b676dd53-441d-427a-b027-c47e319070c9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:33.502399 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3c39be61-c633-4753-8984-101a78aff1b2 req-b676dd53-441d-427a-b027-c47e319070c9 service nova] Creating event network-changed:7773cd41-38e3-4274-94a3-cc76cc4305a9 for instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d on n-h2-862404-2 Oct 28 18:08:33.511662 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3c39be61-c633-4753-8984-101a78aff1b2 req-b676dd53-441d-427a-b027-c47e319070c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.476798 Oct 28 18:08:33.521964 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 824/1504] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:33.548798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:33.549957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:33.567585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:33.568118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:33.568539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:33.569889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:33.570427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:33.577321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.172423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:34.183551 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65db73c4-2fa3-407a-ae7b-9b5ddbbbcbf5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1313 microversion: 2.1 time: 0.660300 Oct 28 18:08:34.190065 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 825/1505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:33 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:34.196440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:34.214722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:34.233652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.239146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.241468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.250303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.251536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.260615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.856654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:08:34.857227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:08:34.857727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:08:34.858292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:08:34.858942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:08:34.882565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.902174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:34.906822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.913888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.917615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.920207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.920519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c146126-d028-48da-a6ab-440bb9d58361 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 0.720597 Oct 28 18:08:34.922974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.923784 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 826/1506] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:34 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:34.941860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-32b41157-17b0-4ba6-9944-b84f092a42f7 req-5414eb75-1038-48e4-a2d9-c8b6a6a3bddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:34.988674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32b41157-17b0-4ba6-9944-b84f092a42f7 req-5414eb75-1038-48e4-a2d9-c8b6a6a3bddd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.992458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32b41157-17b0-4ba6-9944-b84f092a42f7 req-5414eb75-1038-48e4-a2d9-c8b6a6a3bddd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.993382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32b41157-17b0-4ba6-9944-b84f092a42f7 req-5414eb75-1038-48e4-a2d9-c8b6a6a3bddd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:35.008114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Getting quotas for project 58e02d11d4c64d8989eaec758233f04f. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:35.017605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Getting quotas for user 4245221a863a4ba7969c508342e27fdc and project 58e02d11d4c64d8989eaec758233f04f. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:35.025955 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-32b41157-17b0-4ba6-9944-b84f092a42f7 req-5414eb75-1038-48e4-a2d9-c8b6a6a3bddd service nova] Creating event network-changed:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h2-862404-2 Oct 28 18:08:35.043424 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-32b41157-17b0-4ba6-9944-b84f092a42f7 req-5414eb75-1038-48e4-a2d9-c8b6a6a3bddd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112777 Oct 28 18:08:35.045881 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 827/1507] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:35.088781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6af61519-4906-42c0-af38-9dce95c72f92 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2bd280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:35.089572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:08:35.097458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:08:35.179789 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6af61519-4906-42c0-af38-9dce95c72f92 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.132231 Oct 28 18:08:35.183671 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 828/1508] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:35 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:35.222027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:35.223064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:35.258287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:35.266575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:35.268197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:35.275556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:35.280663 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9563747e-722f-4ac3-8d07-ae87100c0d51 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.522200 Oct 28 18:08:35.281701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:35.282463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:35.291906 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 681/1509] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:08:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 7531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:08:35.302058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23601f37-485b-48ee-9f95-03ac3d708290 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:35.305672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23601f37-485b-48ee-9f95-03ac3d708290 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:35.531360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23601f37-485b-48ee-9f95-03ac3d708290 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:35.548662 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23601f37-485b-48ee-9f95-03ac3d708290 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1224 microversion: 2.1 time: 0.255335 Oct 28 18:08:35.556032 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 682/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:35 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1224 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:35.953896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:35.956340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:35.980038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:35.985518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:35.988370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:35.991979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:36.000621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:36.003647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:36.550242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:36.571124 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4798d1cd-0b7a-46da-a807-f55280289456 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 0.623576 Oct 28 18:08:36.576013 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 683/1511] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:35 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:36.593058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c6b6967-49fa-4e8d-9200-84d7888bcb04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e2501670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:36.682823 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c6b6967-49fa-4e8d-9200-84d7888bcb04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.105433 Oct 28 18:08:36.684388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 684/1512] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:36 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:36.691117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:36.704389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:36.721901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:36.722752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:36.723417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:36.726543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:36.727250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:36.727915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:36.742718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:36.759798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a7cc4d58-2a3a-4600-85b6-c8ca7e1d4a31 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1313 microversion: 2.1 time: 1.543088 Oct 28 18:08:36.788521 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 829/1513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:35 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1313 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:36.982429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:36.997332 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-02d795ac-5290-499b-94a7-6a6ed8f53f8b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1220 microversion: 2.1 time: 0.311612 Oct 28 18:08:36.998140 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 685/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:36 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1220 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:37.011083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:37.012367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:37.020793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:37.025609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:37.026390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:37.030315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:37.041732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:37.043220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:37.603915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:37.605053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:37.614854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:37.616462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:37.617487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:37.619419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:37.620187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:37.620849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:37.826107 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-792b6024-87b8-4ed2-b436-023b8a749e1a tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1858 microversion: 2.1 time: 0.813294 Oct 28 18:08:37.830593 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 830/1515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:37 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1858 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:37.856100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a080f736-236c-4dca-b7ae-3d9c817b621d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0e2700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:37.885442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:37.898048 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1b446973-cfbb-44ed-9c25-56d9fe0c6541 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 0.298866 Oct 28 18:08:37.943156 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 686/1516] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:37 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:37.963590 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a080f736-236c-4dca-b7ae-3d9c817b621d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.123461 Oct 28 18:08:37.967133 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 831/1517] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:37 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:37.968523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:37.972286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:37.978366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862404-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:37.984032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:38.002069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:38.008043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:38.008778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:38.009140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:38.009460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:38.010033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:38.012565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:38.012771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:38.013378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:38.014673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:38.019953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:38.021278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:38.101613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lazy-loading 'flavor' on Instance uuid 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:08:38.153813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Going to try to live migrate instance to n-h2-862404-2 {{(pid=120680) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:08:38.369283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:38.380442 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e556f038-b51c-4d3e-ae3a-a78cb3d3b4fb tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1313 microversion: 2.1 time: 0.430366 Oct 28 18:08:38.384694 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 687/1518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:37 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:38.393515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:38.394807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:38.409526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:38.410789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:38.412178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:38.427394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:38.428960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:38.429630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:38.526306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:38.538499 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94b69959-e375-4a41-b698-bbf11354fbe6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1282 microversion: 2.1 time: 0.150264 Oct 28 18:08:38.539853 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 688/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:38 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:38.927779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:38.928730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:38.950183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:38.950828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:38.951326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:38.952454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:38.953157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:38.953797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.243570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:39.258859 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-82cbc547-5d25-493a-9655-9963e2a8c812 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 0.336037 Oct 28 18:08:39.259701 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 689/1520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:38 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:39.282773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-95444a80-a793-4f39-81c4-10a9bbcefbc4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de819e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:39.427037 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-95444a80-a793-4f39-81c4-10a9bbcefbc4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.141639 Oct 28 18:08:39.427716 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 690/1521] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:39 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:39.476925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:39.482581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:39.503567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.506872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.508354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.513117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.515658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.516262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.789409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:39.799685 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78fae670-7f1a-4181-a08e-ce1049ca2774 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1313 microversion: 2.1 time: 0.346262 Oct 28 18:08:39.801826 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 691/1522] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:39 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:39.807381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:39.809713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:39.824016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.824686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.825345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.826386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.827125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.827846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:40.027047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:40.043989 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3146af76-86a8-4b75-837e-4123af01a013 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1282 microversion: 2.1 time: 0.231637 Oct 28 18:08:40.044634 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 692/1523] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:39 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1282 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:40.775110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-829e62c2-c24b-4c83-a1bf-787715968a3c req-8115a906-fcc2-4b68-9de0-227a82c4b734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc23b85-91a3-4035-8cfe-4888d1c6772d", "name": "network-vif-plugged", "status": "completed", "tag": "7773cd41-38e3-4274-94a3-cc76cc4305a9"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:40.797982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-829e62c2-c24b-4c83-a1bf-787715968a3c req-8115a906-fcc2-4b68-9de0-227a82c4b734 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:40.812628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-829e62c2-c24b-4c83-a1bf-787715968a3c req-8115a906-fcc2-4b68-9de0-227a82c4b734 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:40.814841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-829e62c2-c24b-4c83-a1bf-787715968a3c req-8115a906-fcc2-4b68-9de0-227a82c4b734 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:40.865120 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-829e62c2-c24b-4c83-a1bf-787715968a3c req-8115a906-fcc2-4b68-9de0-227a82c4b734 service nova] Creating event network-vif-plugged:7773cd41-38e3-4274-94a3-cc76cc4305a9 for instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d on n-h2-862404-2 Oct 28 18:08:40.889742 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-829e62c2-c24b-4c83-a1bf-787715968a3c req-8115a906-fcc2-4b68-9de0-227a82c4b734 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.757381 Oct 28 18:08:40.893804 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 693/1524] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:40.917357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:40.920633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:40.940506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:40.958579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:40.960251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:40.962422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:40.963324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:40.966666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:41.499917 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0146cde1-b922-4bea-a82b-75a830036a92 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/action" status: 202 len: 0 microversion: 2.1 time: 3.531285 Oct 28 18:08:41.500578 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 832/1525] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:08:37 2022] POST /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/action => generated 0 bytes in 3533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:08:41.509518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80c77d07-a5c1-4642-acb8-e784b1630576 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de16c9d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:41.561703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:41.574291 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86b6f746-da2e-4887-8e4a-b1351e80228f tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 0.677156 Oct 28 18:08:41.575070 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 694/1526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:40 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:41.586666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:41.587710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:41.619674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:41.620455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:41.621008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:41.621836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:41.624184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:41.625488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:41.627588 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80c77d07-a5c1-4642-acb8-e784b1630576 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.120250 Oct 28 18:08:41.641624 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 833/1527] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:41 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:41.720122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:41.720984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:41.767940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:41.768580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:41.769044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:41.769859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:41.770281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:41.770702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:42.226784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:42.242488 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14c0d776-cf72-4591-a416-54d4fa4ddb0c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1313 microversion: 2.1 time: 0.664226 Oct 28 18:08:42.243113 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 695/1528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:41 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:42.269338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:42.269892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:42.310572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:42.312255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:42.312724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:42.313488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:42.313955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:42.314385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:43.108052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:43.136218 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a9de14a-4b5d-4ac1-9d9c-6848cebb076b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.881353 Oct 28 18:08:43.137605 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 696/1529] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:42 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:43.142907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:43.144436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:43.153070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:43.153800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:43.154601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:43.156579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:43.157218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:43.157938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:43.483426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:43.495432 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2d23bfd-bcd1-4f1f-b00a-d24bbddd11bd tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 1.849491 Oct 28 18:08:43.497459 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 834/1530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:41 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:43.522462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bd25d5a-6630-4223-9517-f7fc114901b2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de95ea60>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:43.631948 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6bd25d5a-6630-4223-9517-f7fc114901b2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.133122 Oct 28 18:08:43.633476 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 835/1531] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:43 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:43.638628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-44bad87f-47bf-405c-8cd0-859536bfa63c req-1f7fdaa9-b781-4c29-b13e-c9717cb72ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "name": "network-vif-plugged", "status": "completed", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:43.659027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-44bad87f-47bf-405c-8cd0-859536bfa63c req-1f7fdaa9-b781-4c29-b13e-c9717cb72ce6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:43.659806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-44bad87f-47bf-405c-8cd0-859536bfa63c req-1f7fdaa9-b781-4c29-b13e-c9717cb72ce6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:43.660608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-44bad87f-47bf-405c-8cd0-859536bfa63c req-1f7fdaa9-b781-4c29-b13e-c9717cb72ce6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:43.678597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:43.681610 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-44bad87f-47bf-405c-8cd0-859536bfa63c req-1f7fdaa9-b781-4c29-b13e-c9717cb72ce6 service nova] Creating event network-vif-plugged:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h2-862404-2 Oct 28 18:08:43.698624 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-44bad87f-47bf-405c-8cd0-859536bfa63c req-1f7fdaa9-b781-4c29-b13e-c9717cb72ce6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061617 Oct 28 18:08:43.699536 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 836/1532] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:43.706703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:43.711631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:43.720412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:43.721134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:43.721914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:43.725644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:43.727064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:43.730769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:43.980832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:44.002307 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-41749267-e4a2-457f-854b-4736f7ca854c tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1322 microversion: 2.1 time: 0.860792 Oct 28 18:08:44.002980 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 697/1533] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:43 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1322 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:44.166746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:44.167372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:44.201238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:44.201920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:44.202418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:44.206507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:44.207015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:44.207765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:44.608586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:44.627665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8df50984-008b-4cbc-a5ba-db88860f53f6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1313 microversion: 2.1 time: 0.924853 Oct 28 18:08:44.630801 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 837/1534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:43 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1313 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:44.662637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:44.665315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:44.691510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:44.699120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:44.708931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:44.719393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:44.720123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:44.722241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:44.820524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:44.834567 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1f8e5d35-9baa-4536-a6bc-9168e20463a7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.670634 Oct 28 18:08:44.835303 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 698/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:44 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:44.850375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ac1ed58-c4dc-46c2-aaf6-a0a87b3e6459 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de267550>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:44.970060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:45.022502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4ac1ed58-c4dc-46c2-aaf6-a0a87b3e6459 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.178317 Oct 28 18:08:45.031601 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 699/1536] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:44 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:45.050823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:45.052408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:45.083123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:45.088637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:45.089336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:45.090188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:45.090604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:45.093252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:45.539113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:45.703372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:45.727939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e38cabe9-c5f1-4b5f-9214-71a5d75b69d5 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1472 microversion: 2.1 time: 0.692002 Oct 28 18:08:45.728583 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 700/1537] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:45 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1472 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:45.751409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:45.756621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:45.789913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:45.792250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:45.792887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:45.793857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:45.797132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:45.797785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:45.862342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:46.275743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:46.295134 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a78aa9b8-07d0-4454-8fa1-bac71b880078 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 1.649252 Oct 28 18:08:46.299325 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 838/1538] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:44 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:46.311265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:46.314447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:46.349329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:46.351854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:46.352767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:46.355024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:46.356762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:46.357364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:46.440909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Request method failure captured: Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d/diagnostics HTTP/1.1 Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBqP51OS6qIVg-fbT0tVMsT0y_D-iwpRjp7NIgeV8rAPYRlsegLEL06T_nrUphckNjYfyr1_ZehuFOM1lCACmQU4BdaqC2NQ19Y-vv_hb2rvzN9565M-8yEINHLIODQDh-QsBRC-qU-vVnj3nRwN1nOvUAKR7BaITyMU5fZyv7yRm1Y Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c8fadc9d55a142758e254642e1e23fad Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-804058529 Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:08:46.450283 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8fadc9d55a142758e254642e1e23fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8fadc9d55a142758e254642e1e23fad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8fadc9d55a142758e254642e1e23fad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8fadc9d55a142758e254642e1e23fad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-804058529 Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c8fadc9d55a142758e254642e1e23fad Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-804058529 Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerDiagnosticsNegativeTest-804058529-project Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5b492838053d4f7896216ae780f1dbb2 Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-804058529-project Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:08:46.451739 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '7fc23b85-91a3-4035-8cfe-4888d1c6772d'} Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:08:46.452789 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:08:46.454188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:46.455250 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf06b708-d019-4c6c-9924-ed47ec68156d tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.151299 Oct 28 18:08:46.455250 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 839/1539] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:08:46 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d/diagnostics => generated 117 bytes in 152 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:46.481073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:46.481689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:46.488065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:46.488828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:46.489429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:46.490414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:46.493301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:46.493929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:46.502873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:46.519086 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c14a5e3-1583-4736-8382-30bbbb98db09 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1313 microversion: 2.1 time: 0.783790 Oct 28 18:08:46.534177 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 701/1540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:45 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:46.547355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d5143cf-6c39-480d-9306-f939f61229bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2ab310>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:46.607482 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d5143cf-6c39-480d-9306-f939f61229bc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.071821 Oct 28 18:08:46.618634 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 702/1541] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:46 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:46.624941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:46.625805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:46.633275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:46.634910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:46.635580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:46.637169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:46.637894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:46.639652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:46.681786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:08:46.877871 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c620b102-2c0a-4f96-8f95-014a28f246d7 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 204 len: 0 microversion: 2.1 time: 0.257494 Oct 28 18:08:46.878626 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 703/1542] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:08:46 2022] DELETE /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:08:46.893064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:46.893944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:46.921023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:46.921556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:46.922608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:46.923481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:46.925677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:46.926187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:47.253496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:47.299840 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2047c98-a00d-4cfa-abf4-3d76e7303b55 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.822725 Oct 28 18:08:47.313370 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 840/1543] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:46 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:47.330875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:47.340189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:47.344749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:47.361566 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d16eebf0-bb5d-4a21-a9ed-7861af7aa261 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1478 microversion: 2.1 time: 0.477605 Oct 28 18:08:47.372625 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 704/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:46 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1478 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:47.374971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:47.375497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:47.380119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:47.382252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:47.382737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:47.383179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:47.550355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:47.553613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:47.580411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:47.588599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:47.589385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:47.591419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:47.592088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:47.592683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:47.960511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:47.973347 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5b9fda20-ed78-4e95-b801-e6b9ce607488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 0.640675 Oct 28 18:08:47.988426 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 841/1545] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:47 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:48.001884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0bfc44d7-20ec-4c7c-8367-eeb98e3ca274 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0ee790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:48.071127 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0bfc44d7-20ec-4c7c-8367-eeb98e3ca274 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.079802 Oct 28 18:08:48.072505 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 842/1546] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:47 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:48.077829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d79fc599-da86-4d44-aa66-61b7f7235c0b req-40c83807-fe77-413c-b72d-6aaa3793af90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc86d75-014e-43a2-956b-03e203fba456", "tag": "0225049a-d33b-439d-aef3-99aa74ba5f5a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:48.090117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d79fc599-da86-4d44-aa66-61b7f7235c0b req-40c83807-fe77-413c-b72d-6aaa3793af90 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:48.091203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d79fc599-da86-4d44-aa66-61b7f7235c0b req-40c83807-fe77-413c-b72d-6aaa3793af90 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:48.091899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d79fc599-da86-4d44-aa66-61b7f7235c0b req-40c83807-fe77-413c-b72d-6aaa3793af90 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:48.117120 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d79fc599-da86-4d44-aa66-61b7f7235c0b req-40c83807-fe77-413c-b72d-6aaa3793af90 service nova] Creating event network-changed:0225049a-d33b-439d-aef3-99aa74ba5f5a for instance 1dc86d75-014e-43a2-956b-03e203fba456 on n-h1-862404-2 Oct 28 18:08:48.132582 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d79fc599-da86-4d44-aa66-61b7f7235c0b req-40c83807-fe77-413c-b72d-6aaa3793af90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057074 Oct 28 18:08:48.136222 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 843/1547] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:48.247888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:48.280316 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3220188b-c39c-47ea-b2b9-7664ac486328 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1313 microversion: 2.1 time: 0.734369 Oct 28 18:08:48.281012 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 705/1548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:47 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:48.341012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:48.342519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:48.363216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:48.366702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:48.369732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:48.371020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:48.387528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:48.388440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:48.398449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:48.399217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:48.422265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:48.422778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:48.423236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:48.436755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:48.437372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:48.440817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:49.069061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:49.074177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:49.084915 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d4d17cef-1ae3-45a0-9a4c-99191ffbb665 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.748959 Oct 28 18:08:49.085629 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e6caab8a-1e7c-4f6d-9bb7-761a17f90801 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1478 microversion: 2.1 time: 0.693438 Oct 28 18:08:49.088206 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 706/1549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:48 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1478 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:49.098704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1451539636", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b6597dab-3369-40d8-b5f8-eb1a8f5f7d67"}], "block_device_mapping_v2": [{"uuid": "c2a172c9-1612-40f3-baaa-bced260bfb0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:49.107022 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 844/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:48 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:49.140815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:49.146035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:49.157273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:49.158451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:49.160698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:49.161532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:49.164397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:49.164927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:49.323753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] validate_networks() for [('b6597dab-3369-40d8-b5f8-eb1a8f5f7d67', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:08:50.260510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:50.269004 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24512e0a-bb25-4c7b-85ff-8632e9082dea tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 1.157265 Oct 28 18:08:50.269608 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 845/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:49 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:50.278429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8d7321bd-9168-416d-bc24-f68823f902fe tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de24cf70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:50.382942 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8d7321bd-9168-416d-bc24-f68823f902fe tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.112232 Oct 28 18:08:50.383542 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 846/1552] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:50 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:50.405385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:50.408779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:50.430687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:50.431970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:50.432428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:50.433163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:50.433629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:50.434064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:51.635074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:51.667991 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8271f305-5833-4a19-8e59-f217861afea5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1462 microversion: 2.1 time: 1.266108 Oct 28 18:08:51.669157 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 847/1553] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:50 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1462 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:51.702487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:51.704579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:51.718412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:51.723024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:51.723698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:51.726695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:51.728269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:51.729526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:51.730496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:51.798882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:51.799633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:51.800364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:51.801025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lazy-loading 'fault' on Instance uuid 7fc23b85-91a3-4035-8cfe-4888d1c6772d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:08:51.883503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b492838053d4f7896216ae780f1dbb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8fadc9d55a142758e254642e1e23fad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:51.892192 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32b85d29-581d-4f0b-8893-2c6c2b9be7d3 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 200 len: 1312 microversion: 2.1 time: 0.221598 Oct 28 18:08:51.897271 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 848/1554] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:51 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:51.905132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:51.908898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:51.926066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:51.926906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:51.931993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:51.933052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:51.933945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:51.934618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:52.351760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:52.371098 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e373187-ae88-4a0b-a6e9-577fb9d0e662 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.469185 Oct 28 18:08:52.375528 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 849/1555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:51 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:52.383726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e90b6c1a-5950-4551-b431-8a398ccce55f req-c13952d8-1aae-4ae2-8784-a85efc0085b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc23b85-91a3-4035-8cfe-4888d1c6772d", "name": "network-vif-deleted", "tag": "7773cd41-38e3-4274-94a3-cc76cc4305a9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:52.396225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e90b6c1a-5950-4551-b431-8a398ccce55f req-c13952d8-1aae-4ae2-8784-a85efc0085b3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:52.416090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e90b6c1a-5950-4551-b431-8a398ccce55f req-c13952d8-1aae-4ae2-8784-a85efc0085b3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:52.416591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e90b6c1a-5950-4551-b431-8a398ccce55f req-c13952d8-1aae-4ae2-8784-a85efc0085b3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:52.446272 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e90b6c1a-5950-4551-b431-8a398ccce55f req-c13952d8-1aae-4ae2-8784-a85efc0085b3 service nova] Creating event network-vif-deleted:7773cd41-38e3-4274-94a3-cc76cc4305a9 for instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d on n-h2-862404-2 Oct 28 18:08:52.463640 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e90b6c1a-5950-4551-b431-8a398ccce55f req-c13952d8-1aae-4ae2-8784-a85efc0085b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085735 Oct 28 18:08:52.467498 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 850/1556] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:52.476519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:08:52.477582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:08:52.477956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:52.478359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:08:52.478787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:08:52.479235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:52.479365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:08:52.502669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:52.504890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:52.505573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:52.510108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:52.512496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:52.513188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:52.514283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:52.515911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:52.518020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:52.519000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:52.522781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:52.524088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:52.596908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for project 452c29fdc8114bb985893db1a9d29426. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:52.610972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Getting quotas for user 584b38d4097042999ad262ea77966602 and project 452c29fdc8114bb985893db1a9d29426. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:52.738441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:08:52.741599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2a172c9-1612-40f3-baaa-bced260bfb0d',volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:08:53.020573 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-05b669a3-e1fa-4125-9af5-14862d68dab4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.931354 Oct 28 18:08:53.031847 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 707/1557] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3943 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:08:53.040248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-161afe0a-ca71-4d36-a5ed-8544caa00f4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e256a8b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:53.057574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:53.066835 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3e05a0b-afec-48e7-af82-b39c593d9c58 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 0.597765 Oct 28 18:08:53.089616 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 851/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:52 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:53.099325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:53.107625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:53.120326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:53.120853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:53.121308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:53.122196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:53.125069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:53.125566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:53.182133 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-161afe0a-ca71-4d36-a5ed-8544caa00f4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1413 microversion: 2.1 time: 0.148420 Oct 28 18:08:53.186754 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 708/1559] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:53 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:53.194370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:53.200352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] [instance: 7fc23b85-91a3-4035-8cfe-4888d1c6772d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:53.219585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:53.222716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:53.224022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:53.227135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:53.227958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:53.229362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:53.268370 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] HTTP exception thrown: Instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d could not be found. Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Request method failure captured: Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d HTTP/1.1 Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBqP51OS6qIVg-fbT0tVMsT0y_D-iwpRjp7NIgeV8rAPYRlsegLEL06T_nrUphckNjYfyr1_ZehuFOM1lCACmQU4BdaqC2NQ19Y-vv_hb2rvzN9565M-8yEINHLIODQDh-QsBRC-qU-vVnj3nRwN1nOvUAKR7BaITyMU5fZyv7yRm1Y Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c8fadc9d55a142758e254642e1e23fad Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-804058529 Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:08:53.270694 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8fadc9d55a142758e254642e1e23fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c8fadc9d55a142758e254642e1e23fad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c8fadc9d55a142758e254642e1e23fad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c8fadc9d55a142758e254642e1e23fad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-804058529 Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c8fadc9d55a142758e254642e1e23fad Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-804058529 Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerDiagnosticsNegativeTest-804058529-project Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 5b492838053d4f7896216ae780f1dbb2 Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-804058529-project Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d could not be found. Oct 28 18:08:53.273147 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '7fc23b85-91a3-4035-8cfe-4888d1c6772d'} Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d could not be found. Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:53.274143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d could not be found. Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d could not be found. Oct 28 18:08:53.275650 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:08:53.281911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] Returning 404 to user: Instance 7fc23b85-91a3-4035-8cfe-4888d1c6772d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:53.282992 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e7556f6b-6b65-4328-a01f-e733b3f93604 tempest-ServerDiagnosticsNegativeTest-804058529 tempest-ServerDiagnosticsNegativeTest-804058529-project] 10.222.0.16 "GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d" status: 404 len: 111 microversion: 2.1 time: 0.094475 Oct 28 18:08:53.290320 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 709/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:53 2022] GET /compute/v2.1/servers/7fc23b85-91a3-4035-8cfe-4888d1c6772d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:53.305303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c28e0b3c-87bc-4ec6-9113-4330941dbab3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:53.306198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c28e0b3c-87bc-4ec6-9113-4330941dbab3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:53.502600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c28e0b3c-87bc-4ec6-9113-4330941dbab3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:53.513897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c28e0b3c-87bc-4ec6-9113-4330941dbab3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:53.516293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c28e0b3c-87bc-4ec6-9113-4330941dbab3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:53.518680 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c28e0b3c-87bc-4ec6-9113-4330941dbab3 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1104 microversion: 2.25 time: 0.224983 Oct 28 18:08:53.541066 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 710/1561] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:53 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1104 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:53.547252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:53.548415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:53.565262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:53.566006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:53.566618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:53.567504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:53.568631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:53.569538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:53.738276 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1889e3a5-f38e-4ae5-bed8-7376aa70d3ff tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1613 microversion: 2.1 time: 0.647424 Oct 28 18:08:53.742207 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 852/1562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:53 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1613 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:53.763703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:53.764366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:53.771592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:53.772523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:53.773139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:53.774354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:53.775924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:53.776577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:53.899415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '71b476f967ce43ffba2db93cf8280563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0e70f015684fc1be169e373d94762c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:53.900319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] flavor_id is None. Assuming migration. {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 28 18:08:53.900946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:08:54.073983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:54.094626 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ec66c84f-1c54-439d-9ea6-dc41e309acdd tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.552063 Oct 28 18:08:54.095229 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 711/1563] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:53 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:54.121103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:54.127310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:54.173815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:54.178302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:54.181111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:54.185124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:54.190371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:54.196369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:54.557373 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95ff74e3-11c9-42c4-8253-965c1a6b123a tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028/action" status: 202 len: 0 microversion: 2.1 time: 0.797920 Oct 28 18:08:54.560992 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 853/1564] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:08:53 2022] POST /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:08:54.587616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70888204-bb8d-42c3-bbcf-48a0598f7bc2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de0ee790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:54.683014 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-70888204-bb8d-42c3-bbcf-48a0598f7bc2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1422 microversion: 2.1 time: 0.122791 Oct 28 18:08:54.683627 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 854/1565] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:54 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:54.712376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:54.713040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:54.748161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:54.749420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:54.750052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:54.750986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:54.751623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:54.752940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:55.175486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:55.197237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:55.207745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:55.213688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0453b0ef-3986-4412-a401-586dc25d8bc2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1233 microversion: 2.25 time: 0.507192 Oct 28 18:08:55.234802 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 855/1566] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:54 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1233 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:55.253424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:55.254040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:55.271047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:55.275055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:55.277632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:55.278098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:55.278875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:55.279343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:55.288072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:55.290364 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d48323e-973e-4584-bfa1-862ae6752042 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 1.181565 Oct 28 18:08:55.291066 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 712/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:54 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:55.301225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:55.324044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-89fc0920-f3f8-4027-8442-3eafa984a592 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de2593a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:55.413755 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-89fc0920-f3f8-4027-8442-3eafa984a592 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 200 len: 1422 microversion: 2.1 time: 0.108083 Oct 28 18:08:55.418159 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 713/1568] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:08:55 2022] GET /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:55.424820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:55.425447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:55.465676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:55.466180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:55.467034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:55.469933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:55.470839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:55.473162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:56.168491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:56.189897 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c4098887-a2b7-4970-bc61-31753f9d1644 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.769769 Oct 28 18:08:56.190926 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 714/1569] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:55 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:56.261116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:56.277947 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9fd713f9-bcc4-47e1-8efc-66ff1f24a5c6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1471 microversion: 2.1 time: 1.040479 Oct 28 18:08:56.282908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 856/1570] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:55 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1471 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:56.288587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-142865052", "imageRef": "1beceb79-aa6c-4e01-af51-93dca9aa2953", "flavorRef": "452", "networks": [{"uuid": "d98ef463-74a4-479c-b632-73800f8bbec7"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:56.430223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] validate_networks() for [('d98ef463-74a4-479c-b632-73800f8bbec7', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:08:56.472413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0ed34c35-542b-419b-a298-7cfc591cba11 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Action: 'create', calling method: .version_select at 0x7f78de819160>, body: {"keypair": {"name": "tempest-keypair-2076178402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJmIFDFVz8RoMAySaQIuR/I/i6tkZnekC6E7pwQV5XDozFsgShNdzJxHIfPIshXQpmQOdHcfEe13i8Q2EAbMpaVn8Iq4OK4XjQ/jBqCXxGs+X9DT4KOq52Cp7u2NXFtiw=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:56.494007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:56.515716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0ed34c35-542b-419b-a298-7cfc591cba11 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Getting quotas for project 379769ae736843d0bddf1849cf09d837. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:56.531348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0ed34c35-542b-419b-a298-7cfc591cba11 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Getting quotas for user 24ef4ee8fd6349dba67ca7c4cb32234c and project 379769ae736843d0bddf1849cf09d837. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:56.595383 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0ed34c35-542b-419b-a298-7cfc591cba11 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.400915 Oct 28 18:08:56.603316 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 715/1571] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:08:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:56.610022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:56.610864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:56.632436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:56.633506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:56.635680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:56.637028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:56.639397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:56.640064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:56.856177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:56.871135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:56.872914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:56.874267 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c469a6db-2193-49f5-9577-01a7f0832d7a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1251 microversion: 2.25 time: 0.269634 Oct 28 18:08:56.875426 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 716/1572] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:56 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1251 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:56.887127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:56.897382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:56.905809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:56.906533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:56.907369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:56.908336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:56.909547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:56.910144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:57.305496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:57.316661 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4770f3bb-e2fb-4939-8ad2-95742d2c84eb tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 0.439910 Oct 28 18:08:57.319506 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 717/1573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:56 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:57.337060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:57.341539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:57.369117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:57.371298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:57.372042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:57.377157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:57.378627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:57.379898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:57.845955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:57.891734 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17a7d4ee-c846-4fc3-8e9c-bff1af8aa5ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.559774 Oct 28 18:08:57.895800 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 718/1574] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:57 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:57.908726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:57.918367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:57.958989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:57.960869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:57.961336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:57.965591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:57.968173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:57.970359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:58.610668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:58.625899 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0066a95c-4e05-463b-9fa4-00c760ad7d10 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1471 microversion: 2.1 time: 0.728001 Oct 28 18:08:58.629295 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 719/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:57 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1471 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:58.636852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:58.637986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:58.663544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:58.667295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:58.668546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:58.676439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:58.677284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:58.679650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:58.840806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:58.851144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:58.857551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:58.863926 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2b44415c-67ec-40bb-a006-e92c48922c8e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1251 microversion: 2.25 time: 0.232188 Oct 28 18:08:58.882352 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 720/1576] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:08:58 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1251 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:08:58.889846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:58.899533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:08:58.911560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:58.917674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:58.918497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:58.919492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:58.920609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:58.921542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:59.589271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:08:59.589963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:08:59.590443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:08:59.590852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:08:59.591697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:08:59.626150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:59.626693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:59.628754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:59.633102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:59.634160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:59.638395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:59.659029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:59.686777 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-920ebff0-9945-4fd3-8f35-7ca166ac3c67 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 0.802835 Oct 28 18:08:59.702223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:59.708609 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 721/1577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:58 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:59.710521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for user 46b892cd4bff49b78773d9b78da06bcd and project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:59.729875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:08:59.734854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1beceb79-aa6c-4e01-af51-93dca9aa2953',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:08:59.922647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e227956d-38f0-44a4-8b8a-ea8752450b0f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.638507 Oct 28 18:08:59.931057 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 857/1578] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:08:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:08:59.963725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:59.968256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:00.012549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:00.013460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:00.015733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:00.017503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:00.017503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:00.020126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:00.377405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1077632030", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "87ea5c4d-5323-42fe-9440-4c544f78f1fd"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:00.516323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] validate_networks() for [('87ea5c4d-5323-42fe-9440-4c544f78f1fd', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:09:00.889718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:00.914004 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d7ef889-2696-445a-9c53-1600d2b11923 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.979009 Oct 28 18:09:00.915008 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 858/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:59 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:00.920528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2ab2b6f7-b435-45dc-bb32-ed1e320ea266 req-fdd38a6e-ff70-431f-bca0-bfe09ba1040a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc86d75-014e-43a2-956b-03e203fba456", "name": "network-vif-plugged", "status": "completed", "tag": "0225049a-d33b-439d-aef3-99aa74ba5f5a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:00.931636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2ab2b6f7-b435-45dc-bb32-ed1e320ea266 req-fdd38a6e-ff70-431f-bca0-bfe09ba1040a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:00.950285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2ab2b6f7-b435-45dc-bb32-ed1e320ea266 req-fdd38a6e-ff70-431f-bca0-bfe09ba1040a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:00.951136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2ab2b6f7-b435-45dc-bb32-ed1e320ea266 req-fdd38a6e-ff70-431f-bca0-bfe09ba1040a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:00.986231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2ab2b6f7-b435-45dc-bb32-ed1e320ea266 req-fdd38a6e-ff70-431f-bca0-bfe09ba1040a service nova] Creating event network-vif-plugged:0225049a-d33b-439d-aef3-99aa74ba5f5a for instance 1dc86d75-014e-43a2-956b-03e203fba456 on n-h1-862404-2 Oct 28 18:09:01.008654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2ab2b6f7-b435-45dc-bb32-ed1e320ea266 req-fdd38a6e-ff70-431f-bca0-bfe09ba1040a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092000 Oct 28 18:09:01.011079 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 859/1580] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:01.031083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:01.034249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:01.057309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:01.065860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:01.071569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:01.075912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:01.076412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:01.084420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:01.648076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:01.674799 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d38c3ffc-f48b-4b79-ab53-d9df1d0e73c1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1471 microversion: 2.1 time: 0.661592 Oct 28 18:09:01.675851 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 860/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:01 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1471 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:01.699000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:01.699652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:01.734629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:01.748378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:01.749420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:01.752425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:01.754826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:01.756571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:02.086625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:09:02.087161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:09:02.087750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:09:02.088560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:09:02.089106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:09:02.120265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:02.121859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:02.128844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:02.130081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:02.135537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:02.137930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:02.212304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Getting quotas for project 2bd919a55e8046e692f5445dfc0fb416. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:09:02.233496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Getting quotas for user 04f9975fa21947338669ae83605610ea and project 2bd919a55e8046e692f5445dfc0fb416. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:09:02.275751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:09:02.284826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:09:02.500135 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a4489f34-f551-4222-86b3-fb085ba67914 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.789393 Oct 28 18:09:02.501260 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 722/1582] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:09:02.516551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:02.517076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:02.524936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:02.530013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:02.535773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:02.539470 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-851f1c44-764b-43f8-8cbe-1da0118e08d4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1293 microversion: 2.25 time: 0.855946 Oct 28 18:09:02.541944 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 861/1583] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:01 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1293 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:02.555684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:02.557333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:02.557956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:02.558327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:02.564199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:02.565096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:02.571284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:02.572216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:02.572570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:02.573103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:02.573696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:02.576281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:02.576982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:02.577986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:02.652162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:03.026073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:03.036430 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f99b3067-6311-43d1-931f-a579b7ef8641 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1259 microversion: 2.1 time: 0.534000 Oct 28 18:09:03.056410 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 723/1584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:02 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1259 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:03.314192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:03.325911 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c950e2e0-deb6-464d-bfaf-af0a416b62bc tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1324 microversion: 2.1 time: 0.781373 Oct 28 18:09:03.335664 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 862/1585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:02 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1324 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:03.353291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:03.354077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:03.390537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:03.392358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:03.393861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:03.399800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:03.402887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:03.406203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:03.411198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86750535-ae4e-41d9-8bda-843b4dc9fd80 tempest-FlavorsV2NegativeTest-944976225 tempest-FlavorsV2NegativeTest-944976225-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:03.425166 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86750535-ae4e-41d9-8bda-843b4dc9fd80 tempest-FlavorsV2NegativeTest-944976225 tempest-FlavorsV2NegativeTest-944976225-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.365942 Oct 28 18:09:03.430126 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 724/1586] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:09:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:03.444986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1911b74f-fa26-4d1e-85fa-c0a255dcd26f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:03.445895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1911b74f-fa26-4d1e-85fa-c0a255dcd26f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:03.680555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1911b74f-fa26-4d1e-85fa-c0a255dcd26f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:03.691613 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1911b74f-fa26-4d1e-85fa-c0a255dcd26f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1216 microversion: 2.1 time: 0.260068 Oct 28 18:09:03.692244 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 725/1587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:03 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1216 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:03.712231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:03.712868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:03.743106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:03.743616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:03.745317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:03.748929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:03.750049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:03.750522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:03.775490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:03.786207 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87d0ae2e-545d-44d5-9aed-195d2eca4d5f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.448743 Oct 28 18:09:03.799847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 863/1588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:03 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:03.822841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7508e5c3-f541-45ff-a0be-3a2cb343a705 req-5c23885e-02d2-4970-92c8-1b9fc3f351dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739ffed6-e9db-4597-b1f1-ccc8bec1de12", "name": "network-vif-unplugged", "status": "completed", "tag": "de1e8806-6a85-4b08-9fea-7dd69598ef6a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:03.856523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7508e5c3-f541-45ff-a0be-3a2cb343a705 req-5c23885e-02d2-4970-92c8-1b9fc3f351dd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:03.857233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7508e5c3-f541-45ff-a0be-3a2cb343a705 req-5c23885e-02d2-4970-92c8-1b9fc3f351dd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:03.857498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7508e5c3-f541-45ff-a0be-3a2cb343a705 req-5c23885e-02d2-4970-92c8-1b9fc3f351dd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:03.872761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7508e5c3-f541-45ff-a0be-3a2cb343a705 req-5c23885e-02d2-4970-92c8-1b9fc3f351dd service nova] Creating event network-vif-unplugged:de1e8806-6a85-4b08-9fea-7dd69598ef6a for instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 on n-h1-862404-2 Oct 28 18:09:03.892541 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7508e5c3-f541-45ff-a0be-3a2cb343a705 req-5c23885e-02d2-4970-92c8-1b9fc3f351dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084279 Oct 28 18:09:03.895357 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 864/1589] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:03.916874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:03.917780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:03.933426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:03.935155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:03.935605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:03.936352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:03.936810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:03.937235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:04.445891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:04.483601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:04.506388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:04.513015 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aca9c487-6467-4584-8a2c-afe79678697f tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1293 microversion: 2.25 time: 0.609915 Oct 28 18:09:04.531870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 865/1590] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:03 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1293 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:04.532117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:04.532117 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d6ab5107-7e7b-4a4d-813c-369b5cfa5284 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.824376 Oct 28 18:09:04.537237 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 726/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:03 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:04.549553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:04.563298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:04.581126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:04.585474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-769c9c11-707d-4251-9f28-2ac95bbece63 req-cba2f26d-de5c-4591-9e38-9b45ae0bc64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62e77c1-0b06-4b88-bcdc-feb958ad4c66", "tag": "9ec5b572-e798-4c2f-8137-0de51ad648ad"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:04.586239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:04.587538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:04.589595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:04.591376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:04.596525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:04.646883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-769c9c11-707d-4251-9f28-2ac95bbece63 req-cba2f26d-de5c-4591-9e38-9b45ae0bc64c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:04.647454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-769c9c11-707d-4251-9f28-2ac95bbece63 req-cba2f26d-de5c-4591-9e38-9b45ae0bc64c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:04.648278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-769c9c11-707d-4251-9f28-2ac95bbece63 req-cba2f26d-de5c-4591-9e38-9b45ae0bc64c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:04.702581 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-769c9c11-707d-4251-9f28-2ac95bbece63 req-cba2f26d-de5c-4591-9e38-9b45ae0bc64c service nova] Creating event network-changed:9ec5b572-e798-4c2f-8137-0de51ad648ad for instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 on n-h2-862404-2 Oct 28 18:09:04.724676 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-769c9c11-707d-4251-9f28-2ac95bbece63 req-cba2f26d-de5c-4591-9e38-9b45ae0bc64c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199769 Oct 28 18:09:04.726476 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 866/1592] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:04.762968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:04.766418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:04.797585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:04.810288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:04.813727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:04.819786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:04.821635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:04.824349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:05.091699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:05.103055 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-afbd827f-1a4b-4854-ac45-186b25d83cd9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1265 microversion: 2.1 time: 0.563143 Oct 28 18:09:05.111557 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 727/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:04 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1265 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:05.137149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:05.138199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:05.165258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:05.167455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:05.168381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:05.170517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:05.172783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:05.173712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:05.528648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:05.547435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c66a3ac-d7c0-4f68-b0e3-74c7a1c53487 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1520 microversion: 2.1 time: 0.815461 Oct 28 18:09:05.549596 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 867/1594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:04 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1520 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:05.569277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:05.575023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:05.576965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:05.594994 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9d1c616-9c08-4291-9f60-afed76b6a98f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1268 microversion: 2.1 time: 0.480832 Oct 28 18:09:05.597553 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 728/1595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:05 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1268 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:05.597772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:05.598235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:05.604498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:05.605340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:05.605822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:05.606452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:05.616551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94602f68-e8ec-4647-9558-a57b11a29f07 tempest-FlavorsV2NegativeTest-944976225 tempest-FlavorsV2NegativeTest-944976225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1640780985", "imageRef": "ad18d6ee-c5ec-4d43-8480-4d1005007571", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:05.789953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-94602f68-e8ec-4647-9558-a57b11a29f07 tempest-FlavorsV2NegativeTest-944976225 tempest-FlavorsV2NegativeTest-944976225-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:09:06.265213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:06.286924 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c87c15c1-9d8e-4263-871f-60ee067f4121 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.733139 Oct 28 18:09:06.291809 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 868/1596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:05 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:06.310511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:06.314859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:06.328585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:06.331908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:06.334818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:06.335768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:06.338779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:06.338987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.010892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:07.023394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:07.043106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:07.044442 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6043a693-88c3-435e-904d-a4c4970a4c71 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1293 microversion: 2.25 time: 0.751152 Oct 28 18:09:07.046147 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 869/1597] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:06 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1293 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:07.051043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:07.067124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:07.102814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:07.103296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:07.115970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.133281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:07.134141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:07.134746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.567622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:07.580780 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-767e65f6-b188-4fd9-a00e-675ee6ac0ced tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.533263 Oct 28 18:09:07.581307 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 870/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:07 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:07.603128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:07.603753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:07.625275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:07.625779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:07.626218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.627015 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-94602f68-e8ec-4647-9558-a57b11a29f07 tempest-FlavorsV2NegativeTest-944976225 tempest-FlavorsV2NegativeTest-944976225-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94602f68-e8ec-4647-9558-a57b11a29f07 tempest-FlavorsV2NegativeTest-944976225 tempest-FlavorsV2NegativeTest-944976225-project] Request method failure captured: Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 143 Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq98x69tGdzwzst4__JBfQDps3C_F2n4imMIM9ORS73QbKUDM5WWF9_TrNeXp-a2rcGBVFuDgacHyNUChdxnoq0Xj6HgoCZCTuj7bHou80eQ9XGDGGGdPo0O0QE1n0x9J1JTNAEdWhtiw1V1bH7wNihqeo2ifWwJUJbs4zoQuPcZrc Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 9c2c1a02540a44f982ac49fc98dee342 Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FlavorsV2NegativeTest-944976225 Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:07.629873 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c2c1a02540a44f982ac49fc98dee342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c2c1a02540a44f982ac49fc98dee342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c2c1a02540a44f982ac49fc98dee342", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c2c1a02540a44f982ac49fc98dee342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FlavorsV2NegativeTest-944976225 Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 9c2c1a02540a44f982ac49fc98dee342 Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-944976225 Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FlavorsV2NegativeTest-944976225-project Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c567415ff59b40659e56e95167fd879d Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FlavorsV2NegativeTest-944976225-project Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1640780985", "imageRef": "ad18d6ee-c5ec-4d43-8480-4d1005007571", "flavorRef": "452"}} Oct 28 18:09:07.631982 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: exception: Flavor's memory is too small for requested image. Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1640780985', 'imageRef': 'ad18d6ee-c5ec-4d43-8480-4d1005007571', 'flavorRef': '452'}}} Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:07.633013 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:07.634739 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:07.636496 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:07.636496 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:07.636496 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:07.636496 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:07.636496 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 28 18:09:07.636496 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:07.636991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:07.636991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:07.636991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.640657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94602f68-e8ec-4647-9558-a57b11a29f07 tempest-FlavorsV2NegativeTest-944976225 tempest-FlavorsV2NegativeTest-944976225-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:07.641771 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94602f68-e8ec-4647-9558-a57b11a29f07 tempest-FlavorsV2NegativeTest-944976225 tempest-FlavorsV2NegativeTest-944976225-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 2.042760 Oct 28 18:09:07.642980 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 729/1599] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:09:05 2022] POST /compute/v2.1/servers => generated 93 bytes in 2044 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:09:07.657474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:07.663088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:07.689508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:07.690349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:07.703788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.704880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:07.709917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:07.710597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.923494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:07.934413 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51b4746e-65be-470b-aeb0-bd82f48e0f5c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1520 microversion: 2.1 time: 0.352052 Oct 28 18:09:07.935406 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 871/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:07 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:07.940491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1337809725", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "8fc60b9b-bd13-4f9a-a7e6-a305fafd82b6"}], "security_groups": [{"name": "tempest-securitygroup--812427472"}], "key_name": "tempest-keypair-2076178402", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:08.425387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:08.442556 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b88abb42-dd90-4745-a232-f84a33d8b47f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.797894 Oct 28 18:09:08.459848 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 730/1601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:07 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:08.470367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:08.471069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:08.498460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:08.500035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:08.502406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:08.504638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] validate_networks() for [('8fc60b9b-bd13-4f9a-a7e6-a305fafd82b6', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:09:08.507095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:08.511336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:08.511837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:08.862924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:08.875047 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78f287e8-6e3e-464a-ae16-5ea7d7d0d118 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1274 microversion: 2.1 time: 0.427232 Oct 28 18:09:08.876885 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 731/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:08 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1274 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:08.889958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-130a924d-9f9c-4617-acc3-9edfeef91428 req-0f6bc5fa-0bed-4fec-a054-b20cd65a6a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0", "name": "network-vif-unplugged", "status": "completed", "tag": "3fb4b6a0-8291-4a9c-b539-9a95bb69a89d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:08.913597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-130a924d-9f9c-4617-acc3-9edfeef91428 req-0f6bc5fa-0bed-4fec-a054-b20cd65a6a08 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:08.915427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-130a924d-9f9c-4617-acc3-9edfeef91428 req-0f6bc5fa-0bed-4fec-a054-b20cd65a6a08 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:08.917269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-130a924d-9f9c-4617-acc3-9edfeef91428 req-0f6bc5fa-0bed-4fec-a054-b20cd65a6a08 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:08.946220 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-130a924d-9f9c-4617-acc3-9edfeef91428 req-0f6bc5fa-0bed-4fec-a054-b20cd65a6a08 service nova] Creating event network-vif-unplugged:3fb4b6a0-8291-4a9c-b539-9a95bb69a89d for instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 on n-h1-862404-2 Oct 28 18:09:08.959676 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-130a924d-9f9c-4617-acc3-9edfeef91428 req-0f6bc5fa-0bed-4fec-a054-b20cd65a6a08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079691 Oct 28 18:09:08.961088 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 732/1603] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:08.972652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:08.976489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:08.997585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:08.999288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:08.999729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:09.000572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:09.001253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:09.001882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:09.591438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:09.605019 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6a4be840-1953-466c-b9f7-2ba568f569d5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.641299 Oct 28 18:09:09.614429 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 733/1604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:08 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:09.629398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1842294040"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:09.633203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:09.646882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:09.647380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:09.648221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:09.648952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:09.649749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:09.650624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:09.663700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:09.723499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:09.841286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:09:09.841941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:09:09.842599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:09:09.843175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:09:09.843789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:09:09.862591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:09.863391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:09.864028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:09.865567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:09.869891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:09.870564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:09.913996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Getting quotas for project 379769ae736843d0bddf1849cf09d837. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:09:09.922921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Getting quotas for user 24ef4ee8fd6349dba67ca7c4cb32234c and project 379769ae736843d0bddf1849cf09d837. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:09:09.946837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:09:09.949736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:09:10.040443 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-52295c9c-2c03-4244-9825-b036d2fa7b89 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456/action" status: 202 len: 0 microversion: 2.1 time: 0.423029 Oct 28 18:09:10.047498 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 734/1605] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:09:09 2022] POST /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:09:10.054535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:10.055304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:10.060057 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91959c62-7cfe-44db-b7f8-5cd4d8d62403 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.123303 Oct 28 18:09:10.070857 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 872/1606] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:09:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:09:10.082950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:10.084331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:10.084582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:10.085578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:10.086099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:10.086875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:10.089405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:10.090208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:10.105979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:10.106652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:10.107254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:10.108184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:10.108791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:10.109398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:10.364216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:10.389379 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64b8dbc8-9183-4dd2-8cde-169ade660384 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.315927 Oct 28 18:09:10.391142 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 873/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:10 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:10.400421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:10.401341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:10.409589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:10.410023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:10.410457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:10.411372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:10.413465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:10.414104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:10.680996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:10.697490 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50d0ddb6-6f44-4a81-b5d7-891eb5f2fd9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.304628 Oct 28 18:09:10.698502 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 874/1608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:10 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:10.704424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:10.705484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:10.712577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:10.713635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:10.714284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:10.715513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:10.716286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:10.716929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:10.765479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:10.775953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:10.780984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:10.784586 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9024bd7f-09a0-40a9-8872-15463dfb68ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.735644 Oct 28 18:09:10.788083 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 735/1609] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:10 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:10.793321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7314823-7020-492d-a06f-e9104622303a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '.version_select at 0x7f78de2b1d30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:10.841299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:10.849349 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45f05aa4-04af-4b92-94ca-94f52da4425c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1274 microversion: 2.1 time: 0.149511 Oct 28 18:09:10.849949 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 875/1610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:10 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:10.859048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba48d9b5-17f3-460a-a310-e56fce284bc1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:10.859670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba48d9b5-17f3-460a-a310-e56fce284bc1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:10.967479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba48d9b5-17f3-460a-a310-e56fce284bc1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:10.982049 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba48d9b5-17f3-460a-a310-e56fce284bc1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1242 microversion: 2.1 time: 0.127500 Oct 28 18:09:10.987612 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 876/1611] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:10 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:11.003689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:11.009310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:11.034734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.035313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.035847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:11.036681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.037215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.037717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:11.042531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:11.042756 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e7314823-7020-492d-a06f-e9104622303a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/images/8c0832e9-390f-4caa-974e-bf435844f7cb" status: 204 len: 0 microversion: 2.1 time: 0.252912 Oct 28 18:09:11.046935 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 736/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:10 2022] DELETE /compute/v2.1/images/8c0832e9-390f-4caa-974e-bf435844f7cb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:09:11.062122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-56a06877-5330-481e-8d44-eb251f5dfdb6 req-5f743934-4236-49b3-a3c9-9e35643a301d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0", "tag": "3fb4b6a0-8291-4a9c-b539-9a95bb69a89d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:11.088890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-56a06877-5330-481e-8d44-eb251f5dfdb6 req-5f743934-4236-49b3-a3c9-9e35643a301d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.089382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-56a06877-5330-481e-8d44-eb251f5dfdb6 req-5f743934-4236-49b3-a3c9-9e35643a301d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.089817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-56a06877-5330-481e-8d44-eb251f5dfdb6 req-5f743934-4236-49b3-a3c9-9e35643a301d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:11.143268 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-56a06877-5330-481e-8d44-eb251f5dfdb6 req-5f743934-4236-49b3-a3c9-9e35643a301d service nova] Creating event network-changed:3fb4b6a0-8291-4a9c-b539-9a95bb69a89d for instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 on n-h1-862404-2 Oct 28 18:09:11.171733 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-56a06877-5330-481e-8d44-eb251f5dfdb6 req-5f743934-4236-49b3-a3c9-9e35643a301d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125415 Oct 28 18:09:11.172389 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 737/1613] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:11.190561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f5adc41-c4f4-4298-b0d0-8096ebfeb2c3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '.version_select at 0x7f78de819430>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:11.276157 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6f5adc41-c4f4-4298-b0d0-8096ebfeb2c3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Image not found. Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f5adc41-c4f4-4298-b0d0-8096ebfeb2c3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/images/8c0832e9-390f-4caa-974e-bf435844f7cb HTTP/1.1 Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:11.286138 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8c0832e9-390f-4caa-974e-bf435844f7cb'} Oct 28 18:09:11.287762 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:09:11.288667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8c0832e9-390f-4caa-974e-bf435844f7cb Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:09:11.289810 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c0832e9-390f-4caa-974e-bf435844f7cb could not be found. Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:09:11.291392 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:09:11.292635 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:11.295773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f5adc41-c4f4-4298-b0d0-8096ebfeb2c3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:11.296912 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f5adc41-c4f4-4298-b0d0-8096ebfeb2c3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/images/8c0832e9-390f-4caa-974e-bf435844f7cb" status: 404 len: 62 microversion: 2.1 time: 0.123403 Oct 28 18:09:11.297701 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 738/1614] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:09:11 2022] GET /compute/v2.1/images/8c0832e9-390f-4caa-974e-bf435844f7cb => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:09:11.306120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:11.308577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:11.346893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.347850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.351420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:11.354237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.356150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.356923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:11.426815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:11.436828 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b7d2dbe7-0a2f-4f96-a283-14b1c03f7ec9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.446906 Oct 28 18:09:11.451571 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 877/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:10 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:11.473792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:11.474460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:11.486602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.492501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.493231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:11.494201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.496567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.497813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:11.809822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:11.822638 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-666a0f9c-f45b-4992-b647-a706a0581aac tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.369587 Oct 28 18:09:11.848263 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 878/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:11 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:11.857941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:11.863105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:11.872763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.873869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.874990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:11.876282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:11.877012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:11.877655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.136751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:12.148957 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a6d5db4c-f23d-4aed-93b6-9557e7f8a4f6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1532 microversion: 2.1 time: 0.846772 Oct 28 18:09:12.149913 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 739/1617] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:11 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1532 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:12.155173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:12.158867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:12.165765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.166522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.167146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.180583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.181561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.187427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.189628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:12.254918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:12.265553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c2e99fc-31e0-4e6f-b71b-a93fd36a4401 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.415887 Oct 28 18:09:12.280064 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 879/1618] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:11 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:12.280064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:12.280064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:12.282342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.282986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.283557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.288874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.288874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.288874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.501842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:12.513143 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-275ee43a-17c2-45c4-af69-187d977d2a4d tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.244873 Oct 28 18:09:12.514096 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 880/1619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:12 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:12.519153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:12.520263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:12.526387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:12.528440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.529388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.530063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.531602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.532424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.533445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.589075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:12.617029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:12.618791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:12.620195 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45e29e92-f0d3-428c-a5aa-b6e2c4bed28e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.468935 Oct 28 18:09:12.622279 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 740/1620] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:12 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:12.644070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:12.646189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:12.664760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.665867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.666609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.667515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.668162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.668770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.742699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:12.758632 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8725cf77-fad3-41e3-acbc-069a321c1aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1294 microversion: 2.1 time: 0.241044 Oct 28 18:09:12.771847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 881/1621] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:12 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1294 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:12.855177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:12.855983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:12.863666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.866548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.869643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:12.870636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:12.871235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:12.873879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.064495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:13.077182 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0dca15ec-2e9d-42a4-8025-c565cf13a377 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.452620 Oct 28 18:09:13.097049 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 741/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:12 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:13.166654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:13.176802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:13.178695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:13.185769 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-014404b3-c6d4-4145-8aad-f6b5699f427d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.334481 Oct 28 18:09:13.189487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.190944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.191552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.192218 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 882/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:12 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:13.193862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.194505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.194942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.226922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2817127c-6769-47a5-bf81-71b9180758f1 req-a107e97e-bd4e-482c-8cb7-5574e55b4602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5dcb46-e496-422a-a3e3-247b17f4dc7c", "tag": "9da53e4f-eb39-4528-9721-0e8f42bb00c2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:13.242935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2817127c-6769-47a5-bf81-71b9180758f1 req-a107e97e-bd4e-482c-8cb7-5574e55b4602 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.256617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2817127c-6769-47a5-bf81-71b9180758f1 req-a107e97e-bd4e-482c-8cb7-5574e55b4602 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.257396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2817127c-6769-47a5-bf81-71b9180758f1 req-a107e97e-bd4e-482c-8cb7-5574e55b4602 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.269717 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2817127c-6769-47a5-bf81-71b9180758f1 req-a107e97e-bd4e-482c-8cb7-5574e55b4602 service nova] Creating event network-changed:9da53e4f-eb39-4528-9721-0e8f42bb00c2 for instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c on n-h1-862404-2 Oct 28 18:09:13.285362 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2817127c-6769-47a5-bf81-71b9180758f1 req-a107e97e-bd4e-482c-8cb7-5574e55b4602 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063293 Oct 28 18:09:13.286568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 883/1624] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:13.297500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:13.298692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:13.315551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.316430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.317082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.320894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.321612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.322265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.445623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:13.455491 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bf6da23a-81ec-4729-bdd3-0bdf059c20b3 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1532 microversion: 2.1 time: 0.282786 Oct 28 18:09:13.460190 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 742/1625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:13 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1532 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:13.542858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:13.543488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:13.558700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.559602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.560262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.561139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.579910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.580791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.639506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:13.654709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b3597dd-db8f-4a34-95f1-ae1f603b611e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.361549 Oct 28 18:09:13.673506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 884/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:13 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:13.686365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:13.687741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=20 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:13.693220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:13.710751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.711309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.711760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.721253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.722002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.722609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:13.935679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:13.951568 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-55d1188c-996f-48f4-83a0-519aab9e5932 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.412891 Oct 28 18:09:13.952125 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 743/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:13 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:13.969763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:13.978156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:13.998778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:13.999286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:13.999725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.000487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.000946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.001379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.075648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:14.093391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:14.095353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:14.103499 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45b27487-2567-402a-bbaf-4cb489d0f8ab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.428492 Oct 28 18:09:14.105968 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 885/1628] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:13 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:14.113954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:14.117253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:14.128308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.129223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.131008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.131577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.132337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.132929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.195219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:14.214160 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ebd6f849-53fb-4f58-befa-f390eb469ce2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1294 microversion: 2.1 time: 0.260805 Oct 28 18:09:14.214709 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 744/1629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:13 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1294 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:14.237714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:14.238537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:14.252122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.253600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.255545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.259376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.260744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.261535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.272462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:14.385170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:14.394057 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f94cb14e-e41c-4482-a8ac-23b338d11f80 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.286801 Oct 28 18:09:14.397399 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 886/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:14 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:14.481228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:14.481875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:14.491574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.494255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.494797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.495621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.498817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.499359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.710479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:14.722188 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1bde19df-7c22-49c1-84c9-14199e004743 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.506360 Oct 28 18:09:14.723059 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 745/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:14 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:14.729870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:14.730933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:14.740053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.741043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.741884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.742876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.743543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.744289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.766259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:14.777671 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7fc202c0-707b-4e57-bd96-bd7a9cfe81ed tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1532 microversion: 2.1 time: 0.299873 Oct 28 18:09:14.805533 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 887/1632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:14 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1532 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:14.977818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:14.981254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:14.988751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:14.991650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:14.992588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:14.999199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.000189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.001556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.021623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:15.030342 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-878aaba0-f357-4d78-bce8-0dca14bc0735 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.306023 Oct 28 18:09:15.045449 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 746/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:14 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:15.135780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:15.137710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:15.147538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.148168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.148615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.149336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.150653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.163535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.312833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:15.329247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa938f2d-4585-48d8-a89a-5d1a66712360 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.354426 Oct 28 18:09:15.348338 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 888/1634] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:14 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:15.365220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:15.365916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:15.383387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.383912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.384355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.385068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.385526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.385955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.480660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:15.500312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:15.503173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:15.506069 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3d889a2c-e46c-4dbe-b8e1-8ab889728c43 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.376057 Oct 28 18:09:15.507062 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 747/1635] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:15 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:09:15.512705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9bd59d68-0f72-4afc-873e-22ed8c66a4a9 req-e05a9f03-fb19-4d22-be96-d4de43572007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd3df56-f1c1-4184-b1e0-96bb328259e4", "tag": "3d85b3e1-95b6-4681-b22f-7f9f3b2a693f"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:15.536452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9bd59d68-0f72-4afc-873e-22ed8c66a4a9 req-e05a9f03-fb19-4d22-be96-d4de43572007 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.538423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9bd59d68-0f72-4afc-873e-22ed8c66a4a9 req-e05a9f03-fb19-4d22-be96-d4de43572007 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.538952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9bd59d68-0f72-4afc-873e-22ed8c66a4a9 req-e05a9f03-fb19-4d22-be96-d4de43572007 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.549650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:15.558021 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9bd59d68-0f72-4afc-873e-22ed8c66a4a9 req-e05a9f03-fb19-4d22-be96-d4de43572007 service nova] Creating event network-changed:3d85b3e1-95b6-4681-b22f-7f9f3b2a693f for instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 on n-h2-862404-2 Oct 28 18:09:15.561952 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7cef58df-565c-47ff-8fbf-0f7d9f82c337 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1294 microversion: 2.1 time: 0.210923 Oct 28 18:09:15.563143 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 889/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:15 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1294 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:15.568679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:15.569762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:15.574285 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9bd59d68-0f72-4afc-873e-22ed8c66a4a9 req-e05a9f03-fb19-4d22-be96-d4de43572007 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065630 Oct 28 18:09:15.576231 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 748/1637] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:15.578165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.578684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.579120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.579849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.580292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.580709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.753270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:15.754512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:15.783686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.784946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.785431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.786193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.787385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.788405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.851036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:15.860095 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8b6980fb-eb4b-430a-9a32-cace6c38479e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.295611 Oct 28 18:09:15.860683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 890/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:15 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:15.866219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:15.866838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:15.873069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.873811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.874430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:15.875474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:15.876244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:15.876836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.052058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:16.053753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:16.092163 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-069611a8-2992-41c6-abc4-0c9499521e91 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.344215 Oct 28 18:09:16.093153 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8a806f5-c087-40b7-8f58-ae2e97797da6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1532 microversion: 2.1 time: 0.229536 Oct 28 18:09:16.093772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 891/1639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:15 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1532 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:16.104230 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 749/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:15 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:16.112378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:16.115257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:16.122431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.122818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.123250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.124183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.124925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.125506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.322585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:16.331273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-124afcec-a5a5-4b67-a46f-8bdfad6ae6e1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.226141 Oct 28 18:09:16.331918 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 892/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:16 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:16.355090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:16.355716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:16.365597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.366147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.366588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.367314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.367774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.368232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.534881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:16.535860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:16.547570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.548481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.549031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.549852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.550617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.551263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.692859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:16.701182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:16.702727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:16.703948 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dd9a5360-674d-49ec-a896-9a35b89607a8 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.173244 Oct 28 18:09:16.704589 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 893/1642] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:16 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:09:16.709589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:16.710349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:16.716168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.716727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.717957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.718735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.719258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.719749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.730657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:16.744085 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f9c413d1-88eb-4fe3-b78b-2ec45ac4833f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.392137 Oct 28 18:09:16.756327 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 750/1643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:16 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:16.756558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:16.801320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:16.810515 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a56dcfec-f8b0-4fbf-8065-50e68fafb53b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1294 microversion: 2.1 time: 0.104784 Oct 28 18:09:16.811275 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 894/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:16 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:16.885857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:16.886644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:16.893918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.894824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.895699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:16.896867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:16.897465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:16.898023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.117226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:17.117853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:17.124815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.125311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.126484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.127219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.127684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.128147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.292236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:17.304245 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2348ee62-c6b2-42e0-9100-dfe68f76c7c0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.191674 Oct 28 18:09:17.305406 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 895/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:17 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:17.310830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:17.311700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:17.318703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.320039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.320743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.321702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.322364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.323002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.452883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:17.465196 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df6e48e1-d53d-4c4e-bae0-75af56876130 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.584027 Oct 28 18:09:17.481387 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 751/1646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:16 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:17.487451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:17.488429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:17.497445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.498799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.500245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.501370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.502621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.504458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.506493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:17.518038 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ddcbe48c-49e7-4b1e-971c-58d187ea8bef tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1538 microversion: 2.1 time: 0.211298 Oct 28 18:09:17.528208 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 896/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:17 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1538 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:17.729774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:17.730731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:17.750894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.751549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.751935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.752723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.753141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.753611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.810077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:17.820111 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2b8d7f28-cab5-449a-a139-2eed92fb89f2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.337220 Oct 28 18:09:17.821200 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 752/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:17 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:17.826451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:17.828822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:17.835742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.836381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.836895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.837696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.838231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.838890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.909022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:17.918269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:17.920002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:17.921433 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9b8d4d26-d6c3-436e-bff2-209f102bca85 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.196222 Oct 28 18:09:17.922172 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 897/1649] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:17 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:09:17.932500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:17.933395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:17.939863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.940610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.941257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:17.942329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:17.943599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:17.944325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.041245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:18.050677 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-254cc821-dfd7-4f05-8b8b-7a3249e65332 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1294 microversion: 2.1 time: 0.125792 Oct 28 18:09:18.052629 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 898/1650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:17 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:18.085998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:18.100558 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-644df0f9-8f37-4fbc-b9d2-c9788c98459c tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.278062 Oct 28 18:09:18.101627 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 753/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:17 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:18.144764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-140e8232-0791-4d22-bf59-6bafb9d6981b req-c89198de-a2fe-4581-b7b2-4e4338ea4999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc86d75-014e-43a2-956b-03e203fba456", "name": "network-vif-plugged", "status": "completed", "tag": "0225049a-d33b-439d-aef3-99aa74ba5f5a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:18.159921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-140e8232-0791-4d22-bf59-6bafb9d6981b req-c89198de-a2fe-4581-b7b2-4e4338ea4999 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.160553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-140e8232-0791-4d22-bf59-6bafb9d6981b req-c89198de-a2fe-4581-b7b2-4e4338ea4999 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.161147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-140e8232-0791-4d22-bf59-6bafb9d6981b req-c89198de-a2fe-4581-b7b2-4e4338ea4999 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.179736 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-140e8232-0791-4d22-bf59-6bafb9d6981b req-c89198de-a2fe-4581-b7b2-4e4338ea4999 service nova] Creating event network-vif-plugged:0225049a-d33b-439d-aef3-99aa74ba5f5a for instance 1dc86d75-014e-43a2-956b-03e203fba456 on n-h1-862404-2 Oct 28 18:09:18.186896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-140e8232-0791-4d22-bf59-6bafb9d6981b req-c89198de-a2fe-4581-b7b2-4e4338ea4999 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046437 Oct 28 18:09:18.188014 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 899/1652] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:18.339897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:18.340626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:18.346441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:18.348186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.348886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.349505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.350491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.351064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.351600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.491636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:18.493111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:18.503968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.504492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.504934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.506008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.506647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.507077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.603017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:18.611690 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e2ee69af-5c12-46cb-85ee-502cd27193c7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.276058 Oct 28 18:09:18.617326 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 754/1653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:18 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:18.622606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:18.627027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:18.640982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.649036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.649855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.650728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.651308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.651876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.708829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:18.721483 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5efe4f87-99d7-4e51-ab81-a5c02d5fb5ad tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.234791 Oct 28 18:09:18.722461 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 900/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:18 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:18.850102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:18.851036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:18.857514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.858256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.858687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.859558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:18.860212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:18.860783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:18.954320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:18.980807 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3edeca4c-13e7-4fd5-b684-b02a84c5b1af tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1538 microversion: 2.1 time: 0.353587 Oct 28 18:09:18.982018 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 755/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:18 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1538 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:19.003028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:19.004106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:19.012732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.013643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.014369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.015966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.017200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.017629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.043957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:19.060677 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24ef43b7-a0f7-471c-9897-2096c342c79b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.215072 Oct 28 18:09:19.076592 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 901/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:18 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:19.089532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:19.090280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:19.096252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.097360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.097360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.097853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.098302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.099906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.180154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:19.187962 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5a1ef9ea-6755-44fa-903f-1b9f1f383200 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1294 microversion: 2.1 time: 0.110111 Oct 28 18:09:19.188913 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 902/1657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:19 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:19.196158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:19.196996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:19.203063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.203852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.204472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.205178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.205633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.206055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.263653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:19.275682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:19.278347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:19.281210 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a88d5a25-1260-416b-a2f9-1fefb2551485 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.287908 Oct 28 18:09:19.282205 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 756/1658] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:18 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:19.383302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:19.398984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a383604-06d3-4e99-bf95-7d382342e6e0 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.208686 Oct 28 18:09:19.402413 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 903/1659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:19 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:19.754796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:19.756620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:19.776404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.777063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.778257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.778840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.779068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.779594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.855476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:19.856582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:19.863019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.863757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.864373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.865743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:19.866531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:19.866981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:19.889433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:19.966089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:19.983231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-444b0a11-13fe-4c31-99a8-6ba94f369d0d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.236506 Oct 28 18:09:19.993801 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 904/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:19 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:20.010627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:20.016645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:20.023774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.024476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.024927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.025813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.026277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.026707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.317360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:20.331717 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f2a9304-2977-456b-8a18-4d0200486b15 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1538 microversion: 2.1 time: 0.328799 Oct 28 18:09:20.348198 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 905/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:20 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1538 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:20.354956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:20.354956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:20.378868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.379375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.379849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.381316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.381686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.382120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.490893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:20.502831 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-85c32839-6206-4ecd-9fdb-3219dc297a6e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.864352 Oct 28 18:09:20.503943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 757/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:19 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:20.510680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:20.512200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:20.519255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.532031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.532031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.532031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.532031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.532672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.666370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:20.675412 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bfc62932-3cab-4c63-8b1a-61b9a1d6c29c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1294 microversion: 2.1 time: 0.170304 Oct 28 18:09:20.686653 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 758/1663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:20 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1294 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:20.693766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:20.694720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:20.704560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.705370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.706564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.725350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.726404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.727133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.744474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:20.763857 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02966a6b-b814-41f7-91b6-a2c6d6ed9f1a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.427876 Oct 28 18:09:20.765016 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 906/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:20 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:20.769810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:20.770432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:20.803762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.804577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.805192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.806254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:20.807607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:20.808460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:20.972595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:21.188406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:21.199610 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8e53f18-bfb5-4155-86cd-9a535e89f05f tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.433467 Oct 28 18:09:21.201020 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 907/1665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:20 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:21.205989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:21.206821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:21.215147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:21.216174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:21.216998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:21.218336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:21.219262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:21.219899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:21.420799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:21.439888 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2df33d80-52ff-4bcb-89f3-fa1bf0244d78 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.236686 Oct 28 18:09:21.453520 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 908/1666] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:21 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:21.461381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:21.462170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:21.470156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:21.470761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:21.471308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:21.472189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:21.472790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:21.473331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:21.520174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:21.533560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:21.535584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:21.537500 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfdf9086-6d6e-4409-877f-ae803c02118d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.849201 Oct 28 18:09:21.554160 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 759/1667] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:20 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:21.563775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8aec0030-d9c0-4cb8-895a-d0130db5387d req-d3734287-8e28-45e9-b9f6-e1f79cd1c033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62e77c1-0b06-4b88-bcdc-feb958ad4c66", "name": "network-vif-plugged", "status": "completed", "tag": "9ec5b572-e798-4c2f-8137-0de51ad648ad"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:21.587150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8aec0030-d9c0-4cb8-895a-d0130db5387d req-d3734287-8e28-45e9-b9f6-e1f79cd1c033 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:21.587939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8aec0030-d9c0-4cb8-895a-d0130db5387d req-d3734287-8e28-45e9-b9f6-e1f79cd1c033 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:21.588096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8aec0030-d9c0-4cb8-895a-d0130db5387d req-d3734287-8e28-45e9-b9f6-e1f79cd1c033 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:21.627203 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8aec0030-d9c0-4cb8-895a-d0130db5387d req-d3734287-8e28-45e9-b9f6-e1f79cd1c033 service nova] Creating event network-vif-plugged:9ec5b572-e798-4c2f-8137-0de51ad648ad for instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 on n-h2-862404-2 Oct 28 18:09:21.640789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8aec0030-d9c0-4cb8-895a-d0130db5387d req-d3734287-8e28-45e9-b9f6-e1f79cd1c033 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084515 Oct 28 18:09:21.642096 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 760/1668] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:21.667146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:21.667890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:21.689319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:21.704668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:21.705212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:21.711998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:21.712651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:21.713269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:21.773933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:21.794576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d637782-b9bd-44f6-82ae-fde86961423c tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1538 microversion: 2.1 time: 0.339383 Oct 28 18:09:21.821168 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 909/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:21 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1538 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:21.906076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-18514d44-bae3-4797-86c0-5f3efa24d16b tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Action: 'create', calling method: .version_select at 0x7f78de063310>, body: {"pool": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:22.268654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:22.285317 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6a365e25-4549-422d-a328-0c91e1e38a8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.641233 Oct 28 18:09:22.290750 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 761/1670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:21 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:22.315096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:22.316154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:22.339357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:22.343083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:22.345394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:22.348441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:22.349867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:22.352846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:22.685188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:22.696594 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e758cb21-63ba-497b-b368-31c5c97cfa94 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1300 microversion: 2.1 time: 0.404146 Oct 28 18:09:22.697205 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 762/1671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:22 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1300 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:22.713813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:22.714531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:22.726487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:22.730136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:22.730635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:22.731487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:22.731985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:22.734716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:22.743772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:23.051079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:23.081936 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cd4a5657-e850-496e-812d-4875dfdce737 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.378784 Oct 28 18:09:23.082548 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 763/1672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:22 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:23.088438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:23.089317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:23.096020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.096773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.097462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.098415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.099671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.100367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.260798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:23.269206 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f69742d-84ff-4b71-bcdd-95587721d857 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.184244 Oct 28 18:09:23.269799 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 764/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:23 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:23.276385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:23.277289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:23.286981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.287626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.288106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.288823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.289309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.289737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.401676 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-18514d44-bae3-4797-86c0-5f3efa24d16b tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 1.579222 Oct 28 18:09:23.402306 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 910/1674] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:09:21 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:23.408969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:23.410223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:23.419092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.419587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.420320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.421031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.421483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.421904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.441839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:23.452174 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-479d538d-aa90-4d94-91ac-7fe2b2a70761 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.180975 Oct 28 18:09:23.452967 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 765/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:23 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:23.457410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:23.459240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:23.466948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.467440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.467894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.472045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.472561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.473015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.572770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:23.581543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:23.584202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:23.585598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8117169-4342-49a3-8288-af7df2a2a6c2 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1281 microversion: 2.25 time: 0.181858 Oct 28 18:09:23.586215 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 911/1676] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:23 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:23.591322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:23.592067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:23.598414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.599792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.600484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.601410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.602077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.602655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.623385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:23.632156 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b307b2d-de48-4d8a-9163-f0c07a90c35f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1538 microversion: 2.1 time: 0.178269 Oct 28 18:09:23.632849 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 766/1677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:23 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1538 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:23.637708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ef5a6c7-099d-4ff8-93d8-7e843657d3b4 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Calling method '.version_select at 0x7f78de2749d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:23.754217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:23.761412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:23.767665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df849b70-73ad-4c4b-b679-40c61a01d16e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1476 microversion: 2.1 time: 0.178982 Oct 28 18:09:23.768527 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 912/1678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:23 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:23.775749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7ff507c6-cb9a-4c73-abff-e2e21c0d4857 req-92fcadc5-9654-4350-8ea0-a0ddd618edf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd3df56-f1c1-4184-b1e0-96bb328259e4", "name": "network-vif-plugged", "status": "completed", "tag": "3d85b3e1-95b6-4681-b22f-7f9f3b2a693f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:23.791796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7ff507c6-cb9a-4c73-abff-e2e21c0d4857 req-92fcadc5-9654-4350-8ea0-a0ddd618edf7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.792727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7ff507c6-cb9a-4c73-abff-e2e21c0d4857 req-92fcadc5-9654-4350-8ea0-a0ddd618edf7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.793965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7ff507c6-cb9a-4c73-abff-e2e21c0d4857 req-92fcadc5-9654-4350-8ea0-a0ddd618edf7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.808815 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7ff507c6-cb9a-4c73-abff-e2e21c0d4857 req-92fcadc5-9654-4350-8ea0-a0ddd618edf7 service nova] Creating event network-vif-plugged:3d85b3e1-95b6-4681-b22f-7f9f3b2a693f for instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 on n-h2-862404-2 Oct 28 18:09:23.814826 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7ff507c6-cb9a-4c73-abff-e2e21c0d4857 req-92fcadc5-9654-4350-8ea0-a0ddd618edf7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044792 Oct 28 18:09:23.815872 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 913/1679] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:23.823096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:23.824280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:23.834037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.834782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.835270 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ef5a6c7-099d-4ff8-93d8-7e843657d3b4 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/4977c39b-69db-412b-87fd-740843f0cdc8" status: 200 len: 140 microversion: 2.1 time: 0.201322 Oct 28 18:09:23.835915 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 767/1680] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:09:23 2022] GET /compute/v2.1/os-floating-ips/4977c39b-69db-412b-87fd-740843f0cdc8 => generated 140 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:23.836309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.837087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:23.837621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:23.838117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:23.848148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d652df9b-e6a2-4d38-aebd-a3113e12bba5 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Calling method '.version_select at 0x7f78def99280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:24.000417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:24.009885 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-407840a9-de03-4db4-8284-64ed5a13fdb7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.192403 Oct 28 18:09:24.020113 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 914/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:23 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:24.034053 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d652df9b-e6a2-4d38-aebd-a3113e12bba5 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 143 microversion: 2.1 time: 0.189712 Oct 28 18:09:24.034656 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 768/1682] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:09:23 2022] GET /compute/v2.1/os-floating-ips => generated 143 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:09:24.050006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc91bf8d-a451-44cc-bfbe-dcc4698b71d2 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Calling method '.version_select at 0x7f78de4e0940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:24.119192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:24.120107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:24.126727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.127215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.127678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.128444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.128892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.129316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.281835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:24.290632 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d22ffc70-80a4-49d2-af43-28d8b1253c7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.185399 Oct 28 18:09:24.291228 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 769/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:24 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:24.301907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:24.303482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:24.310027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.310520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.311180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.312136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.312794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.313219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.459766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:24.468126 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-575a467d-a910-47f7-bb01-37ec2c69a4de tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1316 microversion: 2.1 time: 0.174875 Oct 28 18:09:24.471865 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 770/1684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:24 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:24.477230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:24.477860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:24.484080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.484573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.485010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.485720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.486175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.486608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.654682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:24.664006 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eca637af-77f5-45b0-be73-590083e1874b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.191064 Oct 28 18:09:24.665225 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 771/1685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:24 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:24.670163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:24.671043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:24.678911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.679847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.680529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.681461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.682117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.682726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.954872 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc91bf8d-a451-44cc-bfbe-dcc4698b71d2 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/4977c39b-69db-412b-87fd-740843f0cdc8" status: 202 len: 0 microversion: 2.1 time: 0.910909 Oct 28 18:09:24.955377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:24.960456 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 915/1686] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:09:24 2022] DELETE /compute/v2.1/os-floating-ips/4977c39b-69db-412b-87fd-740843f0cdc8 => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:09:24.964785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:24.965888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:24.966529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:24.967169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:24.968624 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-713e1d7a-794c-4e3e-8c90-519c67c2cd3d tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1477 microversion: 2.25 time: 0.302236 Oct 28 18:09:24.969193 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 772/1687] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:24 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:24.973408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.974388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.974836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.975353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:24.975753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.976255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.976688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.977121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:24.983477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.984310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.984819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:24.985755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:24.986269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:24.987155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:25.178255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:25.189026 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c15dd45d-9a17-4b91-b7f2-19e6b7d19928 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1538 microversion: 2.1 time: 0.227510 Oct 28 18:09:25.191789 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 916/1688] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:24 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1538 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:25.197423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0ea25ceb-0254-4178-bef7-95d95804a213 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Action: 'create', calling method: .version_select at 0x7f78de80aca0>, body: {"pool": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:25.250672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:25.261865 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f6f3e891-1d7b-4dd6-9705-8715ba05a923 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1475 microversion: 2.1 time: 0.291312 Oct 28 18:09:25.262475 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 773/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:24 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1475 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:25.444310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:25.447070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:25.458852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:25.460594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:25.461392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:25.462776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:25.463931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:25.465631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:25.853992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid e62e77c1-0b06-4b88-bcdc-feb958ad4c66 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:09:25.908474 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-01d2a5ef-25c6-49b6-83d3-145f7c3bced8 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1970 microversion: 2.25 time: 0.644657 Oct 28 18:09:25.922176 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 774/1690] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:25 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1970 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:25.923090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:25.924238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:25.937318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:25.937814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:25.938424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:25.940218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:25.941415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:25.943888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:26.310473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:26.326180 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3bc309bb-8e92-4ddd-9580-7620dd7379bd tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.412119 Oct 28 18:09:26.327509 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 775/1691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:25 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:26.333847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:26.334977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:26.343629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:26.346225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:26.346948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:26.348154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:26.349330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:26.350068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:26.723516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:26.733447 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9e3ec804-fd5c-47e5-975f-1ff7253aa4f0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.404393 Oct 28 18:09:26.743248 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 776/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:26 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:26.750088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:26.751092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:26.759403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:26.761215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:26.761638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:26.762887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:26.763360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:26.764352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:27.112076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:27.121101 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbddcc46-f6d1-4fc4-90dc-cd8756b19458 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1502 microversion: 2.1 time: 0.376369 Oct 28 18:09:27.121988 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 777/1693] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:26 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:27.127076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:27.127766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:27.134953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:27.135687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:27.136485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:27.137371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:27.137942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:27.138389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:27.434379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:27.444629 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-93ecb577-db3b-4575-8f8f-cd0fdab18413 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.321195 Oct 28 18:09:27.456769 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 778/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:27 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:27.470221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:27.471167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:27.479188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:27.480071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:27.480601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:27.481379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:27.481899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:27.482387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.079963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0ea25ceb-0254-4178-bef7-95d95804a213 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.886129 Oct 28 18:09:28.081434 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 917/1695] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:09:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:28.089259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.097364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:28.114008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.115724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.120088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.120864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.121329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.130052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.137247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid e62e77c1-0b06-4b88-bcdc-feb958ad4c66 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:09:28.166551 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-24d80840-42eb-4148-ae63-7849bbff3c6b tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1970 microversion: 2.25 time: 0.701229 Oct 28 18:09:28.167793 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 779/1696] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:27 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1970 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:28.175930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.176836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:28.183418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.184196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.184824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.185704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.186330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.186913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.323571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:28.334236 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6ee774e-7e5f-473b-b9ed-c4b049e3f596 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1533 microversion: 2.1 time: 0.251511 Oct 28 18:09:28.335865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 918/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:28 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1533 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:28.345613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-30cb1cea-b934-44f8-94d9-5e9cd94c0a9b req-4827f6ce-b00f-4c12-8e94-5448684b5d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "name": "network-vif-unplugged", "status": "completed", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:28.356919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30cb1cea-b934-44f8-94d9-5e9cd94c0a9b req-4827f6ce-b00f-4c12-8e94-5448684b5d52 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.357751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30cb1cea-b934-44f8-94d9-5e9cd94c0a9b req-4827f6ce-b00f-4c12-8e94-5448684b5d52 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.358337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30cb1cea-b934-44f8-94d9-5e9cd94c0a9b req-4827f6ce-b00f-4c12-8e94-5448684b5d52 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.373458 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-30cb1cea-b934-44f8-94d9-5e9cd94c0a9b req-4827f6ce-b00f-4c12-8e94-5448684b5d52 service nova] Creating event network-vif-unplugged:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h1-862404-2 Oct 28 18:09:28.382900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-30cb1cea-b934-44f8-94d9-5e9cd94c0a9b req-4827f6ce-b00f-4c12-8e94-5448684b5d52 service nova] Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:09:28.394644 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-30cb1cea-b934-44f8-94d9-5e9cd94c0a9b req-4827f6ce-b00f-4c12-8e94-5448684b5d52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057877 Oct 28 18:09:28.396163 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 919/1698] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:28.405253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f537dda6-19a8-42ff-9e5e-b701770d861b req-64cc0d68-0453-4c9c-9fda-eae434f99da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b66dc4-afcd-4eac-89ed-346c9bb49328", "tag": "613f75ce-54a2-40d5-bd57-1e953890b282"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:28.415652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f537dda6-19a8-42ff-9e5e-b701770d861b req-64cc0d68-0453-4c9c-9fda-eae434f99da5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.416346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f537dda6-19a8-42ff-9e5e-b701770d861b req-64cc0d68-0453-4c9c-9fda-eae434f99da5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.416881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f537dda6-19a8-42ff-9e5e-b701770d861b req-64cc0d68-0453-4c9c-9fda-eae434f99da5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.429503 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f537dda6-19a8-42ff-9e5e-b701770d861b req-64cc0d68-0453-4c9c-9fda-eae434f99da5 service nova] Creating event network-changed:613f75ce-54a2-40d5-bd57-1e953890b282 for instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 on n-h1-862404-2 Oct 28 18:09:28.434493 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f537dda6-19a8-42ff-9e5e-b701770d861b req-64cc0d68-0453-4c9c-9fda-eae434f99da5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033148 Oct 28 18:09:28.435235 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 920/1699] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:28.440447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.441032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:28.447760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.448290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.448729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.449423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.449881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.450456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.468507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:28.477825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:09:28.478283 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e9a5668-0b40-4276-b332-b0d518e1909b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1475 microversion: 2.1 time: 0.309039 Oct 28 18:09:28.479203 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 780/1700] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:28 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1475 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:28.483965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.484818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:28.490718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.491448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.492123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.493110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.493783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.494419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.500033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:28.567924 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40ea4de8-7f72-4a7b-bba4-dd920d26635a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 204 len: 0 microversion: 2.1 time: 0.130897 Oct 28 18:09:28.568568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 921/1701] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:09:28 2022] DELETE /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:09:28.577287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.578023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:28.584992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.585491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.585939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.586651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.587110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.587538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.649766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:28.659159 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-076ef9e3-9016-4a50-99b1-364354a5c81d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.178682 Oct 28 18:09:28.659761 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 781/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:28 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:28.664561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b328ce89-0d11-4455-a403-d586b6e6bd8f tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Calling method '.version_select at 0x7f78de2b13a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.732273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:28.740085 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ccbbc3c-0a42-4377-bc17-33d05c0d44ae tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.167083 Oct 28 18:09:28.740671 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 922/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:28 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:28.745226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68ab12e2-1b41-429f-bd95-eacdee852779 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.748888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68ab12e2-1b41-429f-bd95-eacdee852779 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.749375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68ab12e2-1b41-429f-bd95-eacdee852779 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.750032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68ab12e2-1b41-429f-bd95-eacdee852779 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.751429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68ab12e2-1b41-429f-bd95-eacdee852779 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.751929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68ab12e2-1b41-429f-bd95-eacdee852779 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.752361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68ab12e2-1b41-429f-bd95-eacdee852779 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.777915 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68ab12e2-1b41-429f-bd95-eacdee852779 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036222 Oct 28 18:09:28.778527 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 923/1704] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 18:09:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:09:28.783961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.784578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:28.791047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.791540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.792014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.792715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.793174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.793604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.931490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:28.940019 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5470420d-1438-499b-9d04-3626ca89d107 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1717 microversion: 2.1 time: 0.160473 Oct 28 18:09:28.940615 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 924/1705] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:28 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:28.945930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:28.946543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:28.953216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.953808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.954250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:28.959437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:28.959437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:28.959437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:29.102373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:29.110192 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25acaff6-2e6b-47f8-bf4a-69bf8c0d131e tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1508 microversion: 2.1 time: 0.168620 Oct 28 18:09:29.110873 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 925/1706] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:28 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:29.121426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862404-2", "block_migration": "auto"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:29.124016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:29.130766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:29.131242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:29.131671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:29.132390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:29.132838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:29.133256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:29.157688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'flavor' on Instance uuid e62e77c1-0b06-4b88-bcdc-feb958ad4c66 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:09:29.170675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Going to try to live migrate instance to n-h1-862404-2 {{(pid=120680) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:09:29.444007 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b328ce89-0d11-4455-a403-d586b6e6bd8f tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3a7cd293-db0f-460e-b6e0-6102135111a6" status: 202 len: 0 microversion: 2.1 time: 0.783110 Oct 28 18:09:29.444666 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 782/1707] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:09:28 2022] DELETE /compute/v2.1/os-floating-ips/3a7cd293-db0f-460e-b6e0-6102135111a6 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:09:29.449924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:29.450566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:29.456566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:29.457062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:29.457490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:29.459014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:29.459559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:29.459916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:29.600860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:29.609067 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-47f6b2cb-3a62-4750-afba-f86ec475463b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1533 microversion: 2.1 time: 0.163371 Oct 28 18:09:29.609882 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 783/1708] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:29 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1533 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:29.615206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b8a80bf4-7b52-4b84-b9ba-60f92953ec78 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Calling method '.version_select at 0x7f78def2fd30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:29.657018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-b8a80bf4-7b52-4b84-b9ba-60f92953ec78 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3a7cd293-db0f-460e-b6e0-6102135111a6 could not be found", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:09:29.657723 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-b8a80bf4-7b52-4b84-b9ba-60f92953ec78 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] HTTP exception thrown: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b8a80bf4-7b52-4b84-b9ba-60f92953ec78 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Request method failure captured: Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-floating-ips/3a7cd293-db0f-460e-b6e0-6102135111a6 HTTP/1.1 Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBrR-1REvDAiIJhI_GLtA__Zrc83y3juqE3pNWTAAmwl6zSUKnJllvcGmbZdphXky6fUkkjzTwoUfynabEOflr5KfAXTIL8ZD-fXZp2zlX15LwGUQbJSGNfKygXl8nKpFxiV_BlI9wJCf3gAmkT2tx6gcLsFX198FH6pflVMLGAj4wQ Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: ab0afbc6260b47e094dc94b45b320728 Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FloatingIPsTestJSON-797634167 Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:29.662645 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab0afbc6260b47e094dc94b45b320728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab0afbc6260b47e094dc94b45b320728"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab0afbc6260b47e094dc94b45b320728", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab0afbc6260b47e094dc94b45b320728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FloatingIPsTestJSON-797634167 Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: ab0afbc6260b47e094dc94b45b320728 Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FloatingIPsTestJSON-797634167 Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FloatingIPsTestJSON-797634167-project Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 362f10e8a0b8433495fe7aa67b7740d7 Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FloatingIPsTestJSON-797634167-project Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: exception: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '3a7cd293-db0f-460e-b6e0-6102135111a6'} Oct 28 18:09:29.664380 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:09:29.665335 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3a7cd293-db0f-460e-b6e0-6102135111a6 could not be found Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1037ee81-f3ce-4568-859b-9ef69498a2c4'] Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6. Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:29.666569 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:29.667915 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:29.669439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 Oct 28 18:09:29.669439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.669439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b8a80bf4-7b52-4b84-b9ba-60f92953ec78 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Returning 404 to user: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:29.669439 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b8a80bf4-7b52-4b84-b9ba-60f92953ec78 tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/3a7cd293-db0f-460e-b6e0-6102135111a6" status: 404 len: 111 microversion: 2.1 time: 0.053079 Oct 28 18:09:29.669439 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 784/1709] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:09:29 2022] GET /compute/v2.1/os-floating-ips/3a7cd293-db0f-460e-b6e0-6102135111a6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:29.669439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:29.669938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:29.676650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:29.677148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:29.677586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:29.678283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:29.678745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:29.679170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:29.812412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:29.820580 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-29da01f1-5b39-45b2-898e-80a1f6b82f26 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1475 microversion: 2.1 time: 0.154900 Oct 28 18:09:29.821172 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 785/1710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:29 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1475 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:29.825711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a798c71-94be-428a-b64a-ba77e53ba93e tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Calling method '.version_select at 0x7f78de5115e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:29.872647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-3a798c71-94be-428a-b64a-ba77e53ba93e tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3a7cd293-db0f-460e-b6e0-6102135111a6 could not be found", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:09:29.873344 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3a798c71-94be-428a-b64a-ba77e53ba93e tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] HTTP exception thrown: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a798c71-94be-428a-b64a-ba77e53ba93e tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Request method failure captured: Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-floating-ips/3a7cd293-db0f-460e-b6e0-6102135111a6 HTTP/1.1 Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBrR-1REvDAiIJhI_GLtA__Zrc83y3juqE3pNWTAAmwl6zSUKnJllvcGmbZdphXky6fUkkjzTwoUfynabEOflr5KfAXTIL8ZD-fXZp2zlX15LwGUQbJSGNfKygXl8nKpFxiV_BlI9wJCf3gAmkT2tx6gcLsFX198FH6pflVMLGAj4wQ Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: ab0afbc6260b47e094dc94b45b320728 Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FloatingIPsTestJSON-797634167 Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:29.875166 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab0afbc6260b47e094dc94b45b320728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ab0afbc6260b47e094dc94b45b320728"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ab0afbc6260b47e094dc94b45b320728", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ab0afbc6260b47e094dc94b45b320728"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FloatingIPsTestJSON-797634167 Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: ab0afbc6260b47e094dc94b45b320728 Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FloatingIPsTestJSON-797634167 Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FloatingIPsTestJSON-797634167-project Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 362f10e8a0b8433495fe7aa67b7740d7 Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FloatingIPsTestJSON-797634167-project Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: exception: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '3a7cd293-db0f-460e-b6e0-6102135111a6'} Oct 28 18:09:29.876805 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:09:29.878619 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3a7cd293-db0f-460e-b6e0-6102135111a6 could not be found Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53d8db3d-d4ba-480c-b1b6-90ffc0395b01'] Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6. Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:29.880464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:29.881917 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:29.883479 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 Oct 28 18:09:29.883479 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:29.883479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a798c71-94be-428a-b64a-ba77e53ba93e tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] Returning 404 to user: Floating IP not found for ID 3a7cd293-db0f-460e-b6e0-6102135111a6 {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:29.883479 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a798c71-94be-428a-b64a-ba77e53ba93e tempest-FloatingIPsTestJSON-797634167 tempest-FloatingIPsTestJSON-797634167-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3a7cd293-db0f-460e-b6e0-6102135111a6" status: 404 len: 111 microversion: 2.1 time: 0.054531 Oct 28 18:09:29.883479 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 786/1711] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:09:29 2022] DELETE /compute/v2.1/os-floating-ips/3a7cd293-db0f-460e-b6e0-6102135111a6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:29.883479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:29.883479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:29.890120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:29.890610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:29.891056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:29.891765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:29.892255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:29.892700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:30.108935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:30.118131 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-366fda59-7b29-41de-97ff-d7b3c8c261de tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.239731 Oct 28 18:09:30.119341 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 787/1712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:29 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:30.124695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:30.125312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:30.135110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:30.135936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:30.136608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:30.137394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:30.138034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:30.138535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:30.454314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:30.465601 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b5f2b224-eb12-426e-8334-bb7fb2436bb1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.344462 Oct 28 18:09:30.466209 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 788/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:30 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:30.483105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:30.483871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:30.494766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:30.495863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:30.496576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:30.497851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:30.498789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:30.499809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:30.739016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:30.749509 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-36286ec8-341a-4b47-9fa6-c653fd7e30a0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1707 microversion: 2.1 time: 0.282262 Oct 28 18:09:30.750521 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 789/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:30 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1707 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:30.755995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:30.756627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:30.762722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:30.763210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:30.763644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:30.764578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:30.765035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:30.766092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:30.887864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f9975fa21947338669ae83605610ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd919a55e8046e692f5445dfc0fb416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:30.906105 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a9013a68-9c2a-45d1-88be-b3a15b621f84 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 200 len: 1466 microversion: 2.1 time: 0.154238 Oct 28 18:09:30.907379 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 790/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:30 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:30.912975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-fac2731f-f057-45f9-8e43-4582707dd044 req-f290be12-3b4c-4b6e-a4a2-56a3183c09bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:30.935129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-fac2731f-f057-45f9-8e43-4582707dd044 req-f290be12-3b4c-4b6e-a4a2-56a3183c09bf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:30.935647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-fac2731f-f057-45f9-8e43-4582707dd044 req-f290be12-3b4c-4b6e-a4a2-56a3183c09bf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:30.936085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-fac2731f-f057-45f9-8e43-4582707dd044 req-f290be12-3b4c-4b6e-a4a2-56a3183c09bf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:30.956251 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-fac2731f-f057-45f9-8e43-4582707dd044 req-f290be12-3b4c-4b6e-a4a2-56a3183c09bf service nova] Creating event network-changed:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h1-862404-2 Oct 28 18:09:30.963282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-fac2731f-f057-45f9-8e43-4582707dd044 req-f290be12-3b4c-4b6e-a4a2-56a3183c09bf service nova] Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:09:30.975750 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-fac2731f-f057-45f9-8e43-4582707dd044 req-f290be12-3b4c-4b6e-a4a2-56a3183c09bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067007 Oct 28 18:09:30.976732 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 791/1716] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:30.983090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:30.984035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:30.996606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.000345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.001203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:31.001794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.002340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.002634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:31.458893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:31.467099 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0c71d04b-384e-45b4-b45d-59e90cba58c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1533 microversion: 2.1 time: 0.488961 Oct 28 18:09:31.467768 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 792/1717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:30 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1533 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:31.474677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5a9bdb0b-626f-43c6-a712-8314342ac391 req-8faac6ee-a9c4-4706-b5c5-c4b2b253e9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5dcb46-e496-422a-a3e3-247b17f4dc7c", "name": "network-vif-plugged", "status": "completed", "tag": "9da53e4f-eb39-4528-9721-0e8f42bb00c2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:31.487914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5a9bdb0b-626f-43c6-a712-8314342ac391 req-8faac6ee-a9c4-4706-b5c5-c4b2b253e9a0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.488482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5a9bdb0b-626f-43c6-a712-8314342ac391 req-8faac6ee-a9c4-4706-b5c5-c4b2b253e9a0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.488984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5a9bdb0b-626f-43c6-a712-8314342ac391 req-8faac6ee-a9c4-4706-b5c5-c4b2b253e9a0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:31.503902 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5a9bdb0b-626f-43c6-a712-8314342ac391 req-8faac6ee-a9c4-4706-b5c5-c4b2b253e9a0 service nova] Creating event network-vif-plugged:9da53e4f-eb39-4528-9721-0e8f42bb00c2 for instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c on n-h1-862404-2 Oct 28 18:09:31.510026 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5a9bdb0b-626f-43c6-a712-8314342ac391 req-8faac6ee-a9c4-4706-b5c5-c4b2b253e9a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040390 Oct 28 18:09:31.511033 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 793/1718] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:31.516075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1ed73660-bf27-41f9-b4e2-3122899436b0 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '.version_select at 0x7f78de9a5e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:31.520215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ed73660-bf27-41f9-b4e2-3122899436b0 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.521109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ed73660-bf27-41f9-b4e2-3122899436b0 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.521779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ed73660-bf27-41f9-b4e2-3122899436b0 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:31.540124 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1ed73660-bf27-41f9-b4e2-3122899436b0 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4233 microversion: 2.1 time: 0.027238 Oct 28 18:09:31.541074 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 794/1719] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:09:31 2022] GET /compute/v2.1/os-migrations => generated 4233 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:31.548393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:31.549133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:31.558855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.559349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.560313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:31.561017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.561657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.562244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:31.814205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:31.833824 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23c1d13e-dddd-47f8-a8b6-e919856f0c8c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1475 microversion: 2.1 time: 0.289098 Oct 28 18:09:31.834752 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 795/1720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:31 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1475 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:31.861461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-580555d2-c65e-4dbe-9282-e25d5ce78749 req-8b14c26e-115e-42c0-9603-769eaee2d897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd3df56-f1c1-4184-b1e0-96bb328259e4", "name": "network-vif-deleted", "tag": "3d85b3e1-95b6-4681-b22f-7f9f3b2a693f"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:31.887291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-580555d2-c65e-4dbe-9282-e25d5ce78749 req-8b14c26e-115e-42c0-9603-769eaee2d897 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.890369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-580555d2-c65e-4dbe-9282-e25d5ce78749 req-8b14c26e-115e-42c0-9603-769eaee2d897 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.890995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-580555d2-c65e-4dbe-9282-e25d5ce78749 req-8b14c26e-115e-42c0-9603-769eaee2d897 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:31.921843 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-580555d2-c65e-4dbe-9282-e25d5ce78749 req-8b14c26e-115e-42c0-9603-769eaee2d897 service nova] Creating event network-vif-deleted:3d85b3e1-95b6-4681-b22f-7f9f3b2a693f for instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 on n-h2-862404-2 Oct 28 18:09:31.941025 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-580555d2-c65e-4dbe-9282-e25d5ce78749 req-8b14c26e-115e-42c0-9603-769eaee2d897 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089970 Oct 28 18:09:31.948126 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 796/1721] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:31.959421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:31.964802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:31.979689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.984206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.984858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:31.986724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:31.988580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:31.989744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:32.311502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:32.320404 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-47379311-ffec-4562-a652-38d6219e8a71 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.370753 Oct 28 18:09:32.321007 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 797/1722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:31 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:32.329470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:32.332237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:32.341155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:32.342006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:32.342621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:32.343522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:32.344178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:32.344776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:32.704630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:32.714492 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13d9216d-8cfb-487b-b07b-8852a6b49f76 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.388677 Oct 28 18:09:32.728634 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 798/1723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:32 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:32.736498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:32.737354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:32.744938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:32.745729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:32.746386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:32.747281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:32.747951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:32.748861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:32.916829 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4e7c64e-0917-48fe-888c-675de4c88813 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1858 microversion: 2.1 time: 0.185224 Oct 28 18:09:32.918542 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 799/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:32 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1858 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:32.923391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:32.924030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:32.930771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:32.931256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:32.931689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:32.932424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:32.932876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:32.933297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:32.947279 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] HTTP exception thrown: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Request method failure captured: Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 HTTP/1.1 Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq6-1RXxsxcOowsaRn5ipqZlPDhE1sC94pskqFtOPTlEsY32u5xkxw7CskcvncxZwI9z1kvIViXGAAiDHajiKkX9by94LQ-WEKNqyCuQxMoNKI9QZk-omyyXqsv6ehUuf8PS17Il2HZ9UsfUMGndsbP4e9lpL_bsL60ePAXEpa4je8 Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:32.949160 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bd919a55e8046e692f5445dfc0fb416", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 04f9975fa21947338669ae83605610ea Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:32.950641 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8cd3df56-f1c1-4184-b1e0-96bb328259e4'} Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:32.951497 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:32.952989 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:32.954615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Returning 404 to user: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:32.954615 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-44751377-851c-4bc1-97de-ca17756a8d95 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 404 len: 111 microversion: 2.1 time: 0.030818 Oct 28 18:09:32.954615 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 800/1725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:32 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:32.955700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:32.956341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:32.962407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:32.962891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:32.963392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:32.964332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:32.964972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:32.965380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.110718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:33.120396 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e0cc9725-4859-4c1b-a069-66f65140b853 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1520 microversion: 2.1 time: 0.168251 Oct 28 18:09:33.121512 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 801/1726] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:32 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:33.126469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:33.127297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:33.133799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.134496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.135097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.136003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.136970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.137589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.297005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:33.305857 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-671696ec-fc3e-4235-a834-5c52ee2fc7e2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1473 microversion: 2.1 time: 0.183205 Oct 28 18:09:33.306441 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 802/1727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:33 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1473 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:33.310863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:33.311486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:33.318020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.318713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.319324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.320460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.321100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.321643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.553449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:33.559467 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b48f9e23-1a8d-431e-8336-ce46dab4dc81 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1858 microversion: 2.1 time: 0.252034 Oct 28 18:09:33.560092 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 803/1728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:33 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1858 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:33.564844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2085756584", "metadata": {"image_type": "test"}}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:33.567363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:33.573429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.573921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.574364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.575058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.575519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.576008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.595917 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] HTTP exception thrown: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Request method failure captured: Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4/action HTTP/1.1 Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 112 Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq6-1RXxsxcOowsaRn5ipqZlPDhE1sC94pskqFtOPTlEsY32u5xkxw7CskcvncxZwI9z1kvIViXGAAiDHajiKkX9by94LQ-WEKNqyCuQxMoNKI9QZk-omyyXqsv6ehUuf8PS17Il2HZ9UsfUMGndsbP4e9lpL_bsL60ePAXEpa4je8 Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:33.597894 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bd919a55e8046e692f5445dfc0fb416", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 04f9975fa21947338669ae83605610ea Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2085756584", "metadata": {"image_type": "test"}}} Oct 28 18:09:33.600246 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8cd3df56-f1c1-4184-b1e0-96bb328259e4', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2085756584', 'metadata': {'image_type': 'test'}}}} Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:33.601293 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:33.602814 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:33.604604 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:33.604604 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:33.604604 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:33.604604 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:33.604604 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:33.605759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Returning 404 to user: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:33.606781 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8966e316-c3b7-4ad5-a849-f94f2ed3fe03 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "POST /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4/action" status: 404 len: 111 microversion: 2.1 time: 0.045761 Oct 28 18:09:33.607543 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 804/1729] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 18:09:33 2022] POST /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:33.612415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:33.613125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:33.620158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.620660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.621154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.621871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.622521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.623120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.661665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:09:33.765697 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b0ea63a-dfda-4a2c-b6b3-e4f439fc2678 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 204 len: 0 microversion: 2.1 time: 0.156462 Oct 28 18:09:33.767119 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 805/1730] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:09:33 2022] DELETE /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:09:33.777934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:33.778949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:33.794388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.795051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.795575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.796403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.797074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.797817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.081706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:34.090565 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a02228c-2300-4cd2-8b5d-984631f81ead tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.321756 Oct 28 18:09:34.091215 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 806/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:33 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:34.095640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-19a06def-85f0-45e4-83ca-9e5f6924bbd5 req-5aa366b1-c6c2-442e-9548-43e29f71eeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc86d75-014e-43a2-956b-03e203fba456", "name": "network-vif-unplugged", "status": "completed", "tag": "0225049a-d33b-439d-aef3-99aa74ba5f5a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:34.101134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:34.106929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-19a06def-85f0-45e4-83ca-9e5f6924bbd5 req-5aa366b1-c6c2-442e-9548-43e29f71eeaa service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.107502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-19a06def-85f0-45e4-83ca-9e5f6924bbd5 req-5aa366b1-c6c2-442e-9548-43e29f71eeaa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.108023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-19a06def-85f0-45e4-83ca-9e5f6924bbd5 req-5aa366b1-c6c2-442e-9548-43e29f71eeaa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.125900 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-19a06def-85f0-45e4-83ca-9e5f6924bbd5 req-5aa366b1-c6c2-442e-9548-43e29f71eeaa service nova] Creating event network-vif-unplugged:0225049a-d33b-439d-aef3-99aa74ba5f5a for instance 1dc86d75-014e-43a2-956b-03e203fba456 on n-h1-862404-2 Oct 28 18:09:34.132623 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-19a06def-85f0-45e4-83ca-9e5f6924bbd5 req-5aa366b1-c6c2-442e-9548-43e29f71eeaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040186 Oct 28 18:09:34.133562 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 807/1732] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:34.139251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9df25bc2-c87e-4616-8af4-408a07d641d6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-659246708", "metadata": {"image_type": "test"}}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9df25bc2-c87e-4616-8af4-408a07d641d6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Failed to fetch instance by id tempest-invalid-6107943 {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2983}} Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9df25bc2-c87e-4616-8af4-408a07d641d6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] HTTP exception thrown: Instance tempest-invalid-6107943 could not be found. Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9df25bc2-c87e-4616-8af4-408a07d641d6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Request method failure captured: Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/tempest-invalid-6107943/action HTTP/1.1 Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 111 Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq6-1RXxsxcOowsaRn5ipqZlPDhE1sC94pskqFtOPTlEsY32u5xkxw7CskcvncxZwI9z1kvIViXGAAiDHajiKkX9by94LQ-WEKNqyCuQxMoNKI9QZk-omyyXqsv6ehUuf8PS17Il2HZ9UsfUMGndsbP4e9lpL_bsL60ePAXEpa4je8 Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:34.144761 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bd919a55e8046e692f5445dfc0fb416", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 04f9975fa21947338669ae83605610ea Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-659246708", "metadata": {"image_type": "test"}}} Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:34.153741 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance tempest-invalid-6107943 could not be found. Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'tempest-invalid-6107943', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-659246708', 'metadata': {'image_type': 'test'}}}} Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2984, in get Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-6107943 could not be found. Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:34.154745 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-6107943 could not be found. Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-6107943 could not be found. Oct 28 18:09:34.156780 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.159658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9df25bc2-c87e-4616-8af4-408a07d641d6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Returning 404 to user: Instance tempest-invalid-6107943 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:34.159658 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9df25bc2-c87e-4616-8af4-408a07d641d6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-6107943/action" status: 404 len: 98 microversion: 2.1 time: 0.010700 Oct 28 18:09:34.159658 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 808/1733] 10.222.0.16 () {60 vars in 1240 bytes} [Fri Oct 28 18:09:34 2022] POST /compute/v2.1/servers/tempest-invalid-6107943/action => generated 98 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:09:34.159658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:34.159658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:34.162337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.162713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.163279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.164033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.164500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.164929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.300590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lazy-loading 'services' on Instance uuid 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:09:34.417009 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a50a3a43-8e57-4177-8c1d-0a08645bbc50 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments/4653a318-4162-49ce-8ba9-7f963a8548e3" status: 202 len: 0 microversion: 2.1 time: 0.268828 Oct 28 18:09:34.420886 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 809/1734] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:09:34 2022] DELETE /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments/4653a318-4162-49ce-8ba9-7f963a8548e3 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:09:34.426385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:34.427869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:34.449869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.450788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.451354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.453268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.453915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.454726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.625855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:34.634623 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-abe2766b-f1a5-4d73-9f5a-6b9c8e92b22c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.215149 Oct 28 18:09:34.650405 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 810/1735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:34 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:34.650405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:34.650405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:34.650405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.651043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.651043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.651043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.651043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.651410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.788104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:34.795787 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-048f8474-b60d-44f7-b739-f6e1ba9e5696 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1526 microversion: 2.1 time: 0.159251 Oct 28 18:09:34.796379 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 811/1736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:34 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1526 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:34.801225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a025ef9a-bad3-4325-8c9a-f4c3efc47ed4 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-653153244"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:34.803918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a025ef9a-bad3-4325-8c9a-f4c3efc47ed4 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2983}} Oct 28 18:09:34.804502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-a025ef9a-bad3-4325-8c9a-f4c3efc47ed4 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a025ef9a-bad3-4325-8c9a-f4c3efc47ed4 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Request method failure captured: Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 56 Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq6-1RXxsxcOowsaRn5ipqZlPDhE1sC94pskqFtOPTlEsY32u5xkxw7CskcvncxZwI9z1kvIViXGAAiDHajiKkX9by94LQ-WEKNqyCuQxMoNKI9QZk-omyyXqsv6ehUuf8PS17Il2HZ9UsfUMGndsbP4e9lpL_bsL60ePAXEpa4je8 Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:34.806126 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bd919a55e8046e692f5445dfc0fb416", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 04f9975fa21947338669ae83605610ea Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: {"createImage": {"name": "tempest-test-snap-653153244"}} Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:34.807572 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-653153244'}}} Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2984, in get Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:34.808835 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:34.810151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:34.811384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a025ef9a-bad3-4325-8c9a-f4c3efc47ed4 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:34.811384 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a025ef9a-bad3-4325-8c9a-f4c3efc47ed4 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010173 Oct 28 18:09:34.813378 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 812/1737] 10.222.0.16 () {60 vars in 1275 bytes} [Fri Oct 28 18:09:34 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:34.818877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:34.819487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:34.826434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.826923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.827362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.829878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:34.830349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:34.830783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:34.978447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:34.987317 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b08d0b40-0d8e-40bc-b3a9-be9339bfb032 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1473 microversion: 2.1 time: 0.172847 Oct 28 18:09:34.988233 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 813/1738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:34 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1473 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:34.993453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:34.995754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:35.001844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.002447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.003089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.004009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.004734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.006272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.042765 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1764a22-905d-4356-92ed-b12f1329190a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053399 Oct 28 18:09:35.043278 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 814/1739] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:09:34 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:35.058538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a708c280-dd9e-41eb-b283-ba2b00d1630a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2114945976"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:35.061249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a708c280-dd9e-41eb-b283-ba2b00d1630a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2983}} Oct 28 18:09:35.062008 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-a708c280-dd9e-41eb-b283-ba2b00d1630a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a708c280-dd9e-41eb-b283-ba2b00d1630a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Request method failure captured: Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 57 Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq6-1RXxsxcOowsaRn5ipqZlPDhE1sC94pskqFtOPTlEsY32u5xkxw7CskcvncxZwI9z1kvIViXGAAiDHajiKkX9by94LQ-WEKNqyCuQxMoNKI9QZk-omyyXqsv6ehUuf8PS17Il2HZ9UsfUMGndsbP4e9lpL_bsL60ePAXEpa4je8 Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:35.064562 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bd919a55e8046e692f5445dfc0fb416", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 04f9975fa21947338669ae83605610ea Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: {"createImage": {"name": "tempest-test-snap-2114945976"}} Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:35.067024 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2114945976'}}} Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2984, in get Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:35.069845 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 18:09:35.071186 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.072556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a708c280-dd9e-41eb-b283-ba2b00d1630a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:35.074118 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a708c280-dd9e-41eb-b283-ba2b00d1630a tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.019619 Oct 28 18:09:35.074979 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 815/1740] 10.222.0.16 () {60 vars in 1281 bytes} [Fri Oct 28 18:09:35 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:35.084809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:35.085376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:35.092778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.093276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.093722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.094441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.095033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.095524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.110690 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] HTTP exception thrown: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Request method failure captured: Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 HTTP/1.1 Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq6-1RXxsxcOowsaRn5ipqZlPDhE1sC94pskqFtOPTlEsY32u5xkxw7CskcvncxZwI9z1kvIViXGAAiDHajiKkX9by94LQ-WEKNqyCuQxMoNKI9QZk-omyyXqsv6ehUuf8PS17Il2HZ9UsfUMGndsbP4e9lpL_bsL60ePAXEpa4je8 Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:35.112523 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bd919a55e8046e692f5445dfc0fb416", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 04f9975fa21947338669ae83605610ea Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.114524 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8cd3df56-f1c1-4184-b1e0-96bb328259e4'} Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:35.115379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.118033 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.121145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Returning 404 to user: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:35.121145 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d30b2c7b-0aeb-4fc1-be25-4f9ecdf46db6 tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 404 len: 111 microversion: 2.1 time: 0.034166 Oct 28 18:09:35.121145 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 816/1741] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:09:35 2022] DELETE /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:09:35.129060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:35.130640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:35.139057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.139603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.140055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.140764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.142034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.142968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.316957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:35.325121 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-846fffb0-9040-4441-b30a-c328ae56d8a7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.201676 Oct 28 18:09:35.335841 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 817/1742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:35 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:35.335841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:35.335841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] [instance: 8cd3df56-f1c1-4184-b1e0-96bb328259e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:35.344233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.344233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.344233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.344233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.344724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.344724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.363579 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] HTTP exception thrown: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Request method failure captured: Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 HTTP/1.1 Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq6-1RXxsxcOowsaRn5ipqZlPDhE1sC94pskqFtOPTlEsY32u5xkxw7CskcvncxZwI9z1kvIViXGAAiDHajiKkX9by94LQ-WEKNqyCuQxMoNKI9QZk-omyyXqsv6ehUuf8PS17Il2HZ9UsfUMGndsbP4e9lpL_bsL60ePAXEpa4je8 Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:35.366243 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2bd919a55e8046e692f5445dfc0fb416", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2bd919a55e8046e692f5445dfc0fb416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2bd919a55e8046e692f5445dfc0fb416 Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-340355991 Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 04f9975fa21947338669ae83605610ea Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesNegativeTestJSON-340355991-project Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.367744 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8cd3df56-f1c1-4184-b1e0-96bb328259e4'} Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:35.368877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. Oct 28 18:09:35.370366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:35.376210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] Returning 404 to user: Instance 8cd3df56-f1c1-4184-b1e0-96bb328259e4 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:35.377176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5c336982-03b9-4006-9cfd-0df002d6c8cc tempest-ImagesNegativeTestJSON-340355991 tempest-ImagesNegativeTestJSON-340355991-project] 10.222.0.16 "GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4" status: 404 len: 111 microversion: 2.1 time: 0.050177 Oct 28 18:09:35.377777 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 818/1743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:35 2022] GET /compute/v2.1/servers/8cd3df56-f1c1-4184-b1e0-96bb328259e4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:35.660246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:35.661131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:35.669332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.669884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.670336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.671084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:35.671550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:35.672063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:35.995518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:36.010751 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-84cdbf47-75e1-48ac-9ca7-a66d2ffe9716 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.356089 Oct 28 18:09:36.022609 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 819/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:35 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:36.022609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:36.022609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:36.029928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:36.031327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:36.031327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:36.032185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:36.032749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:36.033243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:36.334429 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e3bf8c9c-3297-4e15-b41d-db764701401f tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66/action" status: 202 len: 0 microversion: 2.25 time: 7.216776 Oct 28 18:09:36.338896 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 926/1745] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:09:29 2022] POST /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66/action => generated 0 bytes in 7227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:09:36.348192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:36.350439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:36.360676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:36.361788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:36.362487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:36.363492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:36.364540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:36.365392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:36.752853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:36.765236 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5360f9df-f32f-4fc2-b0ea-6d4eff363a39 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1526 microversion: 2.1 time: 0.751634 Oct 28 18:09:36.780090 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 820/1746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:36 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1526 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:36.796710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:36.809725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:36.823986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:36.824689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:36.825325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:36.826412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:36.827302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:36.828135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:36.872887 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-172df040-2bf5-4176-96bd-507eac8be7ab tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078147 Oct 28 18:09:36.873994 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 821/1747] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:09:36 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:36.886889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:36.888228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:36.896251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:36.897241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:36.897241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:36.898216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:36.900707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:36.901252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:36.979522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:36.989829 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a52418e2-04c2-4cb1-8817-5cd49f9689d6 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1473 microversion: 2.1 time: 0.647402 Oct 28 18:09:36.992417 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 927/1748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:36 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1473 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:37.006136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:37.007159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:37.017724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.018416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.019978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.023007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.023651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.024584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.146070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:37.160436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:37.163471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:37.178923 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bac7a9fc-43b4-4674-80a2-0feec6ebe648 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.289679 Oct 28 18:09:37.178923 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 822/1749] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:36 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:37.184291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:37.184291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:37.194985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.195631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.196331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.197099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.197554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.198313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.531411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:37.535707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:37.543106 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c41ffdb2-1242-4617-a803-2ba0b0032227 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1307 microversion: 2.1 time: 0.375936 Oct 28 18:09:37.543863 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 823/1750] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:37 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:37.561954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c811d540-e5a0-40f5-88be-6f56a789794a req-39ab43cf-2809-47c1-9e5c-f92dd9cc32c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b66dc4-afcd-4eac-89ed-346c9bb49328", "name": "network-vif-plugged", "status": "completed", "tag": "613f75ce-54a2-40d5-bd57-1e953890b282"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:37.572995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c811d540-e5a0-40f5-88be-6f56a789794a req-39ab43cf-2809-47c1-9e5c-f92dd9cc32c4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.573548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c811d540-e5a0-40f5-88be-6f56a789794a req-39ab43cf-2809-47c1-9e5c-f92dd9cc32c4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.574899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c811d540-e5a0-40f5-88be-6f56a789794a req-39ab43cf-2809-47c1-9e5c-f92dd9cc32c4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.586564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:37.600695 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff1490e0-4b73-423d-9e0c-1ddc9006ad96 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.606933 Oct 28 18:09:37.602067 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 928/1751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:36 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:37.617839 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c811d540-e5a0-40f5-88be-6f56a789794a req-39ab43cf-2809-47c1-9e5c-f92dd9cc32c4 service nova] Creating event network-vif-plugged:613f75ce-54a2-40d5-bd57-1e953890b282 for instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 on n-h1-862404-2 Oct 28 18:09:37.623850 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c811d540-e5a0-40f5-88be-6f56a789794a req-39ab43cf-2809-47c1-9e5c-f92dd9cc32c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078962 Oct 28 18:09:37.624776 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 824/1752] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:37.799690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:37.800728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:37.803208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:37.809559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.810448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.811121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.812135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.812816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.814094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.886856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:37.889203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:37.897291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.897789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.898235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.899321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:37.899480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:37.899865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:37.935777 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c38b946-4316-409d-8d26-b92a23fa24f9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052610 Oct 28 18:09:37.937138 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 825/1753] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:09:37 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:38.018984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:38.019616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:38.026769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:38.027268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:38.027712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:38.029402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:38.029870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:38.030329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:38.448613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:38.457423 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43b276e5-0636-4117-82d9-efe27b62da12 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1470 microversion: 2.1 time: 0.442486 Oct 28 18:09:38.471999 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 826/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:38 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:38.480541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:38.480541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:38.497641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:38.498055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:38.501933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:38.503119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:38.505515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:38.506909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:38.761522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:39.049521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:39.059385 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a6445a2-f29a-474c-891d-555d8af33488 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1526 microversion: 2.1 time: 1.263998 Oct 28 18:09:39.084762 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 929/1755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:37 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1526 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:39.100277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:39.102123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:39.122892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:39.123754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:39.124468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:39.126471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:39.127360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:39.128037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:39.190046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:39.423584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cc72178-8155-4d6b-9938-b1a8fbc51940 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "POST /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028/action" status: 202 len: 0 microversion: 2.1 time: 0.336192 Oct 28 18:09:39.426170 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 930/1756] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:09:39 2022] POST /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:09:39.440876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:39.444711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:39.462544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:39.463263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:39.463994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:39.466751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:39.468695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:39.469279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:39.609514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:39.623117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:39.627716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:39.638779 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbbf21f1-9141-43c8-90d0-bc0116d19a91 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 1.165087 Oct 28 18:09:39.660406 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 827/1757] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:38 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:39.667109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:39.668145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:39.678258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:39.679133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:39.679793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:39.680761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:39.681466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:39.682112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.008315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:40.022437 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f050b2e-f56c-4f44-a812-863dd3b72c99 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1488 microversion: 2.1 time: 0.589894 Oct 28 18:09:40.023476 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 931/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:39 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1488 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:40.044173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:40.046946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:40.058424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.059355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.060741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.061715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.064646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.065389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.137103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-de35625e-20be-4363-8364-1190d8b7b776 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112114 Oct 28 18:09:40.141277 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 932/1759] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:09:40 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:40.153836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:40.154661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:40.169650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.170498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.171710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.174008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.175931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.177837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.282336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:40.291917 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09f0a6af-9802-4a74-95c7-cd8edbbbd4b1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.629600 Oct 28 18:09:40.298432 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 828/1760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:39 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:40.306929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:40.310078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:40.323040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.325098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.325885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.326835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.330285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.330973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.397526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:09:40.599880 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42aa238f-661d-4996-a06a-7b7174b5b833 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 204 len: 0 microversion: 2.1 time: 0.299712 Oct 28 18:09:40.601421 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 829/1761] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:09:40 2022] DELETE /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:09:40.607528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:40.613500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:40.628709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.629203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.629679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.630387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.630840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.631267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.037051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:41.046405 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-170e4be3-deb3-4097-872f-3336a76c7884 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1526 microversion: 2.1 time: 0.443555 Oct 28 18:09:41.060612 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 830/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:40 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1526 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:41.075175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:41.078699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:41.092969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.093900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.097109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.098402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.099237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.102993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.199224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:41.216742 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a0d46ca-79e7-4bbe-9cc3-dcd8775b89a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 1.073903 Oct 28 18:09:41.217766 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 933/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:40 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:41.222599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:41.223754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:41.247577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.248150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.248807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.249698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.251646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.252284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.476465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:41.484532 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-acf0c9bc-e74f-48e8-8014-49ea4fffaf44 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1494 microversion: 2.1 time: 0.422103 Oct 28 18:09:41.486753 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 831/1764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:41 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1494 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:41.501025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-793b9dfb-35f4-4e27-8e49-4171dd019744 req-6f7b1abb-bac7-47f3-a349-4fe355bfa059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "name": "network-vif-plugged", "status": "completed", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:41.521371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-793b9dfb-35f4-4e27-8e49-4171dd019744 req-6f7b1abb-bac7-47f3-a349-4fe355bfa059 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.522222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-793b9dfb-35f4-4e27-8e49-4171dd019744 req-6f7b1abb-bac7-47f3-a349-4fe355bfa059 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.522867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-793b9dfb-35f4-4e27-8e49-4171dd019744 req-6f7b1abb-bac7-47f3-a349-4fe355bfa059 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.536835 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-793b9dfb-35f4-4e27-8e49-4171dd019744 req-6f7b1abb-bac7-47f3-a349-4fe355bfa059 service nova] Creating event network-vif-plugged:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h1-862404-2 Oct 28 18:09:41.544173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-793b9dfb-35f4-4e27-8e49-4171dd019744 req-6f7b1abb-bac7-47f3-a349-4fe355bfa059 service nova] Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:09:41.557064 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-793b9dfb-35f4-4e27-8e49-4171dd019744 req-6f7b1abb-bac7-47f3-a349-4fe355bfa059 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068625 Oct 28 18:09:41.560717 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 832/1765] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:41.567692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e1f81b7a-ee05-4f32-8b02-99bd42fb06c4 req-080bc605-150a-4623-994a-9c0f72c7327d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc86d75-014e-43a2-956b-03e203fba456", "name": "network-vif-deleted", "tag": "0225049a-d33b-439d-aef3-99aa74ba5f5a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:41.578273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e1f81b7a-ee05-4f32-8b02-99bd42fb06c4 req-080bc605-150a-4623-994a-9c0f72c7327d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.579287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e1f81b7a-ee05-4f32-8b02-99bd42fb06c4 req-080bc605-150a-4623-994a-9c0f72c7327d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.579729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e1f81b7a-ee05-4f32-8b02-99bd42fb06c4 req-080bc605-150a-4623-994a-9c0f72c7327d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.595365 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e1f81b7a-ee05-4f32-8b02-99bd42fb06c4 req-080bc605-150a-4623-994a-9c0f72c7327d service nova] Creating event network-vif-deleted:0225049a-d33b-439d-aef3-99aa74ba5f5a for instance 1dc86d75-014e-43a2-956b-03e203fba456 on n-h1-862404-2 Oct 28 18:09:41.605753 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e1f81b7a-ee05-4f32-8b02-99bd42fb06c4 req-080bc605-150a-4623-994a-9c0f72c7327d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042583 Oct 28 18:09:41.606693 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 833/1766] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:41.612273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:41.615100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:41.619025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:41.622185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.623579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.624473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.625379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.626291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.626910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.631856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:41.633800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:41.635137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-254653b6-45c5-4fea-9a28-9c97496c4502 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.416857 Oct 28 18:09:41.636352 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 934/1767] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:41 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:41.641322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:41.642183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:41.649492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.650763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.651367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.652444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.653422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.654559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.677590 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-73ef59b8-9161-4bc6-bc8b-3e95f6095574 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069171 Oct 28 18:09:41.678850 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 834/1768] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:09:41 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:09:42.080891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:42.083052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:42.105689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:42.108094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:42.110208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:42.112114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:42.116231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:42.116893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:42.227064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:42.247213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c9e52d5-0dc5-43f2-9cea-d0ccc9cdfc9f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1367 microversion: 2.1 time: 0.609169 Oct 28 18:09:42.249318 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 935/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:41 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1367 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:42.258696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:42.261350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:42.278521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:42.279267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:42.280004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:42.281192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:42.281315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:42.281721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:42.386880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:42.403436 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bf428266-e68d-4886-bb8a-097fda3d0793 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 200 len: 1309 microversion: 2.1 time: 0.324746 Oct 28 18:09:42.422223 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 835/1770] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:42 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:42.513537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:42.514851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:42.525956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:42.528225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:42.530008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:42.531010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:42.536958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:42.537961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:44.082308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:44.104633 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c67c3d42-0dfb-42da-aff3-4f746d16e1e3 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1494 microversion: 2.1 time: 1.596392 Oct 28 18:09:44.106096 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 836/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:42 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1494 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:44.132578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:44.135196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:44.170744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:44.173862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:44.175134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:44.176830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:44.178052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:44.190419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:44.387391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:44.422804 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e848e7bb-4967-4f19-b3e9-1cef229b2601 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 2.172143 Oct 28 18:09:44.428697 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 936/1772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:42 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:44.441148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:44.446996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:44.465926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:44.466717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:44.467330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:44.468322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:44.468952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:44.469545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.031444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:45.064021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:45.071303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:45.073277 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a10a2c6a-69ea-4d35-aaba-c6d858b5b61b tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.951218 Oct 28 18:09:45.089878 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 837/1773] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:44 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:45.111774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:45.117441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:45.136122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.139554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.140508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.141414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.142209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.143430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.212536 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 HTTP/1.1 Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:09:45.219007 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:09:45.220671 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1dc86d75-014e-43a2-956b-03e203fba456'} Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:45.221607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:09:45.223690 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:09:45.228375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:45.230716 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7234af4b-eee5-4309-9f60-77efc1e6a76f tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 404 len: 111 microversion: 2.1 time: 0.132478 Oct 28 18:09:45.237510 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 838/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:45 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:45.261808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c7be79a1-2f33-4f76-8a05-86e537b53be7 req-da9aae61-9618-47d5-926e-be63bb69ec82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5dcb46-e496-422a-a3e3-247b17f4dc7c", "name": "network-vif-deleted", "tag": "9da53e4f-eb39-4528-9721-0e8f42bb00c2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:45.305692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c7be79a1-2f33-4f76-8a05-86e537b53be7 req-da9aae61-9618-47d5-926e-be63bb69ec82 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.306457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c7be79a1-2f33-4f76-8a05-86e537b53be7 req-da9aae61-9618-47d5-926e-be63bb69ec82 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.307240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c7be79a1-2f33-4f76-8a05-86e537b53be7 req-da9aae61-9618-47d5-926e-be63bb69ec82 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.338458 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c7be79a1-2f33-4f76-8a05-86e537b53be7 req-da9aae61-9618-47d5-926e-be63bb69ec82 service nova] Creating event network-vif-deleted:9da53e4f-eb39-4528-9721-0e8f42bb00c2 for instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c on n-h1-862404-2 Oct 28 18:09:45.353326 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c7be79a1-2f33-4f76-8a05-86e537b53be7 req-da9aae61-9618-47d5-926e-be63bb69ec82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112538 Oct 28 18:09:45.355978 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 839/1775] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:45.366479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:45.374089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:45.389528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.394927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.397208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.398284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.400665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.401368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.450783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:45.475251 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af51b69c-cd22-438b-8640-dc49841d9b40 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1557 microversion: 2.1 time: 1.037873 Oct 28 18:09:45.476479 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 937/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:44 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1557 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:45.495965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:45.497418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:45.518219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.518919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.519461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.521074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lazy-loading 'fault' on Instance uuid 7e5dcb46-e496-422a-a3e3-247b17f4dc7c {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:09:45.521482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.535319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.536472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.539910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.541896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.543360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.663416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:45.674866 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ebea5170-9678-4853-9284-cb15dcc4c2e4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1297 microversion: 2.1 time: 0.317247 Oct 28 18:09:45.681364 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 840/1777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:45 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1297 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:45.694840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:45.697708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:45.710241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.712096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.713754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.716485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:45.717924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:45.718617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:45.767912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:46.041635 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5776175d-8862-4507-9539-492ea2c28cc8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.358342 Oct 28 18:09:46.042769 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 841/1778] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:09:45 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-interface => generated 285 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:46.053796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1664519759", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:46.196428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] validate_networks() for [('c36cbffa-a0c0-4bdf-bdca-7ec3fa5b33e3', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:09:46.257603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:46.269906 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-555627a6-d649-4d02-9cfd-b57f36b5a5a7 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 0.792044 Oct 28 18:09:46.271777 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 938/1779] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:45 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:46.289798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:46.291651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:46.306605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:46.309396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:46.312201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:46.313576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:46.316244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:46.318900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:46.933929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:09:46.934355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:09:46.934832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:09:46.935244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:09:46.935844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:09:46.950223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:46.950748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:46.951160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:46.951924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:46.952389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:46.952819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:46.983166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Getting quotas for project 58e02d11d4c64d8989eaec758233f04f. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:09:46.994363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Getting quotas for user 4245221a863a4ba7969c508342e27fdc and project 58e02d11d4c64d8989eaec758233f04f. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:09:47.008733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:09:47.012290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:09:47.081708 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1ec66475-19c4-4c86-8855-939e525b94e9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.036747 Oct 28 18:09:47.085342 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 842/1780] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:09:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:09:47.095233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:47.103254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:47.153309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:47.154939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:47.157771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:47.158717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:47.166323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:47.168763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:47.169060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:47.170672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:47.173391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:47.175642 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4fd47cc3-65f3-46b3-a832-635f9f95ba70 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.902633 Oct 28 18:09:47.187882 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 939/1781] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:46 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:47.196877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d7481c3-1511-44e7-9a83-5b605ed6c265 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:47.200691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d7481c3-1511-44e7-9a83-5b605ed6c265 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:47.252616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:47.252616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:47.253388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:47.253513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lazy-loading 'fault' on Instance uuid 7e5dcb46-e496-422a-a3e3-247b17f4dc7c {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:09:47.341934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:47.351165 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-19ad8df6-2951-4676-905c-6aa04ccb6427 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 200 len: 1297 microversion: 2.1 time: 0.262314 Oct 28 18:09:47.351769 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 843/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:47 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 1297 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:47.389803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:47.390424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:47.424498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:47.425003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:47.425439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:47.426882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:47.427428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:47.427871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:47.759961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:47.771258 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bed93546-b05c-432e-afa7-53a08a62c59f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 0.403946 Oct 28 18:09:47.794331 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 844/1783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:47 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:47.925823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d7481c3-1511-44e7-9a83-5b605ed6c265 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:47.940481 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d7481c3-1511-44e7-9a83-5b605ed6c265 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1225 microversion: 2.1 time: 0.757817 Oct 28 18:09:47.941431 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 940/1784] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:47 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1225 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:48.206882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:48.208596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:48.229354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:48.232793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:48.233344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:48.234097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:48.234567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:48.235000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:48.380639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:48.383591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:48.437954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:48.438836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:48.443466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:48.448609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:48.449789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:48.451605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:48.498207 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c HTTP/1.1 Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:09:48.503940 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:09:48.505643 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '7e5dcb46-e496-422a-a3e3-247b17f4dc7c'} Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:48.506551 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:09:48.508010 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:09:48.509288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:48.509288 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30510a15-12b5-4219-98cd-9470e4e48c4d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 404 len: 111 microversion: 2.1 time: 0.131446 Oct 28 18:09:48.511232 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 941/1785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:48 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:09:48.523941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f41cee8-0ec0-4c98-9245-c5ffc64b6ae2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78de4cd940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:48.594200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:48.610973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:48.612847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:48.620854 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a61ff751-ed35-4aea-b614-fcdd2c1c09cb tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.418515 Oct 28 18:09:48.621751 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 845/1786] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:48 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:09:48.804178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:48.805166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:48.814002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:48.815601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:48.817821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:48.825435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:48.827250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:48.830751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:49.385724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:49.404424 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-51fd22ea-3663-4ec0-bd63-ddbae637e6ff tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 0.605265 Oct 28 18:09:49.407803 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 846/1787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:48 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:49.418456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:49.429467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:49.456930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:49.460419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:49.461158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:49.464661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:49.466209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:49.468370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:49.656630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:49.669398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c0a10fd-46fe-490f-9853-a47ba25dc915 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1277 microversion: 2.1 time: 0.260208 Oct 28 18:09:49.680679 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 847/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:49 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:49.685665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:49.699610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:49.701603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:49.730892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:49.731481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:49.731854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:49.732588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:49.733041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:49.733528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:50.438273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:50.463308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:50.468785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:50.474243 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-02439642-b5d4-44c2-a0cc-d4882477763e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.792230 Oct 28 18:09:50.476082 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 848/1789] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:49 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:50.499290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:50.499798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:50.528315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:50.531071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:50.533389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:50.534983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:50.536996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:50.540773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:50.916141 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f41cee8-0ec0-4c98-9245-c5ffc64b6ae2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 204 len: 0 microversion: 2.1 time: 2.403091 Oct 28 18:09:50.916730 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 942/1790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:48 2022] DELETE /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 0 bytes in 2405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:09:51.110881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:51.122781 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f97dccc6-d81f-4790-a962-1df277a9ad01 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 0.643951 Oct 28 18:09:51.126588 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 849/1791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:50 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:51.133654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:51.137372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:51.168722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.169568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.170635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.173117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.173847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.178120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.262344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1598444601", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:51.384620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:09:51.395259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:51.409963 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50cd69e3-02c9-42c3-814b-12ec8c412e17 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1283 microversion: 2.1 time: 0.279930 Oct 28 18:09:51.412109 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 850/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:51 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1283 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:51.425844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:51.428109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:51.448195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.449729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.452170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.458327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.459183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.462446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.565479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:09:51.743022 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-512ec418-7d39-425f-a7a1-1961b3ff273a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 204 len: 0 microversion: 2.1 time: 0.329262 Oct 28 18:09:51.744700 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 851/1793] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:09:51 2022] DELETE /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:09:51.783019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-83e7c8bd-52c3-4624-b6a3-5d7f6cf66c2d req-7ba2b621-7281-4ca5-97c4-d5f0d90831a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "name": "network-vif-unplugged", "status": "completed", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:51.800521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-83e7c8bd-52c3-4624-b6a3-5d7f6cf66c2d req-7ba2b621-7281-4ca5-97c4-d5f0d90831a0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.802906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-83e7c8bd-52c3-4624-b6a3-5d7f6cf66c2d req-7ba2b621-7281-4ca5-97c4-d5f0d90831a0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.803622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-83e7c8bd-52c3-4624-b6a3-5d7f6cf66c2d req-7ba2b621-7281-4ca5-97c4-d5f0d90831a0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.820550 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-83e7c8bd-52c3-4624-b6a3-5d7f6cf66c2d req-7ba2b621-7281-4ca5-97c4-d5f0d90831a0 service nova] Creating event network-vif-unplugged:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h2-862404-2 Oct 28 18:09:51.828315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-83e7c8bd-52c3-4624-b6a3-5d7f6cf66c2d req-7ba2b621-7281-4ca5-97c4-d5f0d90831a0 service nova] Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:09:51.844942 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-83e7c8bd-52c3-4624-b6a3-5d7f6cf66c2d req-7ba2b621-7281-4ca5-97c4-d5f0d90831a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098267 Oct 28 18:09:51.846129 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 852/1794] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:51.856157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-40c46cda-cf0f-44c6-83f9-5e6c1b60a921 req-9b58d56a-d3c4-46c8-a843-73d6217f55db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b66dc4-afcd-4eac-89ed-346c9bb49328", "tag": "613f75ce-54a2-40d5-bd57-1e953890b282"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:51.868542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-40c46cda-cf0f-44c6-83f9-5e6c1b60a921 req-9b58d56a-d3c4-46c8-a843-73d6217f55db service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.869301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-40c46cda-cf0f-44c6-83f9-5e6c1b60a921 req-9b58d56a-d3c4-46c8-a843-73d6217f55db service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.870150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-40c46cda-cf0f-44c6-83f9-5e6c1b60a921 req-9b58d56a-d3c4-46c8-a843-73d6217f55db service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.891670 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-40c46cda-cf0f-44c6-83f9-5e6c1b60a921 req-9b58d56a-d3c4-46c8-a843-73d6217f55db service nova] Creating event network-changed:613f75ce-54a2-40d5-bd57-1e953890b282 for instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 on n-h1-862404-2 Oct 28 18:09:51.903338 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-40c46cda-cf0f-44c6-83f9-5e6c1b60a921 req-9b58d56a-d3c4-46c8-a843-73d6217f55db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052512 Oct 28 18:09:51.904338 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 853/1795] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:51.913000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:51.914309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:51.923889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.924634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.925554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.927521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.928181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.928778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:52.444318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:09:52.445291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:09:52.445970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:09:52.446391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:09:52.446785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:09:52.459118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:52.459804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:52.460464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:52.461372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:52.462008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:52.465289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:52.501223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Getting quotas for project 81a4f32a961a4bad9d00f2fe644a1b72. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:09:52.509236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Getting quotas for user 8f10e644aa9842e681a4c7bb612a0ab0 and project 81a4f32a961a4bad9d00f2fe644a1b72. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:09:52.523652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:52.525984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:09:52.530226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:09:52.536797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:52.548679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:52.550633 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-54b4cbb4-62df-4db4-94a7-6a0041bb0910 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.643964 Oct 28 18:09:52.552165 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 854/1796] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:51 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:52.562331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-264343297", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "d98ef463-74a4-479c-b632-73800f8bbec7"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:52.726914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] validate_networks() for [('d98ef463-74a4-479c-b632-73800f8bbec7', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:09:52.742532 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-748ae6b9-3f55-44f3-9070-e487a4cd112b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824484 Oct 28 18:09:52.743358 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 943/1797] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:09:52.764510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:52.765174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:52.781366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:52.785160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:52.787161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:52.789460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:52.795129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:52.795801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:53.445604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:53.460159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-310ade0e-a726-432a-9e57-6df82f3d38f9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 0.715352 Oct 28 18:09:53.462362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 944/1798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:52 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:53.472736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:53.475087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:53.494459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:53.495021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:53.499103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:53.501814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:53.502376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:53.502852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:54.184450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:54.205805 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a2e1cf0-6328-4dfe-b35c-2be1aa8d62b8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.741446 Oct 28 18:09:54.206451 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 945/1799] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:53 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:54.221356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:54.224409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:54.233459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:54.234766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:54.235554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:54.236795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:54.237430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:54.238030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:54.784143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:54.801374 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e5ca14c-2b71-439d-9e7a-f4ab40f9c422 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1213 microversion: 2.1 time: 0.588658 Oct 28 18:09:54.802769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 946/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:54 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1213 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:54.821581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:54.822235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:54.839096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:54.842149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:54.842631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:54.844861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:54.845441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:54.849161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:55.275228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:55.303219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:55.314916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:55.318199 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-767d1039-2796-4350-bf3b-63bada3fe5a7 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.511017 Oct 28 18:09:55.319103 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 947/1801] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:54 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:55.462404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1457767838", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "2f07a1ed-dcf0-4f21-8e72-1fd26182882c"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:55.624043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] validate_networks() for [('2f07a1ed-dcf0-4f21-8e72-1fd26182882c', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:09:56.103186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:09:56.103657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:09:56.104133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:09:56.104769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:09:56.104973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:09:56.137732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.138224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.147939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.150366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.151254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.152937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.198455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:09:56.215386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Getting quotas for user 46b892cd4bff49b78773d9b78da06bcd and project 4c759088012747259c1329ac2190ee65. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:09:56.233275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:09:56.236595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:09:56.320270 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-53cf9997-d295-4db9-b66f-3a1ac9c0f327 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.761907 Oct 28 18:09:56.321974 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 855/1802] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:09:56.329783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f51321a0-fa0a-4a24-9e99-d8e4236b9d86 req-ad5f4ac4-88fe-4eb6-a4a2-4f7223c09965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:56.357606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f51321a0-fa0a-4a24-9e99-d8e4236b9d86 req-ad5f4ac4-88fe-4eb6-a4a2-4f7223c09965 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.359044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f51321a0-fa0a-4a24-9e99-d8e4236b9d86 req-ad5f4ac4-88fe-4eb6-a4a2-4f7223c09965 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.359904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f51321a0-fa0a-4a24-9e99-d8e4236b9d86 req-ad5f4ac4-88fe-4eb6-a4a2-4f7223c09965 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.394634 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f51321a0-fa0a-4a24-9e99-d8e4236b9d86 req-ad5f4ac4-88fe-4eb6-a4a2-4f7223c09965 service nova] Creating event network-changed:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h2-862404-2 Oct 28 18:09:56.404179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-f51321a0-fa0a-4a24-9e99-d8e4236b9d86 req-ad5f4ac4-88fe-4eb6-a4a2-4f7223c09965 service nova] Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:09:56.426552 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f51321a0-fa0a-4a24-9e99-d8e4236b9d86 req-ad5f4ac4-88fe-4eb6-a4a2-4f7223c09965 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096348 Oct 28 18:09:56.428544 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 856/1803] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:56.437589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:09:56.438829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:09:56.441010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:09:56.442985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:09:56.443674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:09:56.473646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:56.474784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:56.486177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.487626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.488431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.489843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.490556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.491142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.491646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.492104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.492733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.499387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.499901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.505973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.579168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Getting quotas for project c02c831e9a9148bf969ff1425c464471. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:09:56.586317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Getting quotas for user a59c69413630492a8cc620a32478324b and project c02c831e9a9148bf969ff1425c464471. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:09:56.606293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:09:56.609141 n-d-862404-2 devstack@n-api.service[120680]: WARNING nova.utils [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1457767838 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-145776783 Oct 28 18:09:56.611032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:09:56.760695 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d6d74f9-5f95-4c43-914d-d3595709084d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436790 Oct 28 18:09:56.762026 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 948/1804] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:09:56.777915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:56.780840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:56.803402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.804401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.805204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.806278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.807016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.808684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.815304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:57.635747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:57.646596 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a2b2d39-e11f-43e6-9d54-19dc31408f32 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 1.215175 Oct 28 18:09:57.649916 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 857/1805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:56 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:57.664261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4ca0cb72-ceac-466f-bb2d-3f82c177fa39 req-b12097ea-6720-4603-8f1f-1c91e76efafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739ffed6-e9db-4597-b1f1-ccc8bec1de12", "name": "network-vif-deleted", "tag": "de1e8806-6a85-4b08-9fea-7dd69598ef6a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:57.684586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4ca0cb72-ceac-466f-bb2d-3f82c177fa39 req-b12097ea-6720-4603-8f1f-1c91e76efafc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:57.686471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4ca0cb72-ceac-466f-bb2d-3f82c177fa39 req-b12097ea-6720-4603-8f1f-1c91e76efafc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:57.688594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4ca0cb72-ceac-466f-bb2d-3f82c177fa39 req-b12097ea-6720-4603-8f1f-1c91e76efafc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:57.714671 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4ca0cb72-ceac-466f-bb2d-3f82c177fa39 req-b12097ea-6720-4603-8f1f-1c91e76efafc service nova] Creating event network-vif-deleted:de1e8806-6a85-4b08-9fea-7dd69598ef6a for instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 on n-h1-862404-2 Oct 28 18:09:57.727898 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4ca0cb72-ceac-466f-bb2d-3f82c177fa39 req-b12097ea-6720-4603-8f1f-1c91e76efafc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074786 Oct 28 18:09:57.731015 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 858/1806] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:57.732216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:57.744330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:57.745162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:57.760013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:57.762793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:57.764623 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-952f4c7d-8227-4acd-a2da-1354be0bdf01 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.993556 Oct 28 18:09:57.765115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:57.765876 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 949/1807] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:56 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:57.767427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:57.771041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:57.772301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:57.777804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:57.778441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:57.823287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:57.830685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:57.831232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:57.837034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:57.842789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:57.843480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.024630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:58.029109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:58.042751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:58.043165 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3b84e61b-4aad-4bc2-97d2-36d6cf8843a1 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1275 microversion: 2.1 time: 0.309649 Oct 28 18:09:58.045228 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 859/1808] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:57 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:58.069231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:58.070357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:58.076684 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-21c05560-9e4b-45c0-8849-23a0cddb2b9b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1259 microversion: 2.1 time: 0.309705 Oct 28 18:09:58.080084 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 950/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:57 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1259 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:58.107438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:58.108093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:58.108540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.112554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:58.114911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:58.117541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:58.118152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:58.118608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.137033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:58.139218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:58.140598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.142240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:58.144655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:58.146431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.340079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:58.353452 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82e64031-340f-4a30-8937-9610f683f80f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1236 microversion: 2.1 time: 0.271461 Oct 28 18:09:58.354848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 951/1810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:58 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1236 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:58.679044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:58.680886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:58.697197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:58.699530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:58.701355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.704183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:58.704835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:58.705713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.773729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:58.783587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:58.791079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:58.792345 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5621ac8f-7164-4169-b1fd-625d887ed4c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.743212 Oct 28 18:09:58.795670 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 860/1811] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:58 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:09:58.804553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:58.805790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:58.825801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:58.829305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:58.830233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.836989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:58.837810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:58.838409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.137763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:59.167798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e97204c-7a1e-4038-af4f-65789fce1e52 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 0.494591 Oct 28 18:09:59.173315 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 952/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:58 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:09:59.188491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:59.189545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:59.199377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.200305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.200860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.201774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.202300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.202869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.334161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:59.342946 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2bfe8094-14db-4a5a-a8ba-4b5ce1eddc4c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1275 microversion: 2.1 time: 0.165638 Oct 28 18:09:59.360051 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 953/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:59 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:59.374018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:59.376612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:59.380294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:59.383791 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49bdb8fe-7637-4a1c-9adf-2bae83bb13c6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.586700 Oct 28 18:09:59.400281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.400281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.400281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.400281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.400809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.400809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.402175 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 861/1814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:58 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:59.415716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8909ac8a-4e51-41ef-b948-2fa2246f5948 req-860669bf-dcae-419e-b29e-492855c17f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7bda4c-6e24-4237-8704-396f599fc5e2", "tag": "096f80b5-a8ed-4256-a67b-5df8a69e7c53"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:59.428224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8909ac8a-4e51-41ef-b948-2fa2246f5948 req-860669bf-dcae-419e-b29e-492855c17f43 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.429065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8909ac8a-4e51-41ef-b948-2fa2246f5948 req-860669bf-dcae-419e-b29e-492855c17f43 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.429757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8909ac8a-4e51-41ef-b948-2fa2246f5948 req-860669bf-dcae-419e-b29e-492855c17f43 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.442704 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8909ac8a-4e51-41ef-b948-2fa2246f5948 req-860669bf-dcae-419e-b29e-492855c17f43 service nova] Creating event network-changed:096f80b5-a8ed-4256-a67b-5df8a69e7c53 for instance dc7bda4c-6e24-4237-8704-396f599fc5e2 on n-h2-862404-2 Oct 28 18:09:59.450495 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8909ac8a-4e51-41ef-b948-2fa2246f5948 req-860669bf-dcae-419e-b29e-492855c17f43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045878 Oct 28 18:09:59.451790 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 862/1815] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:59.461232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:59.462136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:59.468787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.469536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.470150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.471104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.471729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.472346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.541883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:59.552447 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0ad5196-13d1-45a6-a301-21bbed0979c4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1265 microversion: 2.1 time: 0.190624 Oct 28 18:09:59.554366 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 954/1816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:59 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:59.610400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:59.621611 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5022b7f0-a604-4739-b23e-79560971888f tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1284 microversion: 2.1 time: 0.165804 Oct 28 18:09:59.636879 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 863/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:59 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:59.823741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:59.824777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:09:59.836526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.837276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.838232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.839191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.840026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.840682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:00.201974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:00.202730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:00.214142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:00.215992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:00.218388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:00.219231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:00.221368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:00.222910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:00.316299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:00.330321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:00.331984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:00.334118 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a238a307-0c37-449c-98b1-b617f8b67399 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.514835 Oct 28 18:10:00.349413 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 955/1818] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:09:59 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:00.373569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:00.374304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:00.393890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:00.394461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:00.395628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:00.396412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:00.397064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:00.402089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:00.953435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:00.962631 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-162ab4a5-a394-4eec-aacf-cbfc28fa29dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.593226 Oct 28 18:10:00.963233 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 956/1819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:00 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:00.994288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:00.995843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:01.004361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:01.007359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.008180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.008796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.009700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.010366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.010953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.027753 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-102bbb69-fcdc-43c4-b1cf-d88f25e58f25 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1469 microversion: 2.1 time: 0.830420 Oct 28 18:10:01.029566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 864/1820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:00 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1469 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:01.037480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:01.038224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:01.045925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.046553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.047168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.048201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.048817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.049533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.239980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:01.252843 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ecddcd7-f62b-4e13-8715-fd5271cad71b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.267752 Oct 28 18:10:01.253482 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 957/1821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:00 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:01.259313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:01.261809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:01.283121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.283931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.284793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.285781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.286791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.287483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.402905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:01.427674 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee766300-e5e8-4a09-9b56-58d45f302ff7 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1290 microversion: 2.1 time: 0.160548 Oct 28 18:10:01.430334 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 958/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:01 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1290 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:01.442697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:01.443276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:01.455897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.457660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.458643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.459586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.460463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.461211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.487982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:01.500533 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5d17297a-7b19-4ed8-81b3-8d0231c076ac tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.468800 Oct 28 18:10:01.501124 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 865/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:01 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:01.858504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:01.873066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:01.875369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:01.877529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-058d0cf8-a0b3-4e23-a6a3-cb81331fc7b0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.445853 Oct 28 18:10:01.878370 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 959/1824] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:01 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:01.992004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:01.992547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:01.999774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:02.000552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:02.001175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:02.002080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:02.002708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:02.003306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:02.078211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:02.079277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:02.101871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:02.102687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:02.103397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:02.104370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:02.104922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:02.105292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:02.405175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:02.418896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47a1d8cd-64f2-48e0-8ced-9b6a23f28fbf tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1462 microversion: 2.1 time: 0.365416 Oct 28 18:10:02.421766 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 960/1825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:02 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1462 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:02.435082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:02.437362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:02.455999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:02.456783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:02.457339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:02.460118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:02.465592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:02.466223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:02.712282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:02.722754 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ba0a817e-2c77-4b83-9199-76a212a5b507 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.735234 Oct 28 18:10:02.740945 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 866/1826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:01 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:02.979321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:02.980552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:02.990220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:03.001544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:03.002341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:03.003015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:03.003374 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a0921a89-0d67-4c63-9e94-052ffc2ef827 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.580234 Oct 28 18:10:03.004362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:03.004585 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 961/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:02 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:03.005321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:03.005999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:03.017300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:03.023833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:03.038463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:03.038976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:03.039420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:03.042857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:03.046425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:03.046902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:03.354561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:03.366414 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55b946ad-9944-4d3b-a3d3-f7d5cffff3d3 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.358329 Oct 28 18:10:03.368385 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 962/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:03 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:03.379102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:03.382067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:03.393129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:03.397574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:03.401400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:03.402119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:03.403751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:03.404984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:03.406598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:03.936081 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-db156ed1-021f-4fa8-944f-162b2e8a53ae tempest-MigrationsAdminTest-1192529000 tempest-MigrationsAdminTest-1192529000-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1613 microversion: 2.1 time: 1.205838 Oct 28 18:10:03.939037 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 867/1829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:02 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1613 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:03.946172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:03.947394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:03.955539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:03.956271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:03.966180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:03.966958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:03.967428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:03.967886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.311882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:04.334626 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72517e43-73a9-4239-8db6-2a8e67c67600 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.964404 Oct 28 18:10:04.351238 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 963/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:03 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:04.359908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e09daefb-b4d7-41ed-9e5f-40b85ef7efd0 req-8c1be265-4120-46a5-a2ac-581876011f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62e77c1-0b06-4b88-bcdc-feb958ad4c66", "name": "network-vif-unplugged", "status": "completed", "tag": "9ec5b572-e798-4c2f-8137-0de51ad648ad"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:04.375989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e09daefb-b4d7-41ed-9e5f-40b85ef7efd0 req-8c1be265-4120-46a5-a2ac-581876011f2a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.376619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e09daefb-b4d7-41ed-9e5f-40b85ef7efd0 req-8c1be265-4120-46a5-a2ac-581876011f2a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.377277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e09daefb-b4d7-41ed-9e5f-40b85ef7efd0 req-8c1be265-4120-46a5-a2ac-581876011f2a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.396491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e09daefb-b4d7-41ed-9e5f-40b85ef7efd0 req-8c1be265-4120-46a5-a2ac-581876011f2a service nova] Creating event network-vif-unplugged:9ec5b572-e798-4c2f-8137-0de51ad648ad for instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 on n-h2-862404-2 Oct 28 18:10:04.404494 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e09daefb-b4d7-41ed-9e5f-40b85ef7efd0 req-8c1be265-4120-46a5-a2ac-581876011f2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050733 Oct 28 18:10:04.405851 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 964/1831] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:04.415017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:04.416689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:04.426581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.427463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.428961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.430051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.430750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.436904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:04.443723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.454038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:04.460690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:04.464820 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9dc932ed-3b62-4368-baf7-f7070b2afdab tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.524198 Oct 28 18:10:04.467517 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 868/1832] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:03 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:04.484802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:04.485876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:04.504977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.505485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.505933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.506658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.507127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.507557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.540573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:04.709372 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8d57c3a0-dd78-4824-b1cb-57aaa70aabe0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 204 len: 0 microversion: 2.1 time: 0.238459 Oct 28 18:10:04.711408 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 869/1833] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:04 2022] DELETE /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:04.718977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:04.721025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:04.732181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.733403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.734544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.736419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.737349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.739076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.848743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:04.864569 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ccc7c8d1-e752-43ce-857d-078825649379 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.454531 Oct 28 18:10:04.868062 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 965/1834] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:04 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:04.875417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-32737e1d-0f55-43e4-9acf-0984a1c8f497 req-6f6a22d4-e308-4fd3-a4b1-c291fba7cdba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeb2151c-7c18-4ede-baa8-237b4570e741", "tag": "2c7e28ce-6367-499f-82ce-5caba1810020"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:04.888180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32737e1d-0f55-43e4-9acf-0984a1c8f497 req-6f6a22d4-e308-4fd3-a4b1-c291fba7cdba service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.888916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32737e1d-0f55-43e4-9acf-0984a1c8f497 req-6f6a22d4-e308-4fd3-a4b1-c291fba7cdba service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.889508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-32737e1d-0f55-43e4-9acf-0984a1c8f497 req-6f6a22d4-e308-4fd3-a4b1-c291fba7cdba service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.920093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-32737e1d-0f55-43e4-9acf-0984a1c8f497 req-6f6a22d4-e308-4fd3-a4b1-c291fba7cdba service nova] Creating event network-changed:2c7e28ce-6367-499f-82ce-5caba1810020 for instance aeb2151c-7c18-4ede-baa8-237b4570e741 on n-h1-862404-2 Oct 28 18:10:04.929886 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-32737e1d-0f55-43e4-9acf-0984a1c8f497 req-6f6a22d4-e308-4fd3-a4b1-c291fba7cdba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059478 Oct 28 18:10:04.930508 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 966/1835] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:04.940889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:04.942367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:04.965442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.965943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.966565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.968007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:04.968908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:04.969632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:04.973550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:04.975530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:05.001535 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9df268ef-f080-43d2-8223-1d02216afc91 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.288317 Oct 28 18:10:05.003217 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 870/1836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:04 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:05.016978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:05.017899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:05.026066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.026854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.027478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:05.028412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.029049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.029650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:05.172023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:05.182083 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81ae36ac-e63a-4b4c-a18b-a91d93e4f040 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.248751 Oct 28 18:10:05.182868 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 967/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:04 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:05.196040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:05.203990 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-19cec7de-b927-4b71-8497-756e8b233cc3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1468 microversion: 2.1 time: 0.190774 Oct 28 18:10:05.204567 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 871/1838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:05 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1468 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:05.360554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:05.361398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:05.368410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.369197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.369853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:05.370807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.371440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.372082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:05.485721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-89017ef2-e7fe-4b0d-ac73-bb003f8db400 req-3ece342a-05dc-4bf1-8d84-d5112ca2072a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "name": "network-vif-plugged", "status": "completed", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:05.500976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-89017ef2-e7fe-4b0d-ac73-bb003f8db400 req-3ece342a-05dc-4bf1-8d84-d5112ca2072a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.501659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-89017ef2-e7fe-4b0d-ac73-bb003f8db400 req-3ece342a-05dc-4bf1-8d84-d5112ca2072a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.502281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-89017ef2-e7fe-4b0d-ac73-bb003f8db400 req-3ece342a-05dc-4bf1-8d84-d5112ca2072a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:05.515165 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-89017ef2-e7fe-4b0d-ac73-bb003f8db400 req-3ece342a-05dc-4bf1-8d84-d5112ca2072a service nova] Creating event network-vif-plugged:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h2-862404-2 Oct 28 18:10:05.521293 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-89017ef2-e7fe-4b0d-ac73-bb003f8db400 req-3ece342a-05dc-4bf1-8d84-d5112ca2072a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039752 Oct 28 18:10:05.522341 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 872/1839] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:05.528613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:05.529549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:05.535170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:05.545747 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a2a35ab-9e98-482a-948f-9a2074ea9ee1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.188994 Oct 28 18:10:05.546543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.547329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.547852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:05.548678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.549190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.549689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:05.560388 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 968/1840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:05 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:05.686789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:05.696245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:05.697705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:05.698860 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c1785a11-c09a-4068-82ff-d0b242403d96 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.175280 Oct 28 18:10:05.699442 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 873/1841] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:05 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:05.890942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:05.891596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:05.903150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.903150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.903150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:05.903150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:05.903489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:05.903489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.037883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:06.042837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:06.043508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:06.046106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9b18583-e748-4de4-ad6f-15abf95d4068 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.159364 Oct 28 18:10:06.047231 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 969/1842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:05 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:06.050902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.052038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.052687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.053410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.053870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.054923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.180772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:06.201802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:06.206249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:06.206869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:06.210856 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-badafa94-4f67-461e-ac98-c002d262f320 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.171987 Oct 28 18:10:06.211746 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 874/1843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:06 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:06.214533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.215120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.215650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.216494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.217154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.217585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.229247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:06.230173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:06.240568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=12 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:06.242264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.242842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.243318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.244089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.244712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.245417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.360900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:06.370293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45ac76ab-0408-4b44-b32d-000f845ccb93 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.167839 Oct 28 18:10:06.374110 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 970/1844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:06 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:06.436844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-13afa94e-4e55-4583-b06e-73357fbdfc05 req-22c84935-ab97-436c-b6e0-5e19d8086024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d061a254-5b3d-4d89-acd8-79c1842c684b", "tag": "ccdbe197-71c8-4c99-a4db-0f84eee173b7"}, {"name": "network-changed", "server_uuid": "e62e77c1-0b06-4b88-bcdc-feb958ad4c66", "tag": "9ec5b572-e798-4c2f-8137-0de51ad648ad"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:06.448984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13afa94e-4e55-4583-b06e-73357fbdfc05 req-22c84935-ab97-436c-b6e0-5e19d8086024 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.449472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13afa94e-4e55-4583-b06e-73357fbdfc05 req-22c84935-ab97-436c-b6e0-5e19d8086024 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.449907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13afa94e-4e55-4583-b06e-73357fbdfc05 req-22c84935-ab97-436c-b6e0-5e19d8086024 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.463587 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-13afa94e-4e55-4583-b06e-73357fbdfc05 req-22c84935-ab97-436c-b6e0-5e19d8086024 service nova] Creating event network-changed:ccdbe197-71c8-4c99-a4db-0f84eee173b7 for instance d061a254-5b3d-4d89-acd8-79c1842c684b on n-h1-862404-2 Oct 28 18:10:06.464316 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-13afa94e-4e55-4583-b06e-73357fbdfc05 req-22c84935-ab97-436c-b6e0-5e19d8086024 service nova] Creating event network-changed:9ec5b572-e798-4c2f-8137-0de51ad648ad for instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 on n-h2-862404-2 Oct 28 18:10:06.474107 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-13afa94e-4e55-4583-b06e-73357fbdfc05 req-22c84935-ab97-436c-b6e0-5e19d8086024 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040178 Oct 28 18:10:06.474919 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 971/1845] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:06.511021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:06.524713 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c281d4f-4e68-489d-8cc2-a5d73fb7961c tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1468 microversion: 2.1 time: 0.300418 Oct 28 18:10:06.525784 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 875/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:06 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1468 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:06.567227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:06.572023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:06.572741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:06.579387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.579906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.580351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.581056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.581515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.581985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.597241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=14 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:06.725472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:06.726473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:06.737295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:06.739303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.740227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.741061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.742020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.746376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.747118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:06.748523 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-595686ab-4317-4a72-97d0-0f05e4c9c1c0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.182707 Oct 28 18:10:06.749638 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 972/1847] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:06 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:06.774245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:06.952405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a1bbd711-369a-49ad-9206-b293675e59c3 req-e9882257-329a-4671-aedd-477dab985726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f25a90-6f6f-4efa-a990-116d1a2fddaa", "tag": "8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:06.982993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a1bbd711-369a-49ad-9206-b293675e59c3 req-e9882257-329a-4671-aedd-477dab985726 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:06.983546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a1bbd711-369a-49ad-9206-b293675e59c3 req-e9882257-329a-4671-aedd-477dab985726 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:06.984024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a1bbd711-369a-49ad-9206-b293675e59c3 req-e9882257-329a-4671-aedd-477dab985726 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.044616 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a1bbd711-369a-49ad-9206-b293675e59c3 req-e9882257-329a-4671-aedd-477dab985726 service nova] Creating event network-changed:8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b for instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa on n-h1-862404-2 Oct 28 18:10:07.061356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a1bbd711-369a-49ad-9206-b293675e59c3 req-e9882257-329a-4671-aedd-477dab985726 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112745 Oct 28 18:10:07.062450 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 973/1848] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:10:07.074143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:07.075404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:07.093989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.094886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.096095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.099152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.099996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.101385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.295349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:07.318642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:07.334319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:07.336186 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f8aa8d37-9c2c-441b-b92a-2d8af277148a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.615909 Oct 28 18:10:07.338925 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 876/1849] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:06 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:10:07.367652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:07.368380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:07.375428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.375952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.376451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.377269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.377811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.378250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.532258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:07.541845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c58dbf44-5c15-46ea-bd8d-2d13c27cceea tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.474592 Oct 28 18:10:07.548535 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 974/1850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:07 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:07.554110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:07.559454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:07.571044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.572453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.573068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.574132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.575279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.575927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.771322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:07.804632 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c2f3d05e-8614-46bb-97fb-f4d123863ef2 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.254691 Oct 28 18:10:07.806557 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 975/1851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:07 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:07.820307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:07.821054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:07.834953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.840983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.842381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.844044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.851187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.860638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.954526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:07.962625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:07.966072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7189cd26-a3b9-4589-9b76-fc7bad622159 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 200 len: 1298 microversion: 2.1 time: 0.156978 Oct 28 18:10:07.967921 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 976/1852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:07 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:07.975405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:07.976358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:07.986817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.987944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.988467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:07.989347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:07.989829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:07.990270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:08.007993 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e31dcb54-d337-4e35-ab93-61d8ce079e71 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.646242 Oct 28 18:10:08.024563 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 877/1853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:07 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:08.197329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:08.206118 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-abea6153-c4c8-4b24-976a-4099f2bceae8 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.236636 Oct 28 18:10:08.220343 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 977/1854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:07 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:08.370781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:08.371679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:08.379227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:08.379990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:08.380569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:08.381428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:08.381991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:08.382556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:08.488680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-54580f05-6b0b-421c-ba19-7446249879ee req-06b271fc-ae3b-43ea-980c-0a0579c03a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028", "name": "network-vif-deleted", "tag": "d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:08.499173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-54580f05-6b0b-421c-ba19-7446249879ee req-06b271fc-ae3b-43ea-980c-0a0579c03a33 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:08.499791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-54580f05-6b0b-421c-ba19-7446249879ee req-06b271fc-ae3b-43ea-980c-0a0579c03a33 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:08.500790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-54580f05-6b0b-421c-ba19-7446249879ee req-06b271fc-ae3b-43ea-980c-0a0579c03a33 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:08.512180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-54580f05-6b0b-421c-ba19-7446249879ee req-06b271fc-ae3b-43ea-980c-0a0579c03a33 service nova] Creating event network-vif-deleted:d63eb0ef-9a6a-40cc-8f17-9cd44111b8e3 for instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 on n-h2-862404-2 Oct 28 18:10:08.517572 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-54580f05-6b0b-421c-ba19-7446249879ee req-06b271fc-ae3b-43ea-980c-0a0579c03a33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Oct 28 18:10:08.518474 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 978/1855] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:10:08.529952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:08.538941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:08.540741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:08.541919 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45619733-15cb-49ab-a136-300b237475be tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.175098 Oct 28 18:10:08.542491 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 878/1856] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:08 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:08.569699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:08.570658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:08.576952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:08.577531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:08.577861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:08.578561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:08.579096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:08.579468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:08.715246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:08.724222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75075c53-a9b8-401e-82fe-ca4ab750625e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.159458 Oct 28 18:10:08.724800 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 979/1857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:08 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:08.835111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:08.835852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:08.842147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:08.842721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:08.843228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:08.844036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:08.844703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:08.845233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:08.994573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:08.995265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:08.997784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:09.003565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.004906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.005679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.006470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.007001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.007500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.009695 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2cfaeef8-baf9-4355-b0c3-fc6a84a51127 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.180474 Oct 28 18:10:09.011019 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 879/1858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:08 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:09.023210 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] HTTP exception thrown: Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 could not be found. Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Request method failure captured: Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 HTTP/1.1 Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmhjKPhHci2KG5fGsfno_76t2eafuB5vyv8mKg4GChgNh_7V7eDtYWypY0Cep1ABTWR8OC9K-z01gCnqQfSOtwp6jxCMP67u7tMFe7BNrLffOAgQde7Vq2szqBFjCMgHu2-3tMgLjKZpU1jpPdSH9ZFiMFjQx2rfS9YihJzRFeM4S4 Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7811accf3d64bc290bc90a33952b51f Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:09.024935 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7811accf3d64bc290bc90a33952b51f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7811accf3d64bc290bc90a33952b51f Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MigrationsAdminTest-1338799371-project Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 3415953e10c445bfa3dcc5a3335826c8 Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MigrationsAdminTest-1338799371-project Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 could not be found. Oct 28 18:10:09.026978 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028'} Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 could not be found. Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:09.027857 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 could not be found. Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 could not be found. Oct 28 18:10:09.029574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:09.031064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Returning 404 to user: Instance 8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:09.031064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a40a7a76-5dc1-4027-b95b-9ff9e933f1a9 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028" status: 404 len: 111 microversion: 2.1 time: 0.035877 Oct 28 18:10:09.031064 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 980/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:08 2022] GET /compute/v2.1/servers/8f401c2b-2cf7-4d3a-8e88-c5d3d5d90028 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:10:09.038565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:09.039164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:09.039280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:09.039783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:09.045807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.046262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.046397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.046722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.047073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.047424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.047728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.048082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.048516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.048778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.049337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.049861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.079071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:09.185039 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d61a02f7-1c93-476c-8c83-b29d21c1f06a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 204 len: 0 microversion: 2.1 time: 0.152142 Oct 28 18:10:09.185557 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 880/1860] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:09 2022] DELETE /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:09.194586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:09.195290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:09.202010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.202759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.203199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.203983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.204446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.204869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.228680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:09.236490 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c4e5a401-2eee-4f3e-aab0-1e8e2a126324 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.201299 Oct 28 18:10:09.245029 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 981/1861] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:09 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:09.255013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:09.255637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:09.261717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.262199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.262632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.263329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.263777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.264223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.354255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:09.362113 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd02c892-f5ea-4775-87ed-a3946b368b8a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1534 microversion: 2.1 time: 0.172351 Oct 28 18:10:09.363851 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 881/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:09 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1534 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:09.403523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:09.411762 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e7f6648-a2d5-4978-af9d-77830b433b3d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.173744 Oct 28 18:10:09.412364 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 982/1863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:09 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:09.566735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:09.567534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:09.570945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:09.576057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.576628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.577148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.577938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.578466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.579129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.705549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f2f1d87f-e746-4d9e-a032-1689377e8009 req-caf31d07-feef-4d50-936d-0dd97617b7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7bda4c-6e24-4237-8704-396f599fc5e2", "name": "network-vif-plugged", "status": "completed", "tag": "096f80b5-a8ed-4256-a67b-5df8a69e7c53"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:09.719538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2f1d87f-e746-4d9e-a032-1689377e8009 req-caf31d07-feef-4d50-936d-0dd97617b7a6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.720328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2f1d87f-e746-4d9e-a032-1689377e8009 req-caf31d07-feef-4d50-936d-0dd97617b7a6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.723689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2f1d87f-e746-4d9e-a032-1689377e8009 req-caf31d07-feef-4d50-936d-0dd97617b7a6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.734351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:09.747503 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f2f1d87f-e746-4d9e-a032-1689377e8009 req-caf31d07-feef-4d50-936d-0dd97617b7a6 service nova] Creating event network-vif-plugged:096f80b5-a8ed-4256-a67b-5df8a69e7c53 for instance dc7bda4c-6e24-4237-8704-396f599fc5e2 on n-h2-862404-2 Oct 28 18:10:09.748178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:09.750633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:09.752741 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5fc99955-8333-406d-a42c-c5b371590705 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.189758 Oct 28 18:10:09.754350 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 882/1864] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:09 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:09.762747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:09.765042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:09.765290 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f2f1d87f-e746-4d9e-a032-1689377e8009 req-caf31d07-feef-4d50-936d-0dd97617b7a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065698 Oct 28 18:10:09.768236 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 983/1865] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:10:09.773341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.773895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.774395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.775159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:09.775916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:09.776524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:09.966000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:09.974594 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd84410f-c241-48a9-bbcb-c57c4e7132d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.217716 Oct 28 18:10:09.988382 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 883/1866] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:09 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:10.042304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:10.043054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:10.052787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.053579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.054112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.055105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.055639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.056131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.260571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:10.261321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:10.268073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.268713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.270019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.271061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.271623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.272442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.303293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:10.313856 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ae2163e-0580-407c-9a14-d95cd7de56ea tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.276403 Oct 28 18:10:10.314611 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 984/1867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:10 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:10.386983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:10.388032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:10.395292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.396132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.396817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.397521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.398213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.399058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.467013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:10.476202 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-da321a70-31ef-4a82-a142-fd9f29da5f2b tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1325 microversion: 2.1 time: 0.219740 Oct 28 18:10:10.476807 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 884/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:10 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:10.482316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:10.482950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:10.489868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.490370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.490809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.491532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.492028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.492460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.590956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:10.608668 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-14a408eb-55ea-4ec8-9649-aa31fc864bc1 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1534 microversion: 2.1 time: 0.225721 Oct 28 18:10:10.609734 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 985/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:10 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1534 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:10.684582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:10.694489 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-57522470-833f-420f-8cdd-b2e33763272d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.216435 Oct 28 18:10:10.695121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 885/1870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:10 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:10.778736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:10.779489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:10.786595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.787183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.787803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.788746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:10.789380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:10.790001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:10.926176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:10.934542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:10.936027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:10.937187 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6e795ff-78a5-4aaa-806b-6e1d427b7899 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.162488 Oct 28 18:10:10.937755 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 986/1871] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:10 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:10.998441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:10.999086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:11.006071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.006558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.007291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.008031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.008556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.009156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.159091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:11.169251 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-375b40f5-3482-45aa-a95b-6c1600fcff3f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.174672 Oct 28 18:10:11.170687 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 886/1872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:10 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:11.339625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:11.340579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:11.353123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.353963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.356052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.356953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.357891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.358478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.391582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:11.499860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:11.505000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:11.515418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.518366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.519131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.524731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.525391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.526032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.653557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:11.662236 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9739f911-5925-485b-a375-ef7a0a6e2e4b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.326535 Oct 28 18:10:11.671692 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 987/1873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:11 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:11.679357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:11.680807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:11.688792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.689385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.690100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.691053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.693299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.694113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.775519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:11.788208 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-588f5d2f-7dc4-49d9-9c16-3cda56f7b905 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1522 microversion: 2.1 time: 0.292704 Oct 28 18:10:11.789704 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 887/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:11 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:11.797363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:11.798314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:11.807836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.808674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.809393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.810307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:11.811163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:11.812205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:11.963207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:11.969144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:11.976863 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78120580-db0b-4def-b67a-e81de1c45ab5 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1534 microversion: 2.1 time: 0.303931 Oct 28 18:10:11.978755 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 988/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:11 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1534 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:11.985120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b6e6bd37-05e9-4c4e-a802-9bbec42d15e9 req-d3da69ac-2b65-4cf2-b94c-90e9509f36ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d061a254-5b3d-4d89-acd8-79c1842c684b", "name": "network-vif-plugged", "status": "completed", "tag": "ccdbe197-71c8-4c99-a4db-0f84eee173b7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:11.992873 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9975d8a7-ae40-4a13-ba75-c171405c0c29 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.201102 Oct 28 18:10:11.993407 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 888/1876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:11 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:11.999758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b6e6bd37-05e9-4c4e-a802-9bbec42d15e9 req-d3da69ac-2b65-4cf2-b94c-90e9509f36ca service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.000347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b6e6bd37-05e9-4c4e-a802-9bbec42d15e9 req-d3da69ac-2b65-4cf2-b94c-90e9509f36ca service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.000831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b6e6bd37-05e9-4c4e-a802-9bbec42d15e9 req-d3da69ac-2b65-4cf2-b94c-90e9509f36ca service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.007481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:12.008323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:12.014832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.015601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.016071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.016780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.016895 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b6e6bd37-05e9-4c4e-a802-9bbec42d15e9 req-d3da69ac-2b65-4cf2-b94c-90e9509f36ca service nova] Creating event network-vif-plugged:ccdbe197-71c8-4c99-a4db-0f84eee173b7 for instance d061a254-5b3d-4d89-acd8-79c1842c684b on n-h1-862404-2 Oct 28 18:10:12.017230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.017650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.022290 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b6e6bd37-05e9-4c4e-a802-9bbec42d15e9 req-d3da69ac-2b65-4cf2-b94c-90e9509f36ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042076 Oct 28 18:10:12.023102 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 989/1877] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:12.029201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:12.030015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:12.037690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.038400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.038840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.039550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.040040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.040466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.046208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:12.103103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:12.139478 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f579d401-8880-4748-871b-0f24028d1e78 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 204 len: 0 microversion: 2.1 time: 0.144715 Oct 28 18:10:12.142893 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 889/1878] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:11 2022] DELETE /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:12.151798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:12.153017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:12.159684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.160970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.161489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.162206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.162718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.163140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.196480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:12.205388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:12.206933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:12.208968 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e77756df-d436-4835-a8b5-5a87a97663f1 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.184462 Oct 28 18:10:12.209581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 990/1879] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:12 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:12.217875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:12.218788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:12.226770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.227600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.228230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.229131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.229604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.230033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.315053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:12.324217 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ca7d8b2c-8f3a-49be-a27b-ad0e4d30e9a6 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1528 microversion: 2.1 time: 0.176646 Oct 28 18:10:12.324920 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 890/1880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:12 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1528 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:12.391227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-956737642", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "93172da3-2cc7-4d23-b5e8-59c944e1e4c4"}], "block_device_mapping_v2": [{"uuid": "7d259e86-de22-45eb-af36-9c3a46425f1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:12.405217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:12.413754 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d90fc5e-cf4b-45f3-b7c4-32bcfc5f5e2e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.202402 Oct 28 18:10:12.428295 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 991/1881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:12 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:12.470105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] validate_networks() for [('93172da3-2cc7-4d23-b5e8-59c944e1e4c4', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:10:12.690363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:12.690991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:12.698198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.698776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.699282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.700088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:12.700620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:12.701115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:12.850284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:12.859963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-708dbb1f-c721-439a-9d63-4f95366c6c6a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.173668 Oct 28 18:10:12.862032 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 992/1882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:12 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:13.011805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:13.012535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:13.018958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.019475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.020275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.020998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.021456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.021939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.174244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:13.183771 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b1744d3-ae5f-43e1-9abf-fec1de3e99ce tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1534 microversion: 2.1 time: 0.175747 Oct 28 18:10:13.184777 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 993/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:13 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1534 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:13.190349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:13.191213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:13.197713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.198435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.199093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.200078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.200825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.201262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.216969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:10:13.218739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:10:13.219221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:10:13.219880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:10:13.220306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:10:13.233773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.234268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.234711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.235446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.235930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.236361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.256575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for project 8253dbe510dd462f974f37fce0a5d990. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:13.262462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Getting quotas for user 12dea4e86fd14c07859b48e22493b9dd and project 8253dbe510dd462f974f37fce0a5d990. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:13.325506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:10:13.327639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d259e86-de22-45eb-af36-9c3a46425f1a',volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:10:13.363025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:13.370888 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-745b2964-06f8-4716-8b9b-30ee1273806b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.184860 Oct 28 18:10:13.371463 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 994/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:13 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:13.378252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:13.378829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:13.385426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.386041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.386683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.387508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.388002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.388434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.491374 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7db9bf3e-3977-4c16-be5a-3f396a631a2d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103926 Oct 28 18:10:13.498098 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 891/1885] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:10:13.498098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:13.498488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:13.507616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.508677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.508838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.509520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.510101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.510515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.551464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:13.561431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:13.563117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:13.564347 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71731a96-73e5-48b5-bc56-b240d30fa456 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.191938 Oct 28 18:10:13.565218 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 995/1886] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:13 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:13.570833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:13.571453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:13.580130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.580630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.581216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.582536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.583457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.584066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.747920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:13.759843 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d430689d-2177-43d7-a76a-46c03c6ac82b tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.193525 Oct 28 18:10:13.760693 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 996/1887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:13 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:13.765851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36073206-aee6-4f3c-b54a-e845f981f4e3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:13.766865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36073206-aee6-4f3c-b54a-e845f981f4e3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:13.837603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36073206-aee6-4f3c-b54a-e845f981f4e3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:13.840457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:13.845493 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36073206-aee6-4f3c-b54a-e845f981f4e3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1052 microversion: 2.1 time: 0.083369 Oct 28 18:10:13.846151 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 997/1888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:13 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1052 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:13.865157 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9880f2be-eb2d-4f3e-a4eb-fe8a3217762d tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1528 microversion: 2.1 time: 0.371437 Oct 28 18:10:13.867175 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 892/1889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:13 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1528 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:13.889757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:13.890389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:13.898648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.899438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.899991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:13.900658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:13.901325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:13.901897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.095209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:14.105666 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca880663-93a0-43e4-aaa8-a6b9203e8789 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.222740 Oct 28 18:10:14.106479 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 998/1890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:13 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:14.213332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:14.214107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:14.220876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.221505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.222018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.223360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.223950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.224642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.397972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:14.398607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:14.409556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.410119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.411220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.412631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.413107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.413545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.508113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:14.530035 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8cb21218-39f0-409d-9f2f-0eedbc783cd3 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1534 microversion: 2.1 time: 0.322093 Oct 28 18:10:14.540627 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 893/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:14 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1534 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:14.572346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e84a2fae-3f4e-48c5-8d33-2427979e5948 req-558d0db2-61fc-494e-adac-c074d9717d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb2151c-7c18-4ede-baa8-237b4570e741", "name": "network-vif-plugged", "status": "completed", "tag": "2c7e28ce-6367-499f-82ce-5caba1810020"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:14.598357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e84a2fae-3f4e-48c5-8d33-2427979e5948 req-558d0db2-61fc-494e-adac-c074d9717d01 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.599206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e84a2fae-3f4e-48c5-8d33-2427979e5948 req-558d0db2-61fc-494e-adac-c074d9717d01 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.599673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e84a2fae-3f4e-48c5-8d33-2427979e5948 req-558d0db2-61fc-494e-adac-c074d9717d01 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.610359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:14.619241 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e84a2fae-3f4e-48c5-8d33-2427979e5948 req-558d0db2-61fc-494e-adac-c074d9717d01 service nova] Creating event network-vif-plugged:2c7e28ce-6367-499f-82ce-5caba1810020 for instance aeb2151c-7c18-4ede-baa8-237b4570e741 on n-h1-862404-2 Oct 28 18:10:14.624474 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e84a2fae-3f4e-48c5-8d33-2427979e5948 req-558d0db2-61fc-494e-adac-c074d9717d01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059513 Oct 28 18:10:14.625428 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 894/1892] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:14.625881 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a23205cf-e45f-4bbf-8fc8-b961e3402e37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.234970 Oct 28 18:10:14.630936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 999/1893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:14 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:14.632890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:14.634563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:14.648224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.649119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.650013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.675260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.678500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.679226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.779197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7aa944b1-ba3d-4a80-ad5a-cf695a270998 req-af3801e8-b06a-4b2a-acb5-92ed4a69af51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7bda4c-6e24-4237-8704-396f599fc5e2", "name": "network-vif-deleted", "tag": "096f80b5-a8ed-4256-a67b-5df8a69e7c53"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:14.802463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7aa944b1-ba3d-4a80-ad5a-cf695a270998 req-af3801e8-b06a-4b2a-acb5-92ed4a69af51 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.802963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7aa944b1-ba3d-4a80-ad5a-cf695a270998 req-af3801e8-b06a-4b2a-acb5-92ed4a69af51 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.808361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7aa944b1-ba3d-4a80-ad5a-cf695a270998 req-af3801e8-b06a-4b2a-acb5-92ed4a69af51 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.833587 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7aa944b1-ba3d-4a80-ad5a-cf695a270998 req-af3801e8-b06a-4b2a-acb5-92ed4a69af51 service nova] Creating event network-vif-deleted:096f80b5-a8ed-4256-a67b-5df8a69e7c53 for instance dc7bda4c-6e24-4237-8704-396f599fc5e2 on n-h2-862404-2 Oct 28 18:10:14.841659 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7aa944b1-ba3d-4a80-ad5a-cf695a270998 req-af3801e8-b06a-4b2a-acb5-92ed4a69af51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066686 Oct 28 18:10:14.842727 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1000/1894] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:10:14.861337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:14.862172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:14.869732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.870525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.871225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:14.872163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:14.872854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:14.873454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.253455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.266954 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c1758d0-a8db-494b-ae08-75258f0cbacc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.421943 Oct 28 18:10:15.268066 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1001/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:14 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:15.273648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:15.274452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:15.290148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.291024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.291663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.293898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.294367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.294846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.333532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.344845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.346385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.355830 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc0ca0a1-7640-4706-8b6d-046f08e289dd tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.720706 Oct 28 18:10:15.356916 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 895/1896] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:14 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:15.362063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:15.367774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:15.375165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.377962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.380472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.381306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.381482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.382204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.382704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.396545 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f21337f5-79ad-454a-83bb-d7b8e17a93cf tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1168 microversion: 2.1 time: 0.127159 Oct 28 18:10:15.397444 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1002/1897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:15 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1168 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:15.402071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:15.402691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:15.414058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.414481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.414956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.415696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.416191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.416758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.442230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.442768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.443376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.444115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lazy-loading 'fault' on Instance uuid dc7bda4c-6e24-4237-8704-396f599fc5e2 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:15.536818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4245221a863a4ba7969c508342e27fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e02d11d4c64d8989eaec758233f04f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.550233 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b124913d-3101-4a72-96af-1c70a67868c8 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 200 len: 1315 microversion: 2.1 time: 0.192031 Oct 28 18:10:15.552028 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 896/1898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:15 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:15.572146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:15.572890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:15.582621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.582621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.584614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.585501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.587091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.587653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.638277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.651887 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a88f21ef-96ff-43f4-a34e-d69e23573dd6 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.251453 Oct 28 18:10:15.653195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1003/1899] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:15 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:15.660085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:15.662082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:15.669492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.670495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.672179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.673137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:15.673600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:15.674029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:15.840762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.855652 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8703fea0-9f75-49c7-8590-b43eb0ae7b78 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1307 microversion: 2.1 time: 0.200425 Oct 28 18:10:15.859907 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1004/1900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:15 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:15.875365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:15.884411 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-12613695-a4f6-4e23-9dc9-af829a0f922d tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1534 microversion: 2.1 time: 0.322114 Oct 28 18:10:15.886485 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 897/1901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:15 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1534 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:16.293820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:16.295457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:16.304428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.305740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.306400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.307927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.308612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.309392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.384519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:16.386637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:16.395714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.397221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.397972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.399667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.400543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.401608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.564910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:16.579426 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e3fc2f9f-fc33-4f82-a9fd-7b54fcdc390f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1317 microversion: 2.1 time: 0.291131 Oct 28 18:10:16.580248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1005/1902] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:16 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:16.614371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:16.615310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:16.637155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.637857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.638480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.639373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.640105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.640695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.693734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:16.740879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:16.764733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:16.769048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:16.771414 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a3be52e-0983-495a-a2f4-741f09a3c2c5 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.392627 Oct 28 18:10:16.772664 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 898/1903] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:16 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:10:16.777749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:16.778571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: dc7bda4c-6e24-4237-8704-396f599fc5e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:16.785801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.786718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.787320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.789069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.789930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.790981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.815223 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Instance dc7bda4c-6e24-4237-8704-396f599fc5e2 could not be found. Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 HTTP/1.1 Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:16.828090 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance dc7bda4c-6e24-4237-8704-396f599fc5e2 could not be found. Oct 28 18:10:16.830023 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'dc7bda4c-6e24-4237-8704-396f599fc5e2'} Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7bda4c-6e24-4237-8704-396f599fc5e2 could not be found. Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:16.831212 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7bda4c-6e24-4237-8704-396f599fc5e2 could not be found. Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7bda4c-6e24-4237-8704-396f599fc5e2 could not be found. Oct 28 18:10:16.839412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:16.840885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Instance dc7bda4c-6e24-4237-8704-396f599fc5e2 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:16.840885 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b51324bd-ba2d-4014-8622-185169c31015 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2" status: 404 len: 111 microversion: 2.1 time: 0.061120 Oct 28 18:10:16.842177 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 899/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:16 2022] GET /compute/v2.1/servers/dc7bda4c-6e24-4237-8704-396f599fc5e2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:16.858231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:16.859407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:16.869564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.870351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.871040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:16.872036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:16.872872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:16.873524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.067381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:17.076616 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b829f8c5-56a0-4702-b24c-4b0d4be6e797 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1210 microversion: 2.1 time: 0.494660 Oct 28 18:10:17.092622 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1006/1905] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:16 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1210 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:17.092622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1906d30e-d6c1-450f-9ca8-f98cf23d00d7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '.version_select at 0x7f78e25601f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:17.174431 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-1906d30e-d6c1-450f-9ca8-f98cf23d00d7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Image not found. Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1906d30e-d6c1-450f-9ca8-f98cf23d00d7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/images/8c0832e9-390f-4caa-974e-bf435844f7cb HTTP/1.1 Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:17.177197 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8c0832e9-390f-4caa-974e-bf435844f7cb'} Oct 28 18:10:17.178755 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8c0832e9-390f-4caa-974e-bf435844f7cb to delete Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:17.179759 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c0832e9-390f-4caa-974e-bf435844f7cb could not be found. Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:17.182096 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1906d30e-d6c1-450f-9ca8-f98cf23d00d7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:17.183757 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1906d30e-d6c1-450f-9ca8-f98cf23d00d7 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/images/8c0832e9-390f-4caa-974e-bf435844f7cb" status: 404 len: 62 microversion: 2.1 time: 0.096426 Oct 28 18:10:17.185018 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1007/1906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:17 2022] DELETE /compute/v2.1/images/8c0832e9-390f-4caa-974e-bf435844f7cb => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:17.188158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:17.195153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:17.212044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:17.212653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.213262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.213804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.214790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.215477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.216172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.220176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59655002-f31a-45b3-be3e-1e0f913e059b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.375023 Oct 28 18:10:17.241768 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 900/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:16 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:17.252341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-1c876090-ae2c-4c6c-b366-32c324e813f4 req-73faccbd-95c4-4ea0-a6e0-683421eb69c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65bf4b2-0082-4097-a88a-84e3cd5c45d6", "name": "network-vif-deleted", "tag": "7a6ab836-9960-49fe-ab6f-64227a64a52a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:17.287092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c876090-ae2c-4c6c-b366-32c324e813f4 req-73faccbd-95c4-4ea0-a6e0-683421eb69c3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.287585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c876090-ae2c-4c6c-b366-32c324e813f4 req-73faccbd-95c4-4ea0-a6e0-683421eb69c3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.288646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c876090-ae2c-4c6c-b366-32c324e813f4 req-73faccbd-95c4-4ea0-a6e0-683421eb69c3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.318671 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-1c876090-ae2c-4c6c-b366-32c324e813f4 req-73faccbd-95c4-4ea0-a6e0-683421eb69c3 service nova] Creating event network-vif-deleted:7a6ab836-9960-49fe-ab6f-64227a64a52a for instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 on n-h1-862404-2 Oct 28 18:10:17.340310 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-1c876090-ae2c-4c6c-b366-32c324e813f4 req-73faccbd-95c4-4ea0-a6e0-683421eb69c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095287 Oct 28 18:10:17.341276 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 901/1908] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:17.364959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:17.367700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:17.388799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.389398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.389722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.392443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.395203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.395944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.448370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.449039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.449656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.450412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lazy-loading 'fault' on Instance uuid c65bf4b2-0082-4097-a88a-84e3cd5c45d6 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:17.537092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:17.560077 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-77391262-0c0a-4dcb-9eb8-f39d4245f797 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 200 len: 1369 microversion: 2.1 time: 0.215839 Oct 28 18:10:17.563750 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 902/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:17 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 1369 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:17.569940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:17.571116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:17.579562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.580292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.580858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.582348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.583158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.584067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.631062 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 HTTP/1.1 Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:17.632830 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:17.634315 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1dc86d75-014e-43a2-956b-03e203fba456'} Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:17.635151 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:17.637891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:17.640992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:17.640992 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-60cd3969-217c-45b9-9eae-c0da7cc4af97 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 404 len: 111 microversion: 2.1 time: 0.069041 Oct 28 18:10:17.640992 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 903/1910] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:17 2022] DELETE /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:17.643250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:17.644220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:17.650665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.651163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.651605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.652366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:17.652827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:17.653258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:17.979237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:17.989480 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-12dab9a5-5193-43ca-b453-09c63c75ef0e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1487 microversion: 2.1 time: 0.808851 Oct 28 18:10:17.991557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:18.001691 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d14cbc19-0556-4de1-a585-60b1a928a8dd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1467 microversion: 2.1 time: 0.362370 Oct 28 18:10:18.004689 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1008/1911] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:17 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1487 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:18.013236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:18.014565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: 1dc86d75-014e-43a2-956b-03e203fba456] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:18.018426 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 904/1912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:17 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1467 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:18.021870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.022532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.023133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.024174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.025467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.026085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.029157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:18.032177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:18.046819 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:18.048376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 HTTP/1.1 Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:18.048509 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:18.049978 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '1dc86d75-014e-43a2-956b-03e203fba456'} Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:18.052115 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. Oct 28 18:10:18.053972 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:18.055487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Instance 1dc86d75-014e-43a2-956b-03e203fba456 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:18.055487 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d35cf267-6b4b-4489-a62a-bf20facbb3e0 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456" status: 404 len: 111 microversion: 2.1 time: 0.043988 Oct 28 18:10:18.055487 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1009/1913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:18 2022] GET /compute/v2.1/servers/1dc86d75-014e-43a2-956b-03e203fba456 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:18.057793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.058534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.059443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.059683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-927689372"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:18.060302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.060905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.062160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:18.069734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.070555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.071182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.072183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.073423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.074033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.351109 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-858b2fbb-10f8-4622-8e7a-8bdf5ee46538 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "POST /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741/action" status: 202 len: 0 microversion: 2.1 time: 0.295183 Oct 28 18:10:18.379342 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1010/1914] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:18 2022] POST /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:10:18.393986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1642941849", "metadata": {"image_type": "test"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:18.407042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:18.423621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.427115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.428998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.432537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.437441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.438096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.521322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Getting quotas for project 81a4f32a961a4bad9d00f2fe644a1b72. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:18.523521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:18.531587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Getting quotas for user 8f10e644aa9842e681a4c7bb612a0ab0 and project 81a4f32a961a4bad9d00f2fe644a1b72. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:18.739368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:18.751976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:18.755934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:18.757859 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7b6275a9-8993-4486-ac57-6cfd64cf41a0 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1487 microversion: 2.25 time: 0.738300 Oct 28 18:10:18.778812 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 905/1915] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:18 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1487 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:18.786697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-abe88c81-ca8e-497e-8d00-37607a257fc9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '.version_select at 0x7f78e2424160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:18.813838 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-abe88c81-ca8e-497e-8d00-37607a257fc9 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7591635" status: 202 len: 0 microversion: 2.1 time: 0.033205 Oct 28 18:10:18.814813 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 906/1916] 10.222.0.16 () {58 vars in 1212 bytes} [Fri Oct 28 18:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7591635 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:10:18.821032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:18.822061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:18.830853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.832083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.832694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.833852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.834462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.835050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.903149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82cb1420-e929-4a7e-889f-52e2477db8d6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "POST /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b/action" status: 202 len: 0 microversion: 2.1 time: 0.514332 Oct 28 18:10:18.910752 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1011/1917] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:18 2022] POST /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:10:18.922286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:18.924260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:18.941923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.942577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.946353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:18.949754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:18.950009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:18.950456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:19.100895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:19.110088 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c435f17-ad94-4a72-a77c-163c712e9def tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1210 microversion: 2.1 time: 0.293746 Oct 28 18:10:19.128268 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 907/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:18 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1210 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:19.134354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a009483-a13c-4ac7-90d4-701752a7f8b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e2375af0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.203797 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a009483-a13c-4ac7-90d4-701752a7f8b0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a" status: 200 len: 1413 microversion: 2.1 time: 0.073738 Oct 28 18:10:19.204856 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 908/1919] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:19 2022] GET /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:19.210223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.211134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: c65bf4b2-0082-4097-a88a-84e3cd5c45d6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:19.218425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:19.219303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:19.220002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:19.220966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:19.221655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:19.223122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:19.241136 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] HTTP exception thrown: Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 could not be found. Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Request method failure captured: Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 HTTP/1.1 Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmhjKPhHci2KG5fGsfno_76t2eafuB5vyv8mKg4GChgNh_7V7eDtYWypY0Cep1ABTWR8OC9K-z01gCnqQfSOtwp6jxCMP67u7tMFe7BNrLffOAgQde7Vq2szqBFjCMgHu2-3tMgLjKZpU1jpPdSH9ZFiMFjQx2rfS9YihJzRFeM4S4 Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7811accf3d64bc290bc90a33952b51f Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:19.243509 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7811accf3d64bc290bc90a33952b51f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7811accf3d64bc290bc90a33952b51f Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-MigrationsAdminTest-1338799371-project Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 3415953e10c445bfa3dcc5a3335826c8 Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-MigrationsAdminTest-1338799371-project Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 could not be found. Oct 28 18:10:19.245049 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'c65bf4b2-0082-4097-a88a-84e3cd5c45d6'} Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 could not be found. Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:19.245882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 could not be found. Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 could not be found. Oct 28 18:10:19.247344 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.251863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Returning 404 to user: Instance c65bf4b2-0082-4097-a88a-84e3cd5c45d6 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:19.253770 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7df099c-ba6c-4387-86b0-d496c5192e70 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6" status: 404 len: 111 microversion: 2.1 time: 0.047848 Oct 28 18:10:19.255050 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 909/1920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:19 2022] GET /compute/v2.1/servers/c65bf4b2-0082-4097-a88a-84e3cd5c45d6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:19.261388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c4a07e8f-4d8c-4f8a-9971-91ecf78e2975 req-04f32096-999c-42fd-90ae-180b4a97f613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f25a90-6f6f-4efa-a990-116d1a2fddaa", "name": "network-vif-plugged", "status": "completed", "tag": "8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:19.273700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4a07e8f-4d8c-4f8a-9971-91ecf78e2975 req-04f32096-999c-42fd-90ae-180b4a97f613 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:19.274432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4a07e8f-4d8c-4f8a-9971-91ecf78e2975 req-04f32096-999c-42fd-90ae-180b4a97f613 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:19.275091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4a07e8f-4d8c-4f8a-9971-91ecf78e2975 req-04f32096-999c-42fd-90ae-180b4a97f613 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:19.296801 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c4a07e8f-4d8c-4f8a-9971-91ecf78e2975 req-04f32096-999c-42fd-90ae-180b4a97f613 service nova] Creating event network-vif-plugged:8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b for instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa on n-h1-862404-2 Oct 28 18:10:19.304347 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c4a07e8f-4d8c-4f8a-9971-91ecf78e2975 req-04f32096-999c-42fd-90ae-180b4a97f613 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047688 Oct 28 18:10:19.305560 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 910/1921] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:19.312477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-47c77a90-1068-4db7-8747-0fe2d0952426 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78de2abc10>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.363128 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-47c77a90-1068-4db7-8747-0fe2d0952426 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.056002 Oct 28 18:10:19.364344 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 911/1922] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:19 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:19.369128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8960b38c-63a6-4a17-850c-8bf7ab85cdc5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e2375280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.432074 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8960b38c-63a6-4a17-850c-8bf7ab85cdc5 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a" status: 200 len: 1413 microversion: 2.1 time: 0.066376 Oct 28 18:10:19.433460 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 912/1923] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:19 2022] GET /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a => generated 1413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:19.439153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19112547-0b27-46f8-aa79-b1310de3c406 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '.version_select at 0x7f78e2375e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.470206 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-19112547-0b27-46f8-aa79-b1310de3c406 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990892983" status: 202 len: 0 microversion: 2.1 time: 0.035079 Oct 28 18:10:19.471212 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 913/1924] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:10:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990892983 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:10:19.478593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f0eb624-b433-4952-8739-1cf17c67715a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e2410a60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.499233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:19.508930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-118ff974-3665-457d-a20b-9ede490f6f99 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.600272 Oct 28 18:10:19.509531 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1012/1925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:18 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:19.538647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-26406016-9c95-46df-8097-d9d3d3b7a9b7 req-1a540555-defb-458a-b818-2f4872272b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42126e7-fffb-413e-b662-efb6a5141612", "tag": "bda648cd-3190-45fe-ad1e-deb2f2dab3f9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:19.564622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-26406016-9c95-46df-8097-d9d3d3b7a9b7 req-1a540555-defb-458a-b818-2f4872272b8a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:19.567723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-26406016-9c95-46df-8097-d9d3d3b7a9b7 req-1a540555-defb-458a-b818-2f4872272b8a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:19.569656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-26406016-9c95-46df-8097-d9d3d3b7a9b7 req-1a540555-defb-458a-b818-2f4872272b8a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:19.604619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-26406016-9c95-46df-8097-d9d3d3b7a9b7 req-1a540555-defb-458a-b818-2f4872272b8a service nova] Creating event network-changed:bda648cd-3190-45fe-ad1e-deb2f2dab3f9 for instance f42126e7-fffb-413e-b662-efb6a5141612 on n-h2-862404-2 Oct 28 18:10:19.618964 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-26406016-9c95-46df-8097-d9d3d3b7a9b7 req-1a540555-defb-458a-b818-2f4872272b8a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089479 Oct 28 18:10:19.623732 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1013/1926] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:19.656339 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f0eb624-b433-4952-8739-1cf17c67715a tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a" status: 204 len: 0 microversion: 2.1 time: 0.183703 Oct 28 18:10:19.657285 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 914/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:19 2022] DELETE /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:19.670577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61654be3-410c-4ed8-bf5a-c77c0420ea18 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e2472820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.705902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-61654be3-410c-4ed8-bf5a-c77c0420ea18 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Image not found. Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61654be3-410c-4ed8-bf5a-c77c0420ea18 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a HTTP/1.1 Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:19.709698 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '1e719c9e-dd75-427e-b75e-780fea71312a'} Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:19.711559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1e719c9e-dd75-427e-b75e-780fea71312a Oct 28 18:10:19.712830 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:19.714357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e719c9e-dd75-427e-b75e-780fea71312a could not be found. Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:19.715993 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61654be3-410c-4ed8-bf5a-c77c0420ea18 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:19.720813 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61654be3-410c-4ed8-bf5a-c77c0420ea18 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a" status: 404 len: 62 microversion: 2.1 time: 0.049326 Oct 28 18:10:19.722439 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1014/1928] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:19 2022] GET /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:19.726644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.727712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:19.736515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:19.737398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:19.738600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:19.739899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:19.742112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:19.742932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:19.793202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:19.793956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:19.805957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:19.806456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:19.806900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:19.807624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:19.808145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:19.808550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.150468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:20.152632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:20.160380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:20.163507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:20.164372 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1359f189-52cc-4fe2-92cd-552101b5298c tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1499 microversion: 2.1 time: 0.445103 Oct 28 18:10:20.166341 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1e1607d8-6c18-4687-a522-3a55145aea66 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1477 microversion: 2.25 time: 0.376713 Oct 28 18:10:20.167468 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1015/1929] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:19 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:10:20.174718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.176968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:20.180265 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 915/1930] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:19 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1499 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:20.202610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46396d8a-8e6f-4a4f-b2fa-5fedc24e97ad tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '.version_select at 0x7f78e23759d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.215103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46396d8a-8e6f-4a4f-b2fa-5fedc24e97ad tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.217760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.219298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46396d8a-8e6f-4a4f-b2fa-5fedc24e97ad tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.220050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.223632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46396d8a-8e6f-4a4f-b2fa-5fedc24e97ad tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.224405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.225387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.227619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.228088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.237628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:20.255861 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-46396d8a-8e6f-4a4f-b2fa-5fedc24e97ad tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 4048 microversion: 2.25 time: 0.062863 Oct 28 18:10:20.256803 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 916/1931] 10.222.0.16 () {60 vars in 1184 bytes} [Fri Oct 28 18:10:20 2022] GET /compute/v2.1/os-migrations => generated 4048 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:10:20.275807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.278355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:20.292922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.293749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.294409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.300106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.301372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.302049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.552666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] Lazy-loading 'services' on Instance uuid e62e77c1-0b06-4b88-bcdc-feb958ad4c66 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:20.593343 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-87d96d09-b33b-4cbe-a78c-038b797edd88 tempest-LiveAutoBlockMigrationV225Test-376124714 tempest-LiveAutoBlockMigrationV225Test-376124714-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1970 microversion: 2.25 time: 0.324020 Oct 28 18:10:20.601555 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 917/1932] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:20 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1970 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:20.606919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-331349bb-6aaa-465c-93de-5c74419a1384 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78de95ea60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.621655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:20.635785 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad260bb6-de76-4564-b6c3-c970b4b62acb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1210 microversion: 2.1 time: 0.466373 Oct 28 18:10:20.636601 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1016/1933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:20 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1210 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:20.650129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.650770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:20.663549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.664234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.664836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.666042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.666861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.667514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.673016 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-331349bb-6aaa-465c-93de-5c74419a1384 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.070290 Oct 28 18:10:20.673773 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 918/1934] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:20 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:20.686943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.687895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:20.694436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.694927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.695364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.696100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.696552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.696973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.747155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:20.841912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:20.855029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26fad92d-ef3f-4e07-aef1-e9e353f1aa19 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1332 microversion: 2.1 time: 0.216300 Oct 28 18:10:20.860742 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1017/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:20 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1332 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:20.866723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.867251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:20.874178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.874920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.875564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.877135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.877890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.879293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.880370 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-66970714-94ff-4c79-8aa8-836eedc2325e tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 204 len: 0 microversion: 2.25 time: 0.196115 Oct 28 18:10:20.881226 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 919/1936] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:10:20 2022] DELETE /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:10:20.891271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e895e69d-677c-4a64-8f84-7c8e8d49da3a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '.version_select at 0x7f78e23c55e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.920191 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-e895e69d-677c-4a64-8f84-7c8e8d49da3a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Image not found. Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e895e69d-677c-4a64-8f84-7c8e8d49da3a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/images/26e40373-9620-4e1c-b740-b9904a091021 HTTP/1.1 Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:20.922637 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '26e40373-9620-4e1c-b740-b9904a091021'} Oct 28 18:10:20.924363 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 26e40373-9620-4e1c-b740-b9904a091021 to delete Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:20.925821 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 26e40373-9620-4e1c-b740-b9904a091021 could not be found. Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:20.927130 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e895e69d-677c-4a64-8f84-7c8e8d49da3a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:20.930088 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e895e69d-677c-4a64-8f84-7c8e8d49da3a tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/images/26e40373-9620-4e1c-b740-b9904a091021" status: 404 len: 62 microversion: 2.1 time: 0.038773 Oct 28 18:10:20.933218 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 920/1937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:20 2022] DELETE /compute/v2.1/images/26e40373-9620-4e1c-b740-b9904a091021 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:20.933510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:20.939506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:20.940282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:20.947556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.948146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.948843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:20.949776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:20.950408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:20.951012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.038637 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2c64b90-e1b4-45b5-bc80-d53add5ed660 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 204 len: 0 microversion: 2.1 time: 0.176203 Oct 28 18:10:21.039334 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1018/1938] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:20 2022] DELETE /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:21.045467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:21.046148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:21.056316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.056817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.057395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.059861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.059861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.059861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.074596 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 HTTP/1.1 Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:21.076340 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.077786 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'a33011c5-4735-4b59-856a-cac6b6f10d49'} Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:21.079007 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.080420 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.082127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:21.082127 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38c4fcf9-4027-4f76-8183-456d0cad7d06 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 404 len: 111 microversion: 2.1 time: 0.037344 Oct 28 18:10:21.082127 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1019/1939] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:21 2022] DELETE /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:21.083599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:21.084242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:21.090222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.090709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.091152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.091937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.092556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.092953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.146703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:21.155683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:21.157206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:21.158771 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d02ad2bd-131b-4a12-ab21-ae45da1bcd07 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1483 microversion: 2.25 time: 0.224160 Oct 28 18:10:21.159336 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 921/1940] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:20 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1483 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:21.166518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:21.168270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] [instance: a33011c5-4735-4b59-856a-cac6b6f10d49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:21.177035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:21.181580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.182170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.182643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.183397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.183959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.184384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.203578 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] HTTP exception thrown: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Request method failure captured: Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 HTTP/1.1 Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBpRvCIZ4cOcQGOdfkM9cKD4EhttwvLZD6CXGY_UAGmdqEiCskkYKfO5zwIj0WFyfp2wFyK5EDz6Hb4fYmiKQ_k7_9H0DMHnlkfKBbvQkKf01CYvxmsDNJPUoO0CPk7AUznch5w3Q9y8k9wVuNFSWnI67k9WB5YUJd9Xqp3K5D9AGUg Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:21.205493 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58e02d11d4c64d8989eaec758233f04f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58e02d11d4c64d8989eaec758233f04f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58e02d11d4c64d8989eaec758233f04f Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-654313959 Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4245221a863a4ba7969c508342e27fdc Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-654313959-project Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.207111 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'a33011c5-4735-4b59-856a-cac6b6f10d49'} Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:21.208726 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. Oct 28 18:10:21.210190 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:21.211456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] Returning 404 to user: Instance a33011c5-4735-4b59-856a-cac6b6f10d49 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:21.211456 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c4f90c0-5d10-440e-918b-6c1c7b09f375 tempest-ImagesOneServerNegativeTestJSON-654313959 tempest-ImagesOneServerNegativeTestJSON-654313959-project] 10.222.0.16 "GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49" status: 404 len: 111 microversion: 2.1 time: 0.046027 Oct 28 18:10:21.211456 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 922/1941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:21 2022] GET /compute/v2.1/servers/a33011c5-4735-4b59-856a-cac6b6f10d49 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:21.213834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:21.214460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:21.221488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.223544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.223678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.224564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.225265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.225707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.253665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:21.262188 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2974e8b2-abd5-4066-b537-d14d87c9d25f tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1468 microversion: 2.1 time: 0.182521 Oct 28 18:10:21.263441 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1020/1942] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:21 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1468 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:21.466350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:21.477197 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-01f4dab9-7eea-4c5e-99e1-c83aab78d6bd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1499 microversion: 2.1 time: 0.266974 Oct 28 18:10:21.478191 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 923/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:21 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1499 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:21.663484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:21.664212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:21.671460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.672439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.672983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.673930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.674392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.674819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.689041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72ac1123-08d0-4292-b297-b6bb0e06216d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78de827820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:21.741095 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72ac1123-08d0-4292-b297-b6bb0e06216d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.055728 Oct 28 18:10:21.747692 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 924/1944] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:21 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:21.823856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:21.826361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:21.836746 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c30fe22b-2403-4eaf-8b9d-127a676d8e1d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1210 microversion: 2.1 time: 0.177595 Oct 28 18:10:21.853952 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1021/1945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:21 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1210 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:21.881965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:21.882852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:21.892235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.893055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.893681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:21.895057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:21.895703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:21.896335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:22.132927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:22.141114 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f029ef86-059d-4ca0-bfb1-edc62513305b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1535 microversion: 2.1 time: 0.266150 Oct 28 18:10:22.141654 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 925/1946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:21 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1535 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:22.165844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03e85412-b87e-43ac-b925-dec077a0b434 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'create', calling method: .version_select at 0x7f78e2518280>, body: {"pool": "a41bb833-4927-4a7c-8da1-ac702b1559ab"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:22.185354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:22.185878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:22.192253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:22.193037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:22.193470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:22.194168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:22.194623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:22.195044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:22.596808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:22.607807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:22.609752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:22.611735 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-212c321a-e88c-4e80-a2ec-4627748b22ce tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1483 microversion: 2.25 time: 0.429649 Oct 28 18:10:22.611735 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 926/1947] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:22 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1483 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:10:22.633063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:22.634833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:22.640664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:22.641163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:22.641746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:22.642473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:22.642987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:22.643346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:23.246444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:23.270500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:23.461815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:23.471349 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ca0a24ee-ca60-4084-8c3b-e79d4ad6c94a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1468 microversion: 2.1 time: 0.842884 Oct 28 18:10:23.487393 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 927/1948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:22 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1468 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:23.492419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:23.493040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:23.499463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:23.499984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:23.500424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:23.501153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:23.501610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:23.502327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:23.519988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03e85412-b87e-43ac-b925-dec077a0b434 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.357375 Oct 28 18:10:23.530022 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1022/1949] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:10:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:23.530022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ee8f6e9-fe12-4738-9eca-89125b424801 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2472a60>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:23.574064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ee8f6e9-fe12-4738-9eca-89125b424801 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.051587 Oct 28 18:10:23.574654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1023/1950] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:23 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:23.579170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:23.579784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:23.587780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:23.588296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:23.588741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:23.589436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:23.589890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:23.590316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:23.726814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:23.736095 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51949f50-d172-429f-be57-3e1dae7785e2 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1198 microversion: 2.1 time: 0.160378 Oct 28 18:10:23.736683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1024/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:23 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1198 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:23.742210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'action', calling method: .version_select at 0x7f78dfe88af0>, body: {"addFloatingIp": {"address": "172.25.8.136"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:23.744728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:23.750785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:23.751559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:23.752204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:23.753078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:23.754218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:23.754645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:23.824463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:10:23.824851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquired lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:10:23.844714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:23.918788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:23.932975 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-98948a30-d45e-42a7-9cd2-a301079d028b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1505 microversion: 2.1 time: 0.444290 Oct 28 18:10:23.933765 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 928/1952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:23 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:23.938525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:23.939417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:23.951182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:23.952021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:23.953739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:23.955808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:23.957089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:23.957763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:24.349107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:24.362218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:24.382750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:24.387637 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-756ab236-deeb-45eb-add8-2e3901446cca tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1483 microversion: 2.25 time: 0.450216 Oct 28 18:10:24.388749 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 929/1953] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:23 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1483 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:24.499359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:24.500354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:24.523720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:24.526679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:24.527149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:24.529456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:24.531135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:24.532287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:24.724139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:24.767236 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-081137ab-14d5-409d-96df-4e368babf99a tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 200 len: 1426 microversion: 2.1 time: 0.274779 Oct 28 18:10:24.772913 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 930/1954] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:24 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 1426 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:24.790906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-aea63d11-99f8-4f45-bff8-87b48d4762f4 req-abf3811f-f71e-48f7-85d8-f702916e8746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62e77c1-0b06-4b88-bcdc-feb958ad4c66", "name": "network-vif-deleted", "tag": "9ec5b572-e798-4c2f-8137-0de51ad648ad"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:24.829330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aea63d11-99f8-4f45-bff8-87b48d4762f4 req-abf3811f-f71e-48f7-85d8-f702916e8746 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:24.831061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aea63d11-99f8-4f45-bff8-87b48d4762f4 req-abf3811f-f71e-48f7-85d8-f702916e8746 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:24.834083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aea63d11-99f8-4f45-bff8-87b48d4762f4 req-abf3811f-f71e-48f7-85d8-f702916e8746 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:24.866333 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-aea63d11-99f8-4f45-bff8-87b48d4762f4 req-abf3811f-f71e-48f7-85d8-f702916e8746 service nova] Creating event network-vif-deleted:9ec5b572-e798-4c2f-8137-0de51ad648ad for instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 on n-h1-862404-2 Oct 28 18:10:24.880763 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-aea63d11-99f8-4f45-bff8-87b48d4762f4 req-abf3811f-f71e-48f7-85d8-f702916e8746 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104227 Oct 28 18:10:24.883699 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 931/1955] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:24.893477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-88bcf908-6aed-412d-81e4-3e5a97fd9ec7 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2424c10>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:24.985037 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-88bcf908-6aed-412d-81e4-3e5a97fd9ec7 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.099138 Oct 28 18:10:24.993698 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 932/1956] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:24 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:25.000467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:25.001253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:25.036805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:25.037451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:25.038051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:25.043574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:25.044107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:25.045562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:25.560158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:25.569484 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9371f209-ccf6-44ba-8edc-e724bee6665e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1198 microversion: 2.1 time: 0.581484 Oct 28 18:10:25.570324 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 933/1957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:24 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1198 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:25.592619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:25.593233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:25.625405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:25.626006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:25.637399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:25.638174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:25.638647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:25.639074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.009214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:26.021168 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cae37e72-d93e-4265-9b9e-2fafa82b5132 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1505 microversion: 2.1 time: 0.449927 Oct 28 18:10:26.032735 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 934/1958] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:25 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:26.045501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a12626f3-43b0-4cd0-8e08-8f775de0209d req-17ca2f0d-2dfa-4f10-8e2e-40373a563cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb2151c-7c18-4ede-baa8-237b4570e741", "name": "network-vif-plugged", "status": "completed", "tag": "2c7e28ce-6367-499f-82ce-5caba1810020"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:26.058685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a12626f3-43b0-4cd0-8e08-8f775de0209d req-17ca2f0d-2dfa-4f10-8e2e-40373a563cc9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.059430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a12626f3-43b0-4cd0-8e08-8f775de0209d req-17ca2f0d-2dfa-4f10-8e2e-40373a563cc9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.060104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a12626f3-43b0-4cd0-8e08-8f775de0209d req-17ca2f0d-2dfa-4f10-8e2e-40373a563cc9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.074860 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a12626f3-43b0-4cd0-8e08-8f775de0209d req-17ca2f0d-2dfa-4f10-8e2e-40373a563cc9 service nova] Creating event network-vif-plugged:2c7e28ce-6367-499f-82ce-5caba1810020 for instance aeb2151c-7c18-4ede-baa8-237b4570e741 on n-h1-862404-2 Oct 28 18:10:26.080900 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a12626f3-43b0-4cd0-8e08-8f775de0209d req-17ca2f0d-2dfa-4f10-8e2e-40373a563cc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043552 Oct 28 18:10:26.082818 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 935/1959] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:26.090591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:26.091515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:26.098761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.099504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.100176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.101053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.101708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.102328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.230165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:26.236596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Building network info cache for instance {{(pid=120680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:10:26.244499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:26.246349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:26.247550 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7034404d-dd24-4c3f-9c30-331ec88f0fba tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1266 microversion: 2.25 time: 0.162571 Oct 28 18:10:26.260931 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 936/1960] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:26 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:26.265803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:26.266431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 9552def0-8a91-498a-900a-150434e38180] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:26.274186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.274597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.278816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.279678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.282447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.282906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.301848 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] HTTP exception thrown: Instance 9552def0-8a91-498a-900a-150434e38180 could not be found. Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Request method failure captured: Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 HTTP/1.1 Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmhjKPhHci2KG5fGsfno_76t2eafuB5vyv8mKg4GChgNh_7V7eDtYWypY0Cep1ABTWR8OC9K-z01gCnqQfSOtwp6jxCMP67u7tMFe7BNrLffOAgQde7Vq2szqBFjCMgHu2-3tMgLjKZpU1jpPdSH9ZFiMFjQx2rfS9YihJzRFeM4S4 Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7811accf3d64bc290bc90a33952b51f Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:26.304254 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7811accf3d64bc290bc90a33952b51f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7811accf3d64bc290bc90a33952b51f Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-MigrationsAdminTest-1338799371-project Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 3415953e10c445bfa3dcc5a3335826c8 Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-MigrationsAdminTest-1338799371-project Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 9552def0-8a91-498a-900a-150434e38180 could not be found. Oct 28 18:10:26.306073 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '9552def0-8a91-498a-900a-150434e38180'} Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9552def0-8a91-498a-900a-150434e38180 could not be found. Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:26.307099 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9552def0-8a91-498a-900a-150434e38180 could not be found. Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9552def0-8a91-498a-900a-150434e38180 could not be found. Oct 28 18:10:26.308897 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:26.311592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Returning 404 to user: Instance 9552def0-8a91-498a-900a-150434e38180 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:26.312722 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cd6a53a1-e575-42da-a0c1-3352da460e1e tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180" status: 404 len: 111 microversion: 2.1 time: 0.050694 Oct 28 18:10:26.313311 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 937/1961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:26 2022] GET /compute/v2.1/servers/9552def0-8a91-498a-900a-150434e38180 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:26.322726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f0a1a667-b565-4acd-8a3f-92582a09457d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2375670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:26.400162 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f0a1a667-b565-4acd-8a3f-92582a09457d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.081974 Oct 28 18:10:26.400897 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 938/1962] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:26 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:26.416697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-1be47737-7c53-47f4-91e4-17636ca25e66 req-c8223ac8-50f0-4d93-81f4-db79de9e88a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f25a90-6f6f-4efa-a990-116d1a2fddaa", "tag": "8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:26.429631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1be47737-7c53-47f4-91e4-17636ca25e66 req-c8223ac8-50f0-4d93-81f4-db79de9e88a5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.430121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1be47737-7c53-47f4-91e4-17636ca25e66 req-c8223ac8-50f0-4d93-81f4-db79de9e88a5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.430560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1be47737-7c53-47f4-91e4-17636ca25e66 req-c8223ac8-50f0-4d93-81f4-db79de9e88a5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.435006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:26.444633 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-1be47737-7c53-47f4-91e4-17636ca25e66 req-c8223ac8-50f0-4d93-81f4-db79de9e88a5 service nova] Creating event network-changed:8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b for instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa on n-h1-862404-2 Oct 28 18:10:26.450595 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-1be47737-7c53-47f4-91e4-17636ca25e66 req-c8223ac8-50f0-4d93-81f4-db79de9e88a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037593 Oct 28 18:10:26.452499 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 939/1963] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:26.469248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:26.470555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:26.479010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.479772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.480784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.481751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.482939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.483541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.518631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:26.680225 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62a00607-4d20-49c2-ab79-cef50e333f6b tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 204 len: 0 microversion: 2.1 time: 0.225293 Oct 28 18:10:26.685014 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 940/1964] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:26 2022] DELETE /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:26.704905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:26.710442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:26.726888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.730131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.730648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:26.731405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:26.731895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:26.732329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:27.289390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Updating instance_info_cache with network_info: [{"id": "8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b", "address": "fa:16:3e:41:18:6d", "network": {"id": "2f07a1ed-dcf0-4f21-8e72-1fd26182882c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-100822631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c02c831e9a9148bf969ff1425c464471", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8235c1f2-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:10:27.319522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Releasing lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:10:27.321634 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6f57e3f-24d8-4b3b-9bc7-1f77fe79330d tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action" status: 202 len: 0 microversion: 2.1 time: 3.582809 Oct 28 18:10:27.322812 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1025/1965] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:23 2022] POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action => generated 0 bytes in 3585 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:10:27.330133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:27.332453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:27.342406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:27.342871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:27.343530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:27.344570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:27.345208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:27.345792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:27.572620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:27.587227 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22abc0be-9ce7-44be-b8f5-a52516a600d2 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1467 microversion: 2.1 time: 0.262901 Oct 28 18:10:27.588306 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1026/1966] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:27 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1467 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:27.593444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:27.594204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:27.602087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:27.602893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:27.603337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:27.604177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:27.604702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:27.605193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:27.804672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:27.821007 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e097428-31dc-47f5-b396-9c9da05ba481 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1505 microversion: 2.1 time: 0.231382 Oct 28 18:10:27.835955 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1027/1967] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:27 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:27.835955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:27.855890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:27.868618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:27.869347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:27.869793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:27.870732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:27.871536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:27.872267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:27.919047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:27.929537 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad8ab652-68eb-4b7c-8827-3cd51cac6fbc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1198 microversion: 2.1 time: 1.244540 Oct 28 18:10:27.935966 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 941/1968] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:26 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1198 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:27.951469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8319a8e6-bf78-47ed-951e-56a05b95eb30 req-4b512711-02f5-4724-9daa-bd7b6b502137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9552def0-8a91-498a-900a-150434e38180", "name": "network-vif-deleted", "tag": "f5e0147a-caa4-4d4c-9805-66b3014a3b54"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:27.974715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8319a8e6-bf78-47ed-951e-56a05b95eb30 req-4b512711-02f5-4724-9daa-bd7b6b502137 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:27.975218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8319a8e6-bf78-47ed-951e-56a05b95eb30 req-4b512711-02f5-4724-9daa-bd7b6b502137 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:27.975728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8319a8e6-bf78-47ed-951e-56a05b95eb30 req-4b512711-02f5-4724-9daa-bd7b6b502137 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:27.986268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:27.997916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:28.005690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:28.007200 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a83999b-19dd-47cb-b83b-173b56e67249 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1266 microversion: 2.25 time: 0.181371 Oct 28 18:10:28.008982 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1028/1969] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:27 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:28.016156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0aac322f-8091-42e4-a4dd-ebafc86ba8f0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'create', calling method: .version_select at 0x7f78e24354c0>, body: {"pool": "a41bb833-4927-4a7c-8da1-ac702b1559ab"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:28.021609 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8319a8e6-bf78-47ed-951e-56a05b95eb30 req-4b512711-02f5-4724-9daa-bd7b6b502137 service nova] Creating event network-vif-deleted:f5e0147a-caa4-4d4c-9805-66b3014a3b54 for instance 9552def0-8a91-498a-900a-150434e38180 on n-h2-862404-2 Oct 28 18:10:28.029649 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8319a8e6-bf78-47ed-951e-56a05b95eb30 req-4b512711-02f5-4724-9daa-bd7b6b502137 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090920 Oct 28 18:10:28.030456 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 942/1970] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:28.039290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ce7f28f-fd9d-4f91-be59-edc81f132bdd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23d64c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:28.108210 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4ce7f28f-fd9d-4f91-be59-edc81f132bdd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.076349 Oct 28 18:10:28.119566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 943/1971] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:28 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:28.143804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-1c7edbaa-1965-4e6f-8349-6dc2ebbb14e5 req-187207e5-80f6-40eb-a519-ffc6b33ae61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d061a254-5b3d-4d89-acd8-79c1842c684b", "name": "network-vif-plugged", "status": "completed", "tag": "ccdbe197-71c8-4c99-a4db-0f84eee173b7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:28.179162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c7edbaa-1965-4e6f-8349-6dc2ebbb14e5 req-187207e5-80f6-40eb-a519-ffc6b33ae61c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:28.179758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c7edbaa-1965-4e6f-8349-6dc2ebbb14e5 req-187207e5-80f6-40eb-a519-ffc6b33ae61c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:28.180369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c7edbaa-1965-4e6f-8349-6dc2ebbb14e5 req-187207e5-80f6-40eb-a519-ffc6b33ae61c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:28.208638 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-1c7edbaa-1965-4e6f-8349-6dc2ebbb14e5 req-187207e5-80f6-40eb-a519-ffc6b33ae61c service nova] Creating event network-vif-plugged:ccdbe197-71c8-4c99-a4db-0f84eee173b7 for instance d061a254-5b3d-4d89-acd8-79c1842c684b on n-h1-862404-2 Oct 28 18:10:28.223808 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-1c7edbaa-1965-4e6f-8349-6dc2ebbb14e5 req-187207e5-80f6-40eb-a519-ffc6b33ae61c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086246 Oct 28 18:10:28.228413 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 944/1972] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:28.619238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:28.620033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:28.645055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:28.646176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:28.647596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:28.662696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:28.663515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:28.664556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.086790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3415953e10c445bfa3dcc5a3335826c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7811accf3d64bc290bc90a33952b51f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:29.098148 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea8cc1a6-faf8-4a0f-b5a9-432d9446fef4 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 200 len: 1467 microversion: 2.1 time: 0.483331 Oct 28 18:10:29.098737 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 945/1973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:28 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 1467 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:29.132656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:29.140596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:29.153690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.165197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.165673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.166418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.174422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.174875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.485193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:29.495573 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f67b722c-d31b-4ad5-a911-ddcb6d78e0d0 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1500 microversion: 2.1 time: 0.382498 Oct 28 18:10:29.501917 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 946/1974] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:29 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1500 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:29.515527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:29.516825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:29.529501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.532843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.533408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.536144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.536644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.537083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.799418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:29.815844 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea068afe-a4b0-4d0a-8a67-e49433f6618a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1198 microversion: 2.1 time: 0.309980 Oct 28 18:10:29.818547 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 947/1975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:29 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1198 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:29.830182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:29.831128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:29.850571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.851395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.852558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.854102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.855987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.856765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.011055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:30.022528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:30.024709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:30.026132 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aa3ae22e-d684-446b-8cd7-feefba797d84 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1266 microversion: 2.25 time: 0.203807 Oct 28 18:10:30.027147 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 948/1976] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:29 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:30.034177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bfc6985c-21de-43ca-8ab7-c793bc7a254f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e237e700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:30.141237 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bfc6985c-21de-43ca-8ab7-c793bc7a254f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.112620 Oct 28 18:10:30.141965 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 949/1977] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:30 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:30.155089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-85b807f1-1bc0-48ed-850c-29de64f63e95 req-88a1e9f2-a145-4279-ae4b-880682e8de68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b3563e-22f8-45f6-88b2-49ead221357d", "name": "network-vif-deleted", "tag": "c10ccf0a-9c11-409f-9e38-de38e13aa335"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:30.172117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-85b807f1-1bc0-48ed-850c-29de64f63e95 req-88a1e9f2-a145-4279-ae4b-880682e8de68 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.181130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-85b807f1-1bc0-48ed-850c-29de64f63e95 req-88a1e9f2-a145-4279-ae4b-880682e8de68 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.182005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-85b807f1-1bc0-48ed-850c-29de64f63e95 req-88a1e9f2-a145-4279-ae4b-880682e8de68 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.202507 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-85b807f1-1bc0-48ed-850c-29de64f63e95 req-88a1e9f2-a145-4279-ae4b-880682e8de68 service nova] Creating event network-vif-deleted:c10ccf0a-9c11-409f-9e38-de38e13aa335 for instance 59b3563e-22f8-45f6-88b2-49ead221357d on n-h2-862404-2 Oct 28 18:10:30.211344 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-85b807f1-1bc0-48ed-850c-29de64f63e95 req-88a1e9f2-a145-4279-ae4b-880682e8de68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068037 Oct 28 18:10:30.214026 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 950/1978] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:30.222781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:30.227841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] [instance: 59b3563e-22f8-45f6-88b2-49ead221357d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:30.236586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.237309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.238742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.239898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.240695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.241295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.267635 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] HTTP exception thrown: Instance 59b3563e-22f8-45f6-88b2-49ead221357d could not be found. Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Request method failure captured: Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d HTTP/1.1 Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmhjKPhHci2KG5fGsfno_76t2eafuB5vyv8mKg4GChgNh_7V7eDtYWypY0Cep1ABTWR8OC9K-z01gCnqQfSOtwp6jxCMP67u7tMFe7BNrLffOAgQde7Vq2szqBFjCMgHu2-3tMgLjKZpU1jpPdSH9ZFiMFjQx2rfS9YihJzRFeM4S4 Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7811accf3d64bc290bc90a33952b51f Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:30.270339 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7811accf3d64bc290bc90a33952b51f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7811accf3d64bc290bc90a33952b51f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7811accf3d64bc290bc90a33952b51f Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-MigrationsAdminTest-1338799371 Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-MigrationsAdminTest-1338799371-project Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 3415953e10c445bfa3dcc5a3335826c8 Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-MigrationsAdminTest-1338799371-project Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 59b3563e-22f8-45f6-88b2-49ead221357d could not be found. Oct 28 18:10:30.272165 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '59b3563e-22f8-45f6-88b2-49ead221357d'} Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b3563e-22f8-45f6-88b2-49ead221357d could not be found. Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:30.273183 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b3563e-22f8-45f6-88b2-49ead221357d could not be found. Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b3563e-22f8-45f6-88b2-49ead221357d could not be found. Oct 28 18:10:30.274694 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:30.278019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] Returning 404 to user: Instance 59b3563e-22f8-45f6-88b2-49ead221357d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:30.279097 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-61d0c7a3-8014-4489-b49f-10abcbd727a0 tempest-MigrationsAdminTest-1338799371 tempest-MigrationsAdminTest-1338799371-project] 10.222.0.16 "GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d" status: 404 len: 111 microversion: 2.1 time: 0.063920 Oct 28 18:10:30.279699 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 951/1979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:30 2022] GET /compute/v2.1/servers/59b3563e-22f8-45f6-88b2-49ead221357d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:30.527350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:30.528411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:30.540275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.547449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.548334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.549240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.549996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.552126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.819846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:30.820048 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0aac322f-8091-42e4-a4dd-ebafc86ba8f0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.809862 Oct 28 18:10:30.820573 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1029/1980] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:10:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:30.834493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.122"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:30.834719 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5b2acb3f-8596-46be-b0f5-cf63c56cc60d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1487 microversion: 2.1 time: 0.311628 Oct 28 18:10:30.843188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:30.859311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.860351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.862014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.864074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.865352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.866057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.867388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 952/1981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:30 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1487 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:30.881944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:30.882562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:30.912827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.913236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.913674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.914390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.914843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.915265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.933720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:10:30.936579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquired lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:10:31.225538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:31.236550 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1126bc34-dfdb-4fb7-9e2d-732c20b0fee7 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1198 microversion: 2.1 time: 0.367636 Oct 28 18:10:31.252558 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 953/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:30 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1198 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:31.260240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:31.261118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:31.268287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.269616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.270422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.271318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.272235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.275592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.335612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:31.537545 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffd97f2a-ab30-450b-b406-410e1347396d tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 204 len: 0 microversion: 2.1 time: 0.282257 Oct 28 18:10:31.538379 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 954/1983] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:31 2022] DELETE /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:31.548340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:31.549340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:31.561488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.562277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.562900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.564483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.565147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.566494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.724251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:31.742329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:31.744023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:31.745506 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-977b0a1c-882a-4629-8f38-8ace98667709 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 200 len: 1266 microversion: 2.25 time: 0.205794 Oct 28 18:10:31.746307 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 955/1984] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:31 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:31.751340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b8ea7d87-328f-4932-a14a-0ce7d9964942 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23d6040>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:31.804445 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b8ea7d87-328f-4932-a14a-0ce7d9964942 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.056615 Oct 28 18:10:31.805723 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 956/1985] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:31 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:31.811298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96cecd1d-d17c-4e74-bf59-e78f28563b8b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e2424700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:31.837111 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-96cecd1d-d17c-4e74-bf59-e78f28563b8b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Image not found. Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96cecd1d-d17c-4e74-bf59-e78f28563b8b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a HTTP/1.1 Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:31.840153 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1e719c9e-dd75-427e-b75e-780fea71312a'} Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:31.841646 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1e719c9e-dd75-427e-b75e-780fea71312a to delete Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.842610 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e719c9e-dd75-427e-b75e-780fea71312a could not be found. Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:31.845716 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:10:31.847256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.850563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96cecd1d-d17c-4e74-bf59-e78f28563b8b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:31.851648 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96cecd1d-d17c-4e74-bf59-e78f28563b8b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a" status: 404 len: 62 microversion: 2.1 time: 0.044698 Oct 28 18:10:31.853221 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 957/1986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:31 2022] DELETE /compute/v2.1/images/1e719c9e-dd75-427e-b75e-780fea71312a => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:31.863500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:31.864382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:31.875997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.876904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.877671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.879411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.880159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.880857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.920578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:31.938723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.122 (3064f697-e8d8-4c71-8530-977af0a19d6e) with port 8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network a41bb833-4927-4a7c-8da1-ac702b1559ab.", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:10:31.939323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Releasing lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:10:31.939912 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.122 (3064f697-e8d8-4c71-8530-977af0a19d6e) with port 8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network a41bb833-4927-4a7c-8da1-ac702b1559ab. Oct 28 18:10:31.939912 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-0c50c0d9-73e4-4a93-be72-e0454b24b5d4'] Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Request method failure captured: Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action HTTP/1.1 Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 46 Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBrxLt94_LhYey-oYUZg9c563iKPX3_yQH1d47s2cXtvNOBPdWLXSRDfoNVWF8UYckXvEkRiTFWnwmJRUf4ynEsz7J2xBTEovHv1FJ3sH46Xwh-wSXMVDg2JJV_R3djH1RJUmoHfpYQERpMKYCdAG-hpB-u37a1DmbRnvWeRhlL261s Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:31.942853 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c02c831e9a9148bf969ff1425c464471", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a59c69413630492a8cc620a32478324b Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: {"addFloatingIp": {"address": "172.25.8.122"}} Oct 28 18:10:31.945004 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot associate floating IP 172.25.8.122 (3064f697-e8d8-4c71-8530-977af0a19d6e) with port 8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network a41bb833-4927-4a7c-8da1-ac702b1559ab. Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-0c50c0d9-73e4-4a93-be72-e0454b24b5d4'] Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f8f25a90-6f6f-4efa-a990-116d1a2fddaa', 'body': {'addFloatingIp': {'address': '172.25.8.122'}}} Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:10:31.945971 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:10:31.947147 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.122 (3064f697-e8d8-4c71-8530-977af0a19d6e) with port 8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network a41bb833-4927-4a7c-8da1-ac702b1559ab. Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c50c0d9-73e4-4a93-be72-e0454b24b5d4'] Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.122 (3064f697-e8d8-4c71-8530-977af0a19d6e) with port 8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network a41bb833-4927-4a7c-8da1-ac702b1559ab. Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c50c0d9-73e4-4a93-be72-e0454b24b5d4'] Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.950320 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.122 (3064f697-e8d8-4c71-8530-977af0a19d6e) with port 8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network a41bb833-4927-4a7c-8da1-ac702b1559ab. Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c50c0d9-73e4-4a93-be72-e0454b24b5d4'] Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.952626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.122 (3064f697-e8d8-4c71-8530-977af0a19d6e) with port 8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network a41bb833-4927-4a7c-8da1-ac702b1559ab. Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c50c0d9-73e4-4a93-be72-e0454b24b5d4'] Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Returning 400 to user: Cannot associate floating IP 172.25.8.122 (3064f697-e8d8-4c71-8530-977af0a19d6e) with port 8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network a41bb833-4927-4a7c-8da1-ac702b1559ab. Oct 28 18:10:31.955298 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-0c50c0d9-73e4-4a93-be72-e0454b24b5d4'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:31.958597 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f93f5f45-9618-40f4-ad8d-d895cf4d5cbe tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action" status: 400 len: 381 microversion: 2.1 time: 1.114820 Oct 28 18:10:31.958597 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1030/1987] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:30 2022] POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action => generated 381 bytes in 1116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:10:31.967378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdb84252-3a23-456b-81f0-eb971b4b7e81 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '.version_select at 0x7f78e24725e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:31.992306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:32.054006 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.compute.api [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Instance is already in deleting state, ignoring this request Oct 28 18:10:32.054888 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b291d975-5784-4f52-bf8c-b81227bd14b4 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 204 len: 0 microversion: 2.1 time: 0.198140 Oct 28 18:10:32.055469 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 958/1988] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:31 2022] DELETE /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:32.089505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:32.090611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:32.097498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:32.098391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:32.099006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:32.112169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:32.113214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:32.113669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:32.433454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:32.447864 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eede58a4-f62b-4d24-94d1-adbab53c301f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1493 microversion: 2.1 time: 0.374431 Oct 28 18:10:32.448802 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 959/1989] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:32 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1493 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:33.073613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c33e2a3a-da63-46aa-b7ac-1b854e70e6ee tempest-ListImagesTestJSON-1945519148 tempest-ListImagesTestJSON-1945519148-project] Calling method '.version_select at 0x7f78e2390820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:33.158864 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c33e2a3a-da63-46aa-b7ac-1b854e70e6ee tempest-ListImagesTestJSON-1945519148 tempest-ListImagesTestJSON-1945519148-project] 10.222.0.16 "GET /compute/v2.1/images/f17ba65f-a473-4179-8631-ca52e11cfd46" status: 200 len: 784 microversion: 2.1 time: 0.707727 Oct 28 18:10:33.167987 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 960/1990] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:32 2022] GET /compute/v2.1/images/f17ba65f-a473-4179-8631-ca52e11cfd46 => generated 784 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:33.182624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:33.185093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:33.197929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.200991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.202468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.204783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.205779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.206917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.333439 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdb84252-3a23-456b-81f0-eb971b4b7e81 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3064f697-e8d8-4c71-8530-977af0a19d6e" status: 202 len: 0 microversion: 2.1 time: 1.383337 Oct 28 18:10:33.336025 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1031/1991] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:10:31 2022] DELETE /compute/v2.1/os-floating-ips/3064f697-e8d8-4c71-8530-977af0a19d6e => generated 0 bytes in 1385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:10:33.339420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-559d16ae-7dd5-4151-adac-5bdbe78b82c9 req-c04cda9c-d7cf-4b4c-8adf-1cff7a3d14f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb2151c-7c18-4ede-baa8-237b4570e741", "name": "network-vif-unplugged", "status": "completed", "tag": "2c7e28ce-6367-499f-82ce-5caba1810020"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:33.358410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-559d16ae-7dd5-4151-adac-5bdbe78b82c9 req-c04cda9c-d7cf-4b4c-8adf-1cff7a3d14f3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.360968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-559d16ae-7dd5-4151-adac-5bdbe78b82c9 req-c04cda9c-d7cf-4b4c-8adf-1cff7a3d14f3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.361930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-559d16ae-7dd5-4151-adac-5bdbe78b82c9 req-c04cda9c-d7cf-4b4c-8adf-1cff7a3d14f3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.402423 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-559d16ae-7dd5-4151-adac-5bdbe78b82c9 req-c04cda9c-d7cf-4b4c-8adf-1cff7a3d14f3 service nova] Creating event network-vif-unplugged:2c7e28ce-6367-499f-82ce-5caba1810020 for instance aeb2151c-7c18-4ede-baa8-237b4570e741 on n-h1-862404-2 Oct 28 18:10:33.418807 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-559d16ae-7dd5-4151-adac-5bdbe78b82c9 req-c04cda9c-d7cf-4b4c-8adf-1cff7a3d14f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083113 Oct 28 18:10:33.423459 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1032/1992] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:33.445689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:33.448577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: e62e77c1-0b06-4b88-bcdc-feb958ad4c66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:33.470891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.476859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.478084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.484622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.485260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.487946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.501385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:33.511737 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] HTTP exception thrown: Instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 could not be found. Oct 28 18:10:33.512372 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-545a845b-eb7e-43aa-8a73-bcc0cb7a6732 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1198 microversion: 2.1 time: 0.341492 Oct 28 18:10:33.513541 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 961/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:33 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1198 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:33.518642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-953b6a44-cf63-4204-9977-a6d81554ac6e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e24245e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Request method failure captured: Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 HTTP/1.1 Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlJAWwsNC2FXcN-06OqTFgVLCW9bL5Fc-mLKLROT4RWlaiW2YLuo1p1_rwor5FlEPDshBObraoyvOzbMrGzYetvxjxDHS0BiiWtr8qydCFWJTjPorkROtRoALH4UW4iM-3MDDObO4pJ7UhWaKFVOJ8ypG_PM2-3ChANbpQX1mZS5aw Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 452c29fdc8114bb985893db1a9d29426 Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:33.532340 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_452c29fdc8114bb985893db1a9d29426", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 452c29fdc8114bb985893db1a9d29426 Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-LiveAutoBlockMigrationV225Test-1083167124-project Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 584b38d4097042999ad262ea77966602 Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124-project Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 could not be found. Oct 28 18:10:33.534005 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'e62e77c1-0b06-4b88-bcdc-feb958ad4c66'} Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 could not be found. Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:33.536073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 could not be found. Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 could not be found. Oct 28 18:10:33.537480 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:33.541737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Returning 404 to user: Instance e62e77c1-0b06-4b88-bcdc-feb958ad4c66 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:33.545580 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6febf165-34b8-4de8-b419-7d6e49ccc8b6 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66" status: 404 len: 111 microversion: 2.25 time: 0.117731 Oct 28 18:10:33.553091 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1033/1994] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:33 2022] GET /compute/v2.1/servers/e62e77c1-0b06-4b88-bcdc-feb958ad4c66 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:10:33.563624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2a50a75-b725-4ba4-ae08-921bed13d46f tempest-ListImagesTestJSON-1945519148 tempest-ListImagesTestJSON-1945519148-project] Calling method '.version_select at 0x7f78e24519d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:33.606466 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-953b6a44-cf63-4204-9977-a6d81554ac6e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.090174 Oct 28 18:10:33.607073 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 962/1995] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:33 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:33.619734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'action', calling method: .version_select at 0x7f78dfe87c10>, body: {"removeFloatingIp": {"address": "172.25.8.136"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:33.742119 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c2a50a75-b725-4ba4-ae08-921bed13d46f tempest-ListImagesTestJSON-1945519148 tempest-ListImagesTestJSON-1945519148-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.183075 Oct 28 18:10:33.743241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1034/1996] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 18:10:33 2022] GET /compute/v2.1/images => generated 445 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:33.757800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:33.758578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:33.770288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.772024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.772712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.773653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.774380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.775322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:34.062895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:34.079751 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84b3b1f9-1d2e-4cd4-8a00-746d056549f9 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1493 microversion: 2.1 time: 0.333686 Oct 28 18:10:34.080738 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1035/1997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:33 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1493 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:34.092412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f4b0e3e-7173-48b1-9bff-702366b7c51b tempest-ListImagesTestJSON-1945519148 tempest-ListImagesTestJSON-1945519148-project] Calling method '.version_select at 0x7f78e24ed430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:34.177839 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f4b0e3e-7173-48b1-9bff-702366b7c51b tempest-ListImagesTestJSON-1945519148 tempest-ListImagesTestJSON-1945519148-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.092152 Oct 28 18:10:34.178911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1036/1998] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:10:34 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:34.285962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:34.299483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:34.302545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:34.304910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:34.307804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:34.308609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:34.311187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:34.541582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:34.542201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:34.558411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:34.558924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:34.559372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:34.563809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:34.566842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:34.568614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:34.961872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:34.969696 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-281c1e27-167f-4cdb-a400-fd2c4494a9dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1198 microversion: 2.1 time: 0.432505 Oct 28 18:10:34.980095 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1037/1999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:34 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1198 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:34.986351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42b8bbe9-d504-4239-84ef-4ccb3a285c05 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e25228b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:35.120384 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42b8bbe9-d504-4239-84ef-4ccb3a285c05 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.144841 Oct 28 18:10:35.129006 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1038/2000] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:34 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:35.133740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:35.134365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:35.145838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:35.146331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:35.146770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:35.147483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:35.147961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:35.148384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:35.241414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:10:35.242475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquired lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:10:35.635725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:35.644701 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eda6da14-2cde-4e7c-af51-bce69883a365 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1493 microversion: 2.1 time: 0.521131 Oct 28 18:10:35.653133 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1039/2001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:35 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1493 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:35.667551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0f97bb91-9104-438b-b2b1-0cf96c368f0c req-83c16a38-222b-45dd-9dbe-c1c13b7a94b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42126e7-fffb-413e-b662-efb6a5141612", "name": "network-vif-plugged", "status": "completed", "tag": "bda648cd-3190-45fe-ad1e-deb2f2dab3f9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:35.703277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0f97bb91-9104-438b-b2b1-0cf96c368f0c req-83c16a38-222b-45dd-9dbe-c1c13b7a94b7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:35.707037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0f97bb91-9104-438b-b2b1-0cf96c368f0c req-83c16a38-222b-45dd-9dbe-c1c13b7a94b7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:35.707037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0f97bb91-9104-438b-b2b1-0cf96c368f0c req-83c16a38-222b-45dd-9dbe-c1c13b7a94b7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:35.761047 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0f97bb91-9104-438b-b2b1-0cf96c368f0c req-83c16a38-222b-45dd-9dbe-c1c13b7a94b7 service nova] Creating event network-vif-plugged:bda648cd-3190-45fe-ad1e-deb2f2dab3f9 for instance f42126e7-fffb-413e-b662-efb6a5141612 on n-h2-862404-2 Oct 28 18:10:35.789896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0f97bb91-9104-438b-b2b1-0cf96c368f0c req-83c16a38-222b-45dd-9dbe-c1c13b7a94b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135321 Oct 28 18:10:35.798683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1040/2002] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:35.996016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:36.001589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:36.024281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:36.031736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:36.037528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:36.039091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:36.044522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:36.057286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:36.566868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:36.576329 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad1ae794-bd2f-4552-95c3-b23404ffd807 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1198 microversion: 2.1 time: 0.586702 Oct 28 18:10:36.584555 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1041/2003] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:35 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1198 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:36.592762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-859ce714-000e-4743-9d9f-6ed4e4951fac tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2500430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:36.714384 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-859ce714-000e-4743-9d9f-6ed4e4951fac tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.127173 Oct 28 18:10:36.715301 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1042/2004] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:36 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:36.732199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e9c8e59c-6d04-4400-8888-a6b936f8a075 req-aab5292b-8f1c-49df-b8ea-0f7696a89bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeb2151c-7c18-4ede-baa8-237b4570e741", "name": "network-vif-deleted", "tag": "2c7e28ce-6367-499f-82ce-5caba1810020"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:36.778411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e9c8e59c-6d04-4400-8888-a6b936f8a075 req-aab5292b-8f1c-49df-b8ea-0f7696a89bb2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:36.783672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e9c8e59c-6d04-4400-8888-a6b936f8a075 req-aab5292b-8f1c-49df-b8ea-0f7696a89bb2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:36.787465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e9c8e59c-6d04-4400-8888-a6b936f8a075 req-aab5292b-8f1c-49df-b8ea-0f7696a89bb2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:36.814433 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e9c8e59c-6d04-4400-8888-a6b936f8a075 req-aab5292b-8f1c-49df-b8ea-0f7696a89bb2 service nova] Creating event network-vif-deleted:2c7e28ce-6367-499f-82ce-5caba1810020 for instance aeb2151c-7c18-4ede-baa8-237b4570e741 on n-h1-862404-2 Oct 28 18:10:36.826926 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e9c8e59c-6d04-4400-8888-a6b936f8a075 req-aab5292b-8f1c-49df-b8ea-0f7696a89bb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110175 Oct 28 18:10:36.831608 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1043/2005] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:37.237004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Building network info cache for instance {{(pid=120679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:10:37.638225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab1393d8-aecc-4ecf-b5e7-752f4ea9fae7 tempest-NetworksTest-2065381370 tempest-NetworksTest-2065381370-project-admin] Calling method '.version_select at 0x7f78e2500b80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:38.357533 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab1393d8-aecc-4ecf-b5e7-752f4ea9fae7 tempest-NetworksTest-2065381370 tempest-NetworksTest-2065381370-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 7424 microversion: 2.1 time: 1.524051 Oct 28 18:10:38.364927 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1044/2006] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:10:36 2022] GET /compute/v2.1/os-networks => generated 7424 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:38.371029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:38.372315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:38.389631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:38.390532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:38.391410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:38.392976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:38.393915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:38.396279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:38.462179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:38.463004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:38.464247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:38.470727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lazy-loading 'fault' on Instance uuid aeb2151c-7c18-4ede-baa8-237b4570e741 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:38.564027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Updating instance_info_cache with network_info: [{"id": "8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b", "address": "fa:16:3e:41:18:6d", "network": {"id": "2f07a1ed-dcf0-4f21-8e72-1fd26182882c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-100822631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c02c831e9a9148bf969ff1425c464471", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8235c1f2-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:10:38.591690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Releasing lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:10:38.592872 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4a8f32e1-b132-439c-b66f-4be3ccc2c61b tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action" status: 202 len: 0 microversion: 2.1 time: 4.980064 Oct 28 18:10:38.593991 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 963/2007] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:33 2022] POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action => generated 0 bytes in 4984 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:10:38.606605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:38.613887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b892cd4bff49b78773d9b78da06bcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c759088012747259c1329ac2190ee65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:38.617746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:38.630223 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-85419554-98c4-481b-bbb4-43dce0130ba1 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 200 len: 1297 microversion: 2.1 time: 0.263921 Oct 28 18:10:38.633860 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1045/2008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:38 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 1297 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:38.640408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:38.643249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b477a0d6-2ded-4b01-959f-132218e97c65 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e24cc4c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:38.644099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:38.644779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:38.645727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:38.648646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:38.652277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:38.754967 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b477a0d6-2ded-4b01-959f-132218e97c65 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.118019 Oct 28 18:10:38.760667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1046/2009] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:38 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:38.766565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82a77100-d9b1-4b44-b515-7b55d4be844f tempest-NetworksTest-2065381370 tempest-NetworksTest-2065381370-project-admin] Calling method '.version_select at 0x7f78e2500430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:39.133584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82a77100-d9b1-4b44-b515-7b55d4be844f tempest-NetworksTest-2065381370 tempest-NetworksTest-2065381370-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/a41bb833-4927-4a7c-8da1-ac702b1559ab" status: 200 len: 652 microversion: 2.1 time: 0.371497 Oct 28 18:10:39.135429 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1047/2010] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:10:38 2022] GET /compute/v2.1/os-networks/a41bb833-4927-4a7c-8da1-ac702b1559ab => generated 652 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:39.393233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72d35f51-84a3-488f-a2ef-ab604b134866 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Action: 'create', calling method: .version_select at 0x7f78e248ce50>, body: {"keypair": {"name": "tempest-keypair-1147233278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUj7j2xng9Aj5Vd+4eT+ALJ41AxiHrRnEztrQFDX1dcRR/QSEw5R1oOdJxXCcLrsM7/uabxz1jAnCBuAVv46r3l0EJFzlefS6L2MLBsuTvFQ+GDqUYCNXWCqrbdPBmpNg=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:39.433152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-72d35f51-84a3-488f-a2ef-ab604b134866 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:39.447526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-72d35f51-84a3-488f-a2ef-ab604b134866 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:39.514861 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72d35f51-84a3-488f-a2ef-ab604b134866 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.377984 Oct 28 18:10:39.522273 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1048/2011] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 18:10:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 386 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:10:39.530104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f464fc14-560c-44ea-90fd-128580d0be13 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '.version_select at 0x7f78e25004c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:39.648779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:39.659219 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79b36a97-6748-4992-b2d1-54486ee7d714 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1381 microversion: 2.1 time: 1.063325 Oct 28 18:10:39.661639 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 964/2012] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:38 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1381 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:39.669544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e2474ab0-9046-4826-9bef-f196fbab5f18 req-1e9ab4b3-dd3d-4fae-b7b2-5a8e8228d3bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f25a90-6f6f-4efa-a990-116d1a2fddaa", "tag": "8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:39.688973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2474ab0-9046-4826-9bef-f196fbab5f18 req-1e9ab4b3-dd3d-4fae-b7b2-5a8e8228d3bb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:39.699209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2474ab0-9046-4826-9bef-f196fbab5f18 req-1e9ab4b3-dd3d-4fae-b7b2-5a8e8228d3bb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:39.700541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2474ab0-9046-4826-9bef-f196fbab5f18 req-1e9ab4b3-dd3d-4fae-b7b2-5a8e8228d3bb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:39.724583 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e2474ab0-9046-4826-9bef-f196fbab5f18 req-1e9ab4b3-dd3d-4fae-b7b2-5a8e8228d3bb service nova] Creating event network-changed:8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b for instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa on n-h1-862404-2 Oct 28 18:10:39.735388 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e2474ab0-9046-4826-9bef-f196fbab5f18 req-1e9ab4b3-dd3d-4fae-b7b2-5a8e8228d3bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071884 Oct 28 18:10:39.736066 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 965/2013] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:39.741880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7537385e-9bc4-48f2-bfd8-25928c11e90b tempest-NetworksTest-2065381370 tempest-NetworksTest-2065381370-project-admin] Calling method '.version_select at 0x7f78e23a7f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:40.173348 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7537385e-9bc4-48f2-bfd8-25928c11e90b tempest-NetworksTest-2065381370 tempest-NetworksTest-2065381370-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 7424 microversion: 2.1 time: 0.435950 Oct 28 18:10:40.173964 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 966/2014] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:10:39 2022] GET /compute/v2.1/os-networks => generated 7424 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:40.184687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62e4ff4c-2673-46a3-94a7-7e5a3849d163 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e2362ca0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:40.215628 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62e4ff4c-2673-46a3-94a7-7e5a3849d163 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1147233278" status: 200 len: 513 microversion: 2.2 time: 0.035655 Oct 28 18:10:40.226581 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 967/2015] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Oct 28 18:10:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1147233278 => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:40.232496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:40.233257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: aeb2151c-7c18-4ede-baa8-237b4570e741] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:40.250912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:40.251416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:40.256775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:40.259895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:40.260455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:40.260914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:40.293309 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance aeb2151c-7c18-4ede-baa8-237b4570e741 could not be found. Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 HTTP/1.1 Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:40.304086 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance aeb2151c-7c18-4ede-baa8-237b4570e741 could not be found. Oct 28 18:10:40.305925 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'aeb2151c-7c18-4ede-baa8-237b4570e741'} Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb2151c-7c18-4ede-baa8-237b4570e741 could not be found. Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:40.306806 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb2151c-7c18-4ede-baa8-237b4570e741 could not be found. Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb2151c-7c18-4ede-baa8-237b4570e741 could not be found. Oct 28 18:10:40.308179 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:40.309475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance aeb2151c-7c18-4ede-baa8-237b4570e741 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:40.309475 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-643e529c-8512-41db-93b5-4ab2c17423fd tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741" status: 404 len: 111 microversion: 2.1 time: 0.084042 Oct 28 18:10:40.311084 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 968/2016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:40 2022] GET /compute/v2.1/servers/aeb2151c-7c18-4ede-baa8-237b4570e741 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:40.656513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:40.657931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:40.674340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:40.680643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:40.681479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:40.684772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:40.685724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:40.686398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.166873 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c7aa41b8-63f0-4f0c-a9d7-349fb1c6d298 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1532 microversion: 2.1 time: 0.854621 Oct 28 18:10:41.169540 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 969/2017] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:40 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1532 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:41.194781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e1f54ba-1512-4730-b0b0-511b8181ca84 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23c5940>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:41.253675 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3e1f54ba-1512-4730-b0b0-511b8181ca84 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.071467 Oct 28 18:10:41.262943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 970/2018] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:41 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:41.268648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a93f018a-12d0-4c13-bafe-9dbe47fa7f6b tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e23091f0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:41.297160 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a93f018a-12d0-4c13-bafe-9dbe47fa7f6b tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147233278" status: 204 len: 0 microversion: 2.2 time: 0.032483 Oct 28 18:10:41.298537 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 971/2019] 10.222.0.16 () {60 vars in 1261 bytes} [Fri Oct 28 18:10:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147233278 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:41.306849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:41.307749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:41.317727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.318712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.319484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.320580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.321333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.322030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.345524 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c HTTP/1.1 Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:41.349088 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.350659 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '7e5dcb46-e496-422a-a3e3-247b17f4dc7c'} Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:41.351505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.352921 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.357905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:41.359125 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8030f504-a052-40b6-bcbe-99e052746140 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 404 len: 111 microversion: 2.1 time: 0.059030 Oct 28 18:10:41.360332 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 972/2020] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:41 2022] DELETE /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:41.367336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:41.368712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:41.375923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.377008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.378531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.379803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.380533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.381239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.663355 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fc917efc-b7a0-40d7-b123-736e128d53b2 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1532 microversion: 2.1 time: 0.301494 Oct 28 18:10:41.667638 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 973/2021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:41 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1532 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:41.672458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8a15d8d-d05e-4a9c-94fe-d3a66f794c0c tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Action: 'create', calling method: .version_select at 0x7f78e231b670>, body: {"keypair": {"name": "tempest-keypair-1273470069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjJnEbJ33xRqTsjWvt1/TQoCjn1nXkP5/SgJ8BOUT9wIKWF0lRxJK3Xa3STWzapvQwtaHzlqvsDuuS8xbfmBIonMzGX9g4lVZa97+qn1B1ZhaRI+2m8WwtC6NrwkJw6rA=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:41.727710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-d8a15d8d-d05e-4a9c-94fe-d3a66f794c0c tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:41.739454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:41.740659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-d8a15d8d-d05e-4a9c-94fe-d3a66f794c0c tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:41.833415 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8a15d8d-d05e-4a9c-94fe-d3a66f794c0c tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.164053 Oct 28 18:10:41.839589 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 974/2022] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 18:10:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:10:41.841170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:41.841808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 7e5dcb46-e496-422a-a3e3-247b17f4dc7c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:41.866473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.866986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.867435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.868190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.874981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.874981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.922489 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c HTTP/1.1 Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:41.925577 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.927245 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '7e5dcb46-e496-422a-a3e3-247b17f4dc7c'} Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:41.928115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. Oct 28 18:10:41.929495 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:41.931734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 7e5dcb46-e496-422a-a3e3-247b17f4dc7c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:41.931734 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1b9cb6c9-c5a6-4bec-ae55-a1d6d74d9687 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c" status: 404 len: 111 microversion: 2.1 time: 0.092047 Oct 28 18:10:41.947949 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 975/2023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:41 2022] GET /compute/v2.1/servers/7e5dcb46-e496-422a-a3e3-247b17f4dc7c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:41.955901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b28079ec-5bd4-4b3a-9312-935e6e1f0545 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:41.963714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b28079ec-5bd4-4b3a-9312-935e6e1f0545 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.966931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b28079ec-5bd4-4b3a-9312-935e6e1f0545 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.969929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b28079ec-5bd4-4b3a-9312-935e6e1f0545 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.971035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b28079ec-5bd4-4b3a-9312-935e6e1f0545 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.972374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b28079ec-5bd4-4b3a-9312-935e6e1f0545 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.976173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b28079ec-5bd4-4b3a-9312-935e6e1f0545 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:42.036164 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b28079ec-5bd4-4b3a-9312-935e6e1f0545 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.086478 Oct 28 18:10:42.037394 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 976/2024] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:10:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:42.045466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:42.048632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:42.074900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:42.077029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:42.079388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:42.080390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:42.083205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:42.083895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:42.136575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:42.365408 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-877b3990-de3b-4b12-8278-31746d59f529 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 204 len: 0 microversion: 2.25 time: 0.326237 Oct 28 18:10:42.366969 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 977/2025] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:10:42 2022] DELETE /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:10:42.373634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6546f915-d8c1-48e9-8f4d-bc8db921e5e0 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e2309280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:42.401542 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6546f915-d8c1-48e9-8f4d-bc8db921e5e0 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273470069" status: 204 len: 0 microversion: 2.2 time: 0.032830 Oct 28 18:10:42.402709 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 978/2026] 10.222.0.16 () {60 vars in 1261 bytes} [Fri Oct 28 18:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273470069 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:42.418490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c18366a3-cc0b-4df6-91b9-9a1458d0035b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e231bd30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:42.454042 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-c18366a3-cc0b-4df6-91b9-9a1458d0035b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Image not found. Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c18366a3-cc0b-4df6-91b9-9a1458d0035b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 HTTP/1.1 Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:42.456645 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1beceb79-aa6c-4e01-af51-93dca9aa2953'} Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:42.458729 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1beceb79-aa6c-4e01-af51-93dca9aa2953 to delete Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:42.459881 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1beceb79-aa6c-4e01-af51-93dca9aa2953 could not be found. Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:42.461206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c18366a3-cc0b-4df6-91b9-9a1458d0035b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c18366a3-cc0b-4df6-91b9-9a1458d0035b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953" status: 404 len: 62 microversion: 2.1 time: 0.054258 Oct 28 18:10:42.464119 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 979/2027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:42 2022] DELETE /compute/v2.1/images/1beceb79-aa6c-4e01-af51-93dca9aa2953 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:42.469894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862404-2", "block_migration": false, "disk_over_commit": false}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:42.475711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:42.482994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:42.483783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:42.484354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:42.485096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:42.485740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:42.486238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:42.525306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lazy-loading 'flavor' on Instance uuid f42126e7-fffb-413e-b662-efb6a5141612 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:42.567255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Going to try to live migrate instance to n-h1-862404-2 {{(pid=120679) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:10:42.862131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f464fc14-560c-44ea-90fd-128580d0be13 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/7a65659f-3b47-4df6-835a-7487a48f1b35" status: 202 len: 0 microversion: 2.1 time: 3.337421 Oct 28 18:10:42.865962 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1049/2028] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:10:39 2022] DELETE /compute/v2.1/os-floating-ips/7a65659f-3b47-4df6-835a-7487a48f1b35 => generated 0 bytes in 3343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:10:42.873295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69d273dc-0c9a-4a3f-ab6d-fada2431c96c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e248c160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:42.996019 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69d273dc-0c9a-4a3f-ab6d-fada2431c96c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.125886 Oct 28 18:10:42.997783 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1050/2029] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:42 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:43.003489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:43.004681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:43.014621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.016656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.017355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:43.019160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.019917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.020607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:43.511408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:43.531600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:43.535969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:43.538057 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90dfcfdc-8d01-4a9b-8683-e4270fd27285 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1729 microversion: 2.25 time: 0.539122 Oct 28 18:10:43.539451 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1051/2030] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:42 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1729 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:43.545498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d4d1817-68cc-46bc-939a-e396d4007c21 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Action: 'create', calling method: .version_select at 0x7f78e2518280>, body: {"keypair": {"name": "tempest-keypair-1136858404", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:43.568798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6d4d1817-68cc-46bc-939a-e396d4007c21 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:43.576606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6d4d1817-68cc-46bc-939a-e396d4007c21 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:43.639469 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d4d1817-68cc-46bc-939a-e396d4007c21 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.096801 Oct 28 18:10:43.648088 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1052/2031] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 18:10:43 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:10:43.654297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:43.670137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:43.693074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.695861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.699279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:43.700431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.702321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.702953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:43.760759 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 HTTP/1.1 Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:43.763454 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.765397 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '739ffed6-e9db-4597-b1f1-ccc8bec1de12'} Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:43.766488 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.768171 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.775375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:43.776671 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-58615ae7-90ae-480c-b54e-503015412c04 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 404 len: 111 microversion: 2.1 time: 0.127262 Oct 28 18:10:43.780885 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1053/2032] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:43 2022] DELETE /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:43.799191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2664876-24cc-4971-aa28-b5448ef39d5e tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2664876-24cc-4971-aa28-b5448ef39d5e tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Request method failure captured: Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action HTTP/1.1 Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 34 Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBrxLt94_LhYey-oYUZg9c563iKPX3_yQH1d47s2cXtvNOBPdWLXSRDfoNVWF8UYckXvEkRiTFWnwmJRUf4ynEsz7J2xBTEovHv1FJ3sH46Xwh-wSXMVDg2JJV_R3djH1RJUmoHfpYQERpMKYCdAG-hpB-u37a1DmbRnvWeRhlL261s Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:43.811144 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c02c831e9a9148bf969ff1425c464471", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a59c69413630492a8cc620a32478324b Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: {"addFloatingIp": {"address": ""}} Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:10:43.812836 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f8f25a90-6f6f-4efa-a990-116d1a2fddaa', 'body': {'addFloatingIp': {'address': ''}}} Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '' Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:43.814051 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:10:43.816403 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:10:43.818379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 18:10:43.818379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.818379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2664876-24cc-4971-aa28-b5448ef39d5e tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:43.818379 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2664876-24cc-4971-aa28-b5448ef39d5e tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action" status: 400 len: 142 microversion: 2.1 time: 0.032723 Oct 28 18:10:43.818379 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1054/2033] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:43 2022] POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action => generated 142 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:10:43.830408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db05e1f2-851d-49aa-a95b-627586fdce8f tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e25183a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:43.884174 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db05e1f2-851d-49aa-a95b-627586fdce8f tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136858404" status: 204 len: 0 microversion: 2.2 time: 0.065789 Oct 28 18:10:43.893432 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1055/2034] 10.222.0.16 () {60 vars in 1261 bytes} [Fri Oct 28 18:10:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136858404 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:43.899417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:43.900317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 739ffed6-e9db-4597-b1f1-ccc8bec1de12] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:43.907167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.907973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.908925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:43.910184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.910845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.911452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:43.932476 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 HTTP/1.1 Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:43.936363 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.939301 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '739ffed6-e9db-4597-b1f1-ccc8bec1de12'} Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:43.940305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. Oct 28 18:10:43.943674 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:43.947748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 739ffed6-e9db-4597-b1f1-ccc8bec1de12 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:43.948851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6044a083-f809-4c3c-b16c-b45781f5fe7e tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12" status: 404 len: 111 microversion: 2.1 time: 0.053638 Oct 28 18:10:43.950271 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1056/2035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:43 2022] GET /compute/v2.1/servers/739ffed6-e9db-4597-b1f1-ccc8bec1de12 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:43.956249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:43.960027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:43.967956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.968815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.969569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:43.973164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.974055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.974842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:44.011511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:10:44.012523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquired lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:10:44.196893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Releasing lock "refresh_cache-f8f25a90-6f6f-4efa-a990-116d1a2fddaa" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:10:44.197795 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] HTTP exception thrown: floating IP not found Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Request method failure captured: Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action HTTP/1.1 Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 41 Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBrxLt94_LhYey-oYUZg9c563iKPX3_yQH1d47s2cXtvNOBPdWLXSRDfoNVWF8UYckXvEkRiTFWnwmJRUf4ynEsz7J2xBTEovHv1FJ3sH46Xwh-wSXMVDg2JJV_R3djH1RJUmoHfpYQERpMKYCdAG-hpB-u37a1DmbRnvWeRhlL261s Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:44.199647 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c02c831e9a9148bf969ff1425c464471", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a59c69413630492a8cc620a32478324b Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:10:44.201180 n-d-862404-2 devstack@n-api.service[120680]: exception: floating IP not found Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f8f25a90-6f6f-4efa-a990-116d1a2fddaa', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:44.202068 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 28 18:10:44.203384 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.206075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Returning 404 to user: floating IP not found {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:44.207131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dfad9d32-7018-4778-81b2-70186c4b9e67 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action" status: 404 len: 67 microversion: 2.1 time: 0.255609 Oct 28 18:10:44.214320 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1057/2036] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:43 2022] POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action => generated 67 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:44.219748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-367efb56-ab51-4d52-b3a5-3cdae4367090 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Action: 'create', calling method: .version_select at 0x7f78e2469670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-761210979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaXTMBM5Y1U8geriCnNMP7Yenke7gK5L8C5JI3LdsTryQQDXXZEfgbdAIfhS7Fxyfmd/+4Yhm1em86ur/IHr89MUTAEMhY24MgGcg7L61tQahy4QPZWl0+mrMumAxDnmQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:44.233270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:44.240939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-367efb56-ab51-4d52-b3a5-3cdae4367090 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:44.249488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-367efb56-ab51-4d52-b3a5-3cdae4367090 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:44.286891 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-367efb56-ab51-4d52-b3a5-3cdae4367090 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.070961 Oct 28 18:10:44.288247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1058/2037] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 18:10:44 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:10:44.294418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a91a312-b9fe-4235-9c04-d2cac2192750 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e24663a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:44.330550 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-9a91a312-b9fe-4235-9c04-d2cac2192750 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Image not found. Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a91a312-b9fe-4235-9c04-d2cac2192750 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 HTTP/1.1 Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:44.331702 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '25c13c03-1b48-4f2f-9080-11d55ea40ff1'} Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:44.334816 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 25c13c03-1b48-4f2f-9080-11d55ea40ff1 to delete Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.335781 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 25c13c03-1b48-4f2f-9080-11d55ea40ff1 could not be found. Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:44.337321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a91a312-b9fe-4235-9c04-d2cac2192750 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a91a312-b9fe-4235-9c04-d2cac2192750 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1" status: 404 len: 62 microversion: 2.1 time: 0.043076 Oct 28 18:10:44.338988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1059/2038] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:44 2022] DELETE /compute/v2.1/images/25c13c03-1b48-4f2f-9080-11d55ea40ff1 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:44.352874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc77e128-7007-44ab-8dd5-b7238af80c63 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2469160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:44.426275 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc77e128-7007-44ab-8dd5-b7238af80c63 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.091253 Oct 28 18:10:44.427240 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1060/2039] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:44 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:44.433494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55760450-b891-40d4-ad4c-afdae33db3d1 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Action: 'action', calling method: .version_select at 0x7f78dfe88c10>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:44.527904 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-55760450-b891-40d4-ad4c-afdae33db3d1 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55760450-b891-40d4-ad4c-afdae33db3d1 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Request method failure captured: Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action HTTP/1.1 Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 44 Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBrxLt94_LhYey-oYUZg9c563iKPX3_yQH1d47s2cXtvNOBPdWLXSRDfoNVWF8UYckXvEkRiTFWnwmJRUf4ynEsz7J2xBTEovHv1FJ3sH46Xwh-wSXMVDg2JJV_R3djH1RJUmoHfpYQERpMKYCdAG-hpB-u37a1DmbRnvWeRhlL261s Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:44.529569 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c02c831e9a9148bf969ff1425c464471", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a59c69413630492a8cc620a32478324b Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:10:44.531060 n-d-862404-2 devstack@n-api.service[120680]: exception: Floating IP not found for address 0.0.0.0. Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f8f25a90-6f6f-4efa-a990-116d1a2fddaa', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:44.532005 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 28 18:10:44.533341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.535587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55760450-b891-40d4-ad4c-afdae33db3d1 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:44.535587 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55760450-b891-40d4-ad4c-afdae33db3d1 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action" status: 404 len: 88 microversion: 2.1 time: 0.102026 Oct 28 18:10:44.535587 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1061/2040] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:44 2022] POST /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa/action => generated 88 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:44.541094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07f787af-0bdc-4340-b032-41fd40d6ec68 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Action: 'create', calling method: .version_select at 0x7f78e23fdc10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-655006303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQJoBkZzuyUqz8PJlVVO/R1qW5xSxzGmwWdAQqvnn0jz7wOhm6y/2Awtnzuyy0KikUD8M4XTGJV6b45gy69ZoSXRKsgK1gnk/JkH8M0nDYotjr3wtl5hYMM7BkdAOwqJQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:44.587107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-07f787af-0bdc-4340-b032-41fd40d6ec68 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:44.597322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-07f787af-0bdc-4340-b032-41fd40d6ec68 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:44.629002 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07f787af-0bdc-4340-b032-41fd40d6ec68 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.096164 Oct 28 18:10:44.631808 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1062/2041] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 18:10:44 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:10:44.642669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:44.644673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:44.655076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:44.655976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:44.656755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:44.657673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:44.658399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:44.659002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:44.676958 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 HTTP/1.1 Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:44.679051 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:44.680591 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '9d8c7646-a0a7-45ab-b60e-a55d373908d7'} Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:44.681453 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:44.682887 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:44.686252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:44.687329 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ba69e78-f203-4fc9-93aa-96835ad23cd2 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 404 len: 111 microversion: 2.1 time: 0.054322 Oct 28 18:10:44.688679 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1063/2042] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:44 2022] DELETE /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:44.710774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:44.714231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:44.731993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:44.734708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:44.736565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:44.739405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:44.741300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:44.742365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:44.780226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:44.793364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:44.974002 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-167263d0-960d-4295-b43c-b96ab94dc47a tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 204 len: 0 microversion: 2.1 time: 0.283695 Oct 28 18:10:44.975248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1064/2043] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:44 2022] DELETE /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:44.983079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:44.984063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:44.992083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:44.992590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:44.993127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:44.993914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:44.994317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:44.994992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.111136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:45.130801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:45.132334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:45.138407 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2a32980-d83c-412b-9ee7-fd78823b429a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1663 microversion: 2.25 time: 0.161712 Oct 28 18:10:45.158424 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1065/2044] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:44 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1663 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:45.182970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2e090e5-154a-4152-9cc5-7bc0c2be72b0 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Action: 'create', calling method: .version_select at 0x7f78e23fd040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1953101403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/tT+saY9VuxbCPrlipxzYulE3LLsSeau37wa8stfn+rslhh6LQ1F15uFVkJHGvtbEnPBxwybpA5Ye3MZYrB8iWuPp8ZyhPXeRDkghs72743ssfbFy3ltxWVjmDbsAc+A=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:45.239732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d2e090e5-154a-4152-9cc5-7bc0c2be72b0 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:45.270280 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-977b704c-2e33-4ae8-b703-7974a513e51b tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612/action" status: 202 len: 0 microversion: 2.1 time: 2.806713 Oct 28 18:10:45.270959 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 980/2045] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:10:42 2022] POST /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612/action => generated 0 bytes in 2810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:10:45.278150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.279019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 9d8c7646-a0a7-45ab-b60e-a55d373908d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:45.287300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d2e090e5-154a-4152-9cc5-7bc0c2be72b0 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:45.318890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.332884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.333900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.334848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.335487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.336103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.368962 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 HTTP/1.1 Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:45.370738 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:45.372719 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '9d8c7646-a0a7-45ab-b60e-a55d373908d7'} Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:45.373673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. Oct 28 18:10:45.375147 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.386421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 9d8c7646-a0a7-45ab-b60e-a55d373908d7 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:45.388199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a4d9b44-4fb8-4931-938e-adb06a83ca56 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7" status: 404 len: 111 microversion: 2.1 time: 0.115506 Oct 28 18:10:45.388985 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 981/2046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:45 2022] GET /compute/v2.1/servers/9d8c7646-a0a7-45ab-b60e-a55d373908d7 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:45.391990 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2e090e5-154a-4152-9cc5-7bc0c2be72b0 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.229987 Oct 28 18:10:45.392646 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1066/2047] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 18:10:45 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:10:45.405194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.406108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:45.412635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.413263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:45.426014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.426724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.427689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.428698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.429176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.429613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.431059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.431059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.431369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.432109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.432568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.433058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.727113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:45.737686 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bd478a32-11d8-482f-b2eb-6a27b73757c0 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1541 microversion: 2.1 time: 0.343759 Oct 28 18:10:45.753465 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 982/2048] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:45 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1541 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:45.769093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-46b04c3b-0630-489e-b7e8-254f7e05b6fc req-a3b83030-8159-4ce7-8829-bc7bce1825b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad1f5bd-5eed-4cfa-b39b-09586df2a2fa", "name": "network-vif-deleted", "tag": "054624fe-f0fe-4640-8933-f7cf1a970e75"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:45.785327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-46b04c3b-0630-489e-b7e8-254f7e05b6fc req-a3b83030-8159-4ce7-8829-bc7bce1825b4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.786434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-46b04c3b-0630-489e-b7e8-254f7e05b6fc req-a3b83030-8159-4ce7-8829-bc7bce1825b4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.787072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-46b04c3b-0630-489e-b7e8-254f7e05b6fc req-a3b83030-8159-4ce7-8829-bc7bce1825b4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.823057 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-46b04c3b-0630-489e-b7e8-254f7e05b6fc req-a3b83030-8159-4ce7-8829-bc7bce1825b4 service nova] Creating event network-vif-deleted:054624fe-f0fe-4640-8933-f7cf1a970e75 for instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa on n-h1-862404-2 Oct 28 18:10:45.842900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:45.850424 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-46b04c3b-0630-489e-b7e8-254f7e05b6fc req-a3b83030-8159-4ce7-8829-bc7bce1825b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095008 Oct 28 18:10:45.856074 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 983/2049] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:45.857862 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3848224-0925-4864-bfa7-abb51592214a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.464158 Oct 28 18:10:45.872629 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1067/2050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:45 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:45.884280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46938cf7-62bd-4ece-8577-1478019e92dc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e23e8670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.886857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e3ff9f5-e230-47ee-ad65-7bc1cc8afa1c tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e2500820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.896283 n-d-862404-2 devstack@n-api.service[120680]: WARNING oslo_db.sqlalchemy.utils [None req-0e3ff9f5-e230-47ee-ad65-7bc1cc8afa1c tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 18:10:45.907706 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e3ff9f5-e230-47ee-ad65-7bc1cc8afa1c tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.039073 Oct 28 18:10:45.908418 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1068/2051] 10.222.0.16 () {60 vars in 1177 bytes} [Fri Oct 28 18:10:45 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:45.915171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e4232b1-19c8-423a-9aaf-4953f6120b90 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2466820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.923528 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-46938cf7-62bd-4ece-8577-1478019e92dc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Image not found. Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46938cf7-62bd-4ece-8577-1478019e92dc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 HTTP/1.1 Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:45.925966 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '9540b910-68a6-42e1-8dbd-8cd6e0473fc1'} Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:45.927585 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9540b910-68a6-42e1-8dbd-8cd6e0473fc1 to delete Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.929189 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9540b910-68a6-42e1-8dbd-8cd6e0473fc1 could not be found. Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:45.930594 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46938cf7-62bd-4ece-8577-1478019e92dc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-46938cf7-62bd-4ece-8577-1478019e92dc tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1" status: 404 len: 62 microversion: 2.1 time: 0.069653 Oct 28 18:10:45.933471 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 984/2052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:45 2022] DELETE /compute/v2.1/images/9540b910-68a6-42e1-8dbd-8cd6e0473fc1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:45.938699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5718025b-8d7d-41c2-b6b5-b1a1ddbae0c4 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e237e430>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.981388 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5718025b-8d7d-41c2-b6b5-b1a1ddbae0c4 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1953101403" status: 204 len: 0 microversion: 2.2 time: 0.047819 Oct 28 18:10:45.985408 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 985/2053] 10.222.0.16 () {60 vars in 1321 bytes} [Fri Oct 28 18:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1953101403 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:45.996906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.997520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:46.001917 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e4232b1-19c8-423a-9aaf-4953f6120b90 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.092373 Oct 28 18:10:46.011122 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1069/2054] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:45 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:46.016112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa37d671-48ce-417b-bd95-09e9963e1259 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e25004c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.024910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.025411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.025849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.026561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.027016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.027431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.050456 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e HTTP/1.1 Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:46.052421 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.054323 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '3474cd55-0481-4698-a73f-f4666dc5164e'} Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:46.055323 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.057030 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.058672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:46.058672 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14f1a45c-920e-445e-bf5d-2096f71f6f0b tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 404 len: 111 microversion: 2.1 time: 0.070006 Oct 28 18:10:46.074351 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 986/2055] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:45 2022] DELETE /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:46.075785 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa37d671-48ce-417b-bd95-09e9963e1259 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-655006303" status: 204 len: 0 microversion: 2.2 time: 0.063538 Oct 28 18:10:46.085957 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1070/2056] 10.222.0.16 () {60 vars in 1318 bytes} [Fri Oct 28 18:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-655006303 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:46.091356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6cad49cc-137a-472b-9dba-aca86cf5f795 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e2466670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.112763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.114293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 3474cd55-0481-4698-a73f-f4666dc5164e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:46.133918 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6cad49cc-137a-472b-9dba-aca86cf5f795 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-761210979" status: 204 len: 0 microversion: 2.2 time: 0.046423 Oct 28 18:10:46.135927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.139396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1071/2057] 10.222.0.16 () {60 vars in 1318 bytes} [Fri Oct 28 18:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-761210979 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:46.140197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.140832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.142663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.143293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.144554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.152225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a74b45c-a1a6-4d2f-a4cf-aa79538963fc tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Action: 'create', calling method: .version_select at 0x7f78e2469ca0>, body: {"keypair": {"name": "tempest-keypair-412689947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2eeUc8V/Hk8V34+zpQyuKT90ampYgUm8hznXtc7mF++tWFFTVkoIPiI+1ddzfMYzYTLOtbZTgBjI71BX4OQozAp3XXqoKYNvm2kgzQfh3tYi7zCT6/2KAyH7/jDtcLcQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:46.165918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:46.206639 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e HTTP/1.1 Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:46.213941 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.215669 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '3474cd55-0481-4698-a73f-f4666dc5164e'} Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:46.216591 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. Oct 28 18:10:46.220697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.228380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 3474cd55-0481-4698-a73f-f4666dc5164e could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:46.230592 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20139512-ee39-435c-b8dc-424548517c37 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e" status: 404 len: 111 microversion: 2.1 time: 0.135074 Oct 28 18:10:46.231803 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 987/2058] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:46 2022] GET /compute/v2.1/servers/3474cd55-0481-4698-a73f-f4666dc5164e => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:46.240198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0a74b45c-a1a6-4d2f-a4cf-aa79538963fc tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:46.242335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.243210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:46.251452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0a74b45c-a1a6-4d2f-a4cf-aa79538963fc tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:46.258024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.259482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.260297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.262127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.263152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.264115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.316248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.317461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.318376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.319057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lazy-loading 'fault' on Instance uuid dad1f5bd-5eed-4cfa-b39b-09586df2a2fa {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:46.344176 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a74b45c-a1a6-4d2f-a4cf-aa79538963fc tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.195763 Oct 28 18:10:46.344797 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1072/2059] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 18:10:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 28 18:10:46.351142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f8a6ea8-82a5-4daa-98d8-f5723ccadc91 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '.version_select at 0x7f78e2451790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.397180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4f8a6ea8-82a5-4daa-98d8-f5723ccadc91 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Image not found. Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f8a6ea8-82a5-4daa-98d8-f5723ccadc91 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 HTTP/1.1 Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:46.399071 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8d624ae1-dcfd-47ef-ac5d-d23b64315779'} Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:46.400963 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8d624ae1-dcfd-47ef-ac5d-d23b64315779 to delete Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.402202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8d624ae1-dcfd-47ef-ac5d-d23b64315779 could not be found. Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:46.403735 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:10:46.405439 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.407344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f8a6ea8-82a5-4daa-98d8-f5723ccadc91 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:46.412534 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f8a6ea8-82a5-4daa-98d8-f5723ccadc91 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779" status: 404 len: 62 microversion: 2.1 time: 0.061630 Oct 28 18:10:46.419610 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1073/2060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:46 2022] DELETE /compute/v2.1/images/8d624ae1-dcfd-47ef-ac5d-d23b64315779 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:10:46.427603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db71a58c-7bbc-4abe-8ee1-18eb36661f71 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e24691f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.437349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:46.457809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:46.459059 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db71a58c-7bbc-4abe-8ee1-18eb36661f71 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-412689947" status: 200 len: 512 microversion: 2.2 time: 0.034725 Oct 28 18:10:46.460093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1074/2061] 10.222.0.16 () {60 vars in 1255 bytes} [Fri Oct 28 18:10:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-412689947 => generated 512 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:46.461138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:46.465102 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c016359a-f8ce-4816-b894-011770a6f015 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 200 len: 1375 microversion: 2.25 time: 0.231716 Oct 28 18:10:46.465964 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 988/2062] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:46 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 1375 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:46.485226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.486553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:46.494178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.494722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.495158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.495888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.496380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.496803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.506214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f07bc82a-f078-4dfc-bb0c-2009e0fee208 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e231baf0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.524255 n-d-862404-2 devstack@n-api.service[120679]: WARNING oslo_db.sqlalchemy.utils [None req-f07bc82a-f078-4dfc-bb0c-2009e0fee208 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 18:10:46.541909 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f07bc82a-f078-4dfc-bb0c-2009e0fee208 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.048102 Oct 28 18:10:46.547362 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.547588 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 989/2063] 10.222.0.16 () {60 vars in 1177 bytes} [Fri Oct 28 18:10:46 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c HTTP/1.1 Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:46.555611 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.557459 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4a3ae6b5-7f14-4401-9680-ebcf1756a40c'} Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:46.558465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.560113 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.561905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d01bfec9-6e3c-47fa-8cad-c709130ecbd7 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e23a7ca0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.566298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:46.568137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f089ba1-d0f2-45e7-b58a-bd348f794fa6 tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 404 len: 111 microversion: 2.1 time: 0.104671 Oct 28 18:10:46.605002 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d01bfec9-6e3c-47fa-8cad-c709130ecbd7 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-412689947" status: 204 len: 0 microversion: 2.2 time: 0.052467 Oct 28 18:10:46.606146 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 990/2064] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Oct 28 18:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-412689947 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:46.610481 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1075/2065] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:46 2022] DELETE /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:46.614558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.615646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] [instance: 4a3ae6b5-7f14-4401-9680-ebcf1756a40c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:46.631559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.635255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.635949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.636894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.639378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.641099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Action: 'create', calling method: .version_select at 0x7f78e2451430>, body: {"keypair": {"name": "tempest-keypair-267753349", "type": "x509"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:46.641304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.667339 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] HTTP exception thrown: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Request method failure captured: Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c HTTP/1.1 Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBmxRt422io5W15usACaz_Jc1PTLAw_lnJBss6daeq7Z1PYjbs27NiIhydmoAxUAv6nSycbF_HLxMxljz8r6aHC7DobgemtMTwyATC1fImKsvu_Qm5uEfcmY1RMuTp7YkkZm35x3c6k1MwbTSY6OZ465_JP0xW3ez7wmcL2JzF--HPk Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:46.673089 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4c759088012747259c1329ac2190ee65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4c759088012747259c1329ac2190ee65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4c759088012747259c1329ac2190ee65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4c759088012747259c1329ac2190ee65 Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesTestJSON-1602110546 Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 46b892cd4bff49b78773d9b78da06bcd Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesTestJSON-1602110546-project Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.675053 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '4a3ae6b5-7f14-4401-9680-ebcf1756a40c'} Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:46.676172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. Oct 28 18:10:46.677858 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:46.686119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] Returning 404 to user: Instance 4a3ae6b5-7f14-4401-9680-ebcf1756a40c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:46.687303 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0ac3fe08-2e81-4199-889e-aa25b531b33f tempest-ImagesTestJSON-1602110546 tempest-ImagesTestJSON-1602110546-project] 10.222.0.16 "GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c" status: 404 len: 111 microversion: 2.1 time: 0.077442 Oct 28 18:10:46.692138 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 991/2066] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:46 2022] GET /compute/v2.1/servers/4a3ae6b5-7f14-4401-9680-ebcf1756a40c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:10:46.740247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:46.766514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.767148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:46.775093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:46.785108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.785607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.786252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.787287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.787992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.789337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.846076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.processutils [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp5lhgz4p9/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp5lhgz4p9/temp.key -subj /CN=6b65ef034bc249e4ae1720429f04bce4 -extensions v3_req_client {{(pid=120680) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 18:10:47.332128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:47.352323 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e75ddef4-53a1-4411-9dea-64177f7fe846 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1541 microversion: 2.1 time: 0.589368 Oct 28 18:10:47.367845 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 992/2067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:46 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1541 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:47.367845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:47.367845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:47.401422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:47.404046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:47.404579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:47.408007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:47.408507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:47.408948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:47.449478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.processutils [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp5lhgz4p9/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp5lhgz4p9/temp.key -subj /CN=6b65ef034bc249e4ae1720429f04bce4 -extensions v3_req_client" returned: 0 in 0.604s {{(pid=120680) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 18:10:47.451263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.processutils [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp5lhgz4p9/temp.key -password pass: {{(pid=120680) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 18:10:47.517735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.processutils [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp5lhgz4p9/temp.key -password pass:" returned: 0 in 0.066s {{(pid=120680) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 18:10:47.613907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:47.634367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Getting quotas for user 6b65ef034bc249e4ae1720429f04bce4 and project 4b8a21f5dbd34be29a007e8a1f112873. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:47.705419 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d4bd66d8-ad84-4b4b-9fe4-55c4375f8caf tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.092132 Oct 28 18:10:47.716077 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1076/2068] 10.222.0.16 () {62 vars in 1198 bytes} [Fri Oct 28 18:10:46 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1105 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:47.734747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e173ee4-7824-47fb-a7da-88a47e093f9f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2451820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:47.825287 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e173ee4-7824-47fb-a7da-88a47e093f9f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.106407 Oct 28 18:10:47.827695 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1077/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:47 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:47.844420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:47.845635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: dad1f5bd-5eed-4cfa-b39b-09586df2a2fa] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:47.860673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:47.864508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:47.865997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:47.868771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:47.869333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:47.869844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:47.895927 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] HTTP exception thrown: Instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa could not be found. Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Request method failure captured: Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa HTTP/1.1 Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlJAWwsNC2FXcN-06OqTFgVLCW9bL5Fc-mLKLROT4RWlaiW2YLuo1p1_rwor5FlEPDshBObraoyvOzbMrGzYetvxjxDHS0BiiWtr8qydCFWJTjPorkROtRoALH4UW4iM-3MDDObO4pJ7UhWaKFVOJ8ypG_PM2-3ChANbpQX1mZS5aw Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 452c29fdc8114bb985893db1a9d29426 Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:10:47.902596 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_452c29fdc8114bb985893db1a9d29426", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 452c29fdc8114bb985893db1a9d29426 Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-LiveAutoBlockMigrationV225Test-1083167124-project Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 584b38d4097042999ad262ea77966602 Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124-project Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa could not be found. Oct 28 18:10:47.904474 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'dad1f5bd-5eed-4cfa-b39b-09586df2a2fa'} Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa could not be found. Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:47.905554 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa could not be found. Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa could not be found. Oct 28 18:10:47.912774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:10:47.915711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Returning 404 to user: Instance dad1f5bd-5eed-4cfa-b39b-09586df2a2fa could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:47.915711 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-205c05fd-8ecf-4561-aa40-c459ef4bfd59 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa" status: 404 len: 111 microversion: 2.25 time: 0.075114 Oct 28 18:10:47.915711 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1078/2070] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:47 2022] GET /compute/v2.1/servers/dad1f5bd-5eed-4cfa-b39b-09586df2a2fa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:10:47.919303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:47.959053 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-24b4f057-c150-4810-87bb-0f2c7f313d47 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.603611 Oct 28 18:10:47.976952 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 993/2071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:47 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:47.976952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1d23cb1-7463-4ca1-af9f-5ad698ba41a3 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e2312700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:47.992229 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1d23cb1-7463-4ca1-af9f-5ad698ba41a3 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-267753349" status: 200 len: 1533 microversion: 2.2 time: 0.027318 Oct 28 18:10:47.997589 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 994/2072] 10.222.0.16 () {60 vars in 1255 bytes} [Fri Oct 28 18:10:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-267753349 => generated 1533 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:48.016415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9942826-9dcf-4da2-a9c3-480a09e0dc75 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '.version_select at 0x7f78e23c5ca0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:48.083475 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d9942826-9dcf-4da2-a9c3-480a09e0dc75 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235563863" status: 204 len: 0 microversion: 2.25 time: 0.083437 Oct 28 18:10:48.085202 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 995/2073] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Oct 28 18:10:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235563863 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:10:48.108529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67df9b7d-8645-4cf8-becd-0d4fb58dfa6e tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e23629d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:48.122027 n-d-862404-2 devstack@n-api.service[120679]: WARNING oslo_db.sqlalchemy.utils [None req-67df9b7d-8645-4cf8-becd-0d4fb58dfa6e tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 18:10:48.170509 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-67df9b7d-8645-4cf8-becd-0d4fb58dfa6e tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.083058 Oct 28 18:10:48.180388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 996/2074] 10.222.0.16 () {60 vars in 1177 bytes} [Fri Oct 28 18:10:48 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:48.186874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0beebe31-2784-49fd-81d9-337e53983643 req-37ecae55-2d25-4e42-b3ba-3c9fd7821e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f25a90-6f6f-4efa-a990-116d1a2fddaa", "name": "network-vif-deleted", "tag": "8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:48.220511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0beebe31-2784-49fd-81d9-337e53983643 req-37ecae55-2d25-4e42-b3ba-3c9fd7821e60 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:48.222682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0beebe31-2784-49fd-81d9-337e53983643 req-37ecae55-2d25-4e42-b3ba-3c9fd7821e60 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:48.223514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0beebe31-2784-49fd-81d9-337e53983643 req-37ecae55-2d25-4e42-b3ba-3c9fd7821e60 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:48.248078 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0beebe31-2784-49fd-81d9-337e53983643 req-37ecae55-2d25-4e42-b3ba-3c9fd7821e60 service nova] Creating event network-vif-deleted:8235c1f2-91a8-4c0b-bdab-8ff6c83cec1b for instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa on n-h1-862404-2 Oct 28 18:10:48.266814 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0beebe31-2784-49fd-81d9-337e53983643 req-37ecae55-2d25-4e42-b3ba-3c9fd7821e60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083389 Oct 28 18:10:48.270672 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 997/2075] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:48.285211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59001418-9161-42aa-b80c-f48ba2295a23 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] Calling method '.version_select at 0x7f78e2362280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:48.307079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1290136754", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:48.337358 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59001418-9161-42aa-b80c-f48ba2295a23 tempest-KeyPairsV22TestJSON-2062785825 tempest-KeyPairsV22TestJSON-2062785825-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-267753349" status: 204 len: 0 microversion: 2.2 time: 0.063615 Oct 28 18:10:48.338215 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 998/2076] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Oct 28 18:10:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-267753349 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:48.384879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:48.385712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:48.399360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:48.400405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:48.401530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:48.404050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:48.405861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:48.409712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:48.462188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:10:48.605776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:48.609859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:48.613031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:48.616098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lazy-loading 'fault' on Instance uuid f8f25a90-6f6f-4efa-a990-116d1a2fddaa {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:48.833705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59c69413630492a8cc620a32478324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c02c831e9a9148bf969ff1425c464471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:48.853472 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b706dc79-eefb-4b81-a383-9926d0ee1516 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 200 len: 1322 microversion: 2.1 time: 0.470525 Oct 28 18:10:48.853942 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 999/2077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:48 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:48.887590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c31e60f-0d31-4f3a-a874-b7d200d332b4 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e237e8b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:49.033949 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c31e60f-0d31-4f3a-a874-b7d200d332b4 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.175709 Oct 28 18:10:49.041757 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1000/2078] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:48 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:49.057882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:49.059195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:49.080281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.082386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.083284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.088246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.089022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.089636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.189789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:10:49.191084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:10:49.191747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:10:49.192350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:10:49.192963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:10:49.195378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:49.220032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.223703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.224413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.225443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.226079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.226730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.250024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Getting quotas for project 6aa20e2a97184d9e93c88bd42520667e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:49.256580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Getting quotas for user 375f8887d73d4adbabe4ac06d48ccc70 and project 6aa20e2a97184d9e93c88bd42520667e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:49.276116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:10:49.279156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:10:49.350726 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a67145d-2c1d-4bd0-8cef-b175cfa5be16 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444021 Oct 28 18:10:49.352164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1079/2079] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:10:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:10:49.553225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1270381719", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:49.629806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:49.642676 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-34cec919-2340-4f8e-abd5-548e9aa3ed6a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.599487 Oct 28 18:10:49.643506 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1001/2080] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:49 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:49.663158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:10:49.672062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:49.672829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:49.681171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.681933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.682610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.683708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.684646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.685249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.722358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:49.871628 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad5dab35-f88d-48ae-b92a-33771d96dd09 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 204 len: 0 microversion: 2.25 time: 0.205367 Oct 28 18:10:49.872589 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1002/2081] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:10:49 2022] DELETE /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:10:49.888163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:49.889111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] [instance: f8f25a90-6f6f-4efa-a990-116d1a2fddaa] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:49.900317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.901134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.901794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.902607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.903255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.904127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.930270 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] HTTP exception thrown: Instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa could not be found. Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Request method failure captured: Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa HTTP/1.1 Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBrxLt94_LhYey-oYUZg9c563iKPX3_yQH1d47s2cXtvNOBPdWLXSRDfoNVWF8UYckXvEkRiTFWnwmJRUf4ynEsz7J2xBTEovHv1FJ3sH46Xwh-wSXMVDg2JJV_R3djH1RJUmoHfpYQERpMKYCdAG-hpB-u37a1DmbRnvWeRhlL261s Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:49.932442 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c02c831e9a9148bf969ff1425c464471", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c02c831e9a9148bf969ff1425c464471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c02c831e9a9148bf969ff1425c464471 Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a59c69413630492a8cc620a32478324b Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:49.933993 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa could not be found. Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f8f25a90-6f6f-4efa-a990-116d1a2fddaa'} Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa could not be found. Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:49.934879 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa could not be found. Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa could not be found. Oct 28 18:10:49.936722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:49.939749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] Returning 404 to user: Instance f8f25a90-6f6f-4efa-a990-116d1a2fddaa could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:49.939749 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c1578dc-dec8-45e5-bdd0-b04ae96c3634 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435 tempest-FloatingIPsAssociationNegativeTestJSON-1645540435-project] 10.222.0.16 "GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa" status: 404 len: 111 microversion: 2.1 time: 0.056336 Oct 28 18:10:49.939749 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1003/2082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:49 2022] GET /compute/v2.1/servers/f8f25a90-6f6f-4efa-a990-116d1a2fddaa => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:49.962035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:49.963701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:49.980100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.982217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.982734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.984992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.985397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.985839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:50.531338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:50.546360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:50.549403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:50.554450 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-977f53d2-2654-4382-8430-f40084e8e796 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1546 microversion: 2.25 time: 0.617738 Oct 28 18:10:50.555526 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1004/2083] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:49 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1546 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:50.563703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c588a2e2-4c7f-49a7-848c-57e1628e5ec7 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2312700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:50.638418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c588a2e2-4c7f-49a7-848c-57e1628e5ec7 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.081790 Oct 28 18:10:50.648465 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1005/2084] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:50 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:50.673875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:50.674877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:50.681861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:50.682688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:50.683350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:50.684341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:50.684958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:50.685547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:51.057100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:51.077486 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-98a346f9-0f12-4cdb-bc0c-616241f78336 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.404807 Oct 28 18:10:51.078489 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1006/2085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:50 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:51.371701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:10:51.373039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:10:51.373700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:10:51.374420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:10:51.375016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:10:51.399543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:51.401547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:51.402186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:51.403149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:51.405972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:51.406584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:51.469241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Getting quotas for project 6aa20e2a97184d9e93c88bd42520667e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:51.484303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Getting quotas for user 375f8887d73d4adbabe4ac06d48ccc70 and project 6aa20e2a97184d9e93c88bd42520667e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:51.516964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:10:51.522276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:10:51.588742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:51.589918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:51.619369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:51.619990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:51.623342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:51.626940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:51.627705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:51.630838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:51.645882 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80d585f6-d068-48a8-977f-c928b0072c60 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.096870 Oct 28 18:10:51.653038 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1080/2086] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:10:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:10:51.667224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-261a6207-af68-4735-a9bc-9e31f6e2b8d0 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e24afaf0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:51.749126 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-261a6207-af68-4735-a9bc-9e31f6e2b8d0 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.094855 Oct 28 18:10:51.750955 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1081/2087] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:51 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:51.761857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b915739-e440-4b33-94eb-7118cccc5745 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:51.765064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b915739-e440-4b33-94eb-7118cccc5745 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:51.781609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:51.887591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:51.903798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:51.905804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:51.907245 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-faec8874-0de5-4802-8545-bb88b9a4bb14 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1504 microversion: 2.25 time: 0.323504 Oct 28 18:10:51.928519 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1007/2088] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:51 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:10:51.982777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b915739-e440-4b33-94eb-7118cccc5745 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:52.000783 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b915739-e440-4b33-94eb-7118cccc5745 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1214 microversion: 2.1 time: 0.248439 Oct 28 18:10:52.001855 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1082/2089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:51 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:52.106073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:52.107034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:52.109060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:52.120461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:52.125848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:52.127009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:52.130014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:52.131468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:52.133511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:52.768054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ebcf4b4-c205-4b58-bf3e-19659dea009c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2545430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:52.867712 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ebcf4b4-c205-4b58-bf3e-19659dea009c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.103971 Oct 28 18:10:52.870785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1083/2090] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:52 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:52.936207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:52.937021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:52.970538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:52.972809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:52.974681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:52.980933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:52.982899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:52.983591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:53.214817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:53.232868 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ca73b1a-9463-40bf-b18a-f747ba8f60f0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 1.130528 Oct 28 18:10:53.235210 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1008/2091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:52 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:53.272052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:53.272815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:53.291718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:53.293443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:53.296013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:53.297031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:53.297740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:53.298825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:53.393305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:53.411581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:53.413712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:53.420288 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f1f353c-c067-456e-b211-f7d3edae7215 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 200 len: 1330 microversion: 2.25 time: 0.487706 Oct 28 18:10:53.422420 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1084/2092] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:52 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 1330 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:10:53.439604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-60d78102-e9d0-4b15-a5a1-1169ee5a3cd5 req-b044fc89-0982-404d-8871-d0a3e204d2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9053ad37-860b-4069-80b5-9657ddb3e53d", "name": "network-vif-deleted", "tag": "4413e0ac-d5e4-4c8e-bfbf-f4eb63123267"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:53.467683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-60d78102-e9d0-4b15-a5a1-1169ee5a3cd5 req-b044fc89-0982-404d-8871-d0a3e204d2ad service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:53.473237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-60d78102-e9d0-4b15-a5a1-1169ee5a3cd5 req-b044fc89-0982-404d-8871-d0a3e204d2ad service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:53.481848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-60d78102-e9d0-4b15-a5a1-1169ee5a3cd5 req-b044fc89-0982-404d-8871-d0a3e204d2ad service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:53.515590 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-60d78102-e9d0-4b15-a5a1-1169ee5a3cd5 req-b044fc89-0982-404d-8871-d0a3e204d2ad service nova] Creating event network-vif-deleted:4413e0ac-d5e4-4c8e-bfbf-f4eb63123267 for instance 9053ad37-860b-4069-80b5-9657ddb3e53d on n-h1-862404-2 Oct 28 18:10:53.530903 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-60d78102-e9d0-4b15-a5a1-1169ee5a3cd5 req-b044fc89-0982-404d-8871-d0a3e204d2ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104511 Oct 28 18:10:53.540586 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1085/2093] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:53.885389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ca01551-355c-4f3d-b4bc-2cab8ae1a398 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e24611f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:53.996139 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ca01551-355c-4f3d-b4bc-2cab8ae1a398 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.115191 Oct 28 18:10:53.997431 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1086/2094] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:53 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:54.261226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:54.262499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:54.289065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:54.290105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:54.293060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:54.294752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:54.304639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:54.305833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:54.706109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:54.715553 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-48b1b25f-cef2-4adc-aee1-d900e98871cc tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1210 microversion: 2.1 time: 1.478607 Oct 28 18:10:54.719951 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1009/2095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:53 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1210 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:54.739479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:54.742867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9053ad37-860b-4069-80b5-9657ddb3e53d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:54.745164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:54.773497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:54.776514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:54.777268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:54.778268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:54.778952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:54.780595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:54.831484 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] HTTP exception thrown: Instance 9053ad37-860b-4069-80b5-9657ddb3e53d could not be found. Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Request method failure captured: Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d HTTP/1.1 Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBlJAWwsNC2FXcN-06OqTFgVLCW9bL5Fc-mLKLROT4RWlaiW2YLuo1p1_rwor5FlEPDshBObraoyvOzbMrGzYetvxjxDHS0BiiWtr8qydCFWJTjPorkROtRoALH4UW4iM-3MDDObO4pJ7UhWaKFVOJ8ypG_PM2-3ChANbpQX1mZS5aw Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 452c29fdc8114bb985893db1a9d29426 Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:10:54.837312 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_452c29fdc8114bb985893db1a9d29426", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 452c29fdc8114bb985893db1a9d29426 Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-LiveAutoBlockMigrationV225Test-1083167124-project Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 584b38d4097042999ad262ea77966602 Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124-project Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 9053ad37-860b-4069-80b5-9657ddb3e53d could not be found. Oct 28 18:10:54.839034 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '9053ad37-860b-4069-80b5-9657ddb3e53d'} Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9053ad37-860b-4069-80b5-9657ddb3e53d could not be found. Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:54.839969 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9053ad37-860b-4069-80b5-9657ddb3e53d could not be found. Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9053ad37-860b-4069-80b5-9657ddb3e53d could not be found. Oct 28 18:10:54.841469 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:10:54.846365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Returning 404 to user: Instance 9053ad37-860b-4069-80b5-9657ddb3e53d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:54.848399 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f96462d4-56f0-4adb-873c-bd1e65b2ab98 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d" status: 404 len: 111 microversion: 2.25 time: 0.125479 Oct 28 18:10:54.849986 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1010/2096] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:54 2022] GET /compute/v2.1/servers/9053ad37-860b-4069-80b5-9657ddb3e53d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:10:55.083504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:55.099474 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5666e776-6583-4a43-aae0-ef5c7c1e2afb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.842099 Oct 28 18:10:55.101289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1087/2097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:54 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:55.137884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a1ad4e9e-8ab3-43b6-9e7e-9e9dd67d6975 tempest-AbsoluteLimitsTestJSON-1010087803 tempest-AbsoluteLimitsTestJSON-1010087803-project] Calling method '.version_select at 0x7f78ddc1c4c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:55.153905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:55.160991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:55.184746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1ad4e9e-8ab3-43b6-9e7e-9e9dd67d6975 tempest-AbsoluteLimitsTestJSON-1010087803 tempest-AbsoluteLimitsTestJSON-1010087803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.189790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.191312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1ad4e9e-8ab3-43b6-9e7e-9e9dd67d6975 tempest-AbsoluteLimitsTestJSON-1010087803 tempest-AbsoluteLimitsTestJSON-1010087803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.191916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1ad4e9e-8ab3-43b6-9e7e-9e9dd67d6975 tempest-AbsoluteLimitsTestJSON-1010087803 tempest-AbsoluteLimitsTestJSON-1010087803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.193362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1ad4e9e-8ab3-43b6-9e7e-9e9dd67d6975 tempest-AbsoluteLimitsTestJSON-1010087803 tempest-AbsoluteLimitsTestJSON-1010087803-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.193924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1ad4e9e-8ab3-43b6-9e7e-9e9dd67d6975 tempest-AbsoluteLimitsTestJSON-1010087803 tempest-AbsoluteLimitsTestJSON-1010087803-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.194415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1ad4e9e-8ab3-43b6-9e7e-9e9dd67d6975 tempest-AbsoluteLimitsTestJSON-1010087803 tempest-AbsoluteLimitsTestJSON-1010087803-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.200428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.206628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.209606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.210842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.216143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.281848 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a1ad4e9e-8ab3-43b6-9e7e-9e9dd67d6975 tempest-AbsoluteLimitsTestJSON-1010087803 tempest-AbsoluteLimitsTestJSON-1010087803-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.429854 Oct 28 18:10:55.282459 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1011/2098] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 18:10:54 2022] GET /compute/v2.1/limits => generated 511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:55.316674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:10:55.317793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e3792f7-9bfb-4296-a72b-e684ca7db11d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78ddc1cb80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:55.442184 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e3792f7-9bfb-4296-a72b-e684ca7db11d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.158458 Oct 28 18:10:55.449458 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1012/2099] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:55 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:55.638723 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a31ce935-7072-44db-af91-46fc2a682b9a tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 204 len: 0 microversion: 2.25 time: 0.532956 Oct 28 18:10:55.639398 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1088/2100] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:10:55 2022] DELETE /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:10:55.649862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:55.650531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:55.667170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.667666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.670564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.672033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.673804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.675937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.748222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:55.749115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:55.766926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.776356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.779664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.780729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.787335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.794018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:56.254124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:56.280538 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-749a61ab-2b08-445b-b080-2a851f2903e6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1272 microversion: 2.1 time: 0.531078 Oct 28 18:10:56.302636 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1089/2101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:55 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1272 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:56.308150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:56.321090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:56.349309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:56.351764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:56.353958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:56.356461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:56.360058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:56.362745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:56.858909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:56.877425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:56.888812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:56.890171 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-85ad82c9-c862-4092-8cd5-4284c5a6a4f4 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1563 microversion: 2.25 time: 1.245919 Oct 28 18:10:56.890753 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1013/2102] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:55 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1563 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:56.920969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f2fce3da-8351-4095-94c4-5ffaa6254a8d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78ddc14dc0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:57.039902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:57.041103 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f2fce3da-8351-4095-94c4-5ffaa6254a8d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.148884 Oct 28 18:10:57.044016 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1014/2103] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:56 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:57.056410 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13e44a2f-92e4-4c62-ae21-b501d6d97289 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.750460 Oct 28 18:10:57.057053 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1090/2104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:56 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:57.306472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:57.307108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:57.320073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:57.320585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:57.321035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:57.321768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:57.322231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:57.322661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:57.398888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:57.823343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:57.838116 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f3d7032-b4a6-41bb-91c3-92e2bf35f789 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1272 microversion: 2.1 time: 0.535749 Oct 28 18:10:57.854928 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1015/2105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:57 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1272 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:57.959108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:57.960011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:58.005545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.006094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.007992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:58.009687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.010167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.011889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:58.060862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ee0b71ca-2ebe-411e-846f-a71345ba8df0 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78ddc15e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:58.153489 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ee0b71ca-2ebe-411e-846f-a71345ba8df0 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1424 microversion: 2.1 time: 0.096541 Oct 28 18:10:58.164773 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1016/2106] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:58 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:58.173932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:58.175573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:58.185361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.195359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.196102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:58.198906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.199933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.201306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:58.768726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:58.783310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:58.786361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:58.788101 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76831761-dc84-492a-8a53-239509b09190 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1563 microversion: 2.25 time: 0.872873 Oct 28 18:10:58.789042 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1091/2107] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:57 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1563 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:10:58.807227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:58.817680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2ac8dbc5-ace0-4c7a-bd14-feddfb3d6e9e req-bd4acf05-4c17-41f6-9004-9413eb62c5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5060e3-1d73-4594-a7f6-7369dba3c88a", "name": "network-vif-deleted", "tag": "b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:58.860509 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2f62ee20-a076-4efb-bafc-97597d4b855c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.678489 Oct 28 18:10:58.869119 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1017/2108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:58 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:58.889819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2ac8dbc5-ace0-4c7a-bd14-feddfb3d6e9e req-bd4acf05-4c17-41f6-9004-9413eb62c5b9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.890689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2ac8dbc5-ace0-4c7a-bd14-feddfb3d6e9e req-bd4acf05-4c17-41f6-9004-9413eb62c5b9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.892807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2ac8dbc5-ace0-4c7a-bd14-feddfb3d6e9e req-bd4acf05-4c17-41f6-9004-9413eb62c5b9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:58.896545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:58.902879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:58.934350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.935290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.937549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:58.944989 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2ac8dbc5-ace0-4c7a-bd14-feddfb3d6e9e req-bd4acf05-4c17-41f6-9004-9413eb62c5b9 service nova] Creating event network-vif-deleted:b9d3e05a-35c7-4b77-bf51-6cc3f5d6f694 for instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a on n-h1-862404-2 Oct 28 18:10:58.946467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.947283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.949094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:59.000965 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2ac8dbc5-ace0-4c7a-bd14-feddfb3d6e9e req-bd4acf05-4c17-41f6-9004-9413eb62c5b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204314 Oct 28 18:10:59.003470 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1092/2109] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:59.170549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-efe1e3d9-ece7-4924-89a1-17f79a491aed tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e248c9d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:59.285460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:59.310180 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d675b5a2-de22-4ee7-af37-a2d9cd4999ca tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1272 microversion: 2.1 time: 0.436710 Oct 28 18:10:59.313761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-efe1e3d9-ece7-4924-89a1-17f79a491aed tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1433 microversion: 2.1 time: 0.147799 Oct 28 18:10:59.339414 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1093/2110] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:59 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1433 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:59.340410 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1018/2111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:58 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1272 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:59.364003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f417584b-37c5-4981-aabe-5f49c7514f93 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2369670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:59.527928 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f417584b-37c5-4981-aabe-5f49c7514f93 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 200 len: 1433 microversion: 2.1 time: 0.174312 Oct 28 18:10:59.529748 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1019/2112] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:10:59 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 1433 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:59.546799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:59.547603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:59.566780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:59.567410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:59.568235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:59.569749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:59.571077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:59.571853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:59.821937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:59.823284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:10:59.851631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:59.853871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:59.855278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:59.857666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:59.860485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:59.861934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:59.939282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:59.939964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:59.941113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:59.941678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lazy-loading 'fault' on Instance uuid 9d5060e3-1d73-4594-a7f6-7369dba3c88a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:11:00.093923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:00.123536 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99106d40-0d23-4055-86e1-2395fa365cb6 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1467 microversion: 2.1 time: 0.578324 Oct 28 18:11:00.124228 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1094/2113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:59 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1467 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:00.149501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:00.151914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:00.169884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:00.170075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:00.171057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:00.174456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:00.176117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:00.176868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:00.177487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:00.188663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:00.190850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '584b38d4097042999ad262ea77966602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452c29fdc8114bb985893db1a9d29426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:00.197807 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42581744-8e06-4c1d-a4eb-d4975bdbea39 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 200 len: 1352 microversion: 2.25 time: 0.378129 Oct 28 18:11:00.203371 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1020/2114] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:10:59 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 1352 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:11:00.221286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4e0960d-3e58-4c5d-a18d-0045a40ee15c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23694c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:00.344503 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c4e0960d-3e58-4c5d-a18d-0045a40ee15c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/f17ba65f-a473-4179-8631-ca52e11cfd46" status: 200 len: 784 microversion: 2.1 time: 0.139164 Oct 28 18:11:00.345795 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1021/2115] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:00 2022] GET /compute/v2.1/images/f17ba65f-a473-4179-8631-ca52e11cfd46 => generated 784 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:00.364786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:00.366056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:00.388715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:00.392410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:00.396132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:00.397117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:00.397791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:00.398410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:00.821287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:00.829505 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f6fa8997-c14c-4978-846a-8ec5ea62378c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.472709 Oct 28 18:11:00.844515 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1022/2116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:00 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:00.852854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-931227af-3469-4d06-82f2-6af0223f63cd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:00.861322 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-931227af-3469-4d06-82f2-6af0223f63cd tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014632 Oct 28 18:11:00.862619 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1023/2117] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:11:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:00.867545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6dcf183c-ca55-4475-b7c3-2bdf1db16888 req-0cc98483-c0a4-4b53-a28e-3aedcf3a6151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d061a254-5b3d-4d89-acd8-79c1842c684b", "name": "network-vif-unplugged", "status": "completed", "tag": "ccdbe197-71c8-4c99-a4db-0f84eee173b7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:00.879928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6dcf183c-ca55-4475-b7c3-2bdf1db16888 req-0cc98483-c0a4-4b53-a28e-3aedcf3a6151 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:00.880408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6dcf183c-ca55-4475-b7c3-2bdf1db16888 req-0cc98483-c0a4-4b53-a28e-3aedcf3a6151 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:00.880827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6dcf183c-ca55-4475-b7c3-2bdf1db16888 req-0cc98483-c0a4-4b53-a28e-3aedcf3a6151 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:00.892191 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6dcf183c-ca55-4475-b7c3-2bdf1db16888 req-0cc98483-c0a4-4b53-a28e-3aedcf3a6151 service nova] Creating event network-vif-unplugged:ccdbe197-71c8-4c99-a4db-0f84eee173b7 for instance d061a254-5b3d-4d89-acd8-79c1842c684b on n-h1-862404-2 Oct 28 18:11:00.898009 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6dcf183c-ca55-4475-b7c3-2bdf1db16888 req-0cc98483-c0a4-4b53-a28e-3aedcf3a6151 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033893 Oct 28 18:11:00.898618 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1024/2118] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:00.905739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-182a7bea-e911-4b30-b2c4-064d026e374e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2362d30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:01.238811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:01.252567 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6a0651e-4baa-4168-94e2-c9fe5bbda872 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 1.126788 Oct 28 18:11:01.253334 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1095/2119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:00 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:01.287486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8ecfbcd5-46ba-4b52-ae1b-7984371547fe req-87e0140a-d006-4569-8f9d-f4c0b20e250c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9701323d-b2b2-48a1-baf9-4ee8521c95be", "tag": "6b4f741f-8159-46fb-a039-2ded83b18128"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:01.302239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8ecfbcd5-46ba-4b52-ae1b-7984371547fe req-87e0140a-d006-4569-8f9d-f4c0b20e250c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.303121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8ecfbcd5-46ba-4b52-ae1b-7984371547fe req-87e0140a-d006-4569-8f9d-f4c0b20e250c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.304104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8ecfbcd5-46ba-4b52-ae1b-7984371547fe req-87e0140a-d006-4569-8f9d-f4c0b20e250c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.325664 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8ecfbcd5-46ba-4b52-ae1b-7984371547fe req-87e0140a-d006-4569-8f9d-f4c0b20e250c service nova] Creating event network-changed:6b4f741f-8159-46fb-a039-2ded83b18128 for instance 9701323d-b2b2-48a1-baf9-4ee8521c95be on n-h2-862404-2 Oct 28 18:11:01.345131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8ecfbcd5-46ba-4b52-ae1b-7984371547fe req-87e0140a-d006-4569-8f9d-f4c0b20e250c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078931 Oct 28 18:11:01.347453 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1096/2120] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:01.375837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:01.376736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] [instance: 9d5060e3-1d73-4594-a7f6-7369dba3c88a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:01.390552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.391064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.391530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.394271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.394741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.397088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.423373 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] HTTP exception thrown: Instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a could not be found. Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Request method failure captured: Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a HTTP/1.1 Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBlJAWwsNC2FXcN-06OqTFgVLCW9bL5Fc-mLKLROT4RWlaiW2YLuo1p1_rwor5FlEPDshBObraoyvOzbMrGzYetvxjxDHS0BiiWtr8qydCFWJTjPorkROtRoALH4UW4iM-3MDDObO4pJ7UhWaKFVOJ8ypG_PM2-3ChANbpQX1mZS5aw Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 452c29fdc8114bb985893db1a9d29426 Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:11:01.425540 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_452c29fdc8114bb985893db1a9d29426", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/452c29fdc8114bb985893db1a9d29426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 452c29fdc8114bb985893db1a9d29426 Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124 Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-LiveAutoBlockMigrationV225Test-1083167124-project Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 584b38d4097042999ad262ea77966602 Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1083167124-project Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a could not be found. Oct 28 18:11:01.427360 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '9d5060e3-1d73-4594-a7f6-7369dba3c88a'} Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a could not be found. Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:01.428463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a could not be found. Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a could not be found. Oct 28 18:11:01.430094 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:01.432453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] Returning 404 to user: Instance 9d5060e3-1d73-4594-a7f6-7369dba3c88a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:01.434572 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-978f53dc-0dd1-4c37-bf2b-104b6cffb814 tempest-LiveAutoBlockMigrationV225Test-1083167124 tempest-LiveAutoBlockMigrationV225Test-1083167124-project] 10.222.0.16 "GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a" status: 404 len: 111 microversion: 2.25 time: 0.085412 Oct 28 18:11:01.436495 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1097/2121] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:11:01 2022] GET /compute/v2.1/servers/9d5060e3-1d73-4594-a7f6-7369dba3c88a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:11:01.857109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:01.858014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:01.862615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:01.894083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.895181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.895949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.897610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.900285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.901285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.915594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:02.001640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=46 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:02.296004 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-182a7bea-e911-4b30-b2c4-064d026e374e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "DELETE /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 204 len: 0 microversion: 2.1 time: 1.395641 Oct 28 18:11:02.297412 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1025/2122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:00 2022] DELETE /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 0 bytes in 1398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:11:02.303369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:02.308246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:02.328035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:02.330156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:02.330904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:02.332583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:02.336013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:02.338030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:02.465686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:02.473774 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-430ec21b-746f-4f3a-b616-cf1a8ca6d568 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.621263 Oct 28 18:11:02.500879 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1098/2123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:01 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:02.507174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a9b2274-f9c6-4159-b2f4-8a0e5692fe10 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2469ee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:02.561392 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4a9b2274-f9c6-4159-b2f4-8a0e5692fe10 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] HTTP exception thrown: Image not found. Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a9b2274-f9c6-4159-b2f4-8a0e5692fe10 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Request method failure captured: Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 HTTP/1.1 Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBruci8SsJDvchrX7m5dQdnL5W6tq_d9SShW88mD3iD0Kg_WDR9bCu_QeDyau9udCp020g81BxlGGrGrrwKftDNhxfItt-DBk4PKijiXTkS2E0N2hdR3Os884s6EMLrkHQZUzad4YQg8I9ICPTr6KxkHDM_ltURkXVjgwf5vVMDjx0E Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 81a4f32a961a4bad9d00f2fe644a1b72 Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:11:02.562844 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81a4f32a961a4bad9d00f2fe644a1b72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 81a4f32a961a4bad9d00f2fe644a1b72 Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesOneServerTestJSON-1983840474-project Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 8f10e644aa9842e681a4c7bb612a0ab0 Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesOneServerTestJSON-1983840474-project Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9'} Oct 28 18:11:02.564436 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:11:02.566161 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:11:02.567541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 could not be found. Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:11:02.570516 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a9b2274-f9c6-4159-b2f4-8a0e5692fe10 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:02.575067 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a9b2274-f9c6-4159-b2f4-8a0e5692fe10 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 404 len: 62 microversion: 2.1 time: 0.062649 Oct 28 18:11:02.579403 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1099/2124] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:02 2022] GET /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:11:02.586722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1049382269"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:02.589136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:02.612800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:02.613683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:02.614205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:02.614976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:02.615437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:02.615893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:02.945179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:02.962495 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23311470-ca70-4ec4-8946-ccef8c96153e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.663449 Oct 28 18:11:02.962955 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1026/2125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:02 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:03.031243 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d577a233-0ea6-4e4f-b0e0-7acd7a2de69d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "POST /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b/action" status: 202 len: 0 microversion: 2.1 time: 0.450412 Oct 28 18:11:03.043935 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1100/2126] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:11:02 2022] POST /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:11:03.056682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb470006-d9ec-4efc-88d8-492a0efcc4c9 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2461310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:03.179980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cb470006-d9ec-4efc-88d8-492a0efcc4c9 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.127847 Oct 28 18:11:03.180780 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1101/2127] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:03 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:03.248792 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78f1cfff-6e91-4a69-8b51-e06059cbd76f tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.284521 Oct 28 18:11:03.249750 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1027/2128] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 18:11:02 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 18:11:03.269085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5e9f96a-3b27-4c89-8162-98db724a990c tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Calling method '.version_select at 0x7f78e2545160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:03.344505 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f5e9f96a-3b27-4c89-8162-98db724a990c tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] HTTP exception thrown: Image not found. Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5e9f96a-3b27-4c89-8162-98db724a990c tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Request method failure captured: Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBs2VcfXFzxInUdlb6LQ-yRPodTdrB3k5NVYvsss2DVM8hUlYnYPLGbg9SIXMYCx9lkR8YIcjuJPzCaUA0FFOy73Q-4ascN7XVM_aSKTIHib_6uDthQOaquB8rvs8j3WyTk3CNZJ43czrRKspe6lmjzUO67biweqkRJOxS9j_ihpWSc Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:11:03.352929 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_601ab7ce69594dcd8f50d2bc20cb1a46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 82a767dbc2f844f6ae09d36170feaac8 Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '-1'} Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:03.354568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.359978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:03.362580 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5e9f96a-3b27-4c89-8162-98db724a990c tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5e9f96a-3b27-4c89-8162-98db724a990c tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.097863 Oct 28 18:11:03.364654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1102/2129] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 18:11:03 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:11:03.366611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0bafd0d-b8cf-48f5-a5ba-893bf82b21dc tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Calling method '.version_select at 0x7f78e2309700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:03.405476 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-a0bafd0d-b8cf-48f5-a5ba-893bf82b21dc tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] HTTP exception thrown: Image not found. Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0bafd0d-b8cf-48f5-a5ba-893bf82b21dc tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Request method failure captured: Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/images/645c0ff1-269c-48ba-bed7-022edf6e525j HTTP/1.1 Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBs2VcfXFzxInUdlb6LQ-yRPodTdrB3k5NVYvsss2DVM8hUlYnYPLGbg9SIXMYCx9lkR8YIcjuJPzCaUA0FFOy73Q-4ascN7XVM_aSKTIHib_6uDthQOaquB8rvs8j3WyTk3CNZJ43czrRKspe6lmjzUO67biweqkRJOxS9j_ihpWSc Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:11:03.408227 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_601ab7ce69594dcd8f50d2bc20cb1a46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 82a767dbc2f844f6ae09d36170feaac8 Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '645c0ff1-269c-48ba-bed7-022edf6e525j'} Oct 28 18:11:03.410491 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 645c0ff1-269c-48ba-bed7-022edf6e525j to delete Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.411933 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 645c0ff1-269c-48ba-bed7-022edf6e525j could not be found. Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:03.413695 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:11:03.416291 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.421214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0bafd0d-b8cf-48f5-a5ba-893bf82b21dc tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:03.421214 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0bafd0d-b8cf-48f5-a5ba-893bf82b21dc tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] 10.222.0.16 "DELETE /compute/v2.1/images/645c0ff1-269c-48ba-bed7-022edf6e525j" status: 404 len: 62 microversion: 2.1 time: 0.059928 Oct 28 18:11:03.421214 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1028/2130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:03 2022] DELETE /compute/v2.1/images/645c0ff1-269c-48ba-bed7-022edf6e525j => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:11:03.434716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df67dd99-9c43-45ae-a281-60c78fec2779 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Calling method '.version_select at 0x7f78e2545160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:03.457057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b6c2d51b-a4ca-4a7a-9815-0a4f5b1e5214 req-791d39fe-b95c-4e2f-bc5b-58c8f7419a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8790e29d-c2d9-479a-a1fc-13096df78fce", "tag": "ba56f280-40be-4d22-bda1-d0453d7cf79d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:03.472743 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-df67dd99-9c43-45ae-a281-60c78fec2779 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] HTTP exception thrown: Image not found. Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df67dd99-9c43-45ae-a281-60c78fec2779 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Request method failure captured: Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/images/94d2c8ba-f8ab-4ec8-a01d-0d9da44d70c91 HTTP/1.1 Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBs2VcfXFzxInUdlb6LQ-yRPodTdrB3k5NVYvsss2DVM8hUlYnYPLGbg9SIXMYCx9lkR8YIcjuJPzCaUA0FFOy73Q-4ascN7XVM_aSKTIHib_6uDthQOaquB8rvs8j3WyTk3CNZJ43czrRKspe6lmjzUO67biweqkRJOxS9j_ihpWSc Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:11:03.474621 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_601ab7ce69594dcd8f50d2bc20cb1a46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 82a767dbc2f844f6ae09d36170feaac8 Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '94d2c8ba-f8ab-4ec8-a01d-0d9da44d70c91'} Oct 28 18:11:03.477395 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 94d2c8ba-f8ab-4ec8-a01d-0d9da44d70c91 to delete Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.479056 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 94d2c8ba-f8ab-4ec8-a01d-0d9da44d70c91 could not be found. Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:03.481845 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.484103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df67dd99-9c43-45ae-a281-60c78fec2779 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:03.486631 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df67dd99-9c43-45ae-a281-60c78fec2779 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] 10.222.0.16 "DELETE /compute/v2.1/images/94d2c8ba-f8ab-4ec8-a01d-0d9da44d70c91" status: 404 len: 62 microversion: 2.1 time: 0.050920 Oct 28 18:11:03.490483 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1103/2131] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:11:03 2022] DELETE /compute/v2.1/images/94d2c8ba-f8ab-4ec8-a01d-0d9da44d70c91 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:11:03.505442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95067392-a4fc-448f-943a-702718f4958e tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Calling method '.version_select at 0x7f78e2518f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:03.510423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6c2d51b-a4ca-4a7a-9815-0a4f5b1e5214 req-791d39fe-b95c-4e2f-bc5b-58c8f7419a27 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:03.515575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6c2d51b-a4ca-4a7a-9815-0a4f5b1e5214 req-791d39fe-b95c-4e2f-bc5b-58c8f7419a27 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:03.516601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6c2d51b-a4ca-4a7a-9815-0a4f5b1e5214 req-791d39fe-b95c-4e2f-bc5b-58c8f7419a27 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:03.548737 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b6c2d51b-a4ca-4a7a-9815-0a4f5b1e5214 req-791d39fe-b95c-4e2f-bc5b-58c8f7419a27 service nova] Creating event network-changed:ba56f280-40be-4d22-bda1-d0453d7cf79d for instance 8790e29d-c2d9-479a-a1fc-13096df78fce on n-h1-862404-2 Oct 28 18:11:03.564268 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-95067392-a4fc-448f-943a-702718f4958e tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] HTTP exception thrown: Image not found. Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95067392-a4fc-448f-943a-702718f4958e tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Request method failure captured: Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/images/tempest-invalid-724654780 HTTP/1.1 Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBs2VcfXFzxInUdlb6LQ-yRPodTdrB3k5NVYvsss2DVM8hUlYnYPLGbg9SIXMYCx9lkR8YIcjuJPzCaUA0FFOy73Q-4ascN7XVM_aSKTIHib_6uDthQOaquB8rvs8j3WyTk3CNZJ43czrRKspe6lmjzUO67biweqkRJOxS9j_ihpWSc Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:11:03.566343 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_601ab7ce69594dcd8f50d2bc20cb1a46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 82a767dbc2f844f6ae09d36170feaac8 Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'tempest-invalid-724654780'} Oct 28 18:11:03.567933 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-724654780 to delete Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.569041 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-724654780 could not be found. Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:03.570361 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:11:03.572321 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.574521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95067392-a4fc-448f-943a-702718f4958e tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:03.575577 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95067392-a4fc-448f-943a-702718f4958e tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-724654780" status: 404 len: 62 microversion: 2.1 time: 0.080608 Oct 28 18:11:03.576411 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1104/2132] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 18:11:03 2022] DELETE /compute/v2.1/images/tempest-invalid-724654780 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:11:03.580584 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b6c2d51b-a4ca-4a7a-9815-0a4f5b1e5214 req-791d39fe-b95c-4e2f-bc5b-58c8f7419a27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121733 Oct 28 18:11:03.584705 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1029/2133] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:03.592263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:03.595525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:03.603931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-48719521-d085-4f8c-b1a3-d740086935e3 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Calling method '.version_select at 0x7f78e2309ca0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:03.623734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:03.625501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:03.630129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:03.630904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:03.635335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:03.635969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:03.666880 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-48719521-d085-4f8c-b1a3-d740086935e3 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] HTTP exception thrown: Image not found. Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-48719521-d085-4f8c-b1a3-d740086935e3 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Request method failure captured: Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/images/bbdfa5ef-a46d-4916-918c-147edc688653 HTTP/1.1 Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBs2VcfXFzxInUdlb6LQ-yRPodTdrB3k5NVYvsss2DVM8hUlYnYPLGbg9SIXMYCx9lkR8YIcjuJPzCaUA0FFOy73Q-4ascN7XVM_aSKTIHib_6uDthQOaquB8rvs8j3WyTk3CNZJ43czrRKspe6lmjzUO67biweqkRJOxS9j_ihpWSc Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:11:03.669428 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_601ab7ce69594dcd8f50d2bc20cb1a46", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/601ab7ce69594dcd8f50d2bc20cb1a46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 601ab7ce69594dcd8f50d2bc20cb1a46 Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386 Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 82a767dbc2f844f6ae09d36170feaac8 Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1188422386-project Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'bbdfa5ef-a46d-4916-918c-147edc688653'} Oct 28 18:11:03.671014 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bbdfa5ef-a46d-4916-918c-147edc688653 to delete Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.672016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bbdfa5ef-a46d-4916-918c-147edc688653 could not be found. Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:03.673882 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-48719521-d085-4f8c-b1a3-d740086935e3 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:03.678998 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-48719521-d085-4f8c-b1a3-d740086935e3 tempest-ImagesDeleteNegativeTestJSON-1188422386 tempest-ImagesDeleteNegativeTestJSON-1188422386-project] 10.222.0.16 "DELETE /compute/v2.1/images/bbdfa5ef-a46d-4916-918c-147edc688653" status: 404 len: 62 microversion: 2.1 time: 0.079421 Oct 28 18:11:03.680506 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1030/2134] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:03 2022] DELETE /compute/v2.1/images/bbdfa5ef-a46d-4916-918c-147edc688653 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:11:03.996176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:03.998826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:04.017909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:04.019217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:04.019766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:04.021175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:04.023245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:04.031512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:04.500066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:04.513855 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca815733-21ef-464b-a0fe-49c6b00265f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.935967 Oct 28 18:11:04.515184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1105/2135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:03 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:04.522092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90860438-abfb-4742-809d-2c9490d4b029 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2490a60>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:04.583982 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90860438-abfb-4742-809d-2c9490d4b029 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.066411 Oct 28 18:11:04.584581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1106/2136] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:04 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:04.685379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:04.698632 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f0db8d0-688d-412a-aaf2-0b395627a29c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.707037 Oct 28 18:11:04.700537 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1031/2137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:03 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:05.548202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:05.552482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:05.566804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:05.567434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:05.567946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:05.568916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:05.569393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:05.569952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:05.600468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ec216489-5280-451a-ba8c-a30fe0b3d533 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e239fee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:05.614532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:05.615660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:05.708870 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ec216489-5280-451a-ba8c-a30fe0b3d533 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.112391 Oct 28 18:11:05.719136 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1032/2138] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:05 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:05.737880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:05.738784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:05.759139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:05.760767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:05.762939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:05.765553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:05.767504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:05.768704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:05.902566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:05.917452 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e39df37f-6021-43db-b243-dc3ed77c2611 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.376078 Oct 28 18:11:05.919035 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1107/2139] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:05 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:06.261623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2916388a-9283-4f8f-b15d-7fc66ad76a57"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:06.266877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:06.288708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:06.289561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:06.291439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:06.293815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:06.297890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:06.298701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:06.416693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:06.438761 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2bde6a58-044b-4152-b42e-f0dc29e4944d tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.716900 Oct 28 18:11:06.445612 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1033/2140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:05 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:06.729925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5515c384-8ef7-43ad-a291-42760f8a4c4e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78de986a60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:06.816480 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5515c384-8ef7-43ad-a291-42760f8a4c4e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.092883 Oct 28 18:11:06.828166 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1034/2141] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:06 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:06.944743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:06.945704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:06.964622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:06.965444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:06.967088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:06.968240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:06.968872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:06.969668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:07.663087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:07.685688 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a2fdc1a4-eaf1-449a-83b7-7bafdf7fd720 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.746620 Oct 28 18:11:07.690066 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1035/2142] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:06 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:07.965654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1bd80d1-5271-48f2-9920-5791dd5af367 tempest-AZV2TestJSON-313720528 tempest-AZV2TestJSON-313720528-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:07.968570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1bd80d1-5271-48f2-9920-5791dd5af367 tempest-AZV2TestJSON-313720528 tempest-AZV2TestJSON-313720528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:07.969174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1bd80d1-5271-48f2-9920-5791dd5af367 tempest-AZV2TestJSON-313720528 tempest-AZV2TestJSON-313720528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:07.969630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1bd80d1-5271-48f2-9920-5791dd5af367 tempest-AZV2TestJSON-313720528 tempest-AZV2TestJSON-313720528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:07.973955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1bd80d1-5271-48f2-9920-5791dd5af367 tempest-AZV2TestJSON-313720528 tempest-AZV2TestJSON-313720528-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:07.974635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1bd80d1-5271-48f2-9920-5791dd5af367 tempest-AZV2TestJSON-313720528 tempest-AZV2TestJSON-313720528-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:07.975112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1bd80d1-5271-48f2-9920-5791dd5af367 tempest-AZV2TestJSON-313720528 tempest-AZV2TestJSON-313720528-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:08.031223 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f1bd80d1-5271-48f2-9920-5791dd5af367 tempest-AZV2TestJSON-313720528 tempest-AZV2TestJSON-313720528-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.338469 Oct 28 18:11:08.032133 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1036/2143] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 18:11:07 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:11:08.039164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:08.053513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:08.083071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:08.084261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:08.087102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:08.088202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:08.088837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:08.089523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:08.459139 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7ddf468-c6f8-4cdb-a364-4401835ff250 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "POST /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.205665 Oct 28 18:11:08.460428 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1108/2144] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:11:06 2022] POST /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments => generated 194 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:08.508396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3968c8f7-47a3-43cd-ad36-ad8800b3c6ef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2466820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:08.606331 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3968c8f7-47a3-43cd-ad36-ad8800b3c6ef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.142865 Oct 28 18:11:08.608958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1109/2145] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:08 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:08.720996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:08.723040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:08.747858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:08.750983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:08.752649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:08.755634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:08.766317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:08.775960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:09.007427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:09.019773 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6a8fea7f-2212-4ac4-a4bd-7766183883c9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.985975 Oct 28 18:11:09.025135 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1037/2146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:08 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:09.253283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:09.275565 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8adfe351-0424-4a29-ba1e-4c0e1d3cce00 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.560894 Oct 28 18:11:09.277117 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1110/2147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:08 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:09.598983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2e82943-c14e-4762-94fb-baced9b3f1bf tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2309550>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:09.624183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcc8ceea-1ba9-42d8-8a3c-3ef092c0f305 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2545040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:09.700033 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a2e82943-c14e-4762-94fb-baced9b3f1bf tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/652cabf4-da3e-4cf0-ae2d-cb9c45a22d1d" status: 200 len: 661 microversion: 2.1 time: 0.109670 Oct 28 18:11:09.703777 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bcc8ceea-1ba9-42d8-8a3c-3ef092c0f305 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.083456 Oct 28 18:11:09.704323 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1038/2148] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:09 2022] GET /compute/v2.1/images/652cabf4-da3e-4cf0-ae2d-cb9c45a22d1d => generated 661 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:09.709204 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1111/2149] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:09 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:09.725205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25fc8e0c-42aa-4c08-969d-b7bdd957f013 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78ddbc41f0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:09.824391 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25fc8e0c-42aa-4c08-969d-b7bdd957f013 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/652cabf4-da3e-4cf0-ae2d-cb9c45a22d1d" status: 200 len: 661 microversion: 2.1 time: 0.103739 Oct 28 18:11:09.825901 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1039/2150] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:09 2022] GET /compute/v2.1/images/652cabf4-da3e-4cf0-ae2d-cb9c45a22d1d => generated 661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:10.058109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:10.059497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:10.075994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:10.076873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:10.077555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:10.078531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:10.082012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:10.083010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:10.304005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:10.305230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:10.316503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:10.322468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:10.323977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:10.325911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:10.327281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:10.329889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:10.386584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:10.404545 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e67544de-4988-4c5a-89ce-5624b04249d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.346383 Oct 28 18:11:10.405661 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1112/2151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:10 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:10.419858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-75faeaa3-c1a7-4458-8b14-c0c997ca15a5 req-af6f1033-ec7a-4365-90f0-efd671d0f200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42126e7-fffb-413e-b662-efb6a5141612", "name": "network-vif-unplugged", "status": "completed", "tag": "bda648cd-3190-45fe-ad1e-deb2f2dab3f9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:10.431809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-75faeaa3-c1a7-4458-8b14-c0c997ca15a5 req-af6f1033-ec7a-4365-90f0-efd671d0f200 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:10.432318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-75faeaa3-c1a7-4458-8b14-c0c997ca15a5 req-af6f1033-ec7a-4365-90f0-efd671d0f200 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:10.432747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-75faeaa3-c1a7-4458-8b14-c0c997ca15a5 req-af6f1033-ec7a-4365-90f0-efd671d0f200 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:10.490336 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-75faeaa3-c1a7-4458-8b14-c0c997ca15a5 req-af6f1033-ec7a-4365-90f0-efd671d0f200 service nova] Creating event network-vif-unplugged:bda648cd-3190-45fe-ad1e-deb2f2dab3f9 for instance f42126e7-fffb-413e-b662-efb6a5141612 on n-h2-862404-2 Oct 28 18:11:10.511094 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-75faeaa3-c1a7-4458-8b14-c0c997ca15a5 req-af6f1033-ec7a-4365-90f0-efd671d0f200 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103621 Oct 28 18:11:10.511715 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1113/2152] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:11:10.734494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52e1f9b9-9112-466c-8f61-d1bf393be7c9 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e24725e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:10.813281 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52e1f9b9-9112-466c-8f61-d1bf393be7c9 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.083529 Oct 28 18:11:10.814972 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1114/2153] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:10 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:11.433757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:11.434676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:11.446808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:11.454817 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b54e2b00-b00e-422f-9ed2-27029c9488c9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 1.157493 Oct 28 18:11:11.457537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:11.458220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:11.459111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:11.460043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:11.463524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:11.467102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:11.473209 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1040/2154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:10 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:11.832407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-619b9fc4-a51c-4d94-ac56-a51c97873dad tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78ddbc6670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:11.889132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:11.908365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c9d290d-efdb-4f2f-b88b-1b65dc5d1252 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.476318 Oct 28 18:11:11.911700 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1115/2155] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:11 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:11.955497 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-619b9fc4-a51c-4d94-ac56-a51c97873dad tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.129573 Oct 28 18:11:11.969203 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1041/2156] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:11 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:12.101929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55db5d27-d921-4edc-a93f-75f7763e2d26 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e23fd040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:12.197312 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55db5d27-d921-4edc-a93f-75f7763e2d26 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/461c44f7-9259-4c11-93d7-b80491505692" status: 200 len: 662 microversion: 2.1 time: 0.109043 Oct 28 18:11:12.197918 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1116/2157] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:12 2022] GET /compute/v2.1/images/461c44f7-9259-4c11-93d7-b80491505692 => generated 662 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:12.215208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4140d26c-b129-4988-ba5e-93ec444cf34c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78ddbba670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:12.289664 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4140d26c-b129-4988-ba5e-93ec444cf34c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/461c44f7-9259-4c11-93d7-b80491505692" status: 200 len: 662 microversion: 2.1 time: 0.078656 Oct 28 18:11:12.290862 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1042/2158] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:12 2022] GET /compute/v2.1/images/461c44f7-9259-4c11-93d7-b80491505692 => generated 662 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:12.499338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:12.500381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:12.511005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:12.512055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:12.512874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:12.514246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:12.515248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:12.516197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:12.557201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f5354fa2-d019-45e0-ba21-38387caa9072 req-9e02ce64-ad3f-4447-91f4-aa2b0e064e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42126e7-fffb-413e-b662-efb6a5141612", "tag": "bda648cd-3190-45fe-ad1e-deb2f2dab3f9"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:12.570237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f5354fa2-d019-45e0-ba21-38387caa9072 req-9e02ce64-ad3f-4447-91f4-aa2b0e064e48 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:12.570731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f5354fa2-d019-45e0-ba21-38387caa9072 req-9e02ce64-ad3f-4447-91f4-aa2b0e064e48 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:12.571171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f5354fa2-d019-45e0-ba21-38387caa9072 req-9e02ce64-ad3f-4447-91f4-aa2b0e064e48 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:12.608905 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f5354fa2-d019-45e0-ba21-38387caa9072 req-9e02ce64-ad3f-4447-91f4-aa2b0e064e48 service nova] Creating event network-changed:bda648cd-3190-45fe-ad1e-deb2f2dab3f9 for instance f42126e7-fffb-413e-b662-efb6a5141612 on n-h2-862404-2 Oct 28 18:11:12.620235 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f5354fa2-d019-45e0-ba21-38387caa9072 req-9e02ce64-ad3f-4447-91f4-aa2b0e064e48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066823 Oct 28 18:11:12.621184 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1043/2159] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:12.836203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:12.854378 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4138d8e0-84d8-449e-9892-69a34a4ecae0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.370683 Oct 28 18:11:12.856898 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1117/2160] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:12 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:12.940923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:12.941758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:12.953936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:12.959506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:12.960112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:12.960944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:12.961435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:12.961925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:12.977009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60b3f0e1-2a82-43c7-9f5e-606d7918de6f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2545160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:13.073730 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60b3f0e1-2a82-43c7-9f5e-606d7918de6f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.101592 Oct 28 18:11:13.083214 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1118/2161] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:12 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:13.889518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:13.889888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:13.945094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:13.945876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:13.951989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:13.952835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:13.953330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:13.953768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:14.488794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:14.496876 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2683e4de-1be3-4bbb-9a93-11d89121076f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.622071 Oct 28 18:11:14.497488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1119/2162] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:13 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:14.513089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-54ff263a-025b-43e4-ab4d-9d4b6930f8b9 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23cd550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:14.618221 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-54ff263a-025b-43e4-ab4d-9d4b6930f8b9 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.119544 Oct 28 18:11:14.620878 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1120/2163] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:14 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:14.635017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3ec9d842-cd4f-469d-b37b-e76b318b81da req-89edd7fa-738c-459b-9f82-690ec7b239a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9701323d-b2b2-48a1-baf9-4ee8521c95be", "name": "network-vif-plugged", "status": "completed", "tag": "6b4f741f-8159-46fb-a039-2ded83b18128"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:14.665243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3ec9d842-cd4f-469d-b37b-e76b318b81da req-89edd7fa-738c-459b-9f82-690ec7b239a3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:14.665617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3ec9d842-cd4f-469d-b37b-e76b318b81da req-89edd7fa-738c-459b-9f82-690ec7b239a3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:14.666053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3ec9d842-cd4f-469d-b37b-e76b318b81da req-89edd7fa-738c-459b-9f82-690ec7b239a3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:14.694907 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3ec9d842-cd4f-469d-b37b-e76b318b81da req-89edd7fa-738c-459b-9f82-690ec7b239a3 service nova] Creating event network-vif-plugged:6b4f741f-8159-46fb-a039-2ded83b18128 for instance 9701323d-b2b2-48a1-baf9-4ee8521c95be on n-h2-862404-2 Oct 28 18:11:14.704126 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3ec9d842-cd4f-469d-b37b-e76b318b81da req-89edd7fa-738c-459b-9f82-690ec7b239a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080510 Oct 28 18:11:14.706061 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1121/2164] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:14.718779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7afcd1bc-7ca9-4ee3-86ca-3e796d29d9d7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e23cd430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:14.794883 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7afcd1bc-7ca9-4ee3-86ca-3e796d29d9d7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/925d40fc-6977-4464-9876-bb25f4864edb" status: 200 len: 662 microversion: 2.1 time: 0.084460 Oct 28 18:11:14.795777 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1122/2165] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:14 2022] GET /compute/v2.1/images/925d40fc-6977-4464-9876-bb25f4864edb => generated 662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:14.809639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd65ad22-8a79-4db0-9f12-1f74c9927b85 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2466940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:14.864503 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd65ad22-8a79-4db0-9f12-1f74c9927b85 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/925d40fc-6977-4464-9876-bb25f4864edb" status: 200 len: 662 microversion: 2.1 time: 0.058810 Oct 28 18:11:14.866203 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1123/2166] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:14 2022] GET /compute/v2.1/images/925d40fc-6977-4464-9876-bb25f4864edb => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:11:14.919124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:14.935446 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9bed0551-4f10-4191-80d4-6c545a40e1dc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 1.996176 Oct 28 18:11:14.948308 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1044/2167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:12 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:15.070450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1907212241", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:15.185168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:11:15.522903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:15.523599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:15.536956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:15.537537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:15.541433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:15.544904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:15.545605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:15.546083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:15.903685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:11:15.904282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:11:15.904607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:11:15.905025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:11:15.905444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:11:15.931341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:15.931882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:15.932343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:15.939164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:15.939808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:15.949453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:16.038404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Getting quotas for project ba3e97eeba9c4e0fa876db71cacafc89. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:11:16.059745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Getting quotas for user 055d46cc8b314ec7a76710fbffa71a9c and project ba3e97eeba9c4e0fa876db71cacafc89. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:11:16.118487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:11:16.137217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:11:16.173357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:16.246615 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6a9dfe1-edbc-44ab-90de-bae995504ad0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184318 Oct 28 18:11:16.247986 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1124/2168] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:11:16.256740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-54c6f799-a052-44b8-b9a7-13325ce3f0f2 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23d90d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:16.376027 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-54c6f799-a052-44b8-b9a7-13325ce3f0f2 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.126436 Oct 28 18:11:16.376615 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1125/2169] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:16 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:16.391910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:16.392557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:16.415241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:16.415672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:16.418816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:16.419624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:16.420156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:16.422438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:16.572411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:16.591657 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c2161ca-cfa6-4a36-93a4-0d5b5a365ec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 1.075001 Oct 28 18:11:16.599170 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1045/2170] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:15 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:16.615423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-433928656", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:16.717497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:11:16.826922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:16.841293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e80c0a83-4234-4652-a402-673addb9ba64 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.458619 Oct 28 18:11:16.843181 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1126/2171] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:16 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:17.233716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1217736566", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "eb145875-a83f-4638-a01f-ece8f5867a2a"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:17.378868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] validate_networks() for [('eb145875-a83f-4638-a01f-ece8f5867a2a', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:11:17.714851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:11:17.717125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:11:17.718372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:11:17.719326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:11:17.720257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:11:17.750128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:17.751237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:17.755589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:17.758600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:17.762848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:17.763586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:17.824392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Getting quotas for project ba3e97eeba9c4e0fa876db71cacafc89. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:11:17.845417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Getting quotas for user 055d46cc8b314ec7a76710fbffa71a9c and project ba3e97eeba9c4e0fa876db71cacafc89. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:11:17.865862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:11:17.868636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:11:17.965380 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11e83994-bd23-4dfa-b062-72909c76d4a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364058 Oct 28 18:11:17.972379 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1046/2172] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:11:17.983345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ffa6c8d0-e41d-4d3b-b198-59f3fd906fb3 req-4f5195e5-c076-4317-9d5c-97c36b372c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d061a254-5b3d-4d89-acd8-79c1842c684b", "name": "network-vif-plugged", "status": "completed", "tag": "ccdbe197-71c8-4c99-a4db-0f84eee173b7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:18.011376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ffa6c8d0-e41d-4d3b-b198-59f3fd906fb3 req-4f5195e5-c076-4317-9d5c-97c36b372c80 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:18.020527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ffa6c8d0-e41d-4d3b-b198-59f3fd906fb3 req-4f5195e5-c076-4317-9d5c-97c36b372c80 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:18.022323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ffa6c8d0-e41d-4d3b-b198-59f3fd906fb3 req-4f5195e5-c076-4317-9d5c-97c36b372c80 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:18.046188 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ffa6c8d0-e41d-4d3b-b198-59f3fd906fb3 req-4f5195e5-c076-4317-9d5c-97c36b372c80 service nova] Creating event network-vif-plugged:ccdbe197-71c8-4c99-a4db-0f84eee173b7 for instance d061a254-5b3d-4d89-acd8-79c1842c684b on n-h1-862404-2 Oct 28 18:11:18.086178 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ffa6c8d0-e41d-4d3b-b198-59f3fd906fb3 req-4f5195e5-c076-4317-9d5c-97c36b372c80 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111286 Oct 28 18:11:18.100147 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1047/2173] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:18.108985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb1231e8-1f4d-488a-9593-12da4f7c474e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78ddbba310>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:18.224959 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eb1231e8-1f4d-488a-9593-12da4f7c474e tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.122536 Oct 28 18:11:18.225819 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1048/2174] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:18 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:18.235154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:18.237832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:18.246913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:18.247545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:18.248753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:18.249926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:18.250490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:18.251615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:18.948069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:18.965014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d6984d04-cbe5-4672-97c7-2d5132fc430d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 0.738199 Oct 28 18:11:18.965638 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1049/2175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:18 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:18.985922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:18.986987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:19.016432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:19.017219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:19.020139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:19.022660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:19.025625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:19.029281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:19.452038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:11:19.452588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:11:19.452991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:11:19.453455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:11:19.453878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:11:19.470142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:19.470644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:19.471629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:19.475666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:19.476236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:19.480040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:19.529591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Getting quotas for project c5344e62d39b463da80ea567fc1265ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:11:19.550470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Getting quotas for user ce8b396d3fca4ec5bb085fb1404328f4 and project c5344e62d39b463da80ea567fc1265ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:11:19.587378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:11:19.596022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:11:19.712630 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-efa2ef95-745d-4ad6-9c87-56debffe7a5b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.867315 Oct 28 18:11:19.713699 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1127/2176] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:11:19.724315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:19.725304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:19.735135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:19.738640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:19.740347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:19.741400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:19.747410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:19.748288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:20.106750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:20.110907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:20.142395 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-77712b23-4525-4a9d-beca-75cd01257577 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 1.171094 Oct 28 18:11:20.144741 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1050/2177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:18 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:20.176860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c21c39f1-6c87-4579-8e2d-50004bcb8b05 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2369a60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:20.302972 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c21c39f1-6c87-4579-8e2d-50004bcb8b05 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.153707 Oct 28 18:11:20.303667 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1051/2178] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:20 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:20.324429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a3396b18-d7e9-4274-86b0-cc154d54d852 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:20.325308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a3396b18-d7e9-4274-86b0-cc154d54d852 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:20.668917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a3396b18-d7e9-4274-86b0-cc154d54d852 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:20.683306 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a3396b18-d7e9-4274-86b0-cc154d54d852 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1218 microversion: 2.1 time: 0.375262 Oct 28 18:11:20.684129 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1052/2179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:20 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1218 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:20.717796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:20.720178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:20.747383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:20.749842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:20.751423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:20.752235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:20.755597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:20.757343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:21.200854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:21.219315 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b182964f-911b-4481-9995-d4b8d33ecf91 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1269 microversion: 2.1 time: 1.504092 Oct 28 18:11:21.242288 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1128/2180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:19 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1269 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:21.256632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2a917ab3-dca7-42c1-a256-75e6831025d2 req-1f459f0d-a1cc-440b-bd16-339d296f1235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8790e29d-c2d9-479a-a1fc-13096df78fce", "name": "network-vif-plugged", "status": "completed", "tag": "ba56f280-40be-4d22-bda1-d0453d7cf79d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:21.278963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2a917ab3-dca7-42c1-a256-75e6831025d2 req-1f459f0d-a1cc-440b-bd16-339d296f1235 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:21.279453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2a917ab3-dca7-42c1-a256-75e6831025d2 req-1f459f0d-a1cc-440b-bd16-339d296f1235 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:21.279919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2a917ab3-dca7-42c1-a256-75e6831025d2 req-1f459f0d-a1cc-440b-bd16-339d296f1235 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:21.312281 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2a917ab3-dca7-42c1-a256-75e6831025d2 req-1f459f0d-a1cc-440b-bd16-339d296f1235 service nova] Creating event network-vif-plugged:ba56f280-40be-4d22-bda1-d0453d7cf79d for instance 8790e29d-c2d9-479a-a1fc-13096df78fce on n-h1-862404-2 Oct 28 18:11:21.324165 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2a917ab3-dca7-42c1-a256-75e6831025d2 req-1f459f0d-a1cc-440b-bd16-339d296f1235 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075601 Oct 28 18:11:21.327233 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1129/2181] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:21.372881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:21.375338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:21.403115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:21.404652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:21.407396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:21.410707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:21.412166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:21.415030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:21.466391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:21.947537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:21.960176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1a0856d0-a568-499f-bc76-fee0073f5ede tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 1.249904 Oct 28 18:11:21.965170 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1053/2182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:20 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:21.987863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b896c574-7811-45ea-928e-810c130342cc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23e8040>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:22.096542 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b896c574-7811-45ea-928e-810c130342cc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.129275 Oct 28 18:11:22.097438 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1054/2183] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:21 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:22.102307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:22.119247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f2c4e33-c82b-4b73-912d-43557940218f tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.790209 Oct 28 18:11:22.123258 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1130/2184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:21 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:22.124943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:22.126050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:22.151242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:22.152527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:22.153160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:22.154780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:22.155872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:22.157770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:22.250543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:22.252816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:22.277531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:22.281556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:22.283278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:22.286482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:22.287234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:22.289621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:22.621597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:22.648801 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-89d23a7d-0ec1-4b22-a13f-bf5f546ac68c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1278 microversion: 2.1 time: 0.540871 Oct 28 18:11:22.655780 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1055/2185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:22 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1278 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:22.833166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:22.853710 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b7df190a-8d62-43be-8155-c3ffdc37df9b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1275 microversion: 2.1 time: 0.612779 Oct 28 18:11:22.859244 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1131/2186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:22 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1275 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:22.984638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:22.985966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:23.004636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:23.007092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:23.010102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:23.012772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:23.014122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:23.029938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:23.113946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d25397de-088a-4fd8-81b7-f380c84679d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2461040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:23.227320 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d25397de-088a-4fd8-81b7-f380c84679d8 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.118649 Oct 28 18:11:23.242592 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1132/2187] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:23 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:23.251421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:23.256448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:23.272989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:23.273494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:23.273944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:23.274670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:23.275134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:23.275571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:23.854326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:23.870336 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c47583af-7e61-4639-b887-335a97004e62 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.626495 Oct 28 18:11:23.871306 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1133/2188] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:23 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:23.876892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:23.878082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:23.895278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:23.895776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:23.896251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:23.897274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:23.897496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:23.909888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:24.282056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:24.296184 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dfdc2b8d-5acc-4801-9d5c-eb1bfc78c1e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1276 microversion: 2.1 time: 0.419318 Oct 28 18:11:24.297353 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1134/2189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:23 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1276 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:24.323427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:24.324605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:24.335736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:24.349802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:24.350637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:24.351586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:24.352358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:24.353121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:24.632545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:24.644102 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4fabf36-c553-45b0-b6af-96a786568478 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1275 microversion: 2.1 time: 0.343758 Oct 28 18:11:24.659654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1135/2190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:24 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1275 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:24.663020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a93d0e3e-53cd-45b8-be1d-a05c2dae584f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e237a5e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:24.794160 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a93d0e3e-53cd-45b8-be1d-a05c2dae584f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.145550 Oct 28 18:11:24.794765 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1136/2191] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:24 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:24.895422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:24.896589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:24.914936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:24.915771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:24.919649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:24.920735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:24.921408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:24.922021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:25.006295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:25.024053 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9cf3a055-4d08-481d-90c6-433c97fed7f2 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1314 microversion: 2.1 time: 2.045028 Oct 28 18:11:25.024825 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1056/2192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:22 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1314 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:25.323027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:25.323650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:25.325666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:25.358056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:25.361123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:25.361564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:25.364668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:25.372511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:25.373299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:25.589423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:25.601703 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce8bf2e0-1a4f-481b-99fd-5d30fa544ab1 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.710708 Oct 28 18:11:25.606831 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1137/2193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:24 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:25.667416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:25.668382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:25.681998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:25.682800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:25.683421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:25.690383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:25.691166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:25.692038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:26.029254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:26.038394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-125caed9-60e2-49f3-8667-73e4ef2d5cf6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1275 microversion: 2.1 time: 0.374765 Oct 28 18:11:26.052389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1138/2194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:25 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1275 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:26.069503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a1ed7ea2-4ddd-4bfb-b529-899963af3bd0 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e24cc4c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:26.117756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:26.152253 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c8bde28c-4c18-4bea-9663-74523b7ebeb8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1276 microversion: 2.1 time: 0.832670 Oct 28 18:11:26.154121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1057/2195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:25 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1276 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:26.168151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a1ed7ea2-4ddd-4bfb-b529-899963af3bd0 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.114372 Oct 28 18:11:26.175852 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1139/2196] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:26 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:26.180440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:26.181419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:26.199005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:26.199883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:26.200586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:26.202354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:26.214086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:26.215650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:26.635214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:26.636165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:26.649908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:26.651235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:26.654203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:26.655311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:26.656051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:26.661678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:27.301646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:27.329458 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e2c088c-f019-4a0c-aef1-df9cd6d7fd64 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1464 microversion: 2.1 time: 1.172028 Oct 28 18:11:27.331475 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1058/2197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:26 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1464 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:27.355304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:27.357061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:27.385879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:27.387372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:27.388459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:27.390069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:27.391999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:27.392647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:27.454334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:27.472834 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52499ad3-aebb-4b59-9ff3-45c0ff0f63c6 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.842174 Oct 28 18:11:27.502346 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1140/2198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:26 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:27.510413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:27.512385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:27.520913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:27.522661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:27.523388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:27.524598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:27.525323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:27.526015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:27.793613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:28.542263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:28.604149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5750b4b2-0516-4b36-949b-61d20497955d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 1.091491 Oct 28 18:11:28.609480 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1141/2199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:27 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:28.629559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbf298cb-8e38-4210-892a-07c7d349bb7f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23d9700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:28.700365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:28.712007 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-058ada77-64dd-4c99-b6f6-9f57757f3988 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 1.376204 Oct 28 18:11:28.715932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1059/2200] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:27 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:28.732712 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbf298cb-8e38-4210-892a-07c7d349bb7f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.120901 Oct 28 18:11:28.733944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:28.734487 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1142/2201] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:28 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:28.734734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:28.742808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:28.744133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:28.754504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:28.755004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:28.755572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:28.755757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:28.757957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:28.758961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:28.760305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:28.761109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:28.761835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:28.761993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:28.762359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:28.762995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:29.497539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:29.574107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:29.592600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:29.606675 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b92bafff-52fc-49f8-bda4-7a6603e0d098 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.867598 Oct 28 18:11:29.611345 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1143/2202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:28 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:29.632484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:29.633381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:29.648295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:29.652963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:29.653665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:29.655397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:29.657388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:29.658469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:30.327767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:30.347627 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-56e3a3a2-8de8-4332-a974-f633235354ea tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1464 microversion: 2.1 time: 1.622989 Oct 28 18:11:30.365390 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1060/2203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:28 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1464 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:30.397576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:30.400039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:30.420576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:30.421384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:30.422004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:30.422899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:30.423532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:30.424354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:30.674915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:30.732282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:30.747573 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-696deb89-57c4-4a0b-880b-74c269e5e9a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 1.120078 Oct 28 18:11:30.751662 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1144/2204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:29 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:30.757261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-476bc5a9-fc04-438b-837b-465ed3614bd2 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e238c9d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:30.827435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-476bc5a9-fc04-438b-837b-465ed3614bd2 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.074296 Oct 28 18:11:30.828572 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1145/2205] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:30 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:30.834324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2067053021", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9701323d-b2b2-48a1-baf9-4ee8521c95be"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:30.908474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:11:31.824982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:31.835909 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-64a4008a-27b0-4b4b-85f3-6477a8b47211 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 1.452903 Oct 28 18:11:31.836769 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1061/2206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:30 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:31.843980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:31.850819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:31.868858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:31.869646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:31.870346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:31.874657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:31.875621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:31.876359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:31.936158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:11:31.936750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:11:31.937032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:11:31.937644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:11:31.938222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:11:31.965342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:31.966104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:31.974608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:31.975570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:31.976432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:31.977078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:32.074431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Getting quotas for project 6aa20e2a97184d9e93c88bd42520667e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:11:32.094402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Getting quotas for user 375f8887d73d4adbabe4ac06d48ccc70 and project 6aa20e2a97184d9e93c88bd42520667e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:11:32.158023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:11:32.165928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:11:32.270290 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb650658-c38d-4646-a27c-2fa92a1f9268 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440007 Oct 28 18:11:32.271130 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1146/2207] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:11:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:11:32.283072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-302f97fd-0345-4545-b172-c4549f867b3f req-18157265-3205-40b5-b6f6-ba5e7b99b5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8148f1bc-d908-4fa0-bd92-aad5464fe069", "tag": "b21e0da3-68f8-41b1-9a87-d0036283bcfe"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:32.310948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-302f97fd-0345-4545-b172-c4549f867b3f req-18157265-3205-40b5-b6f6-ba5e7b99b5b5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:32.311445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-302f97fd-0345-4545-b172-c4549f867b3f req-18157265-3205-40b5-b6f6-ba5e7b99b5b5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:32.316241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-302f97fd-0345-4545-b172-c4549f867b3f req-18157265-3205-40b5-b6f6-ba5e7b99b5b5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:32.342240 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-302f97fd-0345-4545-b172-c4549f867b3f req-18157265-3205-40b5-b6f6-ba5e7b99b5b5 service nova] Creating event network-changed:b21e0da3-68f8-41b1-9a87-d0036283bcfe for instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 on n-h1-862404-2 Oct 28 18:11:32.349463 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-302f97fd-0345-4545-b172-c4549f867b3f req-18157265-3205-40b5-b6f6-ba5e7b99b5b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075264 Oct 28 18:11:32.350754 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1147/2208] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:32.358358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:32.359341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:32.367368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:32.368563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:32.369787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:32.370834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:32.371536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:32.372246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:32.801680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:32.810672 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0feeb331-ba06-4cba-a634-221e401f3c52 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 0.458439 Oct 28 18:11:32.826281 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1148/2209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:32 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:32.831307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-145365db-720b-4610-8dd2-5459323e89b7 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2469c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:32.961695 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-145365db-720b-4610-8dd2-5459323e89b7 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.134143 Oct 28 18:11:32.965136 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1149/2210] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:32 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:33.002460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-94ca402a-aa67-46b6-9086-b44579f75f78 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:33.004056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-94ca402a-aa67-46b6-9086-b44579f75f78 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:33.169811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:33.180495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94ca402a-aa67-46b6-9086-b44579f75f78 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:33.184969 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-007d5bc6-c388-425d-9344-959ba2541214 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 1.340360 Oct 28 18:11:33.187283 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1062/2211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:31 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:33.203481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-841cf9b5-1cdd-4d3c-9c08-11e7244c9905 req-87567fa8-b05c-4df6-bb8a-2ef6aece8f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10ed602-8749-474d-a2e1-46b84ecb86d8", "tag": "ee59cdc4-5702-48f2-a669-40f18f587878"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:33.214778 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-94ca402a-aa67-46b6-9086-b44579f75f78 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1214 microversion: 2.1 time: 0.248446 Oct 28 18:11:33.229842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1150/2212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:32 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:33.241292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:33.244436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-841cf9b5-1cdd-4d3c-9c08-11e7244c9905 req-87567fa8-b05c-4df6-bb8a-2ef6aece8f18 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:33.245198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-841cf9b5-1cdd-4d3c-9c08-11e7244c9905 req-87567fa8-b05c-4df6-bb8a-2ef6aece8f18 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:33.245889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-841cf9b5-1cdd-4d3c-9c08-11e7244c9905 req-87567fa8-b05c-4df6-bb8a-2ef6aece8f18 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:33.252750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:33.265423 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-841cf9b5-1cdd-4d3c-9c08-11e7244c9905 req-87567fa8-b05c-4df6-bb8a-2ef6aece8f18 service nova] Creating event network-changed:ee59cdc4-5702-48f2-a669-40f18f587878 for instance e10ed602-8749-474d-a2e1-46b84ecb86d8 on n-h1-862404-2 Oct 28 18:11:33.277677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-841cf9b5-1cdd-4d3c-9c08-11e7244c9905 req-87567fa8-b05c-4df6-bb8a-2ef6aece8f18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086540 Oct 28 18:11:33.279448 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1063/2213] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:33.286773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:33.290020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:33.292920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:33.294240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:33.297129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:33.298244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:33.646003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:33.658671 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8860b3f3-0824-4f1e-94f9-15e1b778b9f2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 0.427101 Oct 28 18:11:33.677161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1151/2214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:33 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:33.865761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:33.868351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:33.885790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:33.886724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:33.887437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:33.888344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:33.889837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:33.890450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:34.358675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "dc629505-eb89-4cdd-8c7c-4467e44c877a"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:34.363635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:34.383984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:34.385302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:34.385916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:34.389166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:34.389971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:34.390571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:34.420515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:34.429667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-297af540-16dc-4dd5-87f7-c24809900d66 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 0.590724 Oct 28 18:11:34.447053 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1152/2215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:33 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:34.469378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f0deecf-db22-43ec-ac33-5d32a47af2cc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e24691f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:34.589801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f0deecf-db22-43ec-ac33-5d32a47af2cc tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.140655 Oct 28 18:11:34.590566 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1153/2216] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:34 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:34.594751 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] HTTP exception thrown: Volume dc629505-eb89-4cdd-8c7c-4467e44c877a could not be found. Oct 28 18:11:34.615260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:34.618410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:34.633612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:34.634113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:34.634549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:34.635321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:34.635837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:34.636263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Request method failure captured: Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: request: PUT /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments/2916388a-9283-4f8f-b15d-7fc66ad76a57 HTTP/1.1 Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 74 Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBq2YIafSblODb8GPUwfRRO-_0KLyvIMLqAei-SoicLTkKJQCSk_47MD1dgCdMvPPbNs4Cd6TTQQJburFnfYYpPhNblvl-ZHa50Tx4nAyg-Q3hBMdspu58LoJIqOCSZ0_CvFROKcB4gOVCe5SKlcAQCrfo2iK0Zi2XzXo34p8IS5g-E Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4f35ee8e53f548c3a3bf79f37e5a1b57 Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesAdminNegativeTest-601256387 Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:11:34.636738 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f35ee8e53f548c3a3bf79f37e5a1b57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f35ee8e53f548c3a3bf79f37e5a1b57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f35ee8e53f548c3a3bf79f37e5a1b57", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f35ee8e53f548c3a3bf79f37e5a1b57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-VolumesAdminNegativeTest-601256387 Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4f35ee8e53f548c3a3bf79f37e5a1b57 Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-601256387 Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-VolumesAdminNegativeTest-601256387-project-admin Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c8a15279703d4fd5b3679f6883506323 Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-VolumesAdminNegativeTest-601256387-project-admin Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: {"volumeAttachment": {"volumeId": "dc629505-eb89-4cdd-8c7c-4467e44c877a"}} Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:11:34.638747 n-d-862404-2 devstack@n-api.service[120679]: exception: Volume dc629505-eb89-4cdd-8c7c-4467e44c877a could not be found. Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'server_id': '90b66dc4-afcd-4eac-89ed-346c9bb49328', 'id': '2916388a-9283-4f8f-b15d-7fc66ad76a57', 'body': {'volumeAttachment': {'volumeId': 'dc629505-eb89-4cdd-8c7c-4467e44c877a'}}} Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:11:34.639982 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc629505-eb89-4cdd-8c7c-4467e44c877a could not be found. (HTTP 404) (Request-ID: req-2c9457e9-d90a-4b0c-a924-e711583e1229) Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:11:34.641278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc629505-eb89-4cdd-8c7c-4467e44c877a could not be found. Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:34.642798 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume dc629505-eb89-4cdd-8c7c-4467e44c877a could not be found. Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc629505-eb89-4cdd-8c7c-4467e44c877a could not be found. Oct 28 18:11:34.645101 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:34.646515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Returning 400 to user: Volume dc629505-eb89-4cdd-8c7c-4467e44c877a could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:34.646515 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ab530f7d-800a-4fe2-b5fa-6a7382cf46a7 tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments/2916388a-9283-4f8f-b15d-7fc66ad76a57" status: 400 len: 107 microversion: 2.1 time: 1.088473 Oct 28 18:11:34.646515 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1064/2217] 10.222.0.16 () {60 vars in 1433 bytes} [Fri Oct 28 18:11:33 2022] PUT /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments/2916388a-9283-4f8f-b15d-7fc66ad76a57 => generated 107 bytes in 1093 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:11:34.646975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:34.647836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:34.672622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:34.675277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:34.677897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:34.680372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:34.681051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:34.681741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:34.782528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:34.801058 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-56640612-8024-4798-a963-0dd46b670897 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1266 microversion: 2.1 time: 0.154023 Oct 28 18:11:34.804139 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1065/2218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:34 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:34.819510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:34.819807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:34.835548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:34.837261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:34.837720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:34.840304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:34.840869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:34.842596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:35.059660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:35.076410 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d692fcc8-122f-4421-9ffb-54b9c0b6a5e5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1391 microversion: 2.1 time: 0.482832 Oct 28 18:11:35.093705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1154/2219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:34 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1391 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:35.093705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:35.093705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:35.101398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:35.102324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:35.102909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:35.103701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:35.104264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:35.105748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:35.291805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lazy-loading 'services' on Instance uuid 90b66dc4-afcd-4eac-89ed-346c9bb49328 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:11:35.941126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:35.954700 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-966175a2-09c8-4fd8-be5e-874a0ef28615 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments/2916388a-9283-4f8f-b15d-7fc66ad76a57" status: 202 len: 0 microversion: 2.1 time: 0.866382 Oct 28 18:11:35.975165 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1155/2220] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:11:35 2022] DELETE /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments/2916388a-9283-4f8f-b15d-7fc66ad76a57 => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:11:35.993205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:35.995216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:36.005329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.006048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.007335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:36.009886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.010932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.011527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:36.286873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:36.301838 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-890e2788-1335-4321-b2a3-da7687addffa tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 1.496319 Oct 28 18:11:36.302855 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1066/2221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:34 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:36.310825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6dee5855-cdae-4956-beae-38e5b8241baf req-02f43e6a-fd35-4651-8e71-5c835acaa001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c6fd04-db62-4518-9726-de061cb29c49", "tag": "e328e141-4427-4198-8fef-00dcd59707ab"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:36.324582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6dee5855-cdae-4956-beae-38e5b8241baf req-02f43e6a-fd35-4651-8e71-5c835acaa001 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.326481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6dee5855-cdae-4956-beae-38e5b8241baf req-02f43e6a-fd35-4651-8e71-5c835acaa001 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.327396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6dee5855-cdae-4956-beae-38e5b8241baf req-02f43e6a-fd35-4651-8e71-5c835acaa001 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:36.345939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6dee5855-cdae-4956-beae-38e5b8241baf req-02f43e6a-fd35-4651-8e71-5c835acaa001 service nova] Creating event network-changed:e328e141-4427-4198-8fef-00dcd59707ab for instance 88c6fd04-db62-4518-9726-de061cb29c49 on n-h2-862404-2 Oct 28 18:11:36.352219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:36.371485 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6dee5855-cdae-4956-beae-38e5b8241baf req-02f43e6a-fd35-4651-8e71-5c835acaa001 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066391 Oct 28 18:11:36.372845 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1067/2222] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:36.382087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8307f925-f2ec-4b14-be27-7c01dd165dcf tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23629d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:36.388902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73876cae-1997-4216-97b1-80c4310cd13a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 0.408623 Oct 28 18:11:36.390501 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1156/2223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:35 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:36.400886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:36.401976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:36.428500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.429717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.430515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:36.431577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.432316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.433361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:36.477787 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8307f925-f2ec-4b14-be27-7c01dd165dcf tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.102536 Oct 28 18:11:36.478619 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1068/2224] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:36 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:36.487623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:36.494170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:36.507853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.509294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.512426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:36.513404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.514069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.514873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:36.560432 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b63416f6-c4dd-4f1c-931d-8fd996f25d7c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078383 Oct 28 18:11:36.561637 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1069/2225] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:11:36 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:36.743749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:36.752476 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1aa9c9b7-f196-4fbd-84a1-636053c47f3c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1272 microversion: 2.1 time: 0.359597 Oct 28 18:11:36.782082 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1157/2226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:36 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1272 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:36.789871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:36.793153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:36.837862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.841712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.847521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:36.850765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:36.852594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:36.857737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:37.314523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2047914702", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:37.354321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:37.368034 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ab8840b-cc69-47a6-892b-149b2063b603 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1381 microversion: 2.1 time: 0.591570 Oct 28 18:11:37.369733 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1158/2227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:36 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1381 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:37.374625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:37.379388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:37.394593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:37.395341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:37.396171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:37.397133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:37.397760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:37.398405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:37.446515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:11:37.778989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:37.792910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ad50624-4008-4194-a3f5-a1fc12b19574 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 0.421235 Oct 28 18:11:37.794842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1159/2228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:37 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:37.807114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d26a044b-a735-4bd7-8f0d-cb0bf7de41fa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '.version_select at 0x7f78e24254c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:37.813456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d26a044b-a735-4bd7-8f0d-cb0bf7de41fa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:37.814142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d26a044b-a735-4bd7-8f0d-cb0bf7de41fa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:37.814749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d26a044b-a735-4bd7-8f0d-cb0bf7de41fa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:37.838878 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d26a044b-a735-4bd7-8f0d-cb0bf7de41fa tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1551 microversion: 2.1 time: 0.041134 Oct 28 18:11:37.841164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1160/2229] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:11:37 2022] GET /compute/v2.1/os-migrations => generated 1551 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:37.856573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:37.857667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:37.868679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:37.871711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:37.872531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:37.874478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:37.876558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:37.879501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.379844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:38.403742 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf6d843b-474f-468f-9fb1-9229033a154e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 0.561185 Oct 28 18:11:38.408706 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1161/2230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:37 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:38.428529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c409ae8-71d7-48da-98ec-6f05276edcf5 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23cd4c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:38.545378 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c409ae8-71d7-48da-98ec-6f05276edcf5 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.132491 Oct 28 18:11:38.546108 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1162/2231] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:38 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:38.563259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:38.585073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:38.595040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.595895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.597193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.598130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.600921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.602902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.676516 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3de4e20a-81c8-4a31-9c86-62c0c796570b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118831 Oct 28 18:11:38.677463 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1163/2232] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:11:38 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:38.683655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:38.684900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:38.694348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.695449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.697072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.698193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.699568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.700213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.704073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:11:38.704596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:11:38.704990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:11:38.706125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:11:38.706568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:11:38.738581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.739077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.739529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.740304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.740768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.741241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.808990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Getting quotas for project 034e69943b404cedb74838f3bffe4555. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:11:38.820300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Getting quotas for user b5949d98c7534e6eb6029bbad3e6d035 and project 034e69943b404cedb74838f3bffe4555. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:11:38.842725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:38.857649 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6b16c12-785c-4457-a93c-08aa3705e1c7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1272 microversion: 2.1 time: 0.178085 Oct 28 18:11:38.863194 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1164/2233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:38 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:38.883276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:38.885859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:38.890635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:11:38.901811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.903663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.904980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.908479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:11:38.909279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.909965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.910719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:39.039182 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3e298821-7423-4ee0-8955-67d8c7305493 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.473340 Oct 28 18:11:39.042157 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1070/2234] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:11:39.071386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:39.075269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:39.089640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:39.090496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:39.091156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:39.092197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:39.092880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:39.093503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:39.430321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6370f7f0-feb2-488b-84a8-52e18dbd2902 tempest-LiveMigrationTest-456813259 tempest-LiveMigrationTest-456813259-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1532 microversion: 2.1 time: 0.565352 Oct 28 18:11:39.431264 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1165/2235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:38 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1532 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:39.436303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da7f753a-e4f8-462c-a0ed-355e0dbc219d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:39.448792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da7f753a-e4f8-462c-a0ed-355e0dbc219d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:39.618589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da7f753a-e4f8-462c-a0ed-355e0dbc219d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:39.628436 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da7f753a-e4f8-462c-a0ed-355e0dbc219d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1219 microversion: 2.1 time: 0.195181 Oct 28 18:11:39.633021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1166/2236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:39 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:39.656264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:39.659128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:39.670166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:39.671969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:39.678918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:39.679633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:39.685596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:39.686333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:39.686951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.035941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:40.045676 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ef37d902-7430-43a0-ba6b-38c4a09cbe72 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 1.002189 Oct 28 18:11:40.046282 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1071/2237] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:39 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:40.077932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:40.078688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:40.115485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.119193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.122538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.124703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.126854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.135039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.288280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:11:40.307057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:40.315721 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1238ccef-10f0-44f6-b4c2-8c4d91a5946b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 0.678788 Oct 28 18:11:40.327402 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1167/2238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:39 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:40.342317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2622f2e0-ae63-42ef-b4f1-8747bea53e9d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23cd160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:40.452292 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2622f2e0-ae63-42ef-b4f1-8747bea53e9d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.123193 Oct 28 18:11:40.453746 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1168/2239] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:40 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:40.467028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:40.471378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:40.478243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:40.509807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.510367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.513554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.516579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.517928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.519308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.634201 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-211c59aa-9679-4ef1-aca9-d724f3d961a9 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176243 Oct 28 18:11:40.638303 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1169/2240] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:11:40 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:40.646869 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d41e2772-83b5-4085-a135-b2805bd77073 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 204 len: 0 microversion: 2.1 time: 0.599301 Oct 28 18:11:40.647939 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1072/2241] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:11:40 2022] DELETE /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:11:40.655943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:40.656592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:40.661904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:40.664739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:40.677932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.680113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.680791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.683468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.684550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.686411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.687413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.687907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.688568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.689513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.692487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.693130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:41.129868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:41.138556 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-037b97ac-ebcb-4c53-9364-0729bce0163c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1314 microversion: 2.1 time: 0.489569 Oct 28 18:11:41.145046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1170/2242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:40 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:41.156981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:41.160827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:41.182242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:41.183029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:41.186099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:41.187062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:41.187702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:41.191702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:41.849953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:41.875997 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77a9b9ce-df3e-4dad-ba59-2dd20aafd9e3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1271 microversion: 2.1 time: 0.726571 Oct 28 18:11:41.880288 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1171/2243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:41 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1271 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:41.946599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:41.952783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:41.977261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:41.981336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:41.981992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:41.982945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:41.983765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:41.991671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:42.060901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:43.392445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:43.442233 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1d804271-5539-4804-85d2-dc5d4cd10fc9 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1387 microversion: 2.1 time: 2.782816 Oct 28 18:11:43.443868 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1073/2244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:40 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1387 bytes in 2791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:43.460426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:43.462938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:43.503899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:43.504768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:43.505380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:43.506326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:43.507012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:43.507794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:43.629267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:43.640316 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fc313712-75bc-4f89-a6e3-91c5a98e41a7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 1.716854 Oct 28 18:11:43.651900 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1172/2245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:41 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:43.657266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c7b9e1d1-8f62-4afb-9a12-232ba4005e91 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e237ad30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:43.771916 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c7b9e1d1-8f62-4afb-9a12-232ba4005e91 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.118407 Oct 28 18:11:43.772516 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1173/2246] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:43 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:43.786408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e541370c-838f-4f65-a743-889e8e65d008 req-b850bce6-7c2e-4e36-960d-2c1c207cad4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8148f1bc-d908-4fa0-bd92-aad5464fe069", "name": "network-vif-plugged", "status": "completed", "tag": "b21e0da3-68f8-41b1-9a87-d0036283bcfe"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:43.809973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e541370c-838f-4f65-a743-889e8e65d008 req-b850bce6-7c2e-4e36-960d-2c1c207cad4a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:43.810571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e541370c-838f-4f65-a743-889e8e65d008 req-b850bce6-7c2e-4e36-960d-2c1c207cad4a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:43.811031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e541370c-838f-4f65-a743-889e8e65d008 req-b850bce6-7c2e-4e36-960d-2c1c207cad4a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:43.845466 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e541370c-838f-4f65-a743-889e8e65d008 req-b850bce6-7c2e-4e36-960d-2c1c207cad4a service nova] Creating event network-vif-plugged:b21e0da3-68f8-41b1-9a87-d0036283bcfe for instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 on n-h1-862404-2 Oct 28 18:11:43.857808 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e541370c-838f-4f65-a743-889e8e65d008 req-b850bce6-7c2e-4e36-960d-2c1c207cad4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075860 Oct 28 18:11:43.859052 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1174/2247] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:43.865781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:43.883744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:43.898828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:43.901486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:43.902120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:43.903026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:43.904393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:43.909624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:43.978376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36c59c06-d61d-43d8-8d28-e6f1c20a7eb2 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117711 Oct 28 18:11:43.986512 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1175/2248] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:11:43 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:43.992769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:43.994594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:44.001726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:44.003208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:44.004166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:44.005103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:44.005742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:44.006347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:44.196824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:44.216256 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5f05778-9772-470e-94ab-d86db3c79de2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 0.762514 Oct 28 18:11:44.219073 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1074/2249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:43 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:44.237467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:44.239522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:44.256807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:44.258052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:44.258751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:44.259694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:44.260343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:44.260937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:44.503490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:44.514985 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-48dac08e-9b02-4ad8-a584-ecbc773cb1b6 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1277 microversion: 2.1 time: 0.294234 Oct 28 18:11:44.531104 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1075/2250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:44 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1277 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:44.532098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:44.532780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:44.547036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:44.547546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:44.552124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:44.555043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:44.555571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:44.556061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:44.910011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:44.921022 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-24aecd75-9760-4e8d-9b44-8849c590b4d3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1387 microversion: 2.1 time: 0.401912 Oct 28 18:11:44.923872 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1076/2251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:44 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1387 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:44.936608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:44.937611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:44.952308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:44.954705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:44.957187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:44.958207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:44.964936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:44.966098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.128271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:45.137643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-942d7e91-af8d-42bf-9583-334b7f4c08f3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1314 microversion: 2.1 time: 1.148975 Oct 28 18:11:45.144811 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1176/2252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:43 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1314 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:45.150010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e85afcf-5130-41b5-91db-16a07c1f057f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e2451a60>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:45.248996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e85afcf-5130-41b5-91db-16a07c1f057f tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1429 microversion: 2.1 time: 0.102713 Oct 28 18:11:45.252779 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1177/2253] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:45 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:45.269986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:45.275536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:45.290236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.291046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.291683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.292648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.293278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.293930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.332254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:45.335681 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a1bcb0ed-ecbd-4ed6-b3fa-593de35b7972 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079692 Oct 28 18:11:45.341171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1178/2254] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:11:45 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:45.360071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a7b2c4b0-03ca-4e16-a27c-e84bde8935fe req-a4d31913-29f3-4943-8dd2-aa1605839db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71391770-4b79-4140-9753-5708e93caf27", "tag": "befa86b1-c918-4b71-a5fd-be421c3360b5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:45.386595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a7b2c4b0-03ca-4e16-a27c-e84bde8935fe req-a4d31913-29f3-4943-8dd2-aa1605839db6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.387109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a7b2c4b0-03ca-4e16-a27c-e84bde8935fe req-a4d31913-29f3-4943-8dd2-aa1605839db6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.387560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a7b2c4b0-03ca-4e16-a27c-e84bde8935fe req-a4d31913-29f3-4943-8dd2-aa1605839db6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.412759 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a7b2c4b0-03ca-4e16-a27c-e84bde8935fe req-a4d31913-29f3-4943-8dd2-aa1605839db6 service nova] Creating event network-changed:befa86b1-c918-4b71-a5fd-be421c3360b5 for instance 71391770-4b79-4140-9753-5708e93caf27 on n-h2-862404-2 Oct 28 18:11:45.422380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a7b2c4b0-03ca-4e16-a27c-e84bde8935fe req-a4d31913-29f3-4943-8dd2-aa1605839db6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079663 Oct 28 18:11:45.423770 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1179/2255] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:45.431273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:45.432250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:45.439508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.440780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.441426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.442417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.443079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.443677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.682873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:45.693019 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e000f60-340e-4153-9103-c83c5ead2463 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 0.767252 Oct 28 18:11:45.704697 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1077/2256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:44 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:45.712974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:45.728820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:45.741509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.746367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.747899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.752562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.753394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.755563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.941369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:45.949757 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9067d799-cc2d-4dd2-90a2-c9b874a8e1a8 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1277 microversion: 2.1 time: 0.240734 Oct 28 18:11:45.968871 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1078/2257] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:45 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:45.974502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ca9a18a2-5bb4-4776-8c01-bd248f119b82 req-bca7c184-ed72-43b4-9297-40d187c02cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c6fd04-db62-4518-9726-de061cb29c49", "name": "network-vif-plugged", "status": "completed", "tag": "e328e141-4427-4198-8fef-00dcd59707ab"}, {"server_uuid": "e10ed602-8749-474d-a2e1-46b84ecb86d8", "name": "network-vif-plugged", "status": "completed", "tag": "ee59cdc4-5702-48f2-a669-40f18f587878"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:45.986080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ca9a18a2-5bb4-4776-8c01-bd248f119b82 req-bca7c184-ed72-43b4-9297-40d187c02cc2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.987513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ca9a18a2-5bb4-4776-8c01-bd248f119b82 req-bca7c184-ed72-43b4-9297-40d187c02cc2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.988333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ca9a18a2-5bb4-4776-8c01-bd248f119b82 req-bca7c184-ed72-43b4-9297-40d187c02cc2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.002054 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ca9a18a2-5bb4-4776-8c01-bd248f119b82 req-bca7c184-ed72-43b4-9297-40d187c02cc2 service nova] Creating event network-vif-plugged:e328e141-4427-4198-8fef-00dcd59707ab for instance 88c6fd04-db62-4518-9726-de061cb29c49 on n-h2-862404-2 Oct 28 18:11:46.003509 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ca9a18a2-5bb4-4776-8c01-bd248f119b82 req-bca7c184-ed72-43b4-9297-40d187c02cc2 service nova] Creating event network-vif-plugged:ee59cdc4-5702-48f2-a669-40f18f587878 for instance e10ed602-8749-474d-a2e1-46b84ecb86d8 on n-h1-862404-2 Oct 28 18:11:46.012519 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ca9a18a2-5bb4-4776-8c01-bd248f119b82 req-bca7c184-ed72-43b4-9297-40d187c02cc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041933 Oct 28 18:11:46.013428 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1079/2258] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:46.022591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:46.023661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:46.030747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.031649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.032381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.033455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.034144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.034931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.361498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:46.379508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7224e5a7-b181-4b60-9eeb-e214158f02c4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 0.953936 Oct 28 18:11:46.420614 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1180/2259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:45 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:46.433468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:46.437193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:46.470512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.471601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.473539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.475639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.476538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.478602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.485510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:46.494491 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7660d87-53db-4f4c-8eba-a43ef0d8af88 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1387 microversion: 2.1 time: 0.479486 Oct 28 18:11:46.501650 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1080/2260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:46 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1387 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:46.507581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86c2a422-3f0b-4eef-9d5a-aa28915c9f36 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78ddbba0d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:46.604276 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86c2a422-3f0b-4eef-9d5a-aa28915c9f36 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1438 microversion: 2.1 time: 0.088415 Oct 28 18:11:46.605249 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1081/2261] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:46 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:46.610110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:46.613331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:46.650627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.653228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.653710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.657251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.657799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.659573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.783299 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3dac16a4-c0eb-483d-a75c-4bc3c250aa66 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176934 Oct 28 18:11:46.785990 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1082/2262] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:11:46 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:46.791115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3232a7aa-911d-4a17-add6-8513b2969457 req-996807fd-aaa6-42ed-908e-448d43bc938a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42126e7-fffb-413e-b662-efb6a5141612", "name": "network-vif-deleted", "tag": "bda648cd-3190-45fe-ad1e-deb2f2dab3f9"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:46.802651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3232a7aa-911d-4a17-add6-8513b2969457 req-996807fd-aaa6-42ed-908e-448d43bc938a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.803797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3232a7aa-911d-4a17-add6-8513b2969457 req-996807fd-aaa6-42ed-908e-448d43bc938a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.804497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3232a7aa-911d-4a17-add6-8513b2969457 req-996807fd-aaa6-42ed-908e-448d43bc938a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.841256 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3232a7aa-911d-4a17-add6-8513b2969457 req-996807fd-aaa6-42ed-908e-448d43bc938a service nova] Creating event network-vif-deleted:bda648cd-3190-45fe-ad1e-deb2f2dab3f9 for instance f42126e7-fffb-413e-b662-efb6a5141612 on n-h1-862404-2 Oct 28 18:11:46.848997 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3232a7aa-911d-4a17-add6-8513b2969457 req-996807fd-aaa6-42ed-908e-448d43bc938a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061486 Oct 28 18:11:46.850777 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1083/2263] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:46.858313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6efde7c1-5e35-4a50-a753-f799e8fd157d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78ddc159d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:46.918586 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6efde7c1-5e35-4a50-a753-f799e8fd157d tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 200 len: 1438 microversion: 2.1 time: 0.066104 Oct 28 18:11:46.919916 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1084/2264] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:46 2022] GET /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 1438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:46.927243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:46.928357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:46.936740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.937592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.938280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.939364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.941114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.941801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.111250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:47.123521 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ed24667-d046-4832-b3bb-bafea4c2b1a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1314 microversion: 2.1 time: 0.700952 Oct 28 18:11:47.129533 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1181/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:46 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:47.134712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:47.140045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:47.169819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.170592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.171140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.172025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.172590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.173554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.225041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:47.237489 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aadc5c62-dd06-48f1-9e08-a9aedcf0cc50 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 0.315432 Oct 28 18:11:47.238731 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1085/2266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:46 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:47.244735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:47.245617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:47.253855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.256436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.257066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.258330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.270372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.271217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.524599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:47.537953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:47.550968 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79490af4-c947-4f58-998b-c4b8d638df45 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1467 microversion: 2.1 time: 0.419962 Oct 28 18:11:47.552984 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fce00b20-2404-4c22-a239-3d5f159ecaae tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.312778 Oct 28 18:11:47.554055 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1086/2267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:47 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:47.555717 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1182/2268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:47 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1467 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:47.577351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:47.577351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:47.588291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:47.591437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:47.599709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.604070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.604825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.606215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.607131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.607842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.609403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.610416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.611025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.614507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.618123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.618796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.763682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:47.773437 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c740dac5-4630-490c-a0e6-59a6f73446cc tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1183 microversion: 2.1 time: 0.194504 Oct 28 18:11:47.787900 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1183/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:47 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:47.787900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-101116bf-dd92-4e55-86fa-08d8f5105547 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78e23c4c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:47.860801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:47.872972 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-46f462dc-781f-4bbc-b7f9-94252da96af7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1318 microversion: 2.1 time: 0.317225 Oct 28 18:11:47.889459 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1087/2270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:47 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:47.896746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:47.900960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:47.921708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.922809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.923358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.925948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.926544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.927085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.967865 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ccab230f-70c8-4edb-80ae-9805e799f397 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077104 Oct 28 18:11:47.975958 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1088/2271] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:11:47 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:11:48.157023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:48.158099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:48.170633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:48.172837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:48.176416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:48.179069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:48.180891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:48.181821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:48.586186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:48.597916 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e80dd014-b47d-445a-a5f5-c7ee37b22dac tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1314 microversion: 2.1 time: 0.446540 Oct 28 18:11:48.613097 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1089/2272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:48 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:48.623125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:48.624223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:48.632147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:48.633058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:48.633731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:48.634674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:48.636011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:48.636665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:48.785898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:48.832583 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-101116bf-dd92-4e55-86fa-08d8f5105547 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "DELETE /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992" status: 204 len: 0 microversion: 2.1 time: 1.054623 Oct 28 18:11:48.833366 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1184/2273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:47 2022] DELETE /compute/v2.1/images/1c91b8a4-3688-4419-94c8-249ffbde4992 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:11:48.834888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:48.841725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1500875726", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "8fc60b9b-bd13-4f9a-a7e6-a305fafd82b6"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:48.962483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] validate_networks() for [('8fc60b9b-bd13-4f9a-a7e6-a305fafd82b6', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:11:49.009991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:49.018518 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0266ea4d-fbc8-49ea-ae70-8c96044394c5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1317 microversion: 2.1 time: 0.403810 Oct 28 18:11:49.023533 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1090/2274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:48 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:49.028401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:49.031024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:49.043029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:49.046718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:49.051715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:49.055183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:49.056065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:49.056742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:49.401443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:49.410202 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8d94c3ed-de63-4dd9-b691-344f7b2d2dbf tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.385229 Oct 28 18:11:49.410802 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1091/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:49 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:49.427014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:49.427594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:49.449532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:49.450039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:49.450484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:49.451424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:49.452083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:49.452694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:49.514936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:49.588018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:49.598485 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-564cbec0-709c-40db-b3b7-b5efeafaa6d8 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1183 microversion: 2.1 time: 0.175991 Oct 28 18:11:49.599735 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1092/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:49 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:49.604713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-747d08ff-81e4-4acc-b005-168169badf2c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '.version_select at 0x7f78ddba4700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:49.628058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:49.644794 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-747d08ff-81e4-4acc-b005-168169badf2c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] HTTP exception thrown: Image not found. Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-747d08ff-81e4-4acc-b005-168169badf2c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Request method failure captured: Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 HTTP/1.1 Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBruci8SsJDvchrX7m5dQdnL5W6tq_d9SShW88mD3iD0Kg_WDR9bCu_QeDyau9udCp020g81BxlGGrGrrwKftDNhxfItt-DBk4PKijiXTkS2E0N2hdR3Os884s6EMLrkHQZUzad4YQg8I9ICPTr6KxkHDM_ltURkXVjgwf5vVMDjx0E Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 81a4f32a961a4bad9d00f2fe644a1b72 Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:11:49.647314 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81a4f32a961a4bad9d00f2fe644a1b72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 81a4f32a961a4bad9d00f2fe644a1b72 Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerTestJSON-1983840474-project Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8f10e644aa9842e681a4c7bb612a0ab0 Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerTestJSON-1983840474-project Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: exception: Image not found. Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9'} Oct 28 18:11:49.648963 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 to delete Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:49.649941 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 could not be found. Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:49.651356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:11:49.654376 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:49.666367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-747d08ff-81e4-4acc-b005-168169badf2c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Returning 404 to user: Image not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:49.669381 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-747d08ff-81e4-4acc-b005-168169badf2c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "DELETE /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9" status: 404 len: 62 microversion: 2.1 time: 0.068276 Oct 28 18:11:49.672206 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1093/2277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:49 2022] DELETE /compute/v2.1/images/b5f7d8df-d535-45f9-9a6f-bfa4603ebeb9 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:11:49.680503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:49.682235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:49.691435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:49.692380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:49.693059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:49.694499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:49.697186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:49.698117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:49.990430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:50.000362 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4cfb7dc3-0b0e-48ec-b54a-522f97327414 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1508 microversion: 2.1 time: 0.325022 Oct 28 18:11:50.020626 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1094/2278] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:49 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:50.025820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:50.029877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:50.038666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.039391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.040237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.042060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.042060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.042375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.314929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:50.336043 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13b6413e-8502-4f8d-8dfc-3e662e5d71cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1314 microversion: 2.1 time: 0.318583 Oct 28 18:11:50.337272 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1095/2279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:50 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:50.351118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-56fb5d39-9f7d-4e50-a72a-7a38e8642c6a req-0df2aac5-28f4-42e2-9ac6-ad36bf250187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d061a254-5b3d-4d89-acd8-79c1842c684b", "name": "network-vif-unplugged", "status": "completed", "tag": "ccdbe197-71c8-4c99-a4db-0f84eee173b7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:50.372230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-56fb5d39-9f7d-4e50-a72a-7a38e8642c6a req-0df2aac5-28f4-42e2-9ac6-ad36bf250187 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.373297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-56fb5d39-9f7d-4e50-a72a-7a38e8642c6a req-0df2aac5-28f4-42e2-9ac6-ad36bf250187 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.373661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-56fb5d39-9f7d-4e50-a72a-7a38e8642c6a req-0df2aac5-28f4-42e2-9ac6-ad36bf250187 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.575578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:11:50.576105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:11:50.576533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:11:50.576953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:11:50.577367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:11:50.596029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.597025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.597483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.668568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.668568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.668568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.684473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Getting quotas for project 379769ae736843d0bddf1849cf09d837. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:11:50.690712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Getting quotas for user 24ef4ee8fd6349dba67ca7c4cb32234c and project 379769ae736843d0bddf1849cf09d837. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:11:50.705949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:11:50.708534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:11:50.776581 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-56fb5d39-9f7d-4e50-a72a-7a38e8642c6a req-0df2aac5-28f4-42e2-9ac6-ad36bf250187 service nova] Creating event network-vif-unplugged:ccdbe197-71c8-4c99-a4db-0f84eee173b7 for instance d061a254-5b3d-4d89-acd8-79c1842c684b on n-h1-862404-2 Oct 28 18:11:50.782818 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b53fb356-5982-49fa-880d-74783021590a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.946311 Oct 28 18:11:50.787939 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1185/2280] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:11:50.798071 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-56fb5d39-9f7d-4e50-a72a-7a38e8642c6a req-0df2aac5-28f4-42e2-9ac6-ad36bf250187 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.459073 Oct 28 18:11:50.799455 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1096/2281] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:50.801903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:50.809147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:50.813082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:50.817182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:50.825462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.825462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.836390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.837299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.837881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.838391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.852904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.854601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.855128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.857712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.858276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.859341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.937980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:11:51.139609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:51.152618 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-623b2db3-4eea-4021-9f4e-321e5230b2a9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1508 microversion: 2.1 time: 0.351107 Oct 28 18:11:51.154010 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1097/2282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:50 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:51.162833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:51.163012 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2eeb8970-42d4-42c5-bc85-76b197c845fb tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 204 len: 0 microversion: 2.1 time: 0.373734 Oct 28 18:11:51.163872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:51.170051 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1186/2283] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:11:50 2022] DELETE /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:11:51.179095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.179596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.180190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.181109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.181402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.181891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.196789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:51.197523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:51.218594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.219421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.220132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.221622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.222504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.223147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.490399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:51.501191 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-797f513d-0104-4721-b031-eaf92273b637 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1467 microversion: 2.1 time: 0.345671 Oct 28 18:11:51.508330 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1098/2284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:51 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1467 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:51.532837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:51.534320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:51.556436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.557091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.557615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.559172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.560337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.562000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.723306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:51.734965 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6345500b-d3b9-4171-995a-f15a68216ccb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1183 microversion: 2.1 time: 0.225187 Oct 28 18:11:51.738562 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1099/2285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:51 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:51.750784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:51.753725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:51.766493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.771181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.772134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.772916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.773393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.773977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.844333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:51.852571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:51.856458 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb2e6324-6122-4c39-b0ec-658660832431 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1222 microversion: 2.1 time: 0.115714 Oct 28 18:11:51.857050 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1100/2286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:51 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:51.872636 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44113ce0-8e22-4d22-8dcd-b60d1a0007f9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.689188 Oct 28 18:11:51.872636 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1187/2287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:51 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:51.872636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:51.872636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:51.875007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.875746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.876373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.877016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:51.877320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.877996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.878633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.880172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:51.882857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:51.889172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.889172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.889463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.891853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.891853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.891853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.003020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:11:52.003828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:11:52.004483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:11:52.005066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:11:52.005728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:11:52.095661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:52.103314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.104300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.104936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.105842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.106486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.107102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.148583 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c6a9c2be-bd96-4da3-9f42-af5d0ba279c5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "POST /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8/action" status: 202 len: 1110 microversion: 2.1 time: 0.290350 Oct 28 18:11:52.160772 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1101/2288] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:11:51 2022] POST /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8/action => generated 1110 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 18:11:52.169205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ef0894bf-294f-4f97-8428-eaa65d538aba req-e3b18487-d41d-4e0b-aa69-82543517af0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb33f22-de3d-4a95-9658-99d96a5229bf", "tag": "c5d6b20a-7dec-4824-b41f-1ac6a634f2e8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:52.179595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ef0894bf-294f-4f97-8428-eaa65d538aba req-e3b18487-d41d-4e0b-aa69-82543517af0a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.180093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ef0894bf-294f-4f97-8428-eaa65d538aba req-e3b18487-d41d-4e0b-aa69-82543517af0a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.180980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ef0894bf-294f-4f97-8428-eaa65d538aba req-e3b18487-d41d-4e0b-aa69-82543517af0a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.192491 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ef0894bf-294f-4f97-8428-eaa65d538aba req-e3b18487-d41d-4e0b-aa69-82543517af0a service nova] Creating event network-changed:c5d6b20a-7dec-4824-b41f-1ac6a634f2e8 for instance 3eb33f22-de3d-4a95-9658-99d96a5229bf on n-h2-862404-2 Oct 28 18:11:52.197951 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ef0894bf-294f-4f97-8428-eaa65d538aba req-e3b18487-d41d-4e0b-aa69-82543517af0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032417 Oct 28 18:11:52.198815 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1102/2289] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:52.204363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:52.205064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:52.212872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.213111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.213549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.214250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.214705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.215128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.216614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:52.226133 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-986e40fd-76bc-4bad-9360-7c8edc214e3c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1473 microversion: 2.1 time: 0.361983 Oct 28 18:11:52.226771 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1188/2290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:51 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:52.231897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:52.232742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:52.240326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.241143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.241871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.242874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.243577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.244259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.378022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:52.385657 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d426a3d-b9df-444c-b325-45c64651aac3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1314 microversion: 2.1 time: 0.185734 Oct 28 18:11:52.386222 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1103/2291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:52 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:52.398083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:52.398981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:52.405065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.405699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.406237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.408096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.409709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.409709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.604399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:52.610780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:52.635368 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3dbe9475-e2a5-46ad-b621-ee093db2122a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.241256 Oct 28 18:11:52.635988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6a6688b-4e98-4a21-a69c-3ce327c3cdef tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 1468 microversion: 2.1 time: 0.404958 Oct 28 18:11:52.636768 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1104/2292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:52 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:52.649320 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1189/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:52 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 1468 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:52.659852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1296757319"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:52.662371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:52.670258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.670768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.671402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.672022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.672886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.672886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.760960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:52.762701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:52.774295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.776189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.780960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.781968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.782650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.784097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.928404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:52.947575 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7aa5bac8-f0b8-4783-876c-4d5a485f14b3 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1183 microversion: 2.1 time: 0.190278 Oct 28 18:11:52.967377 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1190/2294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:52 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:52.977675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-193cb21f-8715-4bf4-9731-1630bf48b3f9 req-47508546-6e02-4c35-a690-4ea25b4c4c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71391770-4b79-4140-9753-5708e93caf27", "name": "network-vif-plugged", "status": "completed", "tag": "befa86b1-c918-4b71-a5fd-be421c3360b5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:52.995182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-193cb21f-8715-4bf4-9731-1630bf48b3f9 req-47508546-6e02-4c35-a690-4ea25b4c4c17 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.997501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-193cb21f-8715-4bf4-9731-1630bf48b3f9 req-47508546-6e02-4c35-a690-4ea25b4c4c17 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.999509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-193cb21f-8715-4bf4-9731-1630bf48b3f9 req-47508546-6e02-4c35-a690-4ea25b4c4c17 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.027904 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-193cb21f-8715-4bf4-9731-1630bf48b3f9 req-47508546-6e02-4c35-a690-4ea25b4c4c17 service nova] Creating event network-vif-plugged:befa86b1-c918-4b71-a5fd-be421c3360b5 for instance 71391770-4b79-4140-9753-5708e93caf27 on n-h2-862404-2 Oct 28 18:11:53.038589 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-193cb21f-8715-4bf4-9731-1630bf48b3f9 req-47508546-6e02-4c35-a690-4ea25b4c4c17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068505 Oct 28 18:11:53.039900 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1191/2295] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:53.089625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:53.090377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:53.115080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.115593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.116097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.116832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.117301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.117736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.130237 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2aecda6-91c0-42f4-9627-d120750111a6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "POST /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069/action" status: 202 len: 0 microversion: 2.1 time: 0.474323 Oct 28 18:11:53.131312 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1105/2296] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:11:52 2022] POST /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:11:53.137117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:53.138661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:53.146388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.146881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.147371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.148126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.148688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.149199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.221524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:53.230594 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64e3cd27-c9a2-4e74-b74f-6cabd1de930d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1214 microversion: 2.1 time: 0.179092 Oct 28 18:11:53.234276 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1192/2297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:53 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:53.242284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61557189-8596-401a-8122-bcb1dd3d5a35 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e24cc3a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:53.334831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61557189-8596-401a-8122-bcb1dd3d5a35 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.098369 Oct 28 18:11:53.335432 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1193/2298] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:53 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:53.343769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:53.355471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:53.380152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.380655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.381240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.381976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.382440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.382875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.595268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:53.608451 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c32eb0f4-f28f-41b9-a691-ee29e1836496 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.475796 Oct 28 18:11:53.624212 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1106/2299] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:53 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:53.637410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:53.638117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:53.645439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:53.655408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.656035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.656555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.657360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.657883 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-abb5430c-353a-4809-98b3-f2334fa95cef tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1473 microversion: 2.1 time: 0.321366 Oct 28 18:11:53.658005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.659037 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1194/2300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:53 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1473 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:53.670321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:53.670955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:53.672289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.688172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.688419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.689162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.689550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.690111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.690561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.117311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:54.126234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05ae6f3f-7d0e-4906-bb79-e9f481e9817b tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.462190 Oct 28 18:11:54.139116 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1195/2301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:53 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:54.146541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:54.147173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:54.170640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:54.171147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:54.171589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.172343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:54.172802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:54.173231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.242756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:54.257407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:54.271028 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e5379ca-a8d6-479c-a8c2-00ea9df5b63c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1314 microversion: 2.1 time: 0.644363 Oct 28 18:11:54.277907 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1107/2302] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:53 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:54.305755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:54.306415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:54.323718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:54.337354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa62268d-c51b-4949-b307-35ac58f80811 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1183 microversion: 2.1 time: 0.204028 Oct 28 18:11:54.339190 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1196/2303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:54 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:54.353794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-050e0e34-d71f-4b41-896c-2a9a7e4f6472 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2451c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:54.357196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:54.358006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:54.358757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.366014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:54.367108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:54.370756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.444169 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-050e0e34-d71f-4b41-896c-2a9a7e4f6472 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.094954 Oct 28 18:11:54.445499 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1197/2304] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:54 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:54.558417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:54.572637 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9054eb37-2ce7-4859-b692-1969976b8c2a tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1270 microversion: 2.1 time: 0.291877 Oct 28 18:11:54.587842 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1108/2305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:54 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1270 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:54.639445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:54.640483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:54.658212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:54.668668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:54.669408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.670370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:54.671014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:54.671633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.684387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:54.685276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:54.695411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:54.704445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:54.708493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.709671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:54.710248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:54.710902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:54.984747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:55.000541 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-506c78f3-9043-4ac9-88f8-0b2081bd5998 tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1431 microversion: 2.1 time: 0.319962 Oct 28 18:11:55.001587 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1109/2306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:54 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1431 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:55.015644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b271190e-f586-499a-b0c8-a7816071b122 req-ef2877c1-8651-4195-a6e1-d042eb283b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d061a254-5b3d-4d89-acd8-79c1842c684b", "name": "network-vif-deleted", "tag": "ccdbe197-71c8-4c99-a4db-0f84eee173b7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:55.033371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b271190e-f586-499a-b0c8-a7816071b122 req-ef2877c1-8651-4195-a6e1-d042eb283b91 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.034927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b271190e-f586-499a-b0c8-a7816071b122 req-ef2877c1-8651-4195-a6e1-d042eb283b91 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.042412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b271190e-f586-499a-b0c8-a7816071b122 req-ef2877c1-8651-4195-a6e1-d042eb283b91 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.068429 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b271190e-f586-499a-b0c8-a7816071b122 req-ef2877c1-8651-4195-a6e1-d042eb283b91 service nova] Creating event network-vif-deleted:ccdbe197-71c8-4c99-a4db-0f84eee173b7 for instance d061a254-5b3d-4d89-acd8-79c1842c684b on n-h1-862404-2 Oct 28 18:11:55.075443 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b271190e-f586-499a-b0c8-a7816071b122 req-ef2877c1-8651-4195-a6e1-d042eb283b91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071959 Oct 28 18:11:55.078621 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1110/2307] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:55.156759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:55.157483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:55.178084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.178627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.179077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.179834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.180301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.180734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.226706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:55.233304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:55.245810 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-640de39f-ef56-4952-8ede-807aa4fc4be7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.610391 Oct 28 18:11:55.249683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1198/2308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:54 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:55.298136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:55.298767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:55.323131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.330052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.331284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.332072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.337423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.340443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.441705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:55.456110 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a44f6ff0-5fa4-40c0-afef-73026882d435 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.303145 Oct 28 18:11:55.458157 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1111/2309] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:55 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:55.478353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:55.479004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:55.487273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.487715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.488189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.488922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.489384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.489817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.527350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.527870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.528327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.528783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lazy-loading 'fault' on Instance uuid f42126e7-fffb-413e-b662-efb6a5141612 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:11:55.584070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:55.594504 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ce82df22-1be4-41e4-aa92-3e9d6002d961 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 200 len: 1188 microversion: 2.1 time: 0.122047 Oct 28 18:11:55.608774 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1112/2310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:55 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 1188 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:55.619296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bfa809dc-dc41-4b37-8bc7-b37668c358d7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e23e8820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:55.691709 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bfa809dc-dc41-4b37-8bc7-b37668c358d7 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.074651 Oct 28 18:11:55.695627 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1113/2311] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:55 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:55.713693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:55.724417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:55.771987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.772518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.778835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.784922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.786560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.790421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.840776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:55.852319 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d9cc235f-8573-4166-8b44-56f762e61142 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1314 microversion: 2.1 time: 0.560340 Oct 28 18:11:55.875664 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1199/2312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:55 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:55.968912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:55.986379 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d9bea731-8f5c-44c7-9823-8e7383be9771 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1276 microversion: 2.1 time: 0.273364 Oct 28 18:11:55.989937 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1114/2313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:55 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1276 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:56.030453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:56.036494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:56.062563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.063396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.064106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.068299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.069074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.069218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.157398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.159542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.160645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.161235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lazy-loading 'fault' on Instance uuid d061a254-5b3d-4d89-acd8-79c1842c684b {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:11:56.276014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:56.276656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:56.279379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f10e644aa9842e681a4c7bb612a0ab0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81a4f32a961a4bad9d00f2fe644a1b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:56.288819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.289337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.289789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.293231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b0137b9-9e49-4cfe-8b57-7527e70fc5ce tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 200 len: 1307 microversion: 2.1 time: 0.268721 Oct 28 18:11:56.298086 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1200/2314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:56 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:56.301357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.302032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.302617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.486506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:56.487442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:56.507697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.511445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.512166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.515232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.518956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.525292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.642310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:56.653688 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-539c16d5-c5b8-4cf3-8d6a-21ced2f7113d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.381287 Oct 28 18:11:56.654328 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1115/2315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:56 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:56.669251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:56.676910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: f42126e7-fffb-413e-b662-efb6a5141612] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:56.696701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.697208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.699410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.700207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.702602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.703094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.740955 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] HTTP exception thrown: Instance f42126e7-fffb-413e-b662-efb6a5141612 could not be found. Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Request method failure captured: Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 HTTP/1.1 Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBm80NG44keIYTYWfMd2oAhCRoXwrmSV2PMMfrRI0kuVKDCsGi1KFXvgDfprx9Qonq3z0W6b4C1R7TYtMLJM5VexsmJsDKg_8pt-ys82r_PHEk0APZffgLr7AtnsOlxKIp2Kn_1mQgqvWBpEQb1mqoxmYwcPpgWjQfko-JnNAZ2MWv8 Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 8253dbe510dd462f974f37fce0a5d990 Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-LiveMigrationTest-901527908 Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:11:56.743067 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8253dbe510dd462f974f37fce0a5d990", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-LiveMigrationTest-901527908 Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 8253dbe510dd462f974f37fce0a5d990 Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-LiveMigrationTest-901527908 Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-LiveMigrationTest-901527908-project Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 12dea4e86fd14c07859b48e22493b9dd Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-LiveMigrationTest-901527908-project Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f42126e7-fffb-413e-b662-efb6a5141612 could not be found. Oct 28 18:11:56.744336 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f42126e7-fffb-413e-b662-efb6a5141612'} Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f42126e7-fffb-413e-b662-efb6a5141612 could not be found. Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:56.745089 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f42126e7-fffb-413e-b662-efb6a5141612 could not be found. Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f42126e7-fffb-413e-b662-efb6a5141612 could not be found. Oct 28 18:11:56.746108 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:56.747234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Returning 404 to user: Instance f42126e7-fffb-413e-b662-efb6a5141612 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:56.747234 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f63a986-e995-4cc8-bb2a-e7991d4497cb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612" status: 404 len: 111 microversion: 2.1 time: 0.089480 Oct 28 18:11:56.749760 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1116/2316] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:56 2022] GET /compute/v2.1/servers/f42126e7-fffb-413e-b662-efb6a5141612 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:11:56.774969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e945cf33-8d36-4803-a8c2-c2f0eb8791bd tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2424af0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:56.867427 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e945cf33-8d36-4803-a8c2-c2f0eb8791bd tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.115171 Oct 28 18:11:56.868319 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1117/2317] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:56 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:56.885654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:56.886725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:56.902983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.903918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.904631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:56.905445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:56.906017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:56.906659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:57.099423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:57.109020 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3b6766f0-5744-4d75-a715-5fc079c19414 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1464 microversion: 2.1 time: 0.228106 Oct 28 18:11:57.125438 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1118/2318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:56 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1464 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:57.133544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:57.140862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:57.141490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:57.148983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:57.149808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:57.150751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:57.151719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:57.153212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:57.153879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:57.166825 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e80e15e-0e36-4283-a65a-6f5196e073fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.685014 Oct 28 18:11:57.172917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1201/2319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:56 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:57.484937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:57.498105 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4f83a83d-132c-488e-95b5-baf3a217587f tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1318 microversion: 2.1 time: 0.371414 Oct 28 18:11:57.503796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1119/2320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:57 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:57.516140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:57.523612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] [instance: d061a254-5b3d-4d89-acd8-79c1842c684b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:57.532201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:57.538401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Searching by: {'deleted': False, 'project_id': '8af6d5523ede4291b5780c55571fa72e'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:11:57.563625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:57.568529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:57.571387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:57.577472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:57.577472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:57.577792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:57.587325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:57.588046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:57.588509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:57.589338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:57.592516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:57.600608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:57.649654 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] HTTP exception thrown: Instance d061a254-5b3d-4d89-acd8-79c1842c684b could not be found. Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Request method failure captured: Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b HTTP/1.1 Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBruci8SsJDvchrX7m5dQdnL5W6tq_d9SShW88mD3iD0Kg_WDR9bCu_QeDyau9udCp020g81BxlGGrGrrwKftDNhxfItt-DBk4PKijiXTkS2E0N2hdR3Os884s6EMLrkHQZUzad4YQg8I9ICPTr6KxkHDM_ltURkXVjgwf5vVMDjx0E Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 81a4f32a961a4bad9d00f2fe644a1b72 Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:11:57.651315 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_81a4f32a961a4bad9d00f2fe644a1b72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/81a4f32a961a4bad9d00f2fe644a1b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 81a4f32a961a4bad9d00f2fe644a1b72 Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1983840474 Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ImagesOneServerTestJSON-1983840474-project Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8f10e644aa9842e681a4c7bb612a0ab0 Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ImagesOneServerTestJSON-1983840474-project Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance d061a254-5b3d-4d89-acd8-79c1842c684b could not be found. Oct 28 18:11:57.652399 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'd061a254-5b3d-4d89-acd8-79c1842c684b'} Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d061a254-5b3d-4d89-acd8-79c1842c684b could not be found. Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:11:57.653243 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d061a254-5b3d-4d89-acd8-79c1842c684b could not be found. Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d061a254-5b3d-4d89-acd8-79c1842c684b could not be found. Oct 28 18:11:57.654163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:11:57.655069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] Returning 404 to user: Instance d061a254-5b3d-4d89-acd8-79c1842c684b could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:11:57.655069 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9575b3fe-cdd0-42df-af4a-b4edd01a650c tempest-ImagesOneServerTestJSON-1983840474 tempest-ImagesOneServerTestJSON-1983840474-project] 10.222.0.16 "GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b" status: 404 len: 111 microversion: 2.1 time: 0.147754 Oct 28 18:11:57.655069 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1120/2321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:57 2022] GET /compute/v2.1/servers/d061a254-5b3d-4d89-acd8-79c1842c684b => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:11:57.684174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:57.690599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:57.716386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:57.716894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:57.717338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:57.718081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:57.718547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:57.736028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:58.001885 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65ac9549-373b-4ee0-a88e-04c7c610c500 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.827471 Oct 28 18:11:58.018434 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1202/2322] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:11:57 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:11:58.034774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6675982-6bb5-4725-90f9-fd83391de40e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e23c4700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:58.154776 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6675982-6bb5-4725-90f9-fd83391de40e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.129592 Oct 28 18:11:58.155516 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1203/2323] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:58 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:58.164262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:58.198065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Searching by: {'deleted': False} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:11:58.216036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:58.217077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:58.217896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:58.218792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:58.221789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:58.222447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:58.248660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:58.258168 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6416dd3e-6841-4a9e-8edd-72c9c9835fa2 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.580804 Oct 28 18:11:58.270230 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1121/2324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:57 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:58.291944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:58.297395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:58.349019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:58.351387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:58.352080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:58.353289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:58.356146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:58.358207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:58.541519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:11:58.772941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:58.788770 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-403c8b06-36eb-4dae-9251-edfdec59fe8e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.517333 Oct 28 18:11:58.790092 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1122/2325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:58 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:58.802093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:58.808124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:58.825946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:58.835561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:58.839636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:58.841176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:58.845506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:58.846868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:58.850485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:58.853260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:58.853952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:59.217457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:59.228317 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-80874f54-75ec-4128-b509-f6bfa0c29aa1 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1318 microversion: 2.1 time: 0.436655 Oct 28 18:11:59.236723 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1123/2326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:58 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:59.243276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1ab071e-1d33-4ac7-a374-2a504a07d57d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2424f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:59.318388 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1ab071e-1d33-4ac7-a374-2a504a07d57d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.080313 Oct 28 18:11:59.318975 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1124/2327] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:11:59 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:59.329910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:59.335921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:59.347252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:59.348375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:59.350765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:59.351790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:59.353837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:59.354560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:59.758782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:59.772883 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-98df6809-1e36-4e17-a990-11ea1f2c93a4 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.447903 Oct 28 18:11:59.777544 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1125/2328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:59 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:59.786956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4de07114-004c-4b98-9fbd-18cc0e4d9fef req-e6ef5ff9-960f-44ba-8256-3393f4ba15d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb33f22-de3d-4a95-9658-99d96a5229bf", "name": "network-vif-plugged", "status": "completed", "tag": "c5d6b20a-7dec-4824-b41f-1ac6a634f2e8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:59.813167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4de07114-004c-4b98-9fbd-18cc0e4d9fef req-e6ef5ff9-960f-44ba-8256-3393f4ba15d8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:59.816548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4de07114-004c-4b98-9fbd-18cc0e4d9fef req-e6ef5ff9-960f-44ba-8256-3393f4ba15d8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:59.817245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4de07114-004c-4b98-9fbd-18cc0e4d9fef req-e6ef5ff9-960f-44ba-8256-3393f4ba15d8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:59.853908 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4de07114-004c-4b98-9fbd-18cc0e4d9fef req-e6ef5ff9-960f-44ba-8256-3393f4ba15d8 service nova] Creating event network-vif-plugged:c5d6b20a-7dec-4824-b41f-1ac6a634f2e8 for instance 3eb33f22-de3d-4a95-9658-99d96a5229bf on n-h2-862404-2 Oct 28 18:11:59.884904 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4de07114-004c-4b98-9fbd-18cc0e4d9fef req-e6ef5ff9-960f-44ba-8256-3393f4ba15d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105353 Oct 28 18:11:59.888768 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1126/2329] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:59.911010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:59.928992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:11:59.970718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:59.971286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:59.971735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:59.981780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:59.983878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:59.991354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:00.389875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:00.412343 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0434a589-966c-41ad-ade2-2ca7fca7c33e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.521968 Oct 28 18:12:00.415267 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1127/2330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:59 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:00.421533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:00.435563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:00.461078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:00.461905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:00.473601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:00.474860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:00.480021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:00.482200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:00.556808 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5f38ca0-0b5d-4a8e-a992-148e472a5082 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19509 microversion: 2.1 time: 2.397748 Oct 28 18:12:00.560971 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1204/2331] 10.222.0.16 () {58 vars in 1171 bytes} [Fri Oct 28 18:11:58 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19509 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:12:00.567583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4587642-6c89-4e94-890f-01bc74e1c755 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de4caee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:00.697527 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4587642-6c89-4e94-890f-01bc74e1c755 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.134959 Oct 28 18:12:00.698364 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1205/2332] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:00 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:00.702979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:00.709944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Searching by: {'deleted': False, 'project_id': '8af6d5523ede4291b5780c55571fa72e'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:12:00.726016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:00.726511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:00.726957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:00.727692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:00.728193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:00.728802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:00.796579 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c82446e-476b-499d-85f3-53be083d6e08 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=6aa20e2a97184d9e93c88bd42520667e" status: 200 len: 15 microversion: 2.1 time: 0.096444 Oct 28 18:12:00.797216 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1206/2333] 10.222.0.16 () {58 vars in 1231 bytes} [Fri Oct 28 18:12:00 2022] GET /compute/v2.1/servers/detail?tenant_id=6aa20e2a97184d9e93c88bd42520667e => generated 15 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:12:00.803040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:00.803676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:00.813707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:00.814160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:00.817798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:00.818567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:00.819045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:00.819483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:00.863349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:00.873634 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23e509c2-7dcc-4257-b7a4-ad6b50aa39e8 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1318 microversion: 2.1 time: 0.456821 Oct 28 18:12:00.881243 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1128/2334] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:00 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:00.889606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:00.912430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Searching by: {'tenant_id': '6aa20e2a97184d9e93c88bd42520667e', 'deleted': False} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:12:00.943934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:00.945482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:00.946465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:00.947603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:00.948280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:00.948923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:01.253881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:12:01.318927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:01.494860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:01.495372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:01.508356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:01.528416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:01.542917 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51588339-50f6-4489-af68-744c4ba45a9e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1319 microversion: 2.1 time: 0.743767 Oct 28 18:12:01.543900 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1207/2335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:00 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1319 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:01.551392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f5bd1302-f00c-4c69-89de-f9bc2e0ee8af req-68b8017c-5a03-4069-bcee-eca1dd43e2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "647d8a8a-482b-47c9-94ce-c3eeef222378", "tag": "48ef2733-c17e-49c0-b751-bf471fed2830"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:01.563605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5bd1302-f00c-4c69-89de-f9bc2e0ee8af req-68b8017c-5a03-4069-bcee-eca1dd43e2ca service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:01.565164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5bd1302-f00c-4c69-89de-f9bc2e0ee8af req-68b8017c-5a03-4069-bcee-eca1dd43e2ca service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:01.565862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f5bd1302-f00c-4c69-89de-f9bc2e0ee8af req-68b8017c-5a03-4069-bcee-eca1dd43e2ca service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:01.589504 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f5bd1302-f00c-4c69-89de-f9bc2e0ee8af req-68b8017c-5a03-4069-bcee-eca1dd43e2ca service nova] Creating event network-changed:48ef2733-c17e-49c0-b751-bf471fed2830 for instance 647d8a8a-482b-47c9-94ce-c3eeef222378 on n-h1-862404-2 Oct 28 18:12:01.602586 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f5bd1302-f00c-4c69-89de-f9bc2e0ee8af req-68b8017c-5a03-4069-bcee-eca1dd43e2ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056526 Oct 28 18:12:01.604044 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1208/2336] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:01.818703 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4018511d-7547-4c7d-9617-4670b5e1cb77 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6aa20e2a97184d9e93c88bd42520667e" status: 200 len: 4828 microversion: 2.1 time: 0.935956 Oct 28 18:12:01.820079 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1129/2337] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 18:12:00 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6aa20e2a97184d9e93c88bd42520667e => generated 4828 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:01.825497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:01.826485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:01.887165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7cf0e21-2a0a-4f23-bfb3-81b6b4a205e8 tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Calling method '.version_select at 0x7f78e2560790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:01.889342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:01.895255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:01.900227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:01.904217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:01.908213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:01.911409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:01.960942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7cf0e21-2a0a-4f23-bfb3-81b6b4a205e8 tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:01.961527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7cf0e21-2a0a-4f23-bfb3-81b6b4a205e8 tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:01.965809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7cf0e21-2a0a-4f23-bfb3-81b6b4a205e8 tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:01.968991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7cf0e21-2a0a-4f23-bfb3-81b6b4a205e8 tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:01.969495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7cf0e21-2a0a-4f23-bfb3-81b6b4a205e8 tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:01.972873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7cf0e21-2a0a-4f23-bfb3-81b6b4a205e8 tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:02.083728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:02.101780 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7cf0e21-2a0a-4f23-bfb3-81b6b4a205e8 tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.494008 Oct 28 18:12:02.105819 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1209/2338] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 18:12:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:02.121745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-381118a0-6eb0-4df0-b409-55ffdeaeeb06 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2500280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:02.204262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:02.218629 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42881b0b-9789-4b77-a29f-de196ca721a0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.394206 Oct 28 18:12:02.219906 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1130/2339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:01 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:02.226273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:02.235530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Searching by: {'tenant_id': '8af6d5523ede4291b5780c55571fa72e', 'deleted': False} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:12:02.263149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:02.264065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:02.264654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:02.279802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:02.280494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:02.281245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:02.321218 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d201e1b4-4081-43ff-90f0-85c39069e148 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8af6d5523ede4291b5780c55571fa72e" status: 200 len: 15 microversion: 2.1 time: 0.099377 Oct 28 18:12:02.322506 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1131/2340] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 18:12:02 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8af6d5523ede4291b5780c55571fa72e => generated 15 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:12:02.327351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:02.328234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:02.338264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:02.338987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:02.339911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:02.340775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:02.341380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:02.342406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:02.669821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:02.688792 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-85404c5b-2f59-46a2-a7a1-878bbb225ecb tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1318 microversion: 2.1 time: 0.364150 Oct 28 18:12:02.709425 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1132/2341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:02 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:02.722355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-088fc5bc-1b92-4ec2-8ddf-d33194b5d118 req-cb4933cd-0c42-4260-b257-559b4d2c301a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8148f1bc-d908-4fa0-bd92-aad5464fe069", "name": "network-vif-plugged", "status": "completed", "tag": "b21e0da3-68f8-41b1-9a87-d0036283bcfe"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:02.752016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-088fc5bc-1b92-4ec2-8ddf-d33194b5d118 req-cb4933cd-0c42-4260-b257-559b4d2c301a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:02.753357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-088fc5bc-1b92-4ec2-8ddf-d33194b5d118 req-cb4933cd-0c42-4260-b257-559b4d2c301a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:02.754954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-088fc5bc-1b92-4ec2-8ddf-d33194b5d118 req-cb4933cd-0c42-4260-b257-559b4d2c301a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:02.781697 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-088fc5bc-1b92-4ec2-8ddf-d33194b5d118 req-cb4933cd-0c42-4260-b257-559b4d2c301a service nova] Creating event network-vif-plugged:b21e0da3-68f8-41b1-9a87-d0036283bcfe for instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 on n-h1-862404-2 Oct 28 18:12:02.790746 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-088fc5bc-1b92-4ec2-8ddf-d33194b5d118 req-cb4933cd-0c42-4260-b257-559b4d2c301a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079337 Oct 28 18:12:02.802965 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1133/2342] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:02.809921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9bab2511-5961-4159-b778-431eb6866d8f tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1104757208", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:10.844721 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-381118a0-6eb0-4df0-b409-55ffdeaeeb06 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 8.737735 Oct 28 18:12:10.845322 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1210/2343] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:02 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 8739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:10.853053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdf03c53-043c-4d99-b801-d9de3eb30967 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:10.863315 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdf03c53-043c-4d99-b801-d9de3eb30967 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.016913 Oct 28 18:12:10.867555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-9bab2511-5961-4159-b778-431eb6866d8f tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:12:10.876190 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1211/2344] 10.222.0.16 () {58 vars in 1189 bytes} [Fri Oct 28 18:12:10 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:12:10.886518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:10.887267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:10.894015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:10.894526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:10.894973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:10.895701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:10.896191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:10.896635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.114851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:11.124953 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fbdd4938-2863-49ad-bc99-c4eeac7aa80d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1468 microversion: 2.1 time: 0.247620 Oct 28 18:12:11.126148 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1212/2345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:10 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:11.133034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:11.133858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:11.140391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.141146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.141802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.142972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.143622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9bab2511-5961-4159-b778-431eb6866d8f tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Getting quotas for project 40a87a7cbc2e4cc4a38a33c54bb99efc. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:12:11.144143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.144777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.158586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9bab2511-5961-4159-b778-431eb6866d8f tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Getting quotas for user 7973cd9a67d44fceafd4a3283c237baf and project 40a87a7cbc2e4cc4a38a33c54bb99efc. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:12:11.177753 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9bab2511-5961-4159-b778-431eb6866d8f tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9bab2511-5961-4159-b778-431eb6866d8f tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Request method failure captured: Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 1752 Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBtxDL2fLcpHCULvKJkuXXIf4be0N8waddZBiW6MRnEAZ7nIjkIMvc0_5oBrGW97LeR8bqvuD6JgUkbQE_VtTiNxxlnpDucWYT9HkSu5EDrbkuEh0sWCw-_qxjb5LD9nB7lbd-mVnjPFDw2uWQ7CSItDbowqcFNC1yiPYMZ9Rifxugw Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 40a87a7cbc2e4cc4a38a33c54bb99efc Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-683956733 Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40a87a7cbc2e4cc4a38a33c54bb99efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/40a87a7cbc2e4cc4a38a33c54bb99efc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_40a87a7cbc2e4cc4a38a33c54bb99efc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/40a87a7cbc2e4cc4a38a33c54bb99efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-683956733 Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 40a87a7cbc2e4cc4a38a33c54bb99efc Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-683956733 Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-683956733-project Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 7973cd9a67d44fceafd4a3283c237baf Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-683956733-project Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1104757208", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:12:11.220389 n-d-862404-2 devstack@n-api.service[120679]: exception: Maximum number of metadata items exceeds 128 Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1104757208', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:11.223757 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 28 18:12:11.226663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:11.229273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9bab2511-5961-4159-b778-431eb6866d8f tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:11.230182 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9bab2511-5961-4159-b778-431eb6866d8f tempest-AbsoluteLimitsNegativeTestJSON-683956733 tempest-AbsoluteLimitsNegativeTestJSON-683956733-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 8.425843 Oct 28 18:12:11.230796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1134/2346] 10.222.0.16 () {60 vars in 1148 bytes} [Fri Oct 28 18:12:02 2022] POST /compute/v2.1/servers => generated 87 bytes in 8427 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:12:11.238604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:11.239294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:11.251743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.253911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.258113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.262041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.262529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.262973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.308211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:12:11.393112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:11.403619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-398d3d1e-f646-41df-aeba-af767ca5d5df tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.276178 Oct 28 18:12:11.419906 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1213/2347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:11 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:11.424791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:11.424791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:11.437265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.437837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.438481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.438917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.439375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.441480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.475345 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-55fc81c5-5649-4505-8a5e-08ddd57e4cc0 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 204 len: 0 microversion: 2.1 time: 0.240700 Oct 28 18:12:11.479100 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1135/2348] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:12:11 2022] DELETE /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:12:11.495084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ff35cbdf-41f5-4aa4-9039-4248dcdd6b29 req-c7fe7aba-7d3a-4dea-8ef0-e480d51b394f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647d8a8a-482b-47c9-94ce-c3eeef222378", "name": "network-vif-plugged", "status": "completed", "tag": "48ef2733-c17e-49c0-b751-bf471fed2830"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:11.527345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ff35cbdf-41f5-4aa4-9039-4248dcdd6b29 req-c7fe7aba-7d3a-4dea-8ef0-e480d51b394f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.527872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ff35cbdf-41f5-4aa4-9039-4248dcdd6b29 req-c7fe7aba-7d3a-4dea-8ef0-e480d51b394f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.529981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ff35cbdf-41f5-4aa4-9039-4248dcdd6b29 req-c7fe7aba-7d3a-4dea-8ef0-e480d51b394f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.573340 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ff35cbdf-41f5-4aa4-9039-4248dcdd6b29 req-c7fe7aba-7d3a-4dea-8ef0-e480d51b394f service nova] Creating event network-vif-plugged:48ef2733-c17e-49c0-b751-bf471fed2830 for instance 647d8a8a-482b-47c9-94ce-c3eeef222378 on n-h1-862404-2 Oct 28 18:12:11.579538 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ff35cbdf-41f5-4aa4-9039-4248dcdd6b29 req-c7fe7aba-7d3a-4dea-8ef0-e480d51b394f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097182 Oct 28 18:12:11.586296 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1136/2349] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:11.591651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:11.619852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:11.636580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.637093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.637520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.638233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.638686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.639108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.669472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:11.681309 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3bdd6746-eee1-47fc-b22b-65c682c36420 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1318 microversion: 2.1 time: 0.270595 Oct 28 18:12:11.685079 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1214/2350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:11 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:11.850322 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e1facd60-9e34-4a76-8d9b-f2e0afc475e1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action" status: 202 len: 0 microversion: 2.1 time: 0.262398 Oct 28 18:12:11.856388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1137/2351] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:11 2022] POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:12:11.856388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:11.857122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:11.879667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.880370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.880701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.881418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:11.881871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:11.882327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:11.944300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:12.009552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:12.134531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-934331319", "block_migration": true, "disk_over_commit": false}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:12.138561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:12.147592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.149202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.149840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.150790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.151635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.152329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.199003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lazy-loading 'flavor' on Instance uuid 3eb33f22-de3d-4a95-9658-99d96a5229bf {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:12:12.224830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Going to try to live migrate instance to tempest-host-934331319 {{(pid=120680) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:12:12.237289 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] HTTP exception thrown: Compute host tempest-host-934331319 could not be found. Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Request method failure captured: Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf/action HTTP/1.1 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 106 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBtXTU5sS4zYYMbmA-uxyfwKMlqeMVNOin6Wzwu3TrNkYFHNHpnOdOR9-3CZfuFR7YqbReyHN7xUvy2fFvXyXAjr60TNBSmIKm5BRH2e3X4c5U2npDQxxg5uXw475YvDcmJgm-SpSaE79_vLd_kVh2ohaXqmUt-Ro5EarbkgpJ2DSJs Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 22edebea3e9d4abbaab4c8c9da8a79e8 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-LiveMigrationNegativeTest-671045671 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22edebea3e9d4abbaab4c8c9da8a79e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22edebea3e9d4abbaab4c8c9da8a79e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_22edebea3e9d4abbaab4c8c9da8a79e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/22edebea3e9d4abbaab4c8c9da8a79e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-LiveMigrationNegativeTest-671045671 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 22edebea3e9d4abbaab4c8c9da8a79e8 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-671045671 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-LiveMigrationNegativeTest-671045671-project-admin Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 8ea9daeb6f21461aba2fd5e3dcfcd465 Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-LiveMigrationNegativeTest-671045671-project-admin Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: {"os-migrateLive": {"host": "tempest-host-934331319", "block_migration": true, "disk_over_commit": false}} Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: exception: Compute host tempest-host-934331319 could not be found. Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '3eb33f22-de3d-4a95-9658-99d96a5229bf', 'body': {'os-migrateLive': {'host': 'tempest-host-934331319', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5490, in live_migrate Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 28 18:12:12.259653 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-934331319 could not be found. Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-934331319 could not be found. Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-934331319 could not be found. Oct 28 18:12:12.263918 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:12.271880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Returning 400 to user: Compute host tempest-host-934331319 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:12.273131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25328aa6-0437-4874-8823-e5672862edf5 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf/action" status: 400 len: 99 microversion: 2.1 time: 0.583995 Oct 28 18:12:12.280540 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1215/2352] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 18:12:11 2022] POST /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf/action => generated 99 bytes in 598 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:12:12.288755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99d9946b-46d9-4066-9dae-8f1902c7fc29 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de4e5310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:12.301768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:12.369359 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99d9946b-46d9-4066-9dae-8f1902c7fc29 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.087321 Oct 28 18:12:12.375247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1216/2353] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:12 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:12.383077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:12.388419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:12.389612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6aa20e2a97184d9e93c88bd42520667e'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:12:12.397922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.398410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.398841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.399877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.400349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.400826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.579400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:12.591267 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-172b5697-fe32-4b12-a5c5-5b45cdfe66b5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1667 microversion: 2.1 time: 0.738765 Oct 28 18:12:12.594565 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1138/2354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:11 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1667 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:12.601532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:12:12.608571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:12.610283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:12.630325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.632020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.633452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.638600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.639390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.640104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.704510 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb2d0641-fdc9-44bd-a5dc-3f19f197402e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.327716 Oct 28 18:12:12.705977 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1217/2355] 10.222.0.16 () {58 vars in 1150 bytes} [Fri Oct 28 18:12:12 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:12.711072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:12.711696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:12.719127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.719627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.720088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.721339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.721985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.723280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.925287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:12.936397 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-83417218-571d-42f2-9fe5-b7c84feb7fb7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1468 microversion: 2.1 time: 0.339193 Oct 28 18:12:12.943420 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1139/2356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:12 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1468 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:12.956925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:12.960702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:12.973512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.975923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.979043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:12.980023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:12.982567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:12.985411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:13.068575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:13.081092 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84ed5d0f-030c-4067-9e18-8256be38e7ca tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.373215 Oct 28 18:12:13.088533 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1218/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:12 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:13.104223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:13.124454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:13.152934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:13.153361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:13.153806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:13.154534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:13.154989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:13.155414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:13.251946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:13.264916 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4801237-1a97-41ec-8b3f-985849ed504b tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1318 microversion: 2.1 time: 0.316406 Oct 28 18:12:13.285998 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1140/2358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:12 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:13.304213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1300395381", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:13.394666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:12:13.407170 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05f6d3cb-2dc8-4f9c-9bbb-6fc5a71e59b0 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action" status: 202 len: 0 microversion: 2.1 time: 0.316355 Oct 28 18:12:13.412365 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1219/2359] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:13 2022] POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:12:13.420795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-115aa162-c9eb-4616-9a1e-3b5e20739c9a tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de4e0940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:13.533777 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-115aa162-c9eb-4616-9a1e-3b5e20739c9a tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.119568 Oct 28 18:12:13.555902 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1220/2360] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:13 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:13.573200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:13.574655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:13.597691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:13.604799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:13.605685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:13.612250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:13.613558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:13.614369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:13.631965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:13.804102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:12:13.804837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:12:13.805570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:12:13.807077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:12:13.808170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:12:13.811183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:13.825632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:13.826879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:13.827601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:13.829693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:13.833105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:13.833857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:13.884298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Getting quotas for project 034e69943b404cedb74838f3bffe4555. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:12:13.926284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Getting quotas for user b5949d98c7534e6eb6029bbad3e6d035 and project 034e69943b404cedb74838f3bffe4555. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:12:13.954666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:12:13.960160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:12:13.961258 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae6bdf9c-857c-45ea-aa19-7fbc4610b33c tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1615 microversion: 2.1 time: 0.403753 Oct 28 18:12:13.961844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1221/2361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:13 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1615 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:13.966347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:13.967258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:13.973966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:13.974676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:13.975425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:13.976319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:13.977077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:13.977655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:14.122776 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9e32e501-2de2-4411-8909-e1cd7c02935b tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824512 Oct 28 18:12:14.123574 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1141/2362] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:12:14.128937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:14.129554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:14.162375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:14.163227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:14.163963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:14.165197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:14.166317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:14.166986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:14.265186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:14.285897 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d383070-5e61-4d99-ba95-99b8f95f096e tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1600 microversion: 2.1 time: 0.320806 Oct 28 18:12:14.309207 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1222/2363] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:13 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1600 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:14.335475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:14.340234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:14.363741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:14.368539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:14.371107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:14.372093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:14.374639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:14.377176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:14.383448 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ddd4bc43-7452-4d86-84f3-4b3647373625 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1615 microversion: 2.1 time: 0.257060 Oct 28 18:12:14.386570 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1142/2364] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:14 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1615 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:14.396575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30f161e8-5211-429e-b066-8a48c0968cf1 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:14.398290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-30f161e8-5211-429e-b066-8a48c0968cf1 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:14.469170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-30f161e8-5211-429e-b066-8a48c0968cf1 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:14.479111 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-30f161e8-5211-429e-b066-8a48c0968cf1 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1219 microversion: 2.1 time: 0.089452 Oct 28 18:12:14.479846 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1143/2365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:14 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:14.514055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:14.514686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:14.534554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:14.535063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:14.535503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:14.538902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:14.567427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:14.567941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:14.915405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:14.925151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6685ec6f-f016-48a2-8600-c32808a798a3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.613653 Oct 28 18:12:14.949574 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1223/2366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:14 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:14.959991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:14.973280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:14.989500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Searching by: {'host': 'n-h2-862404-2', 'deleted': False} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:12:15.007696 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1afaf222-32e4-4e98-9779-f7fcee6324d3 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1507 microversion: 2.1 time: 0.518340 Oct 28 18:12:15.011872 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1144/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:14 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1507 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:15.029726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a317d5a-8b47-4f03-9b85-9c18adc88ea8 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de7c4280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:15.088294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.093289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.097974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.099145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.100007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.100850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.118576 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a317d5a-8b47-4f03-9b85-9c18adc88ea8 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1455 microversion: 2.1 time: 0.105560 Oct 28 18:12:15.119472 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1145/2368] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:15 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:15.144605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-7e0eb182-9ca4-4e2a-aace-e9a4b27cc53e req-1910efcd-5744-48e3-b1a7-9c3a00d8b86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0", "name": "network-vif-deleted", "tag": "3fb4b6a0-8291-4a9c-b539-9a95bb69a89d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:15.193583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7e0eb182-9ca4-4e2a-aace-e9a4b27cc53e req-1910efcd-5744-48e3-b1a7-9c3a00d8b86c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.195428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7e0eb182-9ca4-4e2a-aace-e9a4b27cc53e req-1910efcd-5744-48e3-b1a7-9c3a00d8b86c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.198674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7e0eb182-9ca4-4e2a-aace-e9a4b27cc53e req-1910efcd-5744-48e3-b1a7-9c3a00d8b86c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.226898 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-7e0eb182-9ca4-4e2a-aace-e9a4b27cc53e req-1910efcd-5744-48e3-b1a7-9c3a00d8b86c service nova] Creating event network-vif-deleted:3fb4b6a0-8291-4a9c-b539-9a95bb69a89d for instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 on n-h2-862404-2 Oct 28 18:12:15.237327 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-7e0eb182-9ca4-4e2a-aace-e9a4b27cc53e req-1910efcd-5744-48e3-b1a7-9c3a00d8b86c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106148 Oct 28 18:12:15.242270 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1146/2369] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:15.314333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:15.315166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:15.331120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.331612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.332073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.342744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.343234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.343672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.419483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.420520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.421527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.422328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lazy-loading 'fault' on Instance uuid 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:12:15.453961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:12:15.535442 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8291ac2a-0bf4-4621-8d58-7182c483d6ea tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h2-862404-2&all_tenants=1" status: 200 len: 2291 microversion: 2.1 time: 0.584270 Oct 28 18:12:15.536971 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1224/2370] 10.222.0.16 () {58 vars in 1190 bytes} [Fri Oct 28 18:12:14 2022] GET /compute/v2.1/servers?host=n-h2-862404-2&all_tenants=1 => generated 2291 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:15.542459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:15.543372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:15.552704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.553446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.554548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.556563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.570117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.571299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.629781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:15.642022 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3825c76e-7eba-40ac-ba79-e5e2f93cb6ec tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 200 len: 1325 microversion: 2.1 time: 0.331877 Oct 28 18:12:15.646787 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1147/2371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:15 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:15.667582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:15.727758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:12:15.741708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.744894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.746711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.750995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.753383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.755559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.766602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:15.777387 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fea7a162-6425-4d37-a490-a1bd9e5ecb7e tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1223 microversion: 2.1 time: 0.237749 Oct 28 18:12:15.796866 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1225/2372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:15 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1223 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:15.960587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:15.961334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:15.981508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.982113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.982572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:15.985590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:15.986083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:15.986738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.024975 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-798f74fe-f02b-48bf-8e09-fafc5a07bb48 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.376996 Oct 28 18:12:16.026129 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1148/2373] 10.222.0.16 () {58 vars in 1196 bytes} [Fri Oct 28 18:12:15 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:12:16.043285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:16.045953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:16.062713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.064591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.065301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.068523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.069322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.069973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.079857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:16.239114 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-29a91ab2-237d-4af6-b163-4f63acc33cb1 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action" status: 202 len: 0 microversion: 2.1 time: 0.201982 Oct 28 18:12:16.248023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:16.248463 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1149/2374] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:16 2022] POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:12:16.255530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-26264af4-8064-45da-98b9-e5b5d06e8ccf tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dead9280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:16.263245 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af56490b-9d21-46a8-9b89-fbcfa1d0d9bd tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.309524 Oct 28 18:12:16.264905 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1226/2375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:15 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:16.273500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:16.277398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:16.291410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.292157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.292740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.295560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.296089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.296530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.358470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-26264af4-8064-45da-98b9-e5b5d06e8ccf tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1464 microversion: 2.1 time: 0.108769 Oct 28 18:12:16.359573 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1150/2376] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:16 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1464 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:16.391619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a643e029-3993-48d0-9266-5c25e96e6a52 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de4ebb80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:16.512389 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a643e029-3993-48d0-9266-5c25e96e6a52 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 200 len: 1464 microversion: 2.1 time: 0.135540 Oct 28 18:12:16.513621 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1151/2377] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:16 2022] GET /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 1464 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:16.521378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:12:16.522481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:12:16.523331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:12:16.524022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:12:16.524661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:12:16.539874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:16.541079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:16.561728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.565985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.567715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.569878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.570471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.571264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.736144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:16.744825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.745625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.746322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.747237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.747925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.748556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.859776 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45f8d3b8-eda8-4e96-91a8-11c1dea47258 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action" status: 202 len: 1068 microversion: 2.1 time: 0.563243 Oct 28 18:12:16.862218 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1227/2378] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:16 2022] POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action => generated 1068 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 18:12:16.868303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:16.869333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:16.882315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.882813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.884873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:16.886617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.888705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.890418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.890927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.904350 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aac9a27d-5d8e-4ff8-8e3c-ddfe27ced625 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 1481 microversion: 2.1 time: 0.377548 Oct 28 18:12:16.905279 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1152/2379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:16 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 1481 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:16.928161 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] HTTP exception thrown: Instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 could not be found. Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Request method failure captured: Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 HTTP/1.1 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBm80NG44keIYTYWfMd2oAhCRoXwrmSV2PMMfrRI0kuVKDCsGi1KFXvgDfprx9Qonq3z0W6b4C1R7TYtMLJM5VexsmJsDKg_8pt-ys82r_PHEk0APZffgLr7AtnsOlxKIp2Kn_1mQgqvWBpEQb1mqoxmYwcPpgWjQfko-JnNAZ2MWv8 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8253dbe510dd462f974f37fce0a5d990 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-LiveMigrationTest-901527908 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8253dbe510dd462f974f37fce0a5d990", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-LiveMigrationTest-901527908 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8253dbe510dd462f974f37fce0a5d990 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-LiveMigrationTest-901527908 Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-LiveMigrationTest-901527908-project Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 12dea4e86fd14c07859b48e22493b9dd Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-LiveMigrationTest-901527908-project Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 could not be found. Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0'} Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 could not be found. Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 could not be found. Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:16.930989 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:16.934148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:16.934148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:16.934148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:16.934148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:16.934148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:16.934148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 could not be found. Oct 28 18:12:16.934148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:16.934148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Returning 404 to user: Instance 6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:16.935980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ba0fda3-d8b2-4560-8e2b-e97ed53ede1b tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0" status: 404 len: 111 microversion: 2.1 time: 0.070071 Oct 28 18:12:16.940867 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1228/2380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:16 2022] GET /compute/v2.1/servers/6e6bdbb1-bcb7-4379-aa04-ae7d95273bf0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:16.954049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:16.954846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:16.959546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:16.961478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:16.969378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.970686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.972818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.974303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.975747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:16.976912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:16.998135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:16.998689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:17.004320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:17.006483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:17.007040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:17.007477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:17.170160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:17.181954 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38ea05a3-4a69-4b11-bb42-18cb2fcb4c18 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1271 microversion: 2.1 time: 0.240028 Oct 28 18:12:17.196936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1229/2381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:16 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:17.196936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d99a1a01-08d8-423e-8c23-0c1bf364c26a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '.version_select at 0x7f78e2545ee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:17.244801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d99a1a01-08d8-423e-8c23-0c1bf364c26a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431406984" status: 202 len: 0 microversion: 2.1 time: 0.060222 Oct 28 18:12:17.246279 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1230/2382] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431406984 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:12:17.292888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:17.293522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:17.310525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:17.311046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:17.311488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:17.315966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:17.316460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:17.316899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:17.398598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:17.409868 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-efee740d-0691-4646-8179-2d7f4299fec9 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.462801 Oct 28 18:12:17.410731 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1153/2383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:16 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:17.898723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:17.909463 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a93077f8-7723-40e9-8775-4be07b828543 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.621606 Oct 28 18:12:17.911157 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1231/2384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:17 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:17.936551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:17.937176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:17.950180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:17.950656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:17.951091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:17.951804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:17.958495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:17.959275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.084483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d4484561-af96-4d13-830a-71860c15bdb2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:18.087513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:18.103054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:18.103921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:18.104435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.106980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:18.110164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:18.110887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.200653 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] HTTP exception thrown: Volume d1bfe748-b9b3-4885-bb67-2fa238c0561f could not be found. Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Request method failure captured: Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378/os-volume_attachments/d1bfe748-b9b3-4885-bb67-2fa238c0561f HTTP/1.1 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 74 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBq2YIafSblODb8GPUwfRRO-_0KLyvIMLqAei-SoicLTkKJQCSk_47MD1dgCdMvPPbNs4Cd6TTQQJburFnfYYpPhNblvl-ZHa50Tx4nAyg-Q3hBMdspu58LoJIqOCSZ0_CvFROKcB4gOVCe5SKlcAQCrfo2iK0Zi2XzXo34p8IS5g-E Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4f35ee8e53f548c3a3bf79f37e5a1b57 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesAdminNegativeTest-601256387 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f35ee8e53f548c3a3bf79f37e5a1b57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4f35ee8e53f548c3a3bf79f37e5a1b57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4f35ee8e53f548c3a3bf79f37e5a1b57", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4f35ee8e53f548c3a3bf79f37e5a1b57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesAdminNegativeTest-601256387 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4f35ee8e53f548c3a3bf79f37e5a1b57 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-601256387 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesAdminNegativeTest-601256387-project-admin Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c8a15279703d4fd5b3679f6883506323 Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesAdminNegativeTest-601256387-project-admin Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: {"volumeAttachment": {"volumeId": "d4484561-af96-4d13-830a-71860c15bdb2"}} Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: exception: Volume d1bfe748-b9b3-4885-bb67-2fa238c0561f could not be found. Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '647d8a8a-482b-47c9-94ce-c3eeef222378', 'id': 'd1bfe748-b9b3-4885-bb67-2fa238c0561f', 'body': {'volumeAttachment': {'volumeId': 'd4484561-af96-4d13-830a-71860c15bdb2'}}} Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1bfe748-b9b3-4885-bb67-2fa238c0561f could not be found. (HTTP 404) (Request-ID: req-b8b7e3fb-0c1e-4692-b7e8-10c723f453fd) Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:12:18.205850 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1bfe748-b9b3-4885-bb67-2fa238c0561f could not be found. Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1bfe748-b9b3-4885-bb67-2fa238c0561f could not be found. Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1bfe748-b9b3-4885-bb67-2fa238c0561f could not be found. Oct 28 18:12:18.209538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:18.214286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] Returning 404 to user: Volume d1bfe748-b9b3-4885-bb67-2fa238c0561f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:18.215323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c2543272-aef9-4a96-88f1-61b2a8bbb8fe tempest-VolumesAdminNegativeTest-601256387 tempest-VolumesAdminNegativeTest-601256387-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378/os-volume_attachments/d1bfe748-b9b3-4885-bb67-2fa238c0561f" status: 404 len: 109 microversion: 2.1 time: 0.135582 Oct 28 18:12:18.216387 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1232/2385] 10.222.0.16 () {60 vars in 1433 bytes} [Fri Oct 28 18:12:18 2022] PUT /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378/os-volume_attachments/d1bfe748-b9b3-4885-bb67-2fa238c0561f => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:18.226973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:18.227742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:18.237094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:18.237751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:18.238329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.239199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:18.239787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:18.240387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.416263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:18.425524 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-abfacc1a-a4b2-46ae-8537-4a6d1d2181d5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 1468 microversion: 2.1 time: 0.493216 Oct 28 18:12:18.426995 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1154/2386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:17 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 1468 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:18.435754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:18.436910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:18.444874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:18.445640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:18.446407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.447363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:18.448964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:18.449661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.457290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:18.471793 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-775d8ef9-0327-4a81-9e21-c4a5f46816c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1277 microversion: 2.1 time: 0.251411 Oct 28 18:12:18.487566 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1233/2387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:18 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1277 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:18.503423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1453874773"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:18.507037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:18.515789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:18.518375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:18.519142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.521058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:18.521762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:18.522380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:18.949044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:18.958896 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eba8d539-8b4c-49d2-8387-0dda78dad1d5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.527925 Oct 28 18:12:18.975925 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1155/2388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:18 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:18.980753 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d9cb37a0-8214-49d5-a065-d52a2b6e1a34 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "POST /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49/action" status: 202 len: 0 microversion: 2.1 time: 0.479768 Oct 28 18:12:18.981448 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1234/2389] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:18 2022] POST /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:12:18.988273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:18.988918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:18.995123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4593d666-9c78-4d82-b2de-a900bbbb4de6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de21baf0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:19.043548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.049248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.050155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:19.051732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.052788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.053192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:19.110297 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4593d666-9c78-4d82-b2de-a900bbbb4de6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.119223 Oct 28 18:12:19.110874 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1235/2390] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:18 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:19.477351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:19.477977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:19.494317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.497112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.499697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:19.500796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.501421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.503848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:19.568163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:12:19.606460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:19.745682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:19.763244 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-990a4503-0947-4d14-9099-af37858a54b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.784359 Oct 28 18:12:19.766757 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1156/2391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:18 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:19.778931 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-360f2d69-a71f-438d-afb0-b44b2d493d69 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 204 len: 0 microversion: 2.1 time: 0.306297 Oct 28 18:12:19.780605 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1236/2392] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:12:19 2022] DELETE /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:12:19.787966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:19.789861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:19.802890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-115b88ac-bbcd-4f20-9ebe-1af71e43383e req-a2e544e5-8da7-422c-b4aa-0b1f067b2f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8148f1bc-d908-4fa0-bd92-aad5464fe069", "name": "network-vif-unplugged", "status": "completed", "tag": "b21e0da3-68f8-41b1-9a87-d0036283bcfe"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:19.807519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.808972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.810705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:19.812673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.818068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.818805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:19.841089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-115b88ac-bbcd-4f20-9ebe-1af71e43383e req-a2e544e5-8da7-422c-b4aa-0b1f067b2f55 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.841832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-115b88ac-bbcd-4f20-9ebe-1af71e43383e req-a2e544e5-8da7-422c-b4aa-0b1f067b2f55 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.842859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-115b88ac-bbcd-4f20-9ebe-1af71e43383e req-a2e544e5-8da7-422c-b4aa-0b1f067b2f55 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:19.869934 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-115b88ac-bbcd-4f20-9ebe-1af71e43383e req-a2e544e5-8da7-422c-b4aa-0b1f067b2f55 service nova] Creating event network-vif-unplugged:b21e0da3-68f8-41b1-9a87-d0036283bcfe for instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 on n-h1-862404-2 Oct 28 18:12:19.905093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-115b88ac-bbcd-4f20-9ebe-1af71e43383e req-a2e544e5-8da7-422c-b4aa-0b1f067b2f55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119185 Oct 28 18:12:19.909825 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1237/2393] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:19.931924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:19.933012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:19.965786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.966683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.967332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:19.968293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:19.969008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:19.975009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:20.326288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:20.337698 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7f69ac61-fe31-4099-9f40-20d74ab36d10 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 0.564310 Oct 28 18:12:20.360615 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1157/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:19 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:20.370297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:20.370944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:20.400877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:20.401372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:20.401868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:20.402528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:20.408875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:20.409851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:20.577697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:20.598348 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7d781d5-ad48-4a56-8ba9-724db3ba6dbb tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1485 microversion: 2.1 time: 0.686906 Oct 28 18:12:20.600748 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1238/2395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:19 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1485 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:20.610556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40526620-0acc-4402-8524-9bd6953b57d2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de6f6040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:20.716701 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40526620-0acc-4402-8524-9bd6953b57d2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.112151 Oct 28 18:12:20.719251 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1239/2396] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:20 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:20.795512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:20.796291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:20.813888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:20.817902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:20.818468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:20.819311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:20.819902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:20.820617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:20.958195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:21.012459 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50ceaa5b-249b-4206-b83f-c0f46ed7daae tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.652641 Oct 28 18:12:21.036875 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1158/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:20 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:21.369599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:21.370635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:21.381673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:21.384793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:21.388132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:21.388927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:21.389400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:21.394666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:21.691051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:21.703573 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6520d027-1475-4324-849b-b121658cea99 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 0.339097 Oct 28 18:12:21.708184 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1159/2398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:21 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:21.721326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:21.726678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:21.741079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:21.746594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:21.747216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:21.748127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:21.748755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:21.749400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:21.769320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:21.782812 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da89f6e1-79c1-40f5-bbff-6fbed215fc80 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.993048 Oct 28 18:12:21.795842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1240/2399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:20 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:21.803146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a686217-e935-4253-ad01-6edc9ba224a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de30caf0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:21.865876 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a686217-e935-4253-ad01-6edc9ba224a3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.076941 Oct 28 18:12:21.867289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1241/2400] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:21 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:22.046784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:22.047762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:22.062285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:22.067510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:22.068514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:22.070036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:22.070692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:22.072114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:22.081668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:22.095714 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7ae8883e-8b80-45df-b14c-6d4fa9f1d7ee tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 200 len: 1485 microversion: 2.1 time: 0.386067 Oct 28 18:12:22.112460 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1160/2401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:21 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 1485 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:22.315630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d65ca1ee-2956-4a1d-8079-21198d12913c req-54c64f8f-5e86-4902-bb07-2d3d2285964b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff5ce91-7082-4c04-92ef-96aa64ec0198", "name": "network-vif-deleted", "tag": "08765946-92c3-48db-9dff-7ee1d40f8c0a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:22.353272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d65ca1ee-2956-4a1d-8079-21198d12913c req-54c64f8f-5e86-4902-bb07-2d3d2285964b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:22.353776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d65ca1ee-2956-4a1d-8079-21198d12913c req-54c64f8f-5e86-4902-bb07-2d3d2285964b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:22.361687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d65ca1ee-2956-4a1d-8079-21198d12913c req-54c64f8f-5e86-4902-bb07-2d3d2285964b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:22.386869 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d65ca1ee-2956-4a1d-8079-21198d12913c req-54c64f8f-5e86-4902-bb07-2d3d2285964b service nova] Creating event network-vif-deleted:08765946-92c3-48db-9dff-7ee1d40f8c0a for instance aff5ce91-7082-4c04-92ef-96aa64ec0198 on n-h2-862404-2 Oct 28 18:12:22.398985 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d65ca1ee-2956-4a1d-8079-21198d12913c req-54c64f8f-5e86-4902-bb07-2d3d2285964b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087679 Oct 28 18:12:22.400260 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1161/2402] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:12:22.441042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:22.450966 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-995b68da-0aa9-40ea-9f92-3c6dca3cc6dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.409781 Oct 28 18:12:22.462285 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1242/2403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:22 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:22.746850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:22.747724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:22.782958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:22.784122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:22.795454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:22.796585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:22.797362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:22.798407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:22.811483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:22.812975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:22.829718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:22.830898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:22.838889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:22.839780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:22.840316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:22.840763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:23.547438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:23.559321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e572cb2a-2037-4c3e-9515-d79e8e40202f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.749353 Oct 28 18:12:23.560140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1243/2404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:22 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:23.569258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ec1bddd-d66b-48a8-9db8-f3f5197f1ca8 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de0fd040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:23.605031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:23.619202 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49b82566-2e2a-4834-8d1a-53408b20ae86 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 0.886826 Oct 28 18:12:23.620303 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1162/2405] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:22 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:23.630222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:23.630967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:23.638996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:23.640478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:23.641393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:23.642915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:23.643660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:23.644273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:23.655064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ec1bddd-d66b-48a8-9db8-f3f5197f1ca8 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.091954 Oct 28 18:12:23.655652 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1244/2406] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:23 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:23.660678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:23.661504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: aff5ce91-7082-4c04-92ef-96aa64ec0198] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:23.675466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:23.676244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:23.676872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:23.677759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:23.680387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:23.680999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:23.713304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:12:23.714356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] HTTP exception thrown: Instance aff5ce91-7082-4c04-92ef-96aa64ec0198 could not be found. Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Request method failure captured: Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 HTTP/1.1 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBm80NG44keIYTYWfMd2oAhCRoXwrmSV2PMMfrRI0kuVKDCsGi1KFXvgDfprx9Qonq3z0W6b4C1R7TYtMLJM5VexsmJsDKg_8pt-ys82r_PHEk0APZffgLr7AtnsOlxKIp2Kn_1mQgqvWBpEQb1mqoxmYwcPpgWjQfko-JnNAZ2MWv8 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8253dbe510dd462f974f37fce0a5d990 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-LiveMigrationTest-901527908 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8253dbe510dd462f974f37fce0a5d990", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-LiveMigrationTest-901527908 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8253dbe510dd462f974f37fce0a5d990 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-LiveMigrationTest-901527908 Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-LiveMigrationTest-901527908-project Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 12dea4e86fd14c07859b48e22493b9dd Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-LiveMigrationTest-901527908-project Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance aff5ce91-7082-4c04-92ef-96aa64ec0198 could not be found. Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'aff5ce91-7082-4c04-92ef-96aa64ec0198'} Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5ce91-7082-4c04-92ef-96aa64ec0198 could not be found. Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5ce91-7082-4c04-92ef-96aa64ec0198 could not be found. Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:23.719459 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:23.723787 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:23.723787 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:23.723787 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:23.723787 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:23.723787 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:23.723787 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5ce91-7082-4c04-92ef-96aa64ec0198 could not be found. Oct 28 18:12:23.723787 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:23.725512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Returning 404 to user: Instance aff5ce91-7082-4c04-92ef-96aa64ec0198 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:23.726566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b952e21-8f0e-4091-ae9e-c65d5984ca9a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198" status: 404 len: 111 microversion: 2.1 time: 0.069796 Oct 28 18:12:23.727447 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1245/2407] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:23 2022] GET /compute/v2.1/servers/aff5ce91-7082-4c04-92ef-96aa64ec0198 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:23.737744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:23.738536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:23.754467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:23.755088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:23.759561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:23.760337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:23.760826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:23.761242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:23.914701 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9d7d5eee-8a3b-45ee-8abf-25ed7ed27bb5 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 204 len: 0 microversion: 2.1 time: 0.290024 Oct 28 18:12:23.915311 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1163/2408] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:12:23 2022] DELETE /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:12:23.922758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:23.924617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:23.937580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:23.938853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:23.940533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:23.942621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:23.943259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:23.944563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.011315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:12:24.104299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:24.121471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:24.140682 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02738248-5587-4309-b84f-394e1a5aed5c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.412122 Oct 28 18:12:24.145505 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1246/2409] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:23 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:24.173669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:24.175557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:24.193795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.198921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.199573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.200492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.208510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.210830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.257433 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8dabdc14-0b18-46e7-b242-0a14dc28a0af tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 204 len: 0 microversion: 2.1 time: 0.340409 Oct 28 18:12:24.262794 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1164/2410] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:12:23 2022] DELETE /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:12:24.268297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:24.269015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:24.277242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.277740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.278184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.278910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.279378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.279810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.474710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=14 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:24.556758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:24.585997 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0c4e785-10b8-4d50-a98d-61d9481f66ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1513 microversion: 2.1 time: 0.435370 Oct 28 18:12:24.587711 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1247/2411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:24 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1513 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:24.595178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fee4d01a-edfc-4ed9-8745-9b4939d5fa04 req-32a179de-8346-4d67-8f51-da145d3a49e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0146d1-97ba-46e2-95dd-1b12e34a38ee", "tag": "e147efd6-55f8-41b3-a7e2-53521978e0af"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:24.609869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fee4d01a-edfc-4ed9-8745-9b4939d5fa04 req-32a179de-8346-4d67-8f51-da145d3a49e1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.611172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fee4d01a-edfc-4ed9-8745-9b4939d5fa04 req-32a179de-8346-4d67-8f51-da145d3a49e1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.612677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fee4d01a-edfc-4ed9-8745-9b4939d5fa04 req-32a179de-8346-4d67-8f51-da145d3a49e1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.631036 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fee4d01a-edfc-4ed9-8745-9b4939d5fa04 req-32a179de-8346-4d67-8f51-da145d3a49e1 service nova] Creating event network-changed:e147efd6-55f8-41b3-a7e2-53521978e0af for instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee on n-h1-862404-2 Oct 28 18:12:24.638581 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fee4d01a-edfc-4ed9-8745-9b4939d5fa04 req-32a179de-8346-4d67-8f51-da145d3a49e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048998 Oct 28 18:12:24.645658 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1248/2412] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:24.653346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:24.654359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:24.663803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.664545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.665047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.666028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.666553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.667213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.793108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:24.803970 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43974785-d05f-46d8-acf4-973f5a712df5 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1498 microversion: 2.1 time: 0.539850 Oct 28 18:12:24.808104 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1165/2413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:24 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1498 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:24.815085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:24.815918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:24.833513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.835906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.837293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:24.840476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:24.841233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:24.842658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:25.130865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:25.139131 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-56a36696-22ce-4635-9dd6-e36c4468f960 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 0.328533 Oct 28 18:12:25.144158 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1166/2414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:24 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:25.151798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c6c0c47-7992-45b8-8ceb-c80f7f5f243c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dead9040>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:25.222572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:25.232589 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c6c0c47-7992-45b8-8ceb-c80f7f5f243c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.087121 Oct 28 18:12:25.235397 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1167/2415] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:25 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:25.241850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:25.246362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:25.261344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:25.262635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:25.276848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:25.292815 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e320ccb5-39f4-4550-aa5b-ccc112ee7922 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.644846 Oct 28 18:12:25.293654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:25.294543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:25.295344 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1249/2416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:24 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:25.296874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:25.297559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:25.594755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1526a2cc-355d-4e62-be68-11369e679d31 req-c109f8bb-5148-45a9-8b0f-1e5b6dda848d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c6fd04-db62-4518-9726-de061cb29c49", "name": "network-vif-plugged", "status": "completed", "tag": "e328e141-4427-4198-8fef-00dcd59707ab"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:25.615216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1526a2cc-355d-4e62-be68-11369e679d31 req-c109f8bb-5148-45a9-8b0f-1e5b6dda848d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:25.622046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1526a2cc-355d-4e62-be68-11369e679d31 req-c109f8bb-5148-45a9-8b0f-1e5b6dda848d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:25.622500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1526a2cc-355d-4e62-be68-11369e679d31 req-c109f8bb-5148-45a9-8b0f-1e5b6dda848d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:25.648326 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1526a2cc-355d-4e62-be68-11369e679d31 req-c109f8bb-5148-45a9-8b0f-1e5b6dda848d service nova] Creating event network-vif-plugged:e328e141-4427-4198-8fef-00dcd59707ab for instance 88c6fd04-db62-4518-9726-de061cb29c49 on n-h2-862404-2 Oct 28 18:12:25.664234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1526a2cc-355d-4e62-be68-11369e679d31 req-c109f8bb-5148-45a9-8b0f-1e5b6dda848d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075417 Oct 28 18:12:25.665319 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1250/2417] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:12:25.676177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:25.683966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:25.694358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:25.694854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:25.697829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:25.698879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:25.701079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:25.701708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:25.842173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:25.867790 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b8da7035-9e9e-49ca-903c-3ecfb1c9be71 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.631115 Oct 28 18:12:25.897059 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1168/2418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:25 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:25.949118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:25.953231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:25.993441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:26.003695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:26.007163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:26.008429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:26.011331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:26.014789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:26.019210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:26.327913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:26.336608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:26.345317 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4a2218fb-3b73-4a1a-9a7d-3d6229adcc1c tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1456 microversion: 2.1 time: 0.445268 Oct 28 18:12:26.350000 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1169/2419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:25 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1456 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:26.364052 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e384bc69-4315-44ff-a2a5-3c4d03a6a779 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1513 microversion: 2.1 time: 0.688974 Oct 28 18:12:26.378157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:26.378358 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1251/2420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:25 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1513 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:26.381174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:26.390729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af7548d9-d5ea-4049-aa67-bf95c328a87f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de30c0d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:26.403989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:26.405393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:26.406720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:26.408833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:26.412312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:26.412926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:26.528669 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af7548d9-d5ea-4049-aa67-bf95c328a87f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.148813 Oct 28 18:12:26.528941 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1252/2421] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:26 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:26.575265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:26.575949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:26.634294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:26.634843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:26.637708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:26.641696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:26.643667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:26.652632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:26.768801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:26.790023 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b469a840-d2fa-49b8-9abf-879306998e40 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 0.424328 Oct 28 18:12:26.790718 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1170/2422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:26 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:26.819534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d11265ed-6a23-42a1-b940-e1d07fba1571 req-2012ac97-060c-4814-aca9-1404da6fa5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7e8cea-b2a4-437f-9036-98060f5e182c", "name": "network-vif-deleted", "tag": "8592cf03-4542-4f98-93b2-7c1f1ab5bbeb"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:26.862075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d11265ed-6a23-42a1-b940-e1d07fba1571 req-2012ac97-060c-4814-aca9-1404da6fa5ab service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:26.878423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d11265ed-6a23-42a1-b940-e1d07fba1571 req-2012ac97-060c-4814-aca9-1404da6fa5ab service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:26.882705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d11265ed-6a23-42a1-b940-e1d07fba1571 req-2012ac97-060c-4814-aca9-1404da6fa5ab service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:26.905936 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d11265ed-6a23-42a1-b940-e1d07fba1571 req-2012ac97-060c-4814-aca9-1404da6fa5ab service nova] Creating event network-vif-deleted:8592cf03-4542-4f98-93b2-7c1f1ab5bbeb for instance 0f7e8cea-b2a4-437f-9036-98060f5e182c on n-h2-862404-2 Oct 28 18:12:26.914404 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d11265ed-6a23-42a1-b940-e1d07fba1571 req-2012ac97-060c-4814-aca9-1404da6fa5ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104755 Oct 28 18:12:26.915484 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1171/2423] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:26.939107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:26.942356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:27.006956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.007456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.007909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.008928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.009529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.010127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.110985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:27.125941 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69d72b7c-d893-43dd-8e54-0056f027370a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.592309 Oct 28 18:12:27.129081 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1253/2424] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:26 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:27.351808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:27.381258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:27.381862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:27.384434 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1ea761ae-5167-4761-95a4-bb59edf589a5 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.448713 Oct 28 18:12:27.388859 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1172/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:26 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:27.408852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.411864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.412327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.413062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.413526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.413955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.420072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:27.420424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:27.474330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.478724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.481935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.483313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.484968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.487224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.513709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.519191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.519880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.520915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lazy-loading 'fault' on Instance uuid 0f7e8cea-b2a4-437f-9036-98060f5e182c {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:12:27.617017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dea4e86fd14c07859b48e22493b9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253dbe510dd462f974f37fce0a5d990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:27.626070 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b32af466-13db-4482-ad92-8db8eae4c29a tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 200 len: 1299 microversion: 2.1 time: 0.251433 Oct 28 18:12:27.646803 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1254/2426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:27 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 1299 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:27.657041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc7faaff-aad3-4cca-b4d6-971d73ff702f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de25d670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:27.748042 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc7faaff-aad3-4cca-b4d6-971d73ff702f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.099640 Oct 28 18:12:27.762556 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1255/2427] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:27 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:27.937276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:27.947093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8d87bb11-5077-4f8c-829a-2d31062101ba tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1513 microversion: 2.1 time: 0.539612 Oct 28 18:12:27.951553 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1173/2428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:27 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:27.964382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:27.970236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:27.988754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.991092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.991717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.994012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.996876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.998639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:28.084349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e08d7f9-73cb-4b30-9296-2a2a3910670c tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Calling method '.version_select at 0x7f78de0d2dc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.133841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-9e08d7f9-73cb-4b30-9296-2a2a3910670c tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba does not exist", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:12:28.134712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.security_group_api [None req-9e08d7f9-73cb-4b30-9296-2a2a3910670c tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Neutron security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba not found {{(pid=120680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:12:28.135643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-9e08d7f9-73cb-4b30-9296-2a2a3910670c tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] HTTP exception thrown: Security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba does not exist Oct 28 18:12:28.135643 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-1738f2e6-8ec7-47dc-867d-692db4e7e85c'] Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e08d7f9-73cb-4b30-9296-2a2a3910670c tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Request method failure captured: Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-security-groups/d9493b98-6ae4-4c38-a806-e6b12a96d3ba HTTP/1.1 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBuL_qCIJnJPYfiDwKIOTnUnjJ3eSBJSgvTKk24cg9Ro5udCaBNSVgtay2p23WS9yprHge0UQDipfx2FYkLKq6G29QpgIANszg5jB2FSld8QQsvg3n6qp0sJGyV62vNXRKJcZ3OJAOnLGk3WYbxiZoJeISUsUlrKm7oNHqIIqt5w4u0 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b885d891d83141bcbaeb47e15cc43e2d Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b885d891d83141bcbaeb47e15cc43e2d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b885d891d83141bcbaeb47e15cc43e2d Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsNegativeTestJSON-60826710-project Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c76d09e1c4bb408aa9b605708be78b1d Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-60826710-project Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: exception: Security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba does not exist Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-1738f2e6-8ec7-47dc-867d-692db4e7e85c'] Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'd9493b98-6ae4-4c38-a806-e6b12a96d3ba'} Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:12:28.161322 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba does not exist Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1738f2e6-8ec7-47dc-867d-692db4e7e85c'] Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba does not exist Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1738f2e6-8ec7-47dc-867d-692db4e7e85c'] Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba does not exist Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1738f2e6-8ec7-47dc-867d-692db4e7e85c'] Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba does not exist Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1738f2e6-8ec7-47dc-867d-692db4e7e85c'] Oct 28 18:12:28.164574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.172616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e08d7f9-73cb-4b30-9296-2a2a3910670c tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Returning 404 to user: Security group d9493b98-6ae4-4c38-a806-e6b12a96d3ba does not exist Oct 28 18:12:28.172616 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-1738f2e6-8ec7-47dc-867d-692db4e7e85c'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:28.174222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9e08d7f9-73cb-4b30-9296-2a2a3910670c tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/d9493b98-6ae4-4c38-a806-e6b12a96d3ba" status: 404 len: 194 microversion: 2.1 time: 0.410266 Oct 28 18:12:28.175343 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1256/2429] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:12:27 2022] DELETE /compute/v2.1/os-security-groups/d9493b98-6ae4-4c38-a806-e6b12a96d3ba => generated 194 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:28.182752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.183704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:28.196383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:28.201588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:28.202444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:28.203784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:28.204512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:28.204854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:28.269267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:28.279297 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d2bb26e6-6d52-45c8-ba21-07246c995628 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 0.325661 Oct 28 18:12:28.279904 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1174/2430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:27 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:28.308116 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aca8e35a-b9d5-4ca6-a225-7b740f9e6d22 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.009356 Oct 28 18:12:28.317259 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1175/2431] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 18:12:28 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 18:12:28.325931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-785b454c-4a39-451d-b99c-2697d6ea761e tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Calling method '.version_select at 0x7f78de986dc0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.412924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:28.424865 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9be1eac-7a13-492d-8fe3-f2e6c632c1b7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1515 microversion: 2.1 time: 0.245500 Oct 28 18:12:28.425833 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1257/2432] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:28 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:28.431400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.432049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:28.439175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:28.440444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:28.440893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:28.442882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:28.443349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:28.443783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:28.560325 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-785b454c-4a39-451d-b99c-2697d6ea761e tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.238050 Oct 28 18:12:28.561319 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1176/2433] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:12:28 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:28.576618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8ea6f3b-551e-4613-98d9-660f44f814bc tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Calling method '.version_select at 0x7f78de7f64c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.719600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:28.728270 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-330a5803-2f7c-45e5-9915-8c2ab35239ab tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.301304 Oct 28 18:12:28.731877 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1258/2434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:28 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:28.744675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.745320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] [instance: 0f7e8cea-b2a4-437f-9036-98060f5e182c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:28.761786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:28.762295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:28.762739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:28.763477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:28.769274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:28.769796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:28.789050 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] HTTP exception thrown: Instance 0f7e8cea-b2a4-437f-9036-98060f5e182c could not be found. Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Request method failure captured: Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c HTTP/1.1 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBm80NG44keIYTYWfMd2oAhCRoXwrmSV2PMMfrRI0kuVKDCsGi1KFXvgDfprx9Qonq3z0W6b4C1R7TYtMLJM5VexsmJsDKg_8pt-ys82r_PHEk0APZffgLr7AtnsOlxKIp2Kn_1mQgqvWBpEQb1mqoxmYwcPpgWjQfko-JnNAZ2MWv8 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8253dbe510dd462f974f37fce0a5d990 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-LiveMigrationTest-901527908 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8253dbe510dd462f974f37fce0a5d990", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8253dbe510dd462f974f37fce0a5d990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-LiveMigrationTest-901527908 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8253dbe510dd462f974f37fce0a5d990 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-LiveMigrationTest-901527908 Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-LiveMigrationTest-901527908-project Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 12dea4e86fd14c07859b48e22493b9dd Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-LiveMigrationTest-901527908-project Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0f7e8cea-b2a4-437f-9036-98060f5e182c could not be found. Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0f7e8cea-b2a4-437f-9036-98060f5e182c'} Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f7e8cea-b2a4-437f-9036-98060f5e182c could not be found. Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f7e8cea-b2a4-437f-9036-98060f5e182c could not be found. Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.790714 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.795019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.795019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:28.795019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:28.795019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:28.795019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:28.795019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f7e8cea-b2a4-437f-9036-98060f5e182c could not be found. Oct 28 18:12:28.795019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.795469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-d8ea6f3b-551e-4613-98d9-660f44f814bc tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:12:28.795559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] Returning 404 to user: Instance 0f7e8cea-b2a4-437f-9036-98060f5e182c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:28.795636 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d8ea6f3b-551e-4613-98d9-660f44f814bc tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 28 18:12:28.795636 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-04642f3d-3fb0-4d9a-ae8a-bdfbab914d56'] Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8ea6f3b-551e-4613-98d9-660f44f814bc tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Request method failure captured: Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-security-groups/777301d6-c8b0-48ec-a0d5-eeccd6ad5a49 HTTP/1.1 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBuL_qCIJnJPYfiDwKIOTnUnjJ3eSBJSgvTKk24cg9Ro5udCaBNSVgtay2p23WS9yprHge0UQDipfx2FYkLKq6G29QpgIANszg5jB2FSld8QQsvg3n6qp0sJGyV62vNXRKJcZ3OJAOnLGk3WYbxiZoJeISUsUlrKm7oNHqIIqt5w4u0 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: b885d891d83141bcbaeb47e15cc43e2d Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b885d891d83141bcbaeb47e15cc43e2d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: b885d891d83141bcbaeb47e15cc43e2d Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsNegativeTestJSON-60826710-project Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c76d09e1c4bb408aa9b605708be78b1d Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-60826710-project Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: exception: Insufficient rights for removing default security group. Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-04642f3d-3fb0-4d9a-ae8a-bdfbab914d56'] Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '777301d6-c8b0-48ec-a0d5-eeccd6ad5a49'} Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:12:28.797206 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04642f3d-3fb0-4d9a-ae8a-bdfbab914d56'] Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04642f3d-3fb0-4d9a-ae8a-bdfbab914d56'] Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04642f3d-3fb0-4d9a-ae8a-bdfbab914d56'] Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04642f3d-3fb0-4d9a-ae8a-bdfbab914d56'] Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8ea6f3b-551e-4613-98d9-660f44f814bc tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-04642f3d-3fb0-4d9a-ae8a-bdfbab914d56'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:28.805452 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8ea6f3b-551e-4613-98d9-660f44f814bc tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/777301d6-c8b0-48ec-a0d5-eeccd6ad5a49" status: 400 len: 182 microversion: 2.1 time: 0.227772 Oct 28 18:12:28.818824 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4536adb-6eca-479d-a7e5-591a8eed4978 tempest-LiveMigrationTest-901527908 tempest-LiveMigrationTest-901527908-project] 10.222.0.16 "GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c" status: 404 len: 111 microversion: 2.1 time: 0.062563 Oct 28 18:12:28.818972 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1177/2435] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:12:28 2022] DELETE /compute/v2.1/os-security-groups/777301d6-c8b0-48ec-a0d5-eeccd6ad5a49 => generated 182 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:12:28.819110 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1259/2436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:28 2022] GET /compute/v2.1/servers/0f7e8cea-b2a4-437f-9036-98060f5e182c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:28.819110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3e3a1dd5-0878-4195-a3d9-b5be4d6f3b40 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Calling method '.version_select at 0x7f78de25c670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.823465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f57676d7-9886-4bfb-9071-f20d49534f84 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e237ea60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.893819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-3e3a1dd5-0878-4195-a3d9-b5be4d6f3b40 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad does not exist", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:12:28.894799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.security_group_api [None req-3e3a1dd5-0878-4195-a3d9-b5be4d6f3b40 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Neutron security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad not found {{(pid=120680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:12:28.895961 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3e3a1dd5-0878-4195-a3d9-b5be4d6f3b40 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] HTTP exception thrown: Security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad does not exist Oct 28 18:12:28.895961 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-e50007a3-2fb7-4fec-8abd-3af5ab75fd1e'] Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3e3a1dd5-0878-4195-a3d9-b5be4d6f3b40 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Request method failure captured: Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-security-groups/ba77f54b-2efa-4b3b-92a7-caba3588d2ad HTTP/1.1 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBuL_qCIJnJPYfiDwKIOTnUnjJ3eSBJSgvTKk24cg9Ro5udCaBNSVgtay2p23WS9yprHge0UQDipfx2FYkLKq6G29QpgIANszg5jB2FSld8QQsvg3n6qp0sJGyV62vNXRKJcZ3OJAOnLGk3WYbxiZoJeISUsUlrKm7oNHqIIqt5w4u0 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b885d891d83141bcbaeb47e15cc43e2d Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b885d891d83141bcbaeb47e15cc43e2d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b885d891d83141bcbaeb47e15cc43e2d Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsNegativeTestJSON-60826710-project Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c76d09e1c4bb408aa9b605708be78b1d Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-60826710-project Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: exception: Security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad does not exist Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-e50007a3-2fb7-4fec-8abd-3af5ab75fd1e'] Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'ba77f54b-2efa-4b3b-92a7-caba3588d2ad'} Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:12:28.899948 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad does not exist Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e50007a3-2fb7-4fec-8abd-3af5ab75fd1e'] Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad does not exist Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e50007a3-2fb7-4fec-8abd-3af5ab75fd1e'] Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad does not exist Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e50007a3-2fb7-4fec-8abd-3af5ab75fd1e'] Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad does not exist Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e50007a3-2fb7-4fec-8abd-3af5ab75fd1e'] Oct 28 18:12:28.902951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:28.910868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3e3a1dd5-0878-4195-a3d9-b5be4d6f3b40 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Returning 404 to user: Security group ba77f54b-2efa-4b3b-92a7-caba3588d2ad does not exist Oct 28 18:12:28.910868 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-e50007a3-2fb7-4fec-8abd-3af5ab75fd1e'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:28.912902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3e3a1dd5-0878-4195-a3d9-b5be4d6f3b40 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/ba77f54b-2efa-4b3b-92a7-caba3588d2ad" status: 404 len: 194 microversion: 2.1 time: 0.098721 Oct 28 18:12:28.913683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1260/2437] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:12:28 2022] GET /compute/v2.1/os-security-groups/ba77f54b-2efa-4b3b-92a7-caba3588d2ad => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:28.926841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f747424d-25ee-4c97-b354-823836bb8ac2 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Action: 'update', calling method: .version_select at 0x7f78de4e0ee0>, body: {"security_group": {"name": "tempest-sg-462285063", "description": "tempest-description-1533998524"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:28.936134 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f57676d7-9886-4bfb-9071-f20d49534f84 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.127236 Oct 28 18:12:28.938336 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1178/2438] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:28 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:28.974693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:28.977001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:29.004907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:29.005502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:29.006594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:29.007927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:29.008406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:29.008836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:29.212920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-f747424d-25ee-4c97-b354-823836bb8ac2 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd does not exist", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:12:29.213659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.security_group_api [None req-f747424d-25ee-4c97-b354-823836bb8ac2 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Neutron security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd not found {{(pid=120680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:12:29.214284 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f747424d-25ee-4c97-b354-823836bb8ac2 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] HTTP exception thrown: Security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd does not exist Oct 28 18:12:29.214284 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-559c5e70-22b6-477d-9101-e179ca437247'] Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f747424d-25ee-4c97-b354-823836bb8ac2 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Request method failure captured: Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/os-security-groups/ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd HTTP/1.1 Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 101 Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBuL_qCIJnJPYfiDwKIOTnUnjJ3eSBJSgvTKk24cg9Ro5udCaBNSVgtay2p23WS9yprHge0UQDipfx2FYkLKq6G29QpgIANszg5jB2FSld8QQsvg3n6qp0sJGyV62vNXRKJcZ3OJAOnLGk3WYbxiZoJeISUsUlrKm7oNHqIIqt5w4u0 Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b885d891d83141bcbaeb47e15cc43e2d Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b885d891d83141bcbaeb47e15cc43e2d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b885d891d83141bcbaeb47e15cc43e2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b885d891d83141bcbaeb47e15cc43e2d Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-60826710 Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsNegativeTestJSON-60826710-project Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c76d09e1c4bb408aa9b605708be78b1d Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-60826710-project Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: {"security_group": {"name": "tempest-sg-462285063", "description": "tempest-description-1533998524"}} Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: exception: Security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd does not exist Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-559c5e70-22b6-477d-9101-e179ca437247'] Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd', 'body': {'security_group': {'name': 'tempest-sg-462285063', 'description': 'tempest-description-1533998524'}}} Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:12:29.216953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd does not exist Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-559c5e70-22b6-477d-9101-e179ca437247'] Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd does not exist Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-559c5e70-22b6-477d-9101-e179ca437247'] Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd does not exist Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-559c5e70-22b6-477d-9101-e179ca437247'] Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd does not exist Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-559c5e70-22b6-477d-9101-e179ca437247'] Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f747424d-25ee-4c97-b354-823836bb8ac2 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] Returning 404 to user: Security group ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd does not exist Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-559c5e70-22b6-477d-9101-e179ca437247'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f747424d-25ee-4c97-b354-823836bb8ac2 tempest-SecurityGroupsNegativeTestJSON-60826710 tempest-SecurityGroupsNegativeTestJSON-60826710-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd" status: 404 len: 194 microversion: 2.1 time: 0.299138 Oct 28 18:12:29.221177 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1261/2439] 10.222.0.16 () {60 vars in 1290 bytes} [Fri Oct 28 18:12:28 2022] PUT /compute/v2.1/os-security-groups/ff3e686e-2b3d-4b08-a4b7-d4b58af99ffd => generated 194 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:29.309477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:29.310234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:29.335800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:29.336324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:29.336765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:29.351477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:29.360639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:29.363132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:29.371016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:29.387088 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f1060574-f2fd-49b2-84a4-3dfb3021da45 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1513 microversion: 2.1 time: 0.419433 Oct 28 18:12:29.389006 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1179/2440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:28 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:29.455498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:29.458217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:29.481129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:29.482147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:29.487469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:29.511479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:29.514676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:29.524578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:29.997917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:30.009851 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-661a9456-698b-4c5e-b173-787d2e052ace tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1521 microversion: 2.1 time: 0.560380 Oct 28 18:12:30.024851 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1180/2441] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:29 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:30.041503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:30.042495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:30.055082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:30.055847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:30.058371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:30.060369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:30.061228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:30.061938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:30.231999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:30.248678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e1cfe483-8d69-45cf-aa15-6f85c652240f tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 0.950202 Oct 28 18:12:30.254210 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1262/2442] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:29 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:30.280010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3e7dcfee-2419-45c0-a8ec-36a507fb11e5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de6c79d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:30.385924 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3e7dcfee-2419-45c0-a8ec-36a507fb11e5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.129297 Oct 28 18:12:30.387795 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1263/2443] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:30 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:30.402013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-64a4bdee-d15d-4b3f-b72a-1f32f3f8cb8e req-1ff11728-70bd-4361-a9c3-7e4377deaa32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0146d1-97ba-46e2-95dd-1b12e34a38ee", "name": "network-vif-plugged", "status": "completed", "tag": "e147efd6-55f8-41b3-a7e2-53521978e0af"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:30.445842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-64a4bdee-d15d-4b3f-b72a-1f32f3f8cb8e req-1ff11728-70bd-4361-a9c3-7e4377deaa32 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:30.448936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-64a4bdee-d15d-4b3f-b72a-1f32f3f8cb8e req-1ff11728-70bd-4361-a9c3-7e4377deaa32 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:30.451759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-64a4bdee-d15d-4b3f-b72a-1f32f3f8cb8e req-1ff11728-70bd-4361-a9c3-7e4377deaa32 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:30.467944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:30.487881 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-64a4bdee-d15d-4b3f-b72a-1f32f3f8cb8e req-1ff11728-70bd-4361-a9c3-7e4377deaa32 service nova] Creating event network-vif-plugged:e147efd6-55f8-41b3-a7e2-53521978e0af for instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee on n-h1-862404-2 Oct 28 18:12:30.508221 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-64a4bdee-d15d-4b3f-b72a-1f32f3f8cb8e req-1ff11728-70bd-4361-a9c3-7e4377deaa32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117073 Oct 28 18:12:30.515568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1264/2444] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:30.522061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:30.526204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:30.543044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:30.543791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:30.544505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:30.545438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:30.546351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:30.547722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:30.891985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:30.905691 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c22312b2-f6ad-4631-96c9-065af0cb23f4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.879393 Oct 28 18:12:30.906480 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1181/2445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:30 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:31.052404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:31.055229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:31.074830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:31.076816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:31.077529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:31.079650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:31.081101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:31.081743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:31.326983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:31.335651 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffb98920-4a10-4ca7-a8f3-770421fde6b7 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1513 microversion: 2.1 time: 0.818339 Oct 28 18:12:31.340953 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1265/2446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:30 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1513 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:31.359792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:31.360904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:31.368609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:31.372042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:31.373129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:31.374758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:31.378644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:31.379339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:31.380020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:31.618878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:31.629444 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14b3b78a-4c50-4f29-bdc8-ceb77db2405c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1521 microversion: 2.1 time: 0.590467 Oct 28 18:12:31.633983 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1182/2447] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:31 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:31.647421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74fa544c-c012-45ac-977a-695c3cbd48a5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dead9040>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:31.729422 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74fa544c-c012-45ac-977a-695c3cbd48a5 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.093390 Oct 28 18:12:31.730018 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1183/2448] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:31 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:31.803221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:31.811160 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75cd86d7-68d2-447f-84dc-eacd4bae1bc3 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 0.468922 Oct 28 18:12:31.817525 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1266/2449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:31 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:31.937454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:31.941667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:31.962546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5c5c81ab-4038-4542-804e-56880f713b26 req-3f9662d1-dc1e-40fb-9736-0ad4c2317bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "647d8a8a-482b-47c9-94ce-c3eeef222378", "name": "network-vif-deleted", "tag": "48ef2733-c17e-49c0-b751-bf471fed2830"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:31.969476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:31.971857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:31.973776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:31.974702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:31.976303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:31.977207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:31.989808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c5c81ab-4038-4542-804e-56880f713b26 req-3f9662d1-dc1e-40fb-9736-0ad4c2317bc1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:31.990303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c5c81ab-4038-4542-804e-56880f713b26 req-3f9662d1-dc1e-40fb-9736-0ad4c2317bc1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:31.990744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c5c81ab-4038-4542-804e-56880f713b26 req-3f9662d1-dc1e-40fb-9736-0ad4c2317bc1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:32.029700 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5c5c81ab-4038-4542-804e-56880f713b26 req-3f9662d1-dc1e-40fb-9736-0ad4c2317bc1 service nova] Creating event network-vif-deleted:48ef2733-c17e-49c0-b751-bf471fed2830 for instance 647d8a8a-482b-47c9-94ce-c3eeef222378 on n-h1-862404-2 Oct 28 18:12:32.041708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5c5c81ab-4038-4542-804e-56880f713b26 req-3f9662d1-dc1e-40fb-9736-0ad4c2317bc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082927 Oct 28 18:12:32.042610 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1267/2450] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:32.298055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:32.316670 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a3d45d5-d607-428c-a781-e705b5824beb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.386762 Oct 28 18:12:32.318567 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1184/2451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:31 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:32.364812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:32.365722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:32.381202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:32.384715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:32.385287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:32.386799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:32.389234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:32.389915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:32.564483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0e27e4ee-066e-40da-9f79-85c61543ef37 req-4640f208-18bd-45f0-9b4d-f9b2601b9013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10ed602-8749-474d-a2e1-46b84ecb86d8", "name": "network-vif-unplugged", "status": "completed", "tag": "ee59cdc4-5702-48f2-a669-40f18f587878"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:32.570811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:32.579398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e27e4ee-066e-40da-9f79-85c61543ef37 req-4640f208-18bd-45f0-9b4d-f9b2601b9013 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:32.580892 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b97f500-d4ec-451e-8410-3ca0afd4f75c tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1471 microversion: 2.1 time: 0.221239 Oct 28 18:12:32.581484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e27e4ee-066e-40da-9f79-85c61543ef37 req-4640f208-18bd-45f0-9b4d-f9b2601b9013 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:32.582199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e27e4ee-066e-40da-9f79-85c61543ef37 req-4640f208-18bd-45f0-9b4d-f9b2601b9013 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:32.595656 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1268/2452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:32 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:32.596965 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0e27e4ee-066e-40da-9f79-85c61543ef37 req-4640f208-18bd-45f0-9b4d-f9b2601b9013 service nova] Creating event network-vif-unplugged:ee59cdc4-5702-48f2-a669-40f18f587878 for instance e10ed602-8749-474d-a2e1-46b84ecb86d8 on n-h1-862404-2 Oct 28 18:12:32.605855 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0e27e4ee-066e-40da-9f79-85c61543ef37 req-4640f208-18bd-45f0-9b4d-f9b2601b9013 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045503 Oct 28 18:12:32.606893 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1185/2453] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:32.661160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:32.661809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:32.675105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:32.675626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:32.676225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:32.680483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:32.683710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:32.685718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:32.747221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09180eed-4bf1-41e9-bbd8-6df6a2c7cb8a tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de9868b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:32.883169 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09180eed-4bf1-41e9-bbd8-6df6a2c7cb8a tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.140392 Oct 28 18:12:32.889203 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1186/2454] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:32 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:32.900032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:32.901142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:32.904668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:32.933608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:32.934135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:32.934587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:32.936045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:32.936700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:32.937386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:33.873983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:33.888232 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b6b87ea-e946-443e-bf45-97c1d7ad78b1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1521 microversion: 2.1 time: 1.230659 Oct 28 18:12:33.888879 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1269/2455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:32 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1521 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:33.904759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:33.904981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:33.907728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:33.924690 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-26f2e0d9-44d2-4c37-8c77-751b743e149d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1319 microversion: 2.1 time: 1.033012 Oct 28 18:12:33.926381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:33.926890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:33.927337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:33.928095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:33.928563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:33.928993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:33.954016 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1187/2456] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:32 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1319 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:33.965056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:33.965700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:33.984251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:33.984748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:33.985192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:33.985913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:33.987672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:33.988170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:34.088953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:34.089457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:34.089903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:34.092379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lazy-loading 'fault' on Instance uuid 647d8a8a-482b-47c9-94ce-c3eeef222378 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:12:34.106873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:34.177687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:34.189312 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22745958-457a-4dc6-a5b6-c195bf4f9895 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 200 len: 1308 microversion: 2.1 time: 0.231904 Oct 28 18:12:34.190786 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1188/2457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:33 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:34.202859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fa7079e3-6f55-46b3-8bb6-0a1d4052402f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de5670d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:34.273168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:34.294110 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-422b2023-0cfd-417c-8a23-b1ac96e59e39 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1472 microversion: 2.1 time: 0.404145 Oct 28 18:12:34.308666 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fa7079e3-6f55-46b3-8bb6-0a1d4052402f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.113769 Oct 28 18:12:34.309447 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1189/2458] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:34 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:34.310263 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1270/2459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:33 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:34.919692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:34.920394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:34.937642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:34.938146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:34.938761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:34.942187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:34.944670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:34.945335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:34.962582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:34.964349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:34.975831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:34.976687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:34.978105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:34.979334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:34.980767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:34.981913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:35.344700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:35.359113 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a8590e10-63b7-4cb5-b9b7-b8582305b521 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1521 microversion: 2.1 time: 0.444255 Oct 28 18:12:35.361966 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1190/2460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:34 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:35.371350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:35.375312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 647d8a8a-482b-47c9-94ce-c3eeef222378] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:35.389403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:35.390136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:35.390749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:35.394478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:35.397128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:35.397746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:35.430192 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] HTTP exception thrown: Instance 647d8a8a-482b-47c9-94ce-c3eeef222378 could not be found. Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Request method failure captured: Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 HTTP/1.1 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBqf6j8BnO0It1_kYg2R0OQ-XPL0BGjJv8v92Rdzv2VWTCcMkKxouM-RbR-DVA-1qi8hQvScmNFYwRpRvJaebGaVn5dJkmgpHJp1FWIV9TBMjgv7TOR3aYKUi6qdrIloSPVLQeUdTvlr9snwfHH1h3LDwuXdBFBgsGl7CGElmGpZjbE Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 379769ae736843d0bddf1849cf09d837 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesAdminNegativeTest-767842816 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/379769ae736843d0bddf1849cf09d837"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/379769ae736843d0bddf1849cf09d837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_379769ae736843d0bddf1849cf09d837", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/379769ae736843d0bddf1849cf09d837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-VolumesAdminNegativeTest-767842816 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 379769ae736843d0bddf1849cf09d837 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-767842816 Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-VolumesAdminNegativeTest-767842816-project Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 24ef4ee8fd6349dba67ca7c4cb32234c Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-VolumesAdminNegativeTest-767842816-project Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 647d8a8a-482b-47c9-94ce-c3eeef222378 could not be found. Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '647d8a8a-482b-47c9-94ce-c3eeef222378'} Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 647d8a8a-482b-47c9-94ce-c3eeef222378 could not be found. Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 647d8a8a-482b-47c9-94ce-c3eeef222378 could not be found. Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:35.434505 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:35.438334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:35.438334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:35.438334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:35.438334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:35.438334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:35.438334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 647d8a8a-482b-47c9-94ce-c3eeef222378 could not be found. Oct 28 18:12:35.438334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:35.440777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Returning 404 to user: Instance 647d8a8a-482b-47c9-94ce-c3eeef222378 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:35.444076 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40c0f5fa-32a4-42d2-ad85-fbfafc5e62d6 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378" status: 404 len: 111 microversion: 2.1 time: 0.080934 Oct 28 18:12:35.451415 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1191/2461] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:35 2022] GET /compute/v2.1/servers/647d8a8a-482b-47c9-94ce-c3eeef222378 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:35.465391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:35.475115 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-88cec265-d4ad-4c9e-a98b-3ce383147193 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1468 microversion: 2.1 time: 0.517583 Oct 28 18:12:35.479538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13ff948f-db54-4d87-953a-e834043a1115 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de561790>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:35.489267 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1271/2462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:34 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1468 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:35.494307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:35.504267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:35.527152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:35.527711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:35.528213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:35.530133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:35.530616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:35.532286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:35.597059 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13ff948f-db54-4d87-953a-e834043a1115 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.144195 Oct 28 18:12:35.599443 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1192/2463] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:35 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:35.621684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:35.622231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:35.643452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:35.644181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:35.644786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:35.645662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:35.646304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:35.651529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:35.701851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lazy-loading 'flavor' on Instance uuid 2c0146d1-97ba-46e2-95dd-1b12e34a38ee {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:12:35.862052 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2bd48e6f-e3fa-4e30-9825-66c1c197780b tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee/action" status: 202 len: 0 microversion: 2.1 time: 0.256745 Oct 28 18:12:35.863226 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1193/2464] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:35 2022] POST /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:12:35.872315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:35.878339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:35.895614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:35.896561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:35.897335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:35.898349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:35.898823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:35.899259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:36.231809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:36.255329 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2f0ba25-bbee-44bc-91f0-3f24b12eadaa tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1478 microversion: 2.1 time: 0.764676 Oct 28 18:12:36.258196 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1272/2465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:35 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1478 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:36.391395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:36.393367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:36.405648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:36.406159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:36.406605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:36.409878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:36.412918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:36.413569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:36.420412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:36.435252 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-746b957b-f71b-4612-9e5b-62d12be131e5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1476 microversion: 2.1 time: 0.565356 Oct 28 18:12:36.453550 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1194/2466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:35 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1476 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:36.612368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2142e22a-fc23-45e3-a691-83b97e5905cb tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e23905e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:36.746433 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2142e22a-fc23-45e3-a691-83b97e5905cb tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.138469 Oct 28 18:12:36.747049 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1195/2467] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:36 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:37.289441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:37.290071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:37.308108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:37.309989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:37.310457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:37.314491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:37.316369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:37.316966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:37.479030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:37.493647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-57df187f-24ad-4044-b53f-dd5386578c8c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1521 microversion: 2.1 time: 1.108773 Oct 28 18:12:37.506008 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1273/2468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:36 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1521 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:37.515554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:37.516205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:37.544312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:37.545096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:37.545557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:37.546283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:37.546753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:37.552607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:37.661436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:37.683309 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cde3ab9d-6d4d-4451-a5d7-fedc4877a460 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1478 microversion: 2.1 time: 0.398757 Oct 28 18:12:37.690351 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1196/2469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:37 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1478 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:37.762827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c008f059-d39e-4818-80f7-c81f47097f38 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78ddc150d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:37.828673 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c008f059-d39e-4818-80f7-c81f47097f38 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.070042 Oct 28 18:12:37.837613 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1197/2470] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:37 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:38.530000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:38.530613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:38.542505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:38.545394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:38.546023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:38.546940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:38.550072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:38.551644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:38.571962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:38.586624 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e940facd-20a3-4516-91d6-b768d4028566 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1459 microversion: 2.1 time: 1.077912 Oct 28 18:12:38.607495 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1274/2471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:37 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1459 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:38.622465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:38.623536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:38.646223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:38.648120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:38.649502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:38.651859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:38.652521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:38.653678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:38.872642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:38.885439 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5c66b49d-b4b0-441e-981f-d4891a6c3680 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1521 microversion: 2.1 time: 0.359409 Oct 28 18:12:38.906453 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1198/2472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:38 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:38.915180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-90cd37c0-79fa-4ca9-8a6a-1f473441a622 req-d697c943-d070-4ed2-b8d2-4f2ac6424f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10ed602-8749-474d-a2e1-46b84ecb86d8", "name": "network-vif-plugged", "status": "completed", "tag": "ee59cdc4-5702-48f2-a669-40f18f587878"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:38.930186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-90cd37c0-79fa-4ca9-8a6a-1f473441a622 req-d697c943-d070-4ed2-b8d2-4f2ac6424f76 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:38.930976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-90cd37c0-79fa-4ca9-8a6a-1f473441a622 req-d697c943-d070-4ed2-b8d2-4f2ac6424f76 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:38.931572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-90cd37c0-79fa-4ca9-8a6a-1f473441a622 req-d697c943-d070-4ed2-b8d2-4f2ac6424f76 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:38.957757 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-90cd37c0-79fa-4ca9-8a6a-1f473441a622 req-d697c943-d070-4ed2-b8d2-4f2ac6424f76 service nova] Creating event network-vif-plugged:ee59cdc4-5702-48f2-a669-40f18f587878 for instance e10ed602-8749-474d-a2e1-46b84ecb86d8 on n-h1-862404-2 Oct 28 18:12:38.966797 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-90cd37c0-79fa-4ca9-8a6a-1f473441a622 req-d697c943-d070-4ed2-b8d2-4f2ac6424f76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058057 Oct 28 18:12:38.968034 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1199/2473] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:38.991264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:38.993479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:39.030911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:39.032451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:39.035956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:39.039743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:39.040571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:39.041217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:39.363496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:39.376571 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6033ee69-a89c-4a48-853c-694afcf563a6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1478 microversion: 2.1 time: 0.407064 Oct 28 18:12:39.378702 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1200/2474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:38 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1478 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:39.383510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-68073068-f904-4cec-9e8b-a39d1a5e3479 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de986430>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:39.500419 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-68073068-f904-4cec-9e8b-a39d1a5e3479 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.120484 Oct 28 18:12:39.502342 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1201/2475] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:39 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:39.869317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a29b22f-5ebf-408e-af51-31364e293866 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1610 microversion: 2.1 time: 1.259532 Oct 28 18:12:39.872104 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1275/2476] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:38 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1610 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:39.896236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bae4da15-3567-4a24-86ae-bd85a1d44c67 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:39.900262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bae4da15-3567-4a24-86ae-bd85a1d44c67 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:39.900752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bae4da15-3567-4a24-86ae-bd85a1d44c67 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:39.901200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bae4da15-3567-4a24-86ae-bd85a1d44c67 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:39.909964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bae4da15-3567-4a24-86ae-bd85a1d44c67 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:39.910468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bae4da15-3567-4a24-86ae-bd85a1d44c67 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:39.910918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bae4da15-3567-4a24-86ae-bd85a1d44c67 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:39.926242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:39.927000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:39.954650 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bae4da15-3567-4a24-86ae-bd85a1d44c67 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064747 Oct 28 18:12:39.959909 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1202/2477] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:12:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:39.962369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:39.963656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:39.969813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862404-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:39.972373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:39.973145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:39.977124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:39.979102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:39.981813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:40.000224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:40.000726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:40.001171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:40.001934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:40.002668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:40.003170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:40.052868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Lazy-loading 'flavor' on Instance uuid 2c0146d1-97ba-46e2-95dd-1b12e34a38ee {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:12:40.089891 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee while it is in vm_state suspended Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Request method failure captured: Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee/action HTTP/1.1 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 97 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBtXTU5sS4zYYMbmA-uxyfwKMlqeMVNOin6Wzwu3TrNkYFHNHpnOdOR9-3CZfuFR7YqbReyHN7xUvy2fFvXyXAjr60TNBSmIKm5BRH2e3X4c5U2npDQxxg5uXw475YvDcmJgm-SpSaE79_vLd_kVh2ohaXqmUt-Ro5EarbkgpJ2DSJs Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 22edebea3e9d4abbaab4c8c9da8a79e8 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-LiveMigrationNegativeTest-671045671 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22edebea3e9d4abbaab4c8c9da8a79e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/22edebea3e9d4abbaab4c8c9da8a79e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_22edebea3e9d4abbaab4c8c9da8a79e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/22edebea3e9d4abbaab4c8c9da8a79e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-LiveMigrationNegativeTest-671045671 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 22edebea3e9d4abbaab4c8c9da8a79e8 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-671045671 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-LiveMigrationNegativeTest-671045671-project-admin Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8ea9daeb6f21461aba2fd5e3dcfcd465 Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-LiveMigrationNegativeTest-671045671-project-admin Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: {"os-migrateLive": {"host": "n-h2-862404-2", "block_migration": true, "disk_over_commit": false}} Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: exception: Cannot 'os-migrateLive' instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee while it is in vm_state suspended Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '2c0146d1-97ba-46e2-95dd-1b12e34a38ee', 'body': {'os-migrateLive': {'host': 'n-h2-862404-2', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:40.092216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee while it is in vm_state suspended Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee while it is in vm_state suspended Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee while it is in vm_state suspended {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:40.096890 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b3036cb2-8bfc-47bc-9e9e-88b9c3430591 tempest-LiveMigrationNegativeTest-671045671 tempest-LiveMigrationNegativeTest-671045671-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee/action" status: 409 len: 155 microversion: 2.1 time: 0.129023 Oct 28 18:12:40.109564 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1203/2478] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:39 2022] POST /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee/action => generated 155 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 18:12:40.116078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:40.129390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:40.136076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:40.136797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:40.137386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:40.138268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:40.138875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:40.139477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:40.176963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:12:40.389524 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fa987fd4-6c59-4b71-b98f-0ce93423e3c7 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 204 len: 0 microversion: 2.1 time: 0.278347 Oct 28 18:12:40.397567 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1204/2479] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:12:40 2022] DELETE /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:12:40.414131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:40.414854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:40.447943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:40.448453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:40.448895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:40.449732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:40.450190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:40.451742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:40.943561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:40.951780 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-29c47275-3d75-4811-b5d0-a68090eddd03 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1465 microversion: 2.1 time: 0.552864 Oct 28 18:12:40.952389 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1205/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:40 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1465 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:40.970359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:40.973150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:41.007801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:41.011801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:41.017306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:41.018333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:41.020795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:41.021415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:41.080410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:41.098938 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbf0dfc2-5fdd-4400-b0df-29c7df5b8c51 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1521 microversion: 2.1 time: 1.191459 Oct 28 18:12:41.100479 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1276/2481] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:39 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1521 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:41.125395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbf537cd-a1f9-4443-bf20-57d7d06e9260 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de24c310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:41.264031 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbf537cd-a1f9-4443-bf20-57d7d06e9260 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.161066 Oct 28 18:12:41.272378 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1277/2482] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:41 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:41.454098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:41.468058 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7945281e-cb6f-4687-9946-8b288b04a4af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1478 microversion: 2.1 time: 0.507680 Oct 28 18:12:41.472191 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1206/2483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:40 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1478 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:41.988355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:41.990144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:42.002913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:42.003676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:42.004731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:42.005661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:42.006446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:42.007008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:42.129837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:42.130639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:42.148301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:42.148953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:42.149466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:42.150413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:42.155533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:42.156972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:42.623206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:42.664813 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-305f3c56-7750-4e91-8341-8147527d870c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1521 microversion: 2.1 time: 0.540700 Oct 28 18:12:42.680788 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1207/2484] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:42 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:42.741615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d0b2721e-ceac-430d-b257-0cf7aed789ab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78deef4ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:42.817895 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d0b2721e-ceac-430d-b257-0cf7aed789ab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.128024 Oct 28 18:12:42.818487 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1208/2485] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:42 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:42.832934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:42.833642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:42.845318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:42.849751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:42.850368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:42.852982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:42.855920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:42.856626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:42.954476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:12:42.965560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:43.261711 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-60e14574-9a99-4afe-af99-6ad77c262268 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "DELETE /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 204 len: 0 microversion: 2.1 time: 0.437569 Oct 28 18:12:43.266525 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1209/2486] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:12:42 2022] DELETE /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:12:43.288469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:43.293009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:43.311411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:43.314415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:43.315189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:43.321389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:43.321771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:43.322221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:43.507725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:43.534957 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-efb2c60f-d127-42b0-90e6-43bb0d7ba6f5 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1465 microversion: 2.1 time: 1.563905 Oct 28 18:12:43.554983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1278/2487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:41 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1465 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:43.568443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-03453f51-b63a-4231-ab04-e074f9fd38e1 req-b8514089-6e38-44c7-bd2c-603ea13c7cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9701323d-b2b2-48a1-baf9-4ee8521c95be", "name": "network-vif-plugged", "status": "completed", "tag": "6b4f741f-8159-46fb-a039-2ded83b18128"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:43.595376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-03453f51-b63a-4231-ab04-e074f9fd38e1 req-b8514089-6e38-44c7-bd2c-603ea13c7cea service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:43.605151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-03453f51-b63a-4231-ab04-e074f9fd38e1 req-b8514089-6e38-44c7-bd2c-603ea13c7cea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:43.605965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-03453f51-b63a-4231-ab04-e074f9fd38e1 req-b8514089-6e38-44c7-bd2c-603ea13c7cea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:43.643801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-03453f51-b63a-4231-ab04-e074f9fd38e1 req-b8514089-6e38-44c7-bd2c-603ea13c7cea service nova] Creating event network-vif-plugged:6b4f741f-8159-46fb-a039-2ded83b18128 for instance 9701323d-b2b2-48a1-baf9-4ee8521c95be on n-h2-862404-2 Oct 28 18:12:43.667441 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-03453f51-b63a-4231-ab04-e074f9fd38e1 req-b8514089-6e38-44c7-bd2c-603ea13c7cea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110327 Oct 28 18:12:43.668551 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1279/2488] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:43.674337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:43.675351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:43.708731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:43.709185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:43.711946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:43.715114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:43.715671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:43.716978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:43.971485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:43.982760 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ef29a4c1-0827-42ff-bd90-09cf2e37fc02 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1478 microversion: 2.1 time: 0.707669 Oct 28 18:12:44.000632 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1210/2489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:43 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1478 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:44.013864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:44.014905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:44.028844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:44.031245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:44.033033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:44.035275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:44.037352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:44.039913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:44.602481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:44.609634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:44.628479 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5b366dd0-b594-4ce1-8c45-6864ae0aba17 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1506 microversion: 2.1 time: 0.621552 Oct 28 18:12:44.628479 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1211/2490] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:44 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:44.655093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e5ce5c64-b335-4ea7-b643-11b0ac857765 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1681 microversion: 2.1 time: 0.952928 Oct 28 18:12:44.658681 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1280/2491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:43 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1681 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:44.671685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c0641fc-fe87-46fb-bdcb-3ce5e15cda70 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de7175e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:44.674560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-feda91d5-5936-45d5-a15b-047ac46dac76 req-d7b822a1-084c-4e04-b0df-4abd75ef7c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0146d1-97ba-46e2-95dd-1b12e34a38ee", "name": "network-vif-deleted", "tag": "e147efd6-55f8-41b3-a7e2-53521978e0af"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:44.686818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-feda91d5-5936-45d5-a15b-047ac46dac76 req-d7b822a1-084c-4e04-b0df-4abd75ef7c05 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:44.687572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-feda91d5-5936-45d5-a15b-047ac46dac76 req-d7b822a1-084c-4e04-b0df-4abd75ef7c05 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:44.688425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-feda91d5-5936-45d5-a15b-047ac46dac76 req-d7b822a1-084c-4e04-b0df-4abd75ef7c05 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:44.706272 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-feda91d5-5936-45d5-a15b-047ac46dac76 req-d7b822a1-084c-4e04-b0df-4abd75ef7c05 service nova] Creating event network-vif-deleted:e147efd6-55f8-41b3-a7e2-53521978e0af for instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee on n-h1-862404-2 Oct 28 18:12:44.714511 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-feda91d5-5936-45d5-a15b-047ac46dac76 req-d7b822a1-084c-4e04-b0df-4abd75ef7c05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054042 Oct 28 18:12:44.715996 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1281/2492] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:44.723049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-776b4550-cfe4-4032-8d40-129d20ff8abc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Action: 'create', calling method: .version_select at 0x7f78de2bdc10>, body: {"keypair": {"name": "tempest-keypair-427085366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH41V9V2MIIvAi/xo4ZPyYYi6Bd+KE8tJJwY89Qlxqn4yEN5u6yWKEen70HUf1S29m65XtiSjXYRkjexOMyOZ4LgkDjl5VWFKPmki+6NvTD2ecZ5RYL55qGDMBJGwVqZGw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:44.782982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-776b4550-cfe4-4032-8d40-129d20ff8abc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Getting quotas for project eeb01cab48b5437cbbe52dea0a0b97e6. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:12:44.800861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-776b4550-cfe4-4032-8d40-129d20ff8abc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Getting quotas for user b7af32e785674747a0c07d471e7f3aa1 and project eeb01cab48b5437cbbe52dea0a0b97e6. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:12:44.803794 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c0641fc-fe87-46fb-bdcb-3ce5e15cda70 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.178588 Oct 28 18:12:44.816006 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1212/2493] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:44 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:44.830786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:44.836277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:44.865676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:44.874493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:44.880366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:44.885197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:44.886297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:44.890106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:44.901228 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-776b4550-cfe4-4032-8d40-129d20ff8abc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.183827 Oct 28 18:12:44.914362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1282/2494] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:12:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 18:12:44.936191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:44.939730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:44.959917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:44.971247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:44.977343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:44.981343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:44.984612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:44.987768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:44.992910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:44.994240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:44.994868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:44.995613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lazy-loading 'fault' on Instance uuid 2c0146d1-97ba-46e2-95dd-1b12e34a38ee {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:12:45.222719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:45.248969 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ac43691a-d639-425f-952b-5dd9a529847c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 200 len: 1309 microversion: 2.1 time: 0.427528 Oct 28 18:12:45.252952 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1213/2495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:44 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:45.275739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:45.278151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:45.307778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:45.308358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:45.308872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:45.317073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:45.319723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:45.321748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:45.773015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:45.783765 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c0dd5aa-fa8d-4b16-a410-34bf2c1a5e58 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1478 microversion: 2.1 time: 0.525961 Oct 28 18:12:45.793025 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1214/2496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:45 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1478 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:45.798029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:45.804676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:45.821522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:45.822367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:45.823007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:45.826608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:45.827356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:45.828320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.183604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:46.198687 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36289f11-5dbb-4ee0-97a4-f1a07796bc43 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 200 len: 1506 microversion: 2.1 time: 1.281604 Oct 28 18:12:46.200232 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1283/2497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:44 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 1506 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:46.207999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-15ba2833-3bb1-4aa2-9f3f-0a37de51b04e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de4cd430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:46.283602 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-15ba2833-3bb1-4aa2-9f3f-0a37de51b04e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.078601 Oct 28 18:12:46.287720 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1284/2498] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:46 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:46.309993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:46.310518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:46.349641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.350164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.353881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:46.357191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.358360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.358865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.363565 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a3f2ed90-6d6a-4a2b-b6f0-d5dc12098e87 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1681 microversion: 2.1 time: 0.569260 Oct 28 18:12:46.364114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.377439 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1215/2499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:45 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1681 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:46.387570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:46.388555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 2c0146d1-97ba-46e2-95dd-1b12e34a38ee] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:46.396586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.397656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.398337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.399281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.400011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.400647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.453225 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] HTTP exception thrown: Instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee could not be found. Oct 28 18:12:46.463965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Request method failure captured: Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee HTTP/1.1 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBtVrM2PZfvEqXzXu6xhNbFQzbbW6EQBRP-2Ak_ScJtychKkQ2tFAXqP79K0qTJL7UsZ3TBK_dYSPnt_LjSL2B9hsvNirZly7ddZ8Ib-SXtYKVEBv0fLz9E2MLKJOo96NS1I5jkDdd0vITFbLBP94h5QqWqcZDCopa7IPC9d-BhBnrg Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 034e69943b404cedb74838f3bffe4555 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-LiveMigrationNegativeTest-348260433 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/034e69943b404cedb74838f3bffe4555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/034e69943b404cedb74838f3bffe4555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_034e69943b404cedb74838f3bffe4555", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/034e69943b404cedb74838f3bffe4555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-LiveMigrationNegativeTest-348260433 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 034e69943b404cedb74838f3bffe4555 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-348260433 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-LiveMigrationNegativeTest-348260433-project Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: b5949d98c7534e6eb6029bbad3e6d035 Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-LiveMigrationNegativeTest-348260433-project Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee could not be found. Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '2c0146d1-97ba-46e2-95dd-1b12e34a38ee'} Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee could not be found. Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee could not be found. Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:46.464963 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:46.468567 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:46.468567 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:46.468567 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:46.468567 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:46.468567 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:46.468567 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee could not be found. Oct 28 18:12:46.468567 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:46.472783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Returning 404 to user: Instance 2c0146d1-97ba-46e2-95dd-1b12e34a38ee could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:46.476472 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-32ad1ad5-2011-4481-a791-7a673a33dbfd tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee" status: 404 len: 111 microversion: 2.1 time: 0.097561 Oct 28 18:12:46.482554 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1216/2500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:46 2022] GET /compute/v2.1/servers/2c0146d1-97ba-46e2-95dd-1b12e34a38ee => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:46.496039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:46.498110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:46.516611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.518757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.521441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.522240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.522726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.523168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.560359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:46.652489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:12:46.689648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07545ecc-6c5e-4180-b5e1-f1ae4839c308 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 204 len: 0 microversion: 2.1 time: 0.396459 Oct 28 18:12:46.693549 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1285/2501] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:12:46 2022] DELETE /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:12:46.820777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:46.821888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:46.839945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.843951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.844586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.847848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.852363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.853027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.883018 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7e4118ff-d048-4f0a-b820-a095873acf5c tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 204 len: 0 microversion: 2.1 time: 0.398606 Oct 28 18:12:46.884667 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1217/2502] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:12:46 2022] DELETE /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:12:46.903856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:46.904596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:46.929702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.930246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.930793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:46.931687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:46.932467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:46.933363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:47.279197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:47.294411 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea922717-228d-4b18-9a30-5dac7e46dbe6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1464 microversion: 2.1 time: 0.476443 Oct 28 18:12:47.295234 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1286/2503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:46 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1464 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:47.305171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1974128073", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "eb145875-a83f-4638-a01f-ece8f5867a2a"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:47.444893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] validate_networks() for [('eb145875-a83f-4638-a01f-ece8f5867a2a', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:12:47.760418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:47.772146 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a849509a-59d2-41cc-8192-7f968cb53740 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1474 microversion: 2.1 time: 0.880703 Oct 28 18:12:47.773930 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1218/2504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:46 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1474 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:47.801927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aa9b18eb-ceb5-49dc-9bdc-7fd826bc0e99 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78ddbd7f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:47.911457 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aa9b18eb-ceb5-49dc-9bdc-7fd826bc0e99 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.126055 Oct 28 18:12:47.912153 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1219/2505] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:47 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:47.934052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:47.934707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:47.949849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:47.950336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:47.950778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:47.951497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:47.956240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:47.956830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:48.864407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:12:48.864923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:12:48.865298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:12:48.865922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:12:48.866499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:12:48.884256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:48.885625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:48.887994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:48.889488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:48.891695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:48.892676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:48.931201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Getting quotas for project c5344e62d39b463da80ea567fc1265ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:12:48.939929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Getting quotas for user ce8b396d3fca4ec5bb085fb1404328f4 and project c5344e62d39b463da80ea567fc1265ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:12:48.954412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:12:48.957757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:12:49.050442 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b789d6ee-002b-4716-b8de-c2f8e8dbb9fc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.753419 Oct 28 18:12:49.051574 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1287/2506] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:12:49.071539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:49.073116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:49.086372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:49.089414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:49.092570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:49.093662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:49.094341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:49.097267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:49.253307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ef4ee8fd6349dba67ca7c4cb32234c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379769ae736843d0bddf1849cf09d837', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:49.263531 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42dc775b-62a7-4e58-87b9-9427bd339450 tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 200 len: 1614 microversion: 2.1 time: 0.196133 Oct 28 18:12:49.269317 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1288/2507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:49 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 1614 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:49.278542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:49.281207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:49.295735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:49.296362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:49.298813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:49.299990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:49.302328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:49.304079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:49.882579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:49.896082 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-81d0fdbb-893f-4a86-afc3-670a6f2b6044 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1464 microversion: 2.1 time: 1.972500 Oct 28 18:12:49.902982 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1220/2508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:47 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1464 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:49.922442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-98721e1d-dc1b-4206-8333-f62c437986bb tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78decf3310>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:49.943360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:50.618068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-98721e1d-dc1b-4206-8333-f62c437986bb tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.710630 Oct 28 18:12:50.619526 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1221/2509] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:49 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:50.640945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:50.644200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:50.663252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:50.666511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:50.667198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:50.668180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:50.669828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:50.672814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:50.801130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:50.809806 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71899218-4889-417e-96da-a76456cac77d tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1474 microversion: 2.1 time: 1.539166 Oct 28 18:12:50.812575 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1289/2510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:49 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1474 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:50.825114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e55d2758-ba33-48de-9cdc-4878a09bf049 req-c6bc77b1-4940-44bb-adc4-2550df38f066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b66dc4-afcd-4eac-89ed-346c9bb49328", "name": "network-vif-deleted", "tag": "613f75ce-54a2-40d5-bd57-1e953890b282"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:50.844932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e55d2758-ba33-48de-9cdc-4878a09bf049 req-c6bc77b1-4940-44bb-adc4-2550df38f066 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:50.848257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e55d2758-ba33-48de-9cdc-4878a09bf049 req-c6bc77b1-4940-44bb-adc4-2550df38f066 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:50.848750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e55d2758-ba33-48de-9cdc-4878a09bf049 req-c6bc77b1-4940-44bb-adc4-2550df38f066 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:50.882001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e55d2758-ba33-48de-9cdc-4878a09bf049 req-c6bc77b1-4940-44bb-adc4-2550df38f066 service nova] Creating event network-vif-deleted:613f75ce-54a2-40d5-bd57-1e953890b282 for instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 on n-h1-862404-2 Oct 28 18:12:50.894872 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e55d2758-ba33-48de-9cdc-4878a09bf049 req-c6bc77b1-4940-44bb-adc4-2550df38f066 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077703 Oct 28 18:12:50.896979 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1290/2511] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:50.909821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:50.914574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:50.929850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:50.933169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:50.933672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:50.934427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:50.934907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:50.937426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.103238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:12:51.104167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:12:51.104854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:12:51.106736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:12:51.108657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:12:51.127512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:51.188290 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fcca160d-6464-4de5-a3ed-1deeeda1dfd7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1270 microversion: 2.1 time: 0.564599 Oct 28 18:12:51.191843 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1222/2512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:50 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1270 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:51.204228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:51.205539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] [instance: 90b66dc4-afcd-4eac-89ed-346c9bb49328] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:51.227801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.231383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.233050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.235177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.235957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.239522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.275592 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] HTTP exception thrown: Instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 could not be found. Oct 28 18:12:51.284754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Request method failure captured: Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 HTTP/1.1 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBqf6j8BnO0It1_kYg2R0OQ-XPL0BGjJv8v92Rdzv2VWTCcMkKxouM-RbR-DVA-1qi8hQvScmNFYwRpRvJaebGaVn5dJkmgpHJp1FWIV9TBMjgv7TOR3aYKUi6qdrIloSPVLQeUdTvlr9snwfHH1h3LDwuXdBFBgsGl7CGElmGpZjbE Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 379769ae736843d0bddf1849cf09d837 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesAdminNegativeTest-767842816 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/379769ae736843d0bddf1849cf09d837"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/379769ae736843d0bddf1849cf09d837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_379769ae736843d0bddf1849cf09d837", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/379769ae736843d0bddf1849cf09d837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-VolumesAdminNegativeTest-767842816 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 379769ae736843d0bddf1849cf09d837 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-767842816 Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-VolumesAdminNegativeTest-767842816-project Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 24ef4ee8fd6349dba67ca7c4cb32234c Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-VolumesAdminNegativeTest-767842816-project Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 could not be found. Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '90b66dc4-afcd-4eac-89ed-346c9bb49328'} Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 could not be found. Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 could not be found. Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:51.285589 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:51.289329 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:51.289329 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:51.289329 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:51.289329 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:51.289329 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:51.289329 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 could not be found. Oct 28 18:12:51.289329 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:12:51.292078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Returning 404 to user: Instance 90b66dc4-afcd-4eac-89ed-346c9bb49328 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:51.296316 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8d3a7b48-ac45-4d98-aa81-ecda3b9098dc tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328" status: 404 len: 111 microversion: 2.1 time: 0.101604 Oct 28 18:12:51.297127 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1223/2513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:51 2022] GET /compute/v2.1/servers/90b66dc4-afcd-4eac-89ed-346c9bb49328 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:51.311488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3ea6e45a-0820-4499-88cd-ad3f6ae4c415 req-c769197c-42ac-446c-b51a-7d6f1f512e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10ed602-8749-474d-a2e1-46b84ecb86d8", "name": "network-vif-unplugged", "status": "completed", "tag": "ee59cdc4-5702-48f2-a669-40f18f587878"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:51.326516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.327290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.327953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.328960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.336332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.337670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.347102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3ea6e45a-0820-4499-88cd-ad3f6ae4c415 req-c769197c-42ac-446c-b51a-7d6f1f512e58 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.347848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3ea6e45a-0820-4499-88cd-ad3f6ae4c415 req-c769197c-42ac-446c-b51a-7d6f1f512e58 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.348823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3ea6e45a-0820-4499-88cd-ad3f6ae4c415 req-c769197c-42ac-446c-b51a-7d6f1f512e58 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.382231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8359bc2-cc0d-43f9-80c7-7e0a750c5796 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action" status: 202 len: 1068 microversion: 2.1 time: 0.481988 Oct 28 18:12:51.394861 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3ea6e45a-0820-4499-88cd-ad3f6ae4c415 req-c769197c-42ac-446c-b51a-7d6f1f512e58 service nova] Creating event network-vif-unplugged:ee59cdc4-5702-48f2-a669-40f18f587878 for instance e10ed602-8749-474d-a2e1-46b84ecb86d8 on n-h1-862404-2 Oct 28 18:12:51.396984 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1291/2514] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:50 2022] POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action => generated 1068 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 18:12:51.403439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13915e15-3865-4791-8f20-9b85bb25b59d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] Calling method '.version_select at 0x7f78de25c310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:51.410811 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3ea6e45a-0820-4499-88cd-ad3f6ae4c415 req-c769197c-42ac-446c-b51a-7d6f1f512e58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106066 Oct 28 18:12:51.414038 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1224/2515] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:51.429787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:51.433736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:51.436938 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13915e15-3865-4791-8f20-9b85bb25b59d tempest-VolumesAdminNegativeTest-767842816 tempest-VolumesAdminNegativeTest-767842816-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076178402" status: 202 len: 0 microversion: 2.1 time: 0.037481 Oct 28 18:12:51.441813 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1292/2516] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:12:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076178402 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:12:51.472230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.474337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.475666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.483046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.484328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.487220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.637959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-512c5dfb-e266-40cb-94ef-f28bd7122079 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de25d3a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:51.721619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-512c5dfb-e266-40cb-94ef-f28bd7122079 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.088995 Oct 28 18:12:51.731285 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1293/2517] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:51 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:51.842115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:51.842896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:51.870702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.870936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.871403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:51.880615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:51.881129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:51.881583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:52.107395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:52.122019 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4a00a499-aaed-4358-9c0f-b2eb54a4598d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.706166 Oct 28 18:12:52.122633 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1225/2518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:51 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:52.219587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:52.221646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:52.232037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:52.232849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:52.233511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:52.234575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:52.235464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:52.236378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:52.262005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5949d98c7534e6eb6029bbad3e6d035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034e69943b404cedb74838f3bffe4555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:52.273766 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2428c46-60c6-4fab-9816-075ac4b78653 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 200 len: 1304 microversion: 2.1 time: 0.436794 Oct 28 18:12:52.286679 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1294/2519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:51 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 1304 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:52.489427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:52.510337 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f30f2635-cd6f-485a-8bb5-81155199c9e3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1276 microversion: 2.1 time: 0.300146 Oct 28 18:12:52.554505 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1226/2520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:52 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1276 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:52.570861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-11b2fb7d-0647-45a2-a505-961677f54927 req-ef7f5cbd-274f-4c50-b563-00ba7573c8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10ed602-8749-474d-a2e1-46b84ecb86d8", "name": "network-vif-deleted", "tag": "ee59cdc4-5702-48f2-a669-40f18f587878"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:52.594534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11b2fb7d-0647-45a2-a505-961677f54927 req-ef7f5cbd-274f-4c50-b563-00ba7573c8f4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:52.595014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11b2fb7d-0647-45a2-a505-961677f54927 req-ef7f5cbd-274f-4c50-b563-00ba7573c8f4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:52.597803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11b2fb7d-0647-45a2-a505-961677f54927 req-ef7f5cbd-274f-4c50-b563-00ba7573c8f4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:52.624106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-11b2fb7d-0647-45a2-a505-961677f54927 req-ef7f5cbd-274f-4c50-b563-00ba7573c8f4 service nova] Creating event network-vif-deleted:ee59cdc4-5702-48f2-a669-40f18f587878 for instance e10ed602-8749-474d-a2e1-46b84ecb86d8 on n-h1-862404-2 Oct 28 18:12:52.631589 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-11b2fb7d-0647-45a2-a505-961677f54927 req-ef7f5cbd-274f-4c50-b563-00ba7573c8f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064267 Oct 28 18:12:52.633241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1295/2521] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:52.751283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd79bb5c-ae2a-4199-b95e-5bf579d85add tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2554820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:52.900808 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd79bb5c-ae2a-4199-b95e-5bf579d85add tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.156869 Oct 28 18:12:52.901436 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1227/2522] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:52 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:52.989437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e82327ed-0177-4ecd-91d0-33e888c5dab8 req-81b6d168-7206-422e-98e3-4d7f6d6b6adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb33f22-de3d-4a95-9658-99d96a5229bf", "name": "network-vif-deleted", "tag": "c5d6b20a-7dec-4824-b41f-1ac6a634f2e8"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:53.026297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e82327ed-0177-4ecd-91d0-33e888c5dab8 req-81b6d168-7206-422e-98e3-4d7f6d6b6adb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:53.026803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e82327ed-0177-4ecd-91d0-33e888c5dab8 req-81b6d168-7206-422e-98e3-4d7f6d6b6adb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:53.027259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e82327ed-0177-4ecd-91d0-33e888c5dab8 req-81b6d168-7206-422e-98e3-4d7f6d6b6adb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:53.072633 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e82327ed-0177-4ecd-91d0-33e888c5dab8 req-81b6d168-7206-422e-98e3-4d7f6d6b6adb service nova] Creating event network-vif-deleted:c5d6b20a-7dec-4824-b41f-1ac6a634f2e8 for instance 3eb33f22-de3d-4a95-9658-99d96a5229bf on n-h2-862404-2 Oct 28 18:12:53.078533 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e82327ed-0177-4ecd-91d0-33e888c5dab8 req-81b6d168-7206-422e-98e3-4d7f6d6b6adb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095817 Oct 28 18:12:53.084219 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1296/2523] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:53.156930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:53.158845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:53.174080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:53.174984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:53.175662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:53.176661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:53.177619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:53.178294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:53.305233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:53.305951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] [instance: 3eb33f22-de3d-4a95-9658-99d96a5229bf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:53.324907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:53.325653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:53.326374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:53.327331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:53.328049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:53.328705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:53.366942 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] HTTP exception thrown: Instance 3eb33f22-de3d-4a95-9658-99d96a5229bf could not be found. Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Request method failure captured: Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf HTTP/1.1 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBtVrM2PZfvEqXzXu6xhNbFQzbbW6EQBRP-2Ak_ScJtychKkQ2tFAXqP79K0qTJL7UsZ3TBK_dYSPnt_LjSL2B9hsvNirZly7ddZ8Ib-SXtYKVEBv0fLz9E2MLKJOo96NS1I5jkDdd0vITFbLBP94h5QqWqcZDCopa7IPC9d-BhBnrg Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 034e69943b404cedb74838f3bffe4555 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-LiveMigrationNegativeTest-348260433 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/034e69943b404cedb74838f3bffe4555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/034e69943b404cedb74838f3bffe4555"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_034e69943b404cedb74838f3bffe4555", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/034e69943b404cedb74838f3bffe4555"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-LiveMigrationNegativeTest-348260433 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 034e69943b404cedb74838f3bffe4555 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-348260433 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-LiveMigrationNegativeTest-348260433-project Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b5949d98c7534e6eb6029bbad3e6d035 Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-LiveMigrationNegativeTest-348260433-project Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 3eb33f22-de3d-4a95-9658-99d96a5229bf could not be found. Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '3eb33f22-de3d-4a95-9658-99d96a5229bf'} Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb33f22-de3d-4a95-9658-99d96a5229bf could not be found. Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb33f22-de3d-4a95-9658-99d96a5229bf could not be found. Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:12:53.369133 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:53.372629 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:12:53.372629 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:12:53.372629 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:12:53.372629 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:12:53.372629 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:12:53.372629 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb33f22-de3d-4a95-9658-99d96a5229bf could not be found. Oct 28 18:12:53.372629 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:12:53.381855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] Returning 404 to user: Instance 3eb33f22-de3d-4a95-9658-99d96a5229bf could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:12:53.383082 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7473de63-60fb-4aaa-925b-5ada6ba812e9 tempest-LiveMigrationNegativeTest-348260433 tempest-LiveMigrationNegativeTest-348260433-project] 10.222.0.16 "GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf" status: 404 len: 111 microversion: 2.1 time: 0.085941 Oct 28 18:12:53.384285 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1297/2524] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:53 2022] GET /compute/v2.1/servers/3eb33f22-de3d-4a95-9658-99d96a5229bf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:12:53.546568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:53.547616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:53.557590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:53.572750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:53.574434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:53.576078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:53.576907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:53.577592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:53.914647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:53.917927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:53.931184 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bc171b0f-c6a3-4d06-813a-2418cedaf710 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.776296 Oct 28 18:12:53.938945 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1228/2525] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:53 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:53.951477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22d0999f-6fa6-47a1-93df-34215b04ba66 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de816550>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:54.030122 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22d0999f-6fa6-47a1-93df-34215b04ba66 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1455 microversion: 2.1 time: 0.088716 Oct 28 18:12:54.030952 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1229/2526] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:53 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:54.422662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:54.446171 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-275ed41a-0c02-42e8-bcec-3945d0d2a699 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1276 microversion: 2.1 time: 0.902352 Oct 28 18:12:54.484073 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1298/2527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:53 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1276 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:54.963148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:54.964332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:54.978639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:54.980468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:54.981644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:54.986526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:54.987216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:54.987836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:55.046660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f375bd70-ba67-4307-8080-8701011d3c8e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de4e0ee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:55.116754 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f375bd70-ba67-4307-8080-8701011d3c8e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1464 microversion: 2.1 time: 0.072636 Oct 28 18:12:55.117514 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1299/2528] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:55 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1464 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:55.133743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e92b9abf-29f3-4c5e-9b38-c721b88dacf8 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de0e2280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:55.189526 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e92b9abf-29f3-4c5e-9b38-c721b88dacf8 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 200 len: 1464 microversion: 2.1 time: 0.060938 Oct 28 18:12:55.191156 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1300/2529] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:55 2022] GET /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 1464 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:55.206208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:55.207342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:55.218518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:55.219369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:55.220060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:55.221834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:55.222835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:55.223486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:55.688448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:55.698415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a0fc248-cfab-4413-982d-c16a77e2ec93 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1467 microversion: 2.1 time: 0.497475 Oct 28 18:12:55.699773 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1301/2530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:55 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1467 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:55.705590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:55.706691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:55.714515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:55.715103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:55.715631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:55.716633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:55.717476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:55.718107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:56.139864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:56.153475 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c3d5e76a-11f8-458a-8953-5793cd9532dd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 1.195395 Oct 28 18:12:56.155025 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1230/2531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:54 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:56.166105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-154802796"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:56.174885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:56.188382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:56.191081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:56.191888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:56.193318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:56.193925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:56.199049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:56.511314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:56.547349 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-577a9c18-16d0-4de1-a549-cd35e080267f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1318 microversion: 2.1 time: 0.838418 Oct 28 18:12:56.551385 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1302/2532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:55 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1318 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:56.646327 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-183b345b-d84e-44a9-b463-424a7c15f3b1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "POST /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069/action" status: 202 len: 0 microversion: 2.1 time: 0.489186 Oct 28 18:12:56.649392 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1231/2533] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:56 2022] POST /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:12:56.661793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ccc5dd6-c3f3-4597-8f61-1ec354fda7c4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de444a60>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:56.743858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ccc5dd6-c3f3-4597-8f61-1ec354fda7c4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.087104 Oct 28 18:12:56.753055 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1303/2534] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:56 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:57.181963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:57.182784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:57.207527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.209792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.217923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:57.225697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.226348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.230245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:57.466336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1655862295", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7d965f03-65a6-4f94-955a-7d90c4a17ded"}, {"port": "0d561e16-be60-4fcd-9838-adb440165e4d", "tag": "port-1"}, {"port": "2408e0e9-b9b2-4b3e-b910-5848a5a8660c", "tag": "port-2"}, {"uuid": "31e99861-838f-4efd-8903-5cfc8275021c", "tag": "net-1"}, {"uuid": "31e99861-838f-4efd-8903-5cfc8275021c"}, {"uuid": "9927e969-73af-429d-ab3d-d3983a859514", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9927e969-73af-429d-ab3d-d3983a859514", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "abeedfdc-2c0b-462d-b76e-0c9f1c43a6a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7cbde764-5b9a-4936-a901-a1e78b134c25", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0bf4cb50-e11d-4e87-9ce9-02371e60c686", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--981224080"}], "key_name": "tempest-keypair-427085366", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:57.519978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:57.646148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] validate_networks() for [('7d965f03-65a6-4f94-955a-7d90c4a17ded', None, None, None, None, None), (None, None, '0d561e16-be60-4fcd-9838-adb440165e4d', None, None, None), (None, None, '2408e0e9-b9b2-4b3e-b910-5848a5a8660c', None, None, None), ('31e99861-838f-4efd-8903-5cfc8275021c', None, None, None, None, None), ('31e99861-838f-4efd-8903-5cfc8275021c', None, None, None, None, None), ('9927e969-73af-429d-ab3d-d3983a859514', '10.2.2.100', None, None, None, None), ('9927e969-73af-429d-ab3d-d3983a859514', '10.2.2.200', None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:12:57.835477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:57.848350 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-71ba40cc-24d0-4e5e-8e3e-b9d91fdc74d7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.672412 Oct 28 18:12:57.867791 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1232/2535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:57 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:57.875731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:57.879101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:57.886460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.886854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.887300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:57.888077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.889002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.889935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:58.475581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:58.491494 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a6b6c553-1421-4625-a402-95168edc5bf3 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1318 microversion: 2.1 time: 0.622161 Oct 28 18:12:58.493362 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1233/2536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:57 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:58.499090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4fbe00c6-4011-41e2-a0ea-0f8ba127c08b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de274b80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:58.602313 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4fbe00c6-4011-41e2-a0ea-0f8ba127c08b tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.107502 Oct 28 18:12:58.613837 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1234/2537] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:12:58 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:58.880713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:58.881957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:58.889954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:58.890705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:58.891694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:58.892721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:58.893624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:58.894274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:58.903643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:58.949444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:59.421789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:59.431344 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d9a88253-7f18-4a65-b855-b5b5fafdf36a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.557352 Oct 28 18:12:59.454062 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1235/2538] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:58 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:59.464521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9cd6a01d-d83c-4b6f-b7ea-d55fc39a38bf req-0814345f-d726-47e2-9f21-c1490f4be09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c09b4345-86e2-477d-a81e-f3c0c69aa329", "tag": "5a0dbef9-5dc4-41f9-816a-6e013f850f4e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:59.475763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9cd6a01d-d83c-4b6f-b7ea-d55fc39a38bf req-0814345f-d726-47e2-9f21-c1490f4be09b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:59.477475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9cd6a01d-d83c-4b6f-b7ea-d55fc39a38bf req-0814345f-d726-47e2-9f21-c1490f4be09b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:59.478430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9cd6a01d-d83c-4b6f-b7ea-d55fc39a38bf req-0814345f-d726-47e2-9f21-c1490f4be09b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:59.552931 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9cd6a01d-d83c-4b6f-b7ea-d55fc39a38bf req-0814345f-d726-47e2-9f21-c1490f4be09b service nova] Creating event network-changed:5a0dbef9-5dc4-41f9-816a-6e013f850f4e for instance c09b4345-86e2-477d-a81e-f3c0c69aa329 on n-h1-862404-2 Oct 28 18:12:59.558917 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9cd6a01d-d83c-4b6f-b7ea-d55fc39a38bf req-0814345f-d726-47e2-9f21-c1490f4be09b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099864 Oct 28 18:12:59.560296 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1236/2539] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:12:59.576910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:59.577916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:12:59.584699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:59.587482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:59.588004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:59.588820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:59.589737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:59.590458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:59.591046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:00.371395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:00.380121 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d2886744-7177-4ceb-be89-5ae382c06115 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1318 microversion: 2.1 time: 0.818249 Oct 28 18:13:00.400123 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1237/2540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:59 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1318 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:00.406538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-00ca77ae-f0a9-4638-9ecf-b95c4c81a74c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de567dc0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:00.513333 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-00ca77ae-f0a9-4638-9ecf-b95c4c81a74c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.110162 Oct 28 18:13:00.520162 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1238/2541] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:00 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:00.535529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4dd8b11d-1108-4b8e-b902-394cac27f678 req-42be9a23-fa8e-47bf-9334-60ea3204e2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c6fd04-db62-4518-9726-de061cb29c49", "name": "network-vif-unplugged", "status": "completed", "tag": "e328e141-4427-4198-8fef-00dcd59707ab"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:00.560679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4dd8b11d-1108-4b8e-b902-394cac27f678 req-42be9a23-fa8e-47bf-9334-60ea3204e2c0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:00.567263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4dd8b11d-1108-4b8e-b902-394cac27f678 req-42be9a23-fa8e-47bf-9334-60ea3204e2c0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:00.568027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4dd8b11d-1108-4b8e-b902-394cac27f678 req-42be9a23-fa8e-47bf-9334-60ea3204e2c0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:00.587903 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4dd8b11d-1108-4b8e-b902-394cac27f678 req-42be9a23-fa8e-47bf-9334-60ea3204e2c0 service nova] Creating event network-vif-unplugged:e328e141-4427-4198-8fef-00dcd59707ab for instance 88c6fd04-db62-4518-9726-de061cb29c49 on n-h2-862404-2 Oct 28 18:13:00.605886 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4dd8b11d-1108-4b8e-b902-394cac27f678 req-42be9a23-fa8e-47bf-9334-60ea3204e2c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084039 Oct 28 18:13:00.608460 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1239/2542] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:00.631692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:00.634667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:00.656307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:00.659275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:00.661888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:00.665832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:00.666597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:00.667254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:02.284135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:02.297595 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d6550c46-8b11-4afe-8a62-ff0afa1a5d83 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 1.686710 Oct 28 18:13:02.300689 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1240/2543] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:00 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:02.831307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1564985257", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:02.840934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:02.842595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:02.843383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:02.844504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:02.845090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:02.870380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:02.873477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:02.877224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:02.878387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:02.883634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:02.884935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:02.912139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Getting quotas for project eeb01cab48b5437cbbe52dea0a0b97e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:02.920400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Getting quotas for user b7af32e785674747a0c07d471e7f3aa1 and project eeb01cab48b5437cbbe52dea0a0b97e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:02.944114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:13:03.143785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:13:03.146798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='abeedfdc-2c0b-462d-b76e-0c9f1c43a6a7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7cbde764-5b9a-4936-a901-a1e78b134c25',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0bf4cb50-e11d-4e87-9ce9-02371e60c686',volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:13:03.706126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:03.706651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:03.707307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:03.707731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:03.709090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:03.721286 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51665b15-1017-442a-8e0e-19575c8ba8cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.286493 Oct 28 18:13:03.722907 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1304/2544] 10.222.0.16 () {62 vars in 1189 bytes} [Fri Oct 28 18:12:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 6290 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:13:03.738020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:03.738960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:03.743693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:03.744270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:03.744721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:03.747173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:03.748174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:03.749094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:03.749656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:03.750583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:03.751405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:03.751546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:03.752034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:03.753334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:03.824135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:03.836000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:03.866959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:13:03.869646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:13:03.949470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74ed6bcf-950a-4915-b4a8-ba2abe3cbe68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643349 Oct 28 18:13:03.958891 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1241/2545] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:13:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:13:03.964298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8824fdfc-7a87-41fe-9e3b-a855eedfe400 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de561160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:04.060987 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8824fdfc-7a87-41fe-9e3b-a855eedfe400 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.100642 Oct 28 18:13:04.061930 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1242/2546] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:03 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:04.073773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:04.074480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:04.089633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:04.090181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:04.090629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:04.096771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:04.097279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:04.097732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:04.099716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:04.110230 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4dbf4d7-582a-4004-91f0-881df5f036b2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1318 microversion: 2.1 time: 0.385949 Oct 28 18:13:04.113562 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1305/2547] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:03 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:04.143453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae69aab7-d478-4616-9823-89910d6fbe60 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:04.146970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae69aab7-d478-4616-9823-89910d6fbe60 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:04.563526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae69aab7-d478-4616-9823-89910d6fbe60 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:04.581809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae69aab7-d478-4616-9823-89910d6fbe60 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:04.583476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae69aab7-d478-4616-9823-89910d6fbe60 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:04.600279 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae69aab7-d478-4616-9823-89910d6fbe60 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1285 microversion: 2.32 time: 0.473758 Oct 28 18:13:04.601993 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1306/2548] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:04 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1285 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:04.616545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72ca31a5-fdc4-4ba3-868f-7ba986ae0553 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:04.617631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72ca31a5-fdc4-4ba3-868f-7ba986ae0553 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:04.696607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:04.706796 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-371c145e-9deb-4d5f-8899-a9e9f65ef12c tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.640023 Oct 28 18:13:04.721208 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1243/2549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:04 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:04.732659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-edb6b65d-ccad-4eeb-8456-727c843b3735 req-7e3ea10b-9662-48b4-ba2c-1c1b501f073c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8148f1bc-d908-4fa0-bd92-aad5464fe069", "name": "network-vif-plugged", "status": "completed", "tag": "b21e0da3-68f8-41b1-9a87-d0036283bcfe"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:04.773559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-edb6b65d-ccad-4eeb-8456-727c843b3735 req-7e3ea10b-9662-48b4-ba2c-1c1b501f073c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:04.774432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-edb6b65d-ccad-4eeb-8456-727c843b3735 req-7e3ea10b-9662-48b4-ba2c-1c1b501f073c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:04.777449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-edb6b65d-ccad-4eeb-8456-727c843b3735 req-7e3ea10b-9662-48b4-ba2c-1c1b501f073c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:04.816665 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-edb6b65d-ccad-4eeb-8456-727c843b3735 req-7e3ea10b-9662-48b4-ba2c-1c1b501f073c service nova] Creating event network-vif-plugged:b21e0da3-68f8-41b1-9a87-d0036283bcfe for instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 on n-h1-862404-2 Oct 28 18:13:04.822729 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-edb6b65d-ccad-4eeb-8456-727c843b3735 req-7e3ea10b-9662-48b4-ba2c-1c1b501f073c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099844 Oct 28 18:13:04.823576 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1244/2550] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:04.936023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72ca31a5-fdc4-4ba3-868f-7ba986ae0553 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:04.949124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72ca31a5-fdc4-4ba3-868f-7ba986ae0553 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1217 microversion: 2.1 time: 0.345838 Oct 28 18:13:04.953552 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1307/2551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:04 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:05.077230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b951febf-1492-445f-940c-d938ef420f94 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de25d5e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:05.126290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-930021af-2a70-4c97-a21b-b20291ea78fa tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Action: 'create', calling method: .version_select at 0x7f78de9a5160>, body: {"keypair": {"name": "tempest-keypair-2112323796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2CBoDcV6/HppoqD/Cpsw6h1yXRnrTGLF4B0dxYtJp5Fuv6uZRx2pO5OuCNPD2xpJxn+W1V4AaNNp3fDcQnG2ltYBRmX3/A7OPQcucDTpihaIgBqpxKzOpER3BlWgg/4A=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:05.168160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-930021af-2a70-4c97-a21b-b20291ea78fa tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Getting quotas for project 1dce2688e04f4361a8b53cc82365cc36. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:05.179149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-930021af-2a70-4c97-a21b-b20291ea78fa tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Getting quotas for user 9be4e90ef137492fac6fcecbed44ee92 and project 1dce2688e04f4361a8b53cc82365cc36. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:05.179360 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b951febf-1492-445f-940c-d938ef420f94 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.106013 Oct 28 18:13:05.183800 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1308/2552] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:05 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:05.198816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:05.199757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:05.209774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:05.211235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:05.212174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:05.213267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:05.214030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:05.214827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:05.272677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-930021af-2a70-4c97-a21b-b20291ea78fa tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.447590 Oct 28 18:13:05.275857 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1245/2553] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:13:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:05.632217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8886ed28-668b-4288-99e0-4c27597eff2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:05.635699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8886ed28-668b-4288-99e0-4c27597eff2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:06.040326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8886ed28-668b-4288-99e0-4c27597eff2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:06.053402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8886ed28-668b-4288-99e0-4c27597eff2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:06.058793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8886ed28-668b-4288-99e0-4c27597eff2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:06.061859 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8886ed28-668b-4288-99e0-4c27597eff2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1285 microversion: 2.32 time: 0.433749 Oct 28 18:13:06.076123 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1246/2554] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:05 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1285 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:06.089190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:06.089742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:06.099486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:06.100160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:06.100708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:06.101839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:06.102589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:06.103247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:06.247287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:06.267781 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61f20126-958a-4547-b132-938255425536 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1318 microversion: 2.1 time: 1.080709 Oct 28 18:13:06.294370 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1309/2555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:05 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1318 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:06.300921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:06.302131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:06.310292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:06.312360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:06.313119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:06.314705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:06.315552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:06.316250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:06.446740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:06.456798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39cdeba1-ccac-4703-8346-b595b0f07a72 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1269 microversion: 2.1 time: 0.160283 Oct 28 18:13:06.478606 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1310/2556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:06 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:06.485909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f80c549f-84db-401e-8831-5a792e8ccf33 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de31faf0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:06.579069 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f80c549f-84db-401e-8831-5a792e8ccf33 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.098035 Oct 28 18:13:06.582159 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1311/2557] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:06 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:06.716082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:06.727217 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7e396f4f-93fc-4498-9512-ee5de4898afd tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.648600 Oct 28 18:13:06.746862 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1247/2558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:06 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:06.939554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2d279cb-013c-4194-8e2d-cbf6dae7e7cf tempest-QuotaClassesAdmin257Test-2089876082 tempest-QuotaClassesAdmin257Test-2089876082-project-admin] Calling method '.version_select at 0x7f78de24c820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:06.962148 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2d279cb-013c-4194-8e2d-cbf6dae7e7cf tempest-QuotaClassesAdmin257Test-2089876082 tempest-QuotaClassesAdmin257Test-2089876082-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.378162 Oct 28 18:13:06.963509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1312/2559] 10.222.0.16 () {60 vars in 1226 bytes} [Fri Oct 28 18:13:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:13:06.977136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e075be1d-3095-4c03-a7b1-92824cb2edf8 tempest-QuotaClassesAdmin257Test-2089876082 tempest-QuotaClassesAdmin257Test-2089876082-project-admin] Action: 'update', calling method: .version_select at 0x7f78dee26670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:07.102525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:07.103163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:07.109990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:07.111983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:07.113836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:07.120182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:07.123569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:07.124233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:07.189625 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e075be1d-3095-4c03-a7b1-92824cb2edf8 tempest-QuotaClassesAdmin257Test-2089876082 tempest-QuotaClassesAdmin257Test-2089876082-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.216707 Oct 28 18:13:07.191324 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1248/2560] 10.222.0.16 () {62 vars in 1247 bytes} [Fri Oct 28 18:13:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:13:07.211024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-10fc450a-174e-4b22-8457-47bd8ea20d96 tempest-QuotaClassesAdmin257Test-2089876082 tempest-QuotaClassesAdmin257Test-2089876082-project-admin] Calling method '.version_select at 0x7f78ddbd7ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:07.221292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:07.227196 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-10fc450a-174e-4b22-8457-47bd8ea20d96 tempest-QuotaClassesAdmin257Test-2089876082 tempest-QuotaClassesAdmin257Test-2089876082-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027494 Oct 28 18:13:07.236074 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1249/2561] 10.222.0.16 () {60 vars in 1226 bytes} [Fri Oct 28 18:13:07 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:13:07.242289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5cc97c10-2da6-4614-8196-802c23b8f1ee tempest-QuotaClassesAdmin257Test-2089876082 tempest-QuotaClassesAdmin257Test-2089876082-project-admin] Action: 'update', calling method: .version_select at 0x7f78de2b11f0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:07.367928 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5cc97c10-2da6-4614-8196-802c23b8f1ee tempest-QuotaClassesAdmin257Test-2089876082 tempest-QuotaClassesAdmin257Test-2089876082-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.130108 Oct 28 18:13:07.369164 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1250/2562] 10.222.0.16 () {62 vars in 1247 bytes} [Fri Oct 28 18:13:07 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:13:07.386352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:07.388222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:07.398179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:07.408358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:07.409165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:07.409875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:07.411043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:07.411708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:07.412575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:07.421193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:07.422725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:07.424305 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8161c99-8568-47a6-b9ae-05e93288170f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1575 microversion: 2.32 time: 0.325723 Oct 28 18:13:07.425049 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1313/2563] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:07 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1575 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:13:07.492906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:07.493459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:07.510106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:07.512391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:07.513685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:07.516104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:07.517805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:07.520680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:08.040875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:08.066535 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2907b3dc-73e7-4476-a23d-e1bd4af83288 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1275 microversion: 2.1 time: 0.573950 Oct 28 18:13:08.067241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1314/2564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:07 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1275 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:08.095091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6caae50c-6bae-48b8-b49f-2968ed93f092 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de0e2ee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:08.184859 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6caae50c-6bae-48b8-b49f-2968ed93f092 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.113244 Oct 28 18:13:08.185487 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1315/2565] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:08 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:08.202128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:08.202762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:08.222152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:08.223203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:08.223751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:08.224860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:08.225561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:08.226209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:08.478158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:08.491496 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a845fcf2-2a4c-49dd-8148-2802724b19b0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1318 microversion: 2.1 time: 1.120159 Oct 28 18:13:08.500003 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1251/2566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:07 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1318 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:08.509551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:08.524816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:08.541002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:08.545656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:08.546962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:08.549185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:08.552204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:08.552842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:08.925659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:08.933801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3fbf3f9-6135-4adb-bdca-36dbf2c44b82 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.736812 Oct 28 18:13:08.934389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1316/2567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:08 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:08.955194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b2fd993d-18ca-42bc-ba34-fad17e37461b req-fb9bd56f-db9d-401a-916d-0bdcb0788cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09b4345-86e2-477d-a81e-f3c0c69aa329", "name": "network-vif-plugged", "status": "completed", "tag": "5a0dbef9-5dc4-41f9-816a-6e013f850f4e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:09.002975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b2fd993d-18ca-42bc-ba34-fad17e37461b req-fb9bd56f-db9d-401a-916d-0bdcb0788cf6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.003459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b2fd993d-18ca-42bc-ba34-fad17e37461b req-fb9bd56f-db9d-401a-916d-0bdcb0788cf6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.003926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b2fd993d-18ca-42bc-ba34-fad17e37461b req-fb9bd56f-db9d-401a-916d-0bdcb0788cf6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:09.015344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:09.036183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:09.044088 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b2fd993d-18ca-42bc-ba34-fad17e37461b req-fb9bd56f-db9d-401a-916d-0bdcb0788cf6 service nova] Creating event network-vif-plugged:5a0dbef9-5dc4-41f9-816a-6e013f850f4e for instance c09b4345-86e2-477d-a81e-f3c0c69aa329 on n-h1-862404-2 Oct 28 18:13:09.044376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:09.050350 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0ec12f59-6ebb-465b-86a0-4d79ea09116c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1593 microversion: 2.32 time: 0.542361 Oct 28 18:13:09.051007 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1252/2568] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:08 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1593 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:09.062713 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b2fd993d-18ca-42bc-ba34-fad17e37461b req-fb9bd56f-db9d-401a-916d-0bdcb0788cf6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115981 Oct 28 18:13:09.070036 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1317/2569] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:09.099107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:09.100128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:09.113373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.115177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.118156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:09.118978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.120192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.120649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:09.202279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c8c5de8-b66a-494a-a644-31f2ad672824 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de31f820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:09.305492 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c8c5de8-b66a-494a-a644-31f2ad672824 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.108118 Oct 28 18:13:09.306107 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1318/2570] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:09 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:09.524350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:09.525107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:09.568223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.570969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.574947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:09.578928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.580566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.581027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:09.898161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:09.908967 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3c7e33b5-9f0d-42ad-ac19-dcc425397211 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1275 microversion: 2.1 time: 0.816837 Oct 28 18:13:09.909716 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1253/2571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:09 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1275 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:09.964845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:09.965815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:09.975860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.978900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.979451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:09.980447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.982682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.983785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:10.134486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:10.146783 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fcfefc75-6bc1-4c41-b694-597073dad9cb tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1318 microversion: 2.1 time: 0.623904 Oct 28 18:13:10.159847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1319/2572] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:09 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:10.161146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:10.166518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:10.185066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:10.185756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:10.186204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:10.186930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:10.187389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:10.187845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:10.340628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:10.355435 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a782fcd0-c33f-416a-95f8-a4d42e6841e0 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.397047 Oct 28 18:13:10.356112 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1254/2573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:09 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:10.361109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4a65b0a5-66c4-4ea6-af35-d7bd0664fa2e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de2b1d30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:10.443686 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4a65b0a5-66c4-4ea6-af35-d7bd0664fa2e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.086123 Oct 28 18:13:10.445296 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1255/2574] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:10 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:10.590779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:10.616538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:10.630364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:10.631805 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96d2ebdf-03aa-450f-8783-a238f0b5c681 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1593 microversion: 2.32 time: 0.480762 Oct 28 18:13:10.637371 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1320/2575] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:10 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1593 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:10.935714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:10.936544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:10.958375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:10.964150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:10.964687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:10.966316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:10.970548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:10.972004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:11.177620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:11.178833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:11.205343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:11.210521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:11.211422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:11.213069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:11.214508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:11.215098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:11.512601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:11.515147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:11.522702 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-30736bba-0f27-4b74-a890-dfdcfc6ba1fe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1317 microversion: 2.1 time: 0.591949 Oct 28 18:13:11.526978 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1256/2576] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:10 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:11.531875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:11.533241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:11.560545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:11.567466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:11.571493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:11.574334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:11.576375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:11.578148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:11.957518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:11.971238 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41cf6539-ff54-422e-96ba-b044f6fa2eb2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1318 microversion: 2.1 time: 0.796895 Oct 28 18:13:11.991710 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1321/2577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:11 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1318 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:11.996980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf9c6dc7-34f7-4b74-8199-dd5c80bf997d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de0525e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:12.020436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:12.033630 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4517f484-3697-4df6-9293-c88607922c15 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.504779 Oct 28 18:13:12.035278 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1257/2578] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:11 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:12.050180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:12.057169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:12.073787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:12.077200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:12.078136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:12.079177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:12.082733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:12.083590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:12.130579 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf9c6dc7-34f7-4b74-8199-dd5c80bf997d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.131000 Oct 28 18:13:12.135902 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1322/2579] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:11 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:12.159919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "17d67c49-b21d-4a7d-b8a6-ecdc7326cba3"}], "security_groups": [{"name": "tempest-securitygroup--737066966"}], "key_name": "tempest-keypair-2112323796", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:12.507065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] validate_networks() for [('17d67c49-b21d-4a7d-b8a6-ecdc7326cba3', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:13:12.565978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:12.609067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:12.611800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:12.613289 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79fc5b8c-5139-4387-bf09-9ca84ebfc370 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1660 microversion: 2.32 time: 0.571157 Oct 28 18:13:12.614522 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1258/2580] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:12 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1660 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:12.631790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:12.632699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:12.639472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:12.644539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:12.645209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:12.646139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:12.646758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:12.647357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:12.900175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:13.110635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:13.129188 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5334f346-f519-4103-9854-2d74043ebff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1317 microversion: 2.1 time: 0.510844 Oct 28 18:13:13.130319 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1259/2581] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:12 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:13.150142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:13.160730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:13.163374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=14 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:13.171223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:13.172069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:13.172672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:13.174174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:13.174789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:13.175407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:13.621052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:13.645002 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22de61f2-7e92-4dfb-a92c-27e478b94656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1509 microversion: 2.1 time: 0.511978 Oct 28 18:13:13.647577 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1260/2582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:13 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1509 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:13.652294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:13.656713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:13.667052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:13.668796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:13.669646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:13.671627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:13.673135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:13.674090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:13.781700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:14.229846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:14.254013 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-681f5bcc-3292-4fd3-8242-6da5aea97f0d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.602610 Oct 28 18:13:14.260206 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1261/2583] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:13 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:14.282463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25246244-9431-4bfd-b2f7-0b8ead45df3c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de5119d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:14.406599 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25246244-9431-4bfd-b2f7-0b8ead45df3c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.143259 Oct 28 18:13:14.410554 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1262/2584] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:14 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:14.415664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4f8924b1-8e13-4b00-932a-f7cae3c06a40 req-612b7e45-6889-4ea5-9e85-d5627ab7cd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482db24a-f4e1-401d-8ace-4a3c5b673e66", "tag": "652cd558-3e8c-4c0f-9be9-e79d47a568ea"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:14.435027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4f8924b1-8e13-4b00-932a-f7cae3c06a40 req-612b7e45-6889-4ea5-9e85-d5627ab7cd94 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:14.436376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4f8924b1-8e13-4b00-932a-f7cae3c06a40 req-612b7e45-6889-4ea5-9e85-d5627ab7cd94 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:14.437021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4f8924b1-8e13-4b00-932a-f7cae3c06a40 req-612b7e45-6889-4ea5-9e85-d5627ab7cd94 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:14.466871 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4f8924b1-8e13-4b00-932a-f7cae3c06a40 req-612b7e45-6889-4ea5-9e85-d5627ab7cd94 service nova] Creating event network-changed:652cd558-3e8c-4c0f-9be9-e79d47a568ea for instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 on n-h2-862404-2 Oct 28 18:13:14.474578 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4f8924b1-8e13-4b00-932a-f7cae3c06a40 req-612b7e45-6889-4ea5-9e85-d5627ab7cd94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062462 Oct 28 18:13:14.475797 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1263/2585] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:14.484176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:14.491480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:14.502262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:14.502944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:14.504167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:14.511294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:14.512164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:14.512907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:14.840066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:14.841326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:14.842206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:14.842787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:14.843381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:14.866039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:14.874293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:14.875502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:14.879134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:14.884194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:14.885412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:14.964572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Getting quotas for project 1dce2688e04f4361a8b53cc82365cc36. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:14.979928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Getting quotas for user 9be4e90ef137492fac6fcecbed44ee92 and project 1dce2688e04f4361a8b53cc82365cc36. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:14.981983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:14.996763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:15.005416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:15.009328 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4a6b7ae7-5574-4576-b0f5-794b551c7fc8 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1706 microversion: 2.32 time: 0.529581 Oct 28 18:13:15.011450 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1264/2586] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:14 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1706 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:15.035794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:15.037552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:15.056476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:13:15.057198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:15.058429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:15.058429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:15.065310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:15.065310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:15.065310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:15.070249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:13:15.208914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f3d0660-cdbf-40fe-9908-3b446ae4844b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.070193 Oct 28 18:13:15.221249 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1323/2587] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:13:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 3085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:13:15.231454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:15.232209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:15.243941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:15.244368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:15.244816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:15.247878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:15.252082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:15.252820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:15.740848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:15.754664 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8bcc56d2-f61c-4969-a8f9-da53d7c8b72a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1509 microversion: 2.1 time: 0.740798 Oct 28 18:13:15.767853 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1265/2588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:15 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1509 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:15.767853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0c5671e-121b-4ac8-8e95-0b28aabe4b46 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:15.767853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e0c5671e-121b-4ac8-8e95-0b28aabe4b46 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:15.936415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e0c5671e-121b-4ac8-8e95-0b28aabe4b46 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:15.953440 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e0c5671e-121b-4ac8-8e95-0b28aabe4b46 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1226 microversion: 2.1 time: 0.192558 Oct 28 18:13:15.973371 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1266/2589] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:15 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1226 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:15.981830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:15.982931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:15.999200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:16.001604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:16.003007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:16.004869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:16.010394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:16.011368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:16.177120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:16.191697 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba90ca9f-49c8-4c25-ba50-0bef0fce0e3d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1317 microversion: 2.1 time: 0.969214 Oct 28 18:13:16.193600 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1324/2590] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:15 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1317 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:16.211232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-925d138f-1f75-4e6b-9abf-3c1c3d2c0f98 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de4ca040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:16.294568 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-925d138f-1f75-4e6b-9abf-3c1c3d2c0f98 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.099701 Oct 28 18:13:16.295624 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1325/2591] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:16 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:16.317072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:16.323604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:16.371094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:16.377798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:16.381899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:16.382874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:16.386844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:16.390379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:16.615035 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf52b225-6e59-4a42-b14f-2749d9eab05c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "PUT /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1081 microversion: 2.1 time: 0.317881 Oct 28 18:13:16.628448 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1326/2592] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:13:16 2022] PUT /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1081 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:16.642790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:16.645303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:16.661580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:16.664874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:16.666887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:16.670335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:16.670972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:16.672634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:16.672814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:16.682599 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f97f6f32-5cab-4fb6-9827-8e80991e24af tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.707148 Oct 28 18:13:16.683221 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1267/2593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:15 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:16.926137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9a656d8-002e-4950-b70f-09e2bf1796c6 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Calling method '.version_select at 0x7f78de2b1d30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:17.076934 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d9a656d8-002e-4950-b70f-09e2bf1796c6 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 371 microversion: 2.1 time: 0.388564 Oct 28 18:13:17.079160 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1268/2594] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:13:16 2022] GET /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:17.090979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:17.091804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:17.112133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.112870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.113500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.114374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.115005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.115589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.291351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:17.306527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:17.309627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:17.315608 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a0d35e3-3c73-42d1-a9b7-92fbeab8e84d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1752 microversion: 2.32 time: 0.685764 Oct 28 18:13:17.317913 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1327/2595] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:16 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1752 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:17.328210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:17.329882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:17.348575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.349355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.350237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.351122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.354824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.355408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.468284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:17.482556 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5073c52b-b430-4f36-9402-fa8c739a9210 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1507 microversion: 2.1 time: 0.400755 Oct 28 18:13:17.483922 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1269/2596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:17 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:17.498563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04dab601-0f0e-4bfb-89ce-ed3c09dd3f6d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Action: 'update', calling method: .version_select at 0x7f78de2abc10>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:17.553669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:17.564246 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9105d2f-8a10-4a3e-bebf-9a3933e7ab2a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1278 microversion: 2.1 time: 0.244559 Oct 28 18:13:17.565252 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1328/2597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:17 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:17.570265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:17.570897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:17.581243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.581997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.582712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.583609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.584260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.585861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.721178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04dab601-0f0e-4bfb-89ce-ed3c09dd3f6d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.724990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04dab601-0f0e-4bfb-89ce-ed3c09dd3f6d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.726955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04dab601-0f0e-4bfb-89ce-ed3c09dd3f6d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.730955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04dab601-0f0e-4bfb-89ce-ed3c09dd3f6d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.731627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04dab601-0f0e-4bfb-89ce-ed3c09dd3f6d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.734505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04dab601-0f0e-4bfb-89ce-ed3c09dd3f6d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.874098 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04dab601-0f0e-4bfb-89ce-ed3c09dd3f6d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 328 microversion: 2.1 time: 0.388590 Oct 28 18:13:17.878726 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1270/2598] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:13:17 2022] PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 328 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:17.887022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11619925-8c0d-48fc-b089-da61d0bb4227 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de2795e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:18.012739 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11619925-8c0d-48fc-b089-da61d0bb4227 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.132413 Oct 28 18:13:18.014511 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1271/2599] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:17 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:18.037536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:18.040080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:18.075121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:18.076270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:18.077373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:18.079342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:18.080933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:18.081585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:18.281967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:18.299286 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07bcc41e-e1f4-4e7a-8bc9-da7b490f341f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1317 microversion: 2.1 time: 0.730643 Oct 28 18:13:18.301907 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1329/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:17 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:18.316471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:18.321094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:18.341308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:18.341758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:18.344179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:18.347872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:18.348585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:18.351253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:18.594029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:18.608921 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-18b095d9-29c0-4067-abe6-1bdcaec80476 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1507 microversion: 2.1 time: 0.592184 Oct 28 18:13:18.623873 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1272/2601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:18 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1507 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:18.792997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-852012703", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:18.884647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:13:19.077464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:19.093788 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef9a24c4-8ba9-4f2b-8c4c-5b2945dd2b7d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1473 microversion: 2.1 time: 0.787888 Oct 28 18:13:19.094605 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1330/2602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:18 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1473 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:19.099431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:19.112286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:19.167996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:19.168513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:19.169175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:19.170037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:19.170371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:19.170800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:19.742934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:19.754661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:19.759737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:19.764602 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb50871b-88ea-4f9e-be29-3dcc10eb04f3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1798 microversion: 2.32 time: 0.666518 Oct 28 18:13:19.768362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1331/2603] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:19 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1798 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:19.798288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:19.800456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:19.826036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:19.830720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:19.837497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:19.839611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:19.843450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:19.844009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.032719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:20.033517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:20.033612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:20.034024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:20.034440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:20.052784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.053302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.053760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.054537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.056893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.067982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.144311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Getting quotas for project 7739369a403245b5a6372651d76b2c05. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:20.155208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Getting quotas for user f227bb0c5fa24780ba3d4a8f4d955ded and project 7739369a403245b5a6372651d76b2c05. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:20.191756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.utils [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] cores quota exceeded for 7739369a403245b5a6372651d76b2c05, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120679) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 18:13:20.192660 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Request method failure captured: Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 144 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBu6YsatldwgtDgPlLPPkvNgAkU4u46ohCd8Zo9BgVDYoLaDQsNPMNaAjjWYWrD1O_aQGu_QpVYhXaFNk49cUAStLAeTtDJnSHCULYMYbxFeqBt_yTq2DSomcgtnI98g5b3I6FWJys0A3B3o5mykR3Swu6wyIdr5NmAxnAEboHphywM Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 7739369a403245b5a6372651d76b2c05 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7739369a403245b5a6372651d76b2c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7739369a403245b5a6372651d76b2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7739369a403245b5a6372651d76b2c05", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7739369a403245b5a6372651d76b2c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 7739369a403245b5a6372651d76b2c05 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-QuotasAdminNegativeTest-1164257173-project Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: f227bb0c5fa24780ba3d4a8f4d955ded Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-QuotasAdminNegativeTest-1164257173-project Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-852012703", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-852012703', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452'}}} Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 18:13:20.206270 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 18:13:20.210728 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:20.214618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:20.215677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-16b666ca-8ba6-471a-b81c-ca1b307a24fe tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.603627 Oct 28 18:13:20.220121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1273/2604] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:13:18 2022] POST /compute/v2.1/servers => generated 111 bytes in 1609 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:20.231366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:20.238280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:20.258935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.262237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.262900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.265619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.266275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.270858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.370726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:20.384930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c72b9b40-1806-4d17-8a70-324982e6c06a tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 0.613471 Oct 28 18:13:20.387318 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1332/2605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:19 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:20.399053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d12c72f-e262-4943-8925-1cb845655e24 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de0520d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:20.446800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:20.452038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:20.453172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:20.458746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:20.459380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:20.544356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d12c72f-e262-4943-8925-1cb845655e24 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.153837 Oct 28 18:13:20.545393 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1333/2606] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:20 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:20.559095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:20.560078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:20.581100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.581928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.582564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.584350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.585892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.591039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.713088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:20.749377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.754079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.755100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.756552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.758740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.760229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.809133 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-acc9afb0-bd3d-4265-b2fd-94efaa47e5a5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "POST /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329/action" status: 202 len: 1113 microversion: 2.1 time: 0.587675 Oct 28 18:13:20.809804 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1274/2607] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:13:20 2022] POST /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329/action => generated 1113 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 18:13:20.832871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:20.833398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:20.842098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.842609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.843053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.843948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.844657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.845851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:21.137154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:21.151631 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e7e471e-1aee-4126-bfc3-31d127c90646 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1479 microversion: 2.1 time: 0.320906 Oct 28 18:13:21.152509 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1275/2608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:20 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1479 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:21.179951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6bf7ea34-3ca7-4320-b90b-9268f8edb7a3 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Action: 'update', calling method: .version_select at 0x7f78de5119d0>, body: {"quota_set": {"cores": 20}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:21.288260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bf7ea34-3ca7-4320-b90b-9268f8edb7a3 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:21.288754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bf7ea34-3ca7-4320-b90b-9268f8edb7a3 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:21.289195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bf7ea34-3ca7-4320-b90b-9268f8edb7a3 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:21.292255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bf7ea34-3ca7-4320-b90b-9268f8edb7a3 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:21.293656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bf7ea34-3ca7-4320-b90b-9268f8edb7a3 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:21.294435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bf7ea34-3ca7-4320-b90b-9268f8edb7a3 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:21.346744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:21.394681 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4247c1a-1a45-465c-a8e9-157cfeb2efe2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1317 microversion: 2.1 time: 0.846040 Oct 28 18:13:21.410404 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6bf7ea34-3ca7-4320-b90b-9268f8edb7a3 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 329 microversion: 2.1 time: 0.236651 Oct 28 18:13:21.411139 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1276/2609] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:13:21 2022] PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 329 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:21.414094 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1334/2610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:20 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:21.440587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:21.443164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:21.447738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:21.451895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:21.456785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:21.460074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:21.460593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:21.461695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:21.462116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:21.462574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:21.490512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:21.493406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:21.495084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:21.496177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:21.505629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:21.507298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:21.922841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:21.934229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:21.941745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:21.944939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7802434e-3e04-450e-bcb4-b87e4b40bcbc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1798 microversion: 2.32 time: 0.516087 Oct 28 18:13:21.950563 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1277/2611] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:21 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1798 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:21.956246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:21.968880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:21.984869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:21.991127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:21.996177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:21.997315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:21.997944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:21.999012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:22.016608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:22.190835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:22.193519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:22.205064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-12f29b98-30b4-4545-9892-422f1c469ed7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 0.788977 Oct 28 18:13:22.209760 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1335/2612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:21 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:22.217532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-188ce159-2d75-46e8-a7ad-0fc20c3bc22c tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Calling method '.version_select at 0x7f78de6c79d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:22.381864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-188ce159-2d75-46e8-a7ad-0fc20c3bc22c tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 371 microversion: 2.1 time: 0.165311 Oct 28 18:13:22.389866 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1336/2613] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:13:22 2022] GET /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:22.405997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df30881a-fa17-48e1-b67c-f5c1f4df2013 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de0bd1f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:22.493618 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df30881a-fa17-48e1-b67c-f5c1f4df2013 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.102468 Oct 28 18:13:22.496813 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1337/2614] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:22 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:22.514462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:22.515804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:22.540807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:22.543191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:22.545553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:22.551320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:22.554041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:22.555601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:22.710332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:22.720644 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50b122da-51d5-471e-ac32-7c567ccd6c6b tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 0.768511 Oct 28 18:13:22.726255 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1278/2615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:21 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:22.754201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b9360c3-ce47-4dcc-b5d8-911a28a8421d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Action: 'update', calling method: .version_select at 0x7f78de2ab3a0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:22.930991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9360c3-ce47-4dcc-b5d8-911a28a8421d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:22.937295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9360c3-ce47-4dcc-b5d8-911a28a8421d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:22.942146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9360c3-ce47-4dcc-b5d8-911a28a8421d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:22.947219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9360c3-ce47-4dcc-b5d8-911a28a8421d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:22.950785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9360c3-ce47-4dcc-b5d8-911a28a8421d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:22.953154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9360c3-ce47-4dcc-b5d8-911a28a8421d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.234803 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6b9360c3-ce47-4dcc-b5d8-911a28a8421d tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 328 microversion: 2.1 time: 0.504557 Oct 28 18:13:23.240505 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1279/2616] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:13:22 2022] PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 328 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:23.261347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:23.262486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:23.273673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:23.274610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:23.275298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.276714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:23.277404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:23.278016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.346893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:23.362761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9fc06cb1-7093-47a6-bb1f-2d79dff75ef3 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1479 microversion: 2.1 time: 0.863308 Oct 28 18:13:23.363537 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1338/2617] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:22 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1479 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:23.368290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-491284e7-6c4b-4381-8aa4-8d3ed6a1ed4e req-d1d9dcd1-450a-44f6-bd59-38c842373588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482db24a-f4e1-401d-8ace-4a3c5b673e66", "name": "network-vif-plugged", "status": "completed", "tag": "652cd558-3e8c-4c0f-9be9-e79d47a568ea"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:23.389882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-491284e7-6c4b-4381-8aa4-8d3ed6a1ed4e req-d1d9dcd1-450a-44f6-bd59-38c842373588 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:23.394526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-491284e7-6c4b-4381-8aa4-8d3ed6a1ed4e req-d1d9dcd1-450a-44f6-bd59-38c842373588 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:23.395236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-491284e7-6c4b-4381-8aa4-8d3ed6a1ed4e req-d1d9dcd1-450a-44f6-bd59-38c842373588 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.411887 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-491284e7-6c4b-4381-8aa4-8d3ed6a1ed4e req-d1d9dcd1-450a-44f6-bd59-38c842373588 service nova] Creating event network-vif-plugged:652cd558-3e8c-4c0f-9be9-e79d47a568ea for instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 on n-h2-862404-2 Oct 28 18:13:23.423532 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-491284e7-6c4b-4381-8aa4-8d3ed6a1ed4e req-d1d9dcd1-450a-44f6-bd59-38c842373588 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058442 Oct 28 18:13:23.425030 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1339/2618] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:23.435016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:23.436082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:23.455335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:23.456243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:23.456910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.457876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:23.458560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:23.459234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.733055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:23.746712 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e50498f-8331-496a-b7db-d1c74482f763 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1317 microversion: 2.1 time: 0.505092 Oct 28 18:13:23.748037 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1280/2619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:23 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:23.758400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f760e3a9-9585-4ce1-867f-f00735498feb req-fe2b580d-43d4-411d-8737-0e2ca7d78b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "044272e7-257b-4504-ab1b-90435d93d21d", "tag": "5dbb710a-7d49-4881-9824-24c2aa5ca847"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:23.779326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f760e3a9-9585-4ce1-867f-f00735498feb req-fe2b580d-43d4-411d-8737-0e2ca7d78b4c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:23.785200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f760e3a9-9585-4ce1-867f-f00735498feb req-fe2b580d-43d4-411d-8737-0e2ca7d78b4c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:23.785791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f760e3a9-9585-4ce1-867f-f00735498feb req-fe2b580d-43d4-411d-8737-0e2ca7d78b4c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.810367 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f760e3a9-9585-4ce1-867f-f00735498feb req-fe2b580d-43d4-411d-8737-0e2ca7d78b4c service nova] Creating event network-changed:5dbb710a-7d49-4881-9824-24c2aa5ca847 for instance 044272e7-257b-4504-ab1b-90435d93d21d on n-h1-862404-2 Oct 28 18:13:23.824185 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f760e3a9-9585-4ce1-867f-f00735498feb req-fe2b580d-43d4-411d-8737-0e2ca7d78b4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070982 Oct 28 18:13:23.825645 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1281/2620] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:23.848385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:23.849233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:23.855763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:23.856210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:23.856636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.857344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:23.857793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:23.858213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:23.877463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:23.892614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:23.899229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:23.900903 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-637b77be-75b2-459f-99a0-46383f483b74 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1844 microversion: 2.32 time: 0.474480 Oct 28 18:13:23.906554 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1340/2621] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:23 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1844 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:23.915602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-766700004", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:24.050360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:13:24.278948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:24.288356 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-16e66164-096e-4914-882d-4c1fc6c77314 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 0.461406 Oct 28 18:13:24.292812 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1282/2622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:23 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:24.299766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c1429000-5716-4e69-b9b2-0f45f3218580 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de257ca0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:24.403409 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c1429000-5716-4e69-b9b2-0f45f3218580 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.109269 Oct 28 18:13:24.404307 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1283/2623] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:24 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:24.410532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:24.411544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:24.423498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:24.424345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:24.424934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:24.425869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:24.427997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:24.428433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:24.828417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:24.829012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:24.829363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:24.829984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:24.830430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:24.847240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:24.847743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:24.851930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:24.852802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:24.853289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:24.853726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:24.890140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:24.903972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Getting quotas for project 7739369a403245b5a6372651d76b2c05. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:24.917154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Getting quotas for user f227bb0c5fa24780ba3d4a8f4d955ded and project 7739369a403245b5a6372651d76b2c05. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:24.951708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.utils [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] instances quota exceeded for 7739369a403245b5a6372651d76b2c05, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120680) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 18:13:24.955953 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Request method failure captured: Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 144 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBu6YsatldwgtDgPlLPPkvNgAkU4u46ohCd8Zo9BgVDYoLaDQsNPMNaAjjWYWrD1O_aQGu_QpVYhXaFNk49cUAStLAeTtDJnSHCULYMYbxFeqBt_yTq2DSomcgtnI98g5b3I6FWJys0A3B3o5mykR3Swu6wyIdr5NmAxnAEboHphywM Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 7739369a403245b5a6372651d76b2c05 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7739369a403245b5a6372651d76b2c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7739369a403245b5a6372651d76b2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7739369a403245b5a6372651d76b2c05", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7739369a403245b5a6372651d76b2c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 7739369a403245b5a6372651d76b2c05 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-QuotasAdminNegativeTest-1164257173-project Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: f227bb0c5fa24780ba3d4a8f4d955ded Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-QuotasAdminNegativeTest-1164257173-project Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-766700004", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-766700004', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452'}}} Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 18:13:24.967888 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 18:13:24.972004 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:24.979146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:24.980350 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cb8482aa-a6bc-4e9e-b1df-641048218a32 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.072630 Oct 28 18:13:24.986762 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1341/2624] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:13:23 2022] POST /compute/v2.1/servers => generated 119 bytes in 1079 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:24.992063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:24.996246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:25.033750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.034504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.037177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.038961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.039606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.041096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.235189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:25.248732 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ab5645e5-debe-4a0e-9dbd-c9544818ebb0 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 0.843166 Oct 28 18:13:25.249326 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1284/2625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:24 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:25.276185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:25.284115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:25.289846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:25.299665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.300449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.301111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.302845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.303540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.305556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.466672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:25.482055 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b23c6de5-43ad-436d-a825-db2f7e665347 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1479 microversion: 2.1 time: 0.491602 Oct 28 18:13:25.483212 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1342/2626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:24 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1479 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:25.495263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:25.495884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:25.512860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.513443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.513900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.514642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.515104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.515537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.788020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:25.799329 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25289489-b423-4bc3-977f-a3848881b75a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1467 microversion: 2.1 time: 0.533166 Oct 28 18:13:25.803627 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1285/2627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:25 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1467 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:25.815968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8da70080-d323-4d90-8211-01d8a6581c50 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Action: 'update', calling method: .version_select at 0x7f78de2ab160>, body: {"quota_set": {"instances": 10}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:25.816660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:25.831756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:25.841652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:25.842861 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91f6c4f2-c175-47fa-a839-67451371c811 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1844 microversion: 2.32 time: 0.358715 Oct 28 18:13:25.843426 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1343/2628] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:25 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1844 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:25.851272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:25.851913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:25.881270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.881769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.882208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.890275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.890773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.891217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.904478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=59,nova_cell0:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:25.907370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8da70080-d323-4d90-8211-01d8a6581c50 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.908643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8da70080-d323-4d90-8211-01d8a6581c50 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.909612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8da70080-d323-4d90-8211-01d8a6581c50 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.910628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8da70080-d323-4d90-8211-01d8a6581c50 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:25.911365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8da70080-d323-4d90-8211-01d8a6581c50 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:25.911882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8da70080-d323-4d90-8211-01d8a6581c50 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:25.984713 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8da70080-d323-4d90-8211-01d8a6581c50 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 329 microversion: 2.1 time: 0.179803 Oct 28 18:13:25.986560 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1286/2629] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:13:25 2022] PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 329 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:26.080921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-71287ced-a943-49e7-8e21-185abd8f00e0 req-7fb2505d-1c0a-4d9c-86f1-7e1366633110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "tag": "24d57195-2b05-4d20-a213-c277be41e78e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:26.094256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-71287ced-a943-49e7-8e21-185abd8f00e0 req-7fb2505d-1c0a-4d9c-86f1-7e1366633110 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:26.095077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-71287ced-a943-49e7-8e21-185abd8f00e0 req-7fb2505d-1c0a-4d9c-86f1-7e1366633110 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:26.096351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-71287ced-a943-49e7-8e21-185abd8f00e0 req-7fb2505d-1c0a-4d9c-86f1-7e1366633110 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:26.111356 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-71287ced-a943-49e7-8e21-185abd8f00e0 req-7fb2505d-1c0a-4d9c-86f1-7e1366633110 service nova] Creating event network-changed:24d57195-2b05-4d20-a213-c277be41e78e for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:13:26.117410 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-71287ced-a943-49e7-8e21-185abd8f00e0 req-7fb2505d-1c0a-4d9c-86f1-7e1366633110 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129428 Oct 28 18:13:26.118901 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1287/2630] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:26.125328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8cf180ad-812d-4d02-be4e-6a110dad6b2f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de2793a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:26.196487 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8cf180ad-812d-4d02-be4e-6a110dad6b2f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.076006 Oct 28 18:13:26.199272 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1288/2631] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:26 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:26.205086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-1c6d9e29-acf1-495d-9289-e6ad8d188907 req-0ba217ef-97bf-40d9-a9d5-05ebe25bdea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9701323d-b2b2-48a1-baf9-4ee8521c95be", "name": "network-vif-plugged", "status": "completed", "tag": "6b4f741f-8159-46fb-a039-2ded83b18128"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:26.216380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c6d9e29-acf1-495d-9289-e6ad8d188907 req-0ba217ef-97bf-40d9-a9d5-05ebe25bdea9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:26.217143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c6d9e29-acf1-495d-9289-e6ad8d188907 req-0ba217ef-97bf-40d9-a9d5-05ebe25bdea9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:26.217749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c6d9e29-acf1-495d-9289-e6ad8d188907 req-0ba217ef-97bf-40d9-a9d5-05ebe25bdea9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:26.229260 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-1c6d9e29-acf1-495d-9289-e6ad8d188907 req-0ba217ef-97bf-40d9-a9d5-05ebe25bdea9 service nova] Creating event network-vif-plugged:6b4f741f-8159-46fb-a039-2ded83b18128 for instance 9701323d-b2b2-48a1-baf9-4ee8521c95be on n-h2-862404-2 Oct 28 18:13:26.234510 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-1c6d9e29-acf1-495d-9289-e6ad8d188907 req-0ba217ef-97bf-40d9-a9d5-05ebe25bdea9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Oct 28 18:13:26.235678 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1289/2632] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:26.536819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:26.537751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:26.550224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:26.560645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:26.561206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:26.563229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:26.564387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:26.567048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:26.606601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:26.640790 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1d632feb-face-4a9b-a4e3-c9fc465e24b5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 0.793028 Oct 28 18:13:26.648669 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1344/2633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:25 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:26.654153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d93a36a-b6a6-4e82-83b6-0526a02fe6ee tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Calling method '.version_select at 0x7f78dd8240d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:27.303650 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d93a36a-b6a6-4e82-83b6-0526a02fe6ee tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 371 microversion: 2.1 time: 0.652847 Oct 28 18:13:27.305451 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1345/2634] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:13:26 2022] GET /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 371 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:27.310873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:27.312165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:27.332885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:27.333717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:27.334375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:27.335355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:27.336090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:27.337365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:27.464732 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9510cf55-df73-443a-b580-90972a4b6459 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1618 microversion: 2.1 time: 1.226877 Oct 28 18:13:27.468985 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1290/2635] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:26 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1618 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:27.479289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:27.479970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:27.507399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:27.508135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:27.511643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:27.513423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:27.514937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:27.515380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:27.588434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:27.600803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-694ca9a9-c5b5-478f-ada8-902eda960ba7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 0.293620 Oct 28 18:13:27.602038 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1346/2636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:27 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:27.616006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:27.617207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:27.624417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:27.625824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:27.626540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:27.627481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:27.628323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:27.629095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:27.956716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:27.972115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11d734bb-71e6-4e37-a331-936c9fdc2557 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1479 microversion: 2.1 time: 0.501495 Oct 28 18:13:27.974776 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1291/2637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:27 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1479 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:27.993152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f06e4490-5451-4af9-afb9-f7bc786c2dde tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de827700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:28.087889 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f06e4490-5451-4af9-afb9-f7bc786c2dde tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.111482 Oct 28 18:13:28.088738 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1292/2638] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:27 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:28.102791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4173f6e2-a6f2-4381-a3e5-272e37a2a591 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Action: 'update', calling method: .version_select at 0x7f78de8169d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:28.191510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:28.210827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:28.212937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:28.218719 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44501e1f-fe2a-4d3b-a4ab-2d6e05dff6ec tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1865 microversion: 2.32 time: 0.615259 Oct 28 18:13:28.220028 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1347/2639] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:27 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1865 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:28.229907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc4bb6f7-ce4d-4edd-99eb-1a9004c7ec45 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Action: 'create', calling method: .version_select at 0x7f78dd824790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1736149200", "policies": ["affinity"]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:28.276984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bc4bb6f7-ce4d-4edd-99eb-1a9004c7ec45 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:28.283672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bc4bb6f7-ce4d-4edd-99eb-1a9004c7ec45 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:28.481369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bc4bb6f7-ce4d-4edd-99eb-1a9004c7ec45 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:28.506791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bc4bb6f7-ce4d-4edd-99eb-1a9004c7ec45 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:28.563115 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc4bb6f7-ce4d-4edd-99eb-1a9004c7ec45 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.339048 Oct 28 18:13:28.565911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1348/2640] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 18:13:28 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:28.570633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4173f6e2-a6f2-4381-a3e5-272e37a2a591 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:28.576869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4173f6e2-a6f2-4381-a3e5-272e37a2a591 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:28.577597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4173f6e2-a6f2-4381-a3e5-272e37a2a591 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:28.578655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4173f6e2-a6f2-4381-a3e5-272e37a2a591 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:28.579415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4173f6e2-a6f2-4381-a3e5-272e37a2a591 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:28.582613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4173f6e2-a6f2-4381-a3e5-272e37a2a591 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:28.593063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:28.599538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:28.657920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:28.660359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:28.662432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:28.667938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:28.668509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:28.669723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:28.702259 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4173f6e2-a6f2-4381-a3e5-272e37a2a591 tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 325 microversion: 2.1 time: 0.611532 Oct 28 18:13:28.703669 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1293/2641] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:13:28 2022] PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 325 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:28.709416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-cfc9f682-0726-4e8b-bc3d-b115e37ecb06 req-6d1e08ba-6880-43f6-b0a3-9c58957d6b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "tag": "0d561e16-be60-4fcd-9838-adb440165e4d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:28.735286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cfc9f682-0726-4e8b-bc3d-b115e37ecb06 req-6d1e08ba-6880-43f6-b0a3-9c58957d6b81 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:28.736166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cfc9f682-0726-4e8b-bc3d-b115e37ecb06 req-6d1e08ba-6880-43f6-b0a3-9c58957d6b81 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:28.736760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cfc9f682-0726-4e8b-bc3d-b115e37ecb06 req-6d1e08ba-6880-43f6-b0a3-9c58957d6b81 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:28.751908 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-cfc9f682-0726-4e8b-bc3d-b115e37ecb06 req-6d1e08ba-6880-43f6-b0a3-9c58957d6b81 service nova] Creating event network-changed:0d561e16-be60-4fcd-9838-adb440165e4d for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:13:28.774005 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-cfc9f682-0726-4e8b-bc3d-b115e37ecb06 req-6d1e08ba-6880-43f6-b0a3-9c58957d6b81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068249 Oct 28 18:13:28.775112 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1294/2642] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:28.788028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:28.789099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:28.805290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:28.806043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:28.806804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:28.807697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:28.808549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:28.809507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:29.139768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:29.161432 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3469e13a-1ebe-4f34-a419-61b979759f69 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 0.379552 Oct 28 18:13:29.164103 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1295/2643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:28 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:29.181784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1405140974", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "73160af1-6986-4ffe-a141-fa77e5515ff6"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:29.301088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:13:29.449627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:29.469159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b807fe0-5238-487f-a50e-2d0e1e0fbbe5 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 0.901306 Oct 28 18:13:29.485931 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1349/2644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:28 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:29.495788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:29.500294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:29.515297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:29.517291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:29.519127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:29.520627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:29.524526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:29.525397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:29.895051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:29.909570 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e610ef66-526e-4c0a-a444-d5dce32b7cc6 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1464 microversion: 2.1 time: 0.421769 Oct 28 18:13:29.912804 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1350/2645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:29 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1464 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:29.944258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1580972678", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:30.038666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:13:30.105665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:30.106576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:30.107366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:30.107996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:30.109016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:30.187888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:30.192752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:30.193899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:30.195126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:30.198173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:30.198812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:30.254612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:30.269169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:30.308537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Going to run 2 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:13:30.313188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:13:30.325282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:30.325714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:30.326190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:30.326607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:30.327023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:30.338099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=37 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:30.339458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:30.340009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:30.340453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:30.341288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:30.341921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:30.342363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:30.367273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Getting quotas for project 7739369a403245b5a6372651d76b2c05. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:30.373584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Getting quotas for user f227bb0c5fa24780ba3d4a8f4d955ded and project 7739369a403245b5a6372651d76b2c05. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:30.388855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.utils [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] ram quota exceeded for 7739369a403245b5a6372651d76b2c05, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120680) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 18:13:30.389415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Request method failure captured: Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 145 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBu6YsatldwgtDgPlLPPkvNgAkU4u46ohCd8Zo9BgVDYoLaDQsNPMNaAjjWYWrD1O_aQGu_QpVYhXaFNk49cUAStLAeTtDJnSHCULYMYbxFeqBt_yTq2DSomcgtnI98g5b3I6FWJys0A3B3o5mykR3Swu6wyIdr5NmAxnAEboHphywM Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 7739369a403245b5a6372651d76b2c05 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7739369a403245b5a6372651d76b2c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7739369a403245b5a6372651d76b2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7739369a403245b5a6372651d76b2c05", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7739369a403245b5a6372651d76b2c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 7739369a403245b5a6372651d76b2c05 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-QuotasAdminNegativeTest-1164257173-project Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: f227bb0c5fa24780ba3d4a8f4d955ded Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-QuotasAdminNegativeTest-1164257173-project Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1580972678", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1580972678', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452'}}} Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 18:13:30.391586 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5332c0a-ddae-4fb0-a221-48c33fe36132 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.479962 Oct 28 18:13:30.396731 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1351/2646] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:13:29 2022] POST /compute/v2.1/servers => generated 110 bytes in 481 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:30.400896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f38f281-9c2f-4ac2-aa8f-8ce5dc2f3f7f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2518a60>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:30.433922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120679) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 18:13:30.457183 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f38f281-9c2f-4ac2-aa8f-8ce5dc2f3f7f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.060886 Oct 28 18:13:30.458509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1352/2647] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:30 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:30.464229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:30.465027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:30.473931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:30.474803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:30.475692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:30.476585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:30.477203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:30.477786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:30.480476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:30.490901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:30.639380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:30.651547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:30.669178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:13:30.768000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:30.785072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:30.793523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:30.850019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:30.864608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:30.867201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:30.868711 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e5b16aae-9669-4cec-b162-a6bdd97d7a2b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1886 microversion: 2.32 time: 0.408835 Oct 28 18:13:30.871331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1353/2648] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:30 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1886 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:30.877779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:30.881696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:30.888987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:30.889788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:30.891006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:30.892655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:30.893689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:30.894276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:30.897614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:30.932463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:31.003221 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2626d676-7563-44ca-b75d-2dc1ea4d9b6d tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action" status: 202 len: 0 microversion: 2.1 time: 0.130099 Oct 28 18:13:31.005325 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1354/2649] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:13:30 2022] POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:13:31.012219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:31.013311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:31.022045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.022911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.023566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.024711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.026273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.027042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.060441 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-67e4aeee-486b-4f05-be7d-74c37e0d54df tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.893554 Oct 28 18:13:31.065781 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1296/2650] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:13:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 1900 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:13:31.071272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d48ab0b-a0a4-462d-909d-00e24aff87dc tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Action: 'update', calling method: .version_select at 0x7f78dedd05e0>, body: {"quota_set": {"ram": 51200}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:31.326280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:31.349941 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7df6717c-e88c-476a-a245-703747cec7f6 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 0.336315 Oct 28 18:13:31.350607 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1355/2651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:31 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:31.355649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:31.356223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:31.370197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.370719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.371153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.371921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.372386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.372851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.654713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:31.679778 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-849377dc-50ae-4a71-a13a-b8def1754954 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 0.325617 Oct 28 18:13:31.682524 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1356/2652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:31 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:31.701582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-54d55af6-42ce-4c1e-adbf-1e6bf27fb6c9 req-6639df46-adc1-49ee-9f1d-cbb587f4afe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "tag": "2408e0e9-b9b2-4b3e-b910-5848a5a8660c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:31.747549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-54d55af6-42ce-4c1e-adbf-1e6bf27fb6c9 req-6639df46-adc1-49ee-9f1d-cbb587f4afe9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.763337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-54d55af6-42ce-4c1e-adbf-1e6bf27fb6c9 req-6639df46-adc1-49ee-9f1d-cbb587f4afe9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.763976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-54d55af6-42ce-4c1e-adbf-1e6bf27fb6c9 req-6639df46-adc1-49ee-9f1d-cbb587f4afe9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.815578 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-54d55af6-42ce-4c1e-adbf-1e6bf27fb6c9 req-6639df46-adc1-49ee-9f1d-cbb587f4afe9 service nova] Creating event network-changed:2408e0e9-b9b2-4b3e-b910-5848a5a8660c for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:13:31.838775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d48ab0b-a0a4-462d-909d-00e24aff87dc tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.839961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d48ab0b-a0a4-462d-909d-00e24aff87dc tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.840135 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-54d55af6-42ce-4c1e-adbf-1e6bf27fb6c9 req-6639df46-adc1-49ee-9f1d-cbb587f4afe9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155026 Oct 28 18:13:31.840721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d48ab0b-a0a4-462d-909d-00e24aff87dc tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.841448 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1357/2653] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:31.841788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d48ab0b-a0a4-462d-909d-00e24aff87dc tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.842362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d48ab0b-a0a4-462d-909d-00e24aff87dc tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.847607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d48ab0b-a0a4-462d-909d-00e24aff87dc tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.851804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:31.856113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:31.872919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.873637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.874228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.875118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.875726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.879467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.920649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:31.964157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:31.964656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:31.965099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:31.965695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lazy-loading 'fault' on Instance uuid 9701323d-b2b2-48a1-baf9-4ee8521c95be {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:13:32.082804 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d48ab0b-a0a4-462d-909d-00e24aff87dc tempest-QuotasAdminNegativeTest-1670749551 tempest-QuotasAdminNegativeTest-1670749551-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 200 len: 329 microversion: 2.1 time: 1.001956 Oct 28 18:13:32.086654 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1297/2654] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:13:31 2022] PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 329 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:32.097154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:32.105337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:32.106703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Searching by: {'deleted': False, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:13:32.128309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:32.129256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:32.130060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:32.131033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:32.131901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:32.132563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:32.228580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:13:32.362848 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-814cab8e-8176-488a-9d3b-b73fbc5bf8ee tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.274762 Oct 28 18:13:32.368417 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1298/2655] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:13:32 2022] GET /compute/v2.1/servers => generated 1004 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:32.380802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c42f9b7-dae1-49a5-bb94-c1d7be62bc0a tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dee26ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:32.488374 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c42f9b7-dae1-49a5-bb94-c1d7be62bc0a tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.118625 Oct 28 18:13:32.489135 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1299/2656] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:32 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:32.494873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:32.495730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:32.503182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:32.504143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:32.504897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:32.505916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:32.507067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:32.507761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:32.545137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c659ffaf-a9cb-4c86-9f48-46532c023cae tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1598 microversion: 2.1 time: 0.701601 Oct 28 18:13:32.546832 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1358/2657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:31 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1598 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:32.557518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f0c2c96-246d-4b09-a87b-c45bd4e4dcd4 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Action: 'update', calling method: .version_select at 0x7f78dd786b80>, body: {"quota_set": {"ram": 0}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:32.563439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f0c2c96-246d-4b09-a87b-c45bd4e4dcd4 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f227bb0c5fa24780ba3d4a8f4d955ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7739369a403245b5a6372651d76b2c05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f0c2c96-246d-4b09-a87b-c45bd4e4dcd4 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Request method failure captured: Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 HTTP/1.1 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 25 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBu6YsatldwgtDgPlLPPkvNgAkU4u46ohCd8Zo9BgVDYoLaDQsNPMNaAjjWYWrD1O_aQGu_QpVYhXaFNk49cUAStLAeTtDJnSHCULYMYbxFeqBt_yTq2DSomcgtnI98g5b3I6FWJys0A3B3o5mykR3Swu6wyIdr5NmAxnAEboHphywM Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 7739369a403245b5a6372651d76b2c05 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7739369a403245b5a6372651d76b2c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7739369a403245b5a6372651d76b2c05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7739369a403245b5a6372651d76b2c05", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7739369a403245b5a6372651d76b2c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 7739369a403245b5a6372651d76b2c05 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1164257173 Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-QuotasAdminNegativeTest-1164257173-project Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: f227bb0c5fa24780ba3d4a8f4d955ded Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-QuotasAdminNegativeTest-1164257173-project Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: {"quota_set": {"ram": 0}} Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '7739369a403245b5a6372651d76b2c05', 'body': {'quota_set': {'ram': 0}}} Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:13:32.578125 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 18:13:32.583558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:32.586160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f0c2c96-246d-4b09-a87b-c45bd4e4dcd4 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:32.587589 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f0c2c96-246d-4b09-a87b-c45bd4e4dcd4 tempest-QuotasAdminNegativeTest-1164257173 tempest-QuotasAdminNegativeTest-1164257173-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05" status: 403 len: 116 microversion: 2.1 time: 0.039374 Oct 28 18:13:32.592559 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1359/2658] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:13:32 2022] PUT /compute/v2.1/os-quota-sets/7739369a403245b5a6372651d76b2c05 => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:32.628495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:32.629571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:32.659341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:32.662369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:32.663592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:32.667751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:32.668545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:32.669104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:33.057317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:33.073066 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec0614df-35f8-4f91-bb62-259f616c17b7 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 0.473303 Oct 28 18:13:33.073830 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1360/2659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:32 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:33.091533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9fa5178d-741a-4927-b8af-c190ef4f1300 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:33.092812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9fa5178d-741a-4927-b8af-c190ef4f1300 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:33.223535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9fa5178d-741a-4927-b8af-c190ef4f1300 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:33.231478 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9fa5178d-741a-4927-b8af-c190ef4f1300 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1219 microversion: 2.1 time: 0.151524 Oct 28 18:13:33.233303 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1361/2660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:33 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:33.242731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:33.252199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:33.258831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:33.259711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:33.260534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:33.261809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:33.261937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:33.262427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:33.275052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:33.290508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:33.293295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:33.298482 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3cc6e283-bcc9-43bb-8170-4288bbe94828 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1886 microversion: 2.32 time: 0.806417 Oct 28 18:13:33.300693 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1300/2661] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:32 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1886 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:33.305631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:33.311171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:33.342941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:33.349582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:33.352213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:33.358311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:33.359119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:33.368529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:33.555982 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95e02549-da7b-4121-b0d4-465fe4c35a80 tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action" status: 202 len: 0 microversion: 2.1 time: 0.321172 Oct 28 18:13:33.559420 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1362/2662] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:13:33 2022] POST /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:13:33.578623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0a947494-3005-4690-9186-754f07388bdb req-de707437-64e9-44eb-98aa-1e8859200b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044272e7-257b-4504-ab1b-90435d93d21d", "name": "network-vif-plugged", "status": "completed", "tag": "5dbb710a-7d49-4881-9824-24c2aa5ca847"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:33.631000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a947494-3005-4690-9186-754f07388bdb req-de707437-64e9-44eb-98aa-1e8859200b84 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:33.631499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a947494-3005-4690-9186-754f07388bdb req-de707437-64e9-44eb-98aa-1e8859200b84 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:33.631954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a947494-3005-4690-9186-754f07388bdb req-de707437-64e9-44eb-98aa-1e8859200b84 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:33.656279 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0a947494-3005-4690-9186-754f07388bdb req-de707437-64e9-44eb-98aa-1e8859200b84 service nova] Creating event network-vif-plugged:5dbb710a-7d49-4881-9824-24c2aa5ca847 for instance 044272e7-257b-4504-ab1b-90435d93d21d on n-h1-862404-2 Oct 28 18:13:33.664459 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0a947494-3005-4690-9186-754f07388bdb req-de707437-64e9-44eb-98aa-1e8859200b84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103682 Oct 28 18:13:33.665335 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1363/2663] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:33.673279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aeef981a-c293-4afb-85f3-bc8656663b06 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2518ca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:33.753124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aeef981a-c293-4afb-85f3-bc8656663b06 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.086334 Oct 28 18:13:33.756173 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1364/2664] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:33 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:33.766230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:33.770113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:33.785092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:33.786506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:33.787165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:33.788125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:33.788757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:33.789351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.124024 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48cd5153-ddbb-4f5d-98df-21324115876e tempest-ServersAdminTestJSON-2022136336 tempest-ServersAdminTestJSON-2022136336-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1615 microversion: 2.1 time: 0.366477 Oct 28 18:13:34.128060 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1365/2665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:33 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1615 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:34.135956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0931c0a7-25ec-432c-8458-49329e40749e req-da91b17d-f5dc-445d-b56e-0ef668122022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "tag": "7f0322f3-5f52-4071-9bb2-531a91aebf45"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:34.170276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0931c0a7-25ec-432c-8458-49329e40749e req-da91b17d-f5dc-445d-b56e-0ef668122022 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.171561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0931c0a7-25ec-432c-8458-49329e40749e req-da91b17d-f5dc-445d-b56e-0ef668122022 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.173493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0931c0a7-25ec-432c-8458-49329e40749e req-da91b17d-f5dc-445d-b56e-0ef668122022 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.199143 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0931c0a7-25ec-432c-8458-49329e40749e req-da91b17d-f5dc-445d-b56e-0ef668122022 service nova] Creating event network-changed:7f0322f3-5f52-4071-9bb2-531a91aebf45 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:13:34.213541 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0931c0a7-25ec-432c-8458-49329e40749e req-da91b17d-f5dc-445d-b56e-0ef668122022 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081166 Oct 28 18:13:34.214856 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1366/2666] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:34.231504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:34.235150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:34.257352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.257860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.258307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.269911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.270510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.270963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.330606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:34.343416 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-46102af9-1f1f-47e0-99c3-2508a7fab5e4 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 1.041395 Oct 28 18:13:34.347797 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1301/2667] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:33 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:34.353559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:34.354458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:34.393127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.394163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.397461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.398536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.399256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.399939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.459971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:13:34.585289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:34.643371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:34.660188 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fbfc6273-419f-43f7-af31-bb15f3fdf910 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 0.440529 Oct 28 18:13:34.681982 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1367/2668] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:34 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:34.688086 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e13450ce-47b0-45a1-900e-17e4be02b321 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 204 len: 0 microversion: 2.1 time: 0.338599 Oct 28 18:13:34.689102 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1302/2669] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:13:34 2022] DELETE /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:34.695400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:34.696434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:34.699431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:34.701216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:34.716380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.719454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.720951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.721697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.722275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.722823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.723706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.724949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.726249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.727073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.728335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.729759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.867384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:34.881451 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb20398a-0b50-4bb5-a167-8902837ae7ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1215 microversion: 2.1 time: 0.197993 Oct 28 18:13:34.884625 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1368/2670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:34 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:34.905299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:34.906201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:34.921574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.922343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.924362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:34.925284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:34.928591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:34.929419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:35.325083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:35.325736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:35.337389 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-025c2af1-bbc1-42b2-acfe-4cb8f6595993 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1470 microversion: 2.1 time: 0.449351 Oct 28 18:13:35.337543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:35.341506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:35.349240 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-428c2fc5-31f9-4789-9d04-dae56a0e4a9a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1886 microversion: 2.32 time: 0.658579 Oct 28 18:13:35.350142 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1303/2671] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:34 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1886 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:35.353163 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1369/2672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:34 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:35.355297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4dbbe374-52e2-42aa-8b6e-d52eae8c1e7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de2ab160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:35.373196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:35.373841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:35.390597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:35.397392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:35.397939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:35.398396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:35.399142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:35.399627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:35.400087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:35.461169 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4dbbe374-52e2-42aa-8b6e-d52eae8c1e7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.109691 Oct 28 18:13:35.463544 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1304/2673] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:35 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:35.690645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:35.692306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:35.722864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:35.727547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:35.729662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:35.732459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:35.738199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:35.739048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:36.277672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:36.301198 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8aab4c27-78a1-4387-9349-c1afc024f625 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 0.932365 Oct 28 18:13:36.321056 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1370/2674] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:35 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:36.326399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:36.337057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:36.349071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:36.349830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:36.350501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:36.352701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:36.353507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:36.360310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:36.568608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:36.585757 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c296240f-e9c6-4cb9-a03d-7c5161810534 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1271 microversion: 2.1 time: 0.262012 Oct 28 18:13:36.601331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1371/2675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:36 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:36.607874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:36.608513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:36.617124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:36.617629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:36.618225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:36.619027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:36.619461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:36.619961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:37.151293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:37.181828 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-251ac75f-e2ff-4ebd-9f51-bc85de3b92df tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1351 microversion: 2.1 time: 1.498925 Oct 28 18:13:37.191953 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1305/2676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:35 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1351 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:37.199042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:37.199912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:37.220945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:37.224214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:37.224837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:37.225744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:37.228153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:37.229858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:37.268586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:37.276960 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6dd8f08b-cf88-464a-93d5-af393dfecdd4 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1470 microversion: 2.1 time: 0.674389 Oct 28 18:13:37.288816 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1372/2677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:36 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1470 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:37.310601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-760724f8-7a2c-4ca0-be16-ddb8057664d2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dd824040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:37.413510 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-760724f8-7a2c-4ca0-be16-ddb8057664d2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1454 microversion: 2.1 time: 0.122776 Oct 28 18:13:37.415334 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1373/2678] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:37 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:37.432665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:37.433594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:37.444935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:37.445446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:37.449559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:37.450482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:37.451033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:37.451484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:37.741843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:37.751809 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b7b0c96b-34ec-4d95-bc99-9378f273c73c tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 0.334749 Oct 28 18:13:37.752625 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1374/2679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:37 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:37.770603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:37.771239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:37.787574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:37.788169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:37.788549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:37.789287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:37.789760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:37.790195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:37.927501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:37.941156 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c89e8c8-2408-415d-a1f1-2034d7fad933 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1277 microversion: 2.1 time: 0.187473 Oct 28 18:13:37.945160 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1375/2680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:37 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:38.205465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:38.205705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:38.219704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:38.220747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:38.221522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:38.222473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:38.223785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:38.225415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:38.888494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:38.905432 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7848e913-39e3-42db-adbc-64180044f870 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1541 microversion: 2.1 time: 0.704643 Oct 28 18:13:38.911399 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1376/2681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:38 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1541 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:38.938480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:38.941519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:38.964800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:38.966151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:38.968416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:38.969534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:38.971260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:38.974065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:39.185555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:39.201456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:39.203228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:39.205249 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-373c18f5-ebe0-4b43-8d7c-54418e37e375 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1886 microversion: 2.32 time: 2.011322 Oct 28 18:13:39.206362 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1306/2682] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:37 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1886 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:39.220295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1fac18bc-5655-47dc-a14f-6b918e4bf295 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de148b80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:39.287188 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1fac18bc-5655-47dc-a14f-6b918e4bf295 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1463 microversion: 2.1 time: 0.079388 Oct 28 18:13:39.290037 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1307/2683] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:39 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1463 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:39.297817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:39.299178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:39.305974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:39.306656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:39.307269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:39.308196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:39.308981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:39.310138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:39.362529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:39.377977 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69d91e72-1cb0-46e2-950f-040f5954c3cb tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1470 microversion: 2.1 time: 0.462585 Oct 28 18:13:39.379115 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1377/2684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:38 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1470 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:39.392696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:39.393432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:39.406313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:39.408840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:39.409437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:39.411397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:39.412133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:39.415628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:39.601930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a83c735-87fa-40a5-b25b-5ac5180fbecf tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221570 Oct 28 18:13:39.602545 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1378/2685] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:13:39 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d/os-interface => generated 285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:39.625174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:39.625999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:39.633838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:39.634801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:39.635396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:39.636421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:39.637035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:39.637614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:39.645234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:40.355358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:40.374281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:40.385516 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-755b91f0-10fd-469d-a5ad-e007b18ebbf8 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 1.094187 Oct 28 18:13:40.386125 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1308/2686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:39 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:40.677893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c9b8772-7e23-40ef-b83d-32547bdae765 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:40.681436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c9b8772-7e23-40ef-b83d-32547bdae765 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:40.683960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c9b8772-7e23-40ef-b83d-32547bdae765 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:40.684408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c9b8772-7e23-40ef-b83d-32547bdae765 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:40.685147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c9b8772-7e23-40ef-b83d-32547bdae765 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:40.685594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c9b8772-7e23-40ef-b83d-32547bdae765 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:40.690521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c9b8772-7e23-40ef-b83d-32547bdae765 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:40.733742 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5c9b8772-7e23-40ef-b83d-32547bdae765 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.346594 Oct 28 18:13:40.734582 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1309/2687] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:13:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:40.740980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df242bf7-2e24-4f86-8eef-40222e75c6dc tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e256a940>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:40.792116 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df242bf7-2e24-4f86-8eef-40222e75c6dc tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 200 len: 1463 microversion: 2.1 time: 0.056166 Oct 28 18:13:40.801141 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1310/2688] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:40 2022] GET /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 1463 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:40.815853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ed4cf052-6042-4b0e-86f9-68d335237724 req-9e7c6589-df0c-4429-a719-f8f69bf21682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71391770-4b79-4140-9753-5708e93caf27", "name": "network-vif-deleted", "tag": "befa86b1-c918-4b71-a5fd-be421c3360b5"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:40.849238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ed4cf052-6042-4b0e-86f9-68d335237724 req-9e7c6589-df0c-4429-a719-f8f69bf21682 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:40.853929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ed4cf052-6042-4b0e-86f9-68d335237724 req-9e7c6589-df0c-4429-a719-f8f69bf21682 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:40.854384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ed4cf052-6042-4b0e-86f9-68d335237724 req-9e7c6589-df0c-4429-a719-f8f69bf21682 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:40.888068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ed4cf052-6042-4b0e-86f9-68d335237724 req-9e7c6589-df0c-4429-a719-f8f69bf21682 service nova] Creating event network-vif-deleted:befa86b1-c918-4b71-a5fd-be421c3360b5 for instance 71391770-4b79-4140-9753-5708e93caf27 on n-h2-862404-2 Oct 28 18:13:40.897431 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ed4cf052-6042-4b0e-86f9-68d335237724 req-9e7c6589-df0c-4429-a719-f8f69bf21682 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094770 Oct 28 18:13:40.898083 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1311/2689] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:40.916185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:40.917530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:40.936502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:40.940212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:40.941192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:40.944080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:40.944769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:40.946820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:40.968065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:40.980898 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8212420-b36d-43fa-bebb-1b54abd31d26 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1277 microversion: 2.1 time: 1.365777 Oct 28 18:13:40.983189 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1379/2690] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:39 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1277 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:40.992477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:40.994506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:41.010935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.011687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.012322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.015913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.019100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.020676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.107346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.109880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.111939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.117124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lazy-loading 'fault' on Instance uuid 71391770-4b79-4140-9753-5708e93caf27 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:13:41.238596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:41.247554 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7871e612-c0c4-4c72-8d88-8d8e8d6d78f8 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 200 len: 1304 microversion: 2.1 time: 0.262452 Oct 28 18:13:41.248600 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1380/2691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:40 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 1304 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:41.254493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7be843c1-6688-43ae-8730-38f80c881369 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:41.259958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be843c1-6688-43ae-8730-38f80c881369 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.260721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be843c1-6688-43ae-8730-38f80c881369 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.261229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be843c1-6688-43ae-8730-38f80c881369 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.262834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be843c1-6688-43ae-8730-38f80c881369 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.263374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be843c1-6688-43ae-8730-38f80c881369 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.263898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be843c1-6688-43ae-8730-38f80c881369 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.302453 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7be843c1-6688-43ae-8730-38f80c881369 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.052053 Oct 28 18:13:41.311184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1381/2692] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 18:13:41 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:41.311184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:41.311184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:41.317582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.318075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.318673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.319456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.320065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.320640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.533077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:41.543841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:41.545847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:41.547307 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c69a022-1529-440c-a530-108d9289c774 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1886 microversion: 2.32 time: 0.646086 Oct 28 18:13:41.548597 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1312/2693] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:40 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1886 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:41.553391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-48b3eb3b-3491-43cf-a50d-7de79dd29d93 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:41.557324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b3eb3b-3491-43cf-a50d-7de79dd29d93 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.558044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b3eb3b-3491-43cf-a50d-7de79dd29d93 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.558807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b3eb3b-3491-43cf-a50d-7de79dd29d93 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.559762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b3eb3b-3491-43cf-a50d-7de79dd29d93 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.560451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b3eb3b-3491-43cf-a50d-7de79dd29d93 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.561256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48b3eb3b-3491-43cf-a50d-7de79dd29d93 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.588521 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-48b3eb3b-3491-43cf-a50d-7de79dd29d93 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.038416 Oct 28 18:13:41.589079 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1313/2694] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:13:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:41.593633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:41.594388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:41.601597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.602154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.602741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.603506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.604056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.604651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.690365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:41.699079 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6711c33-3464-4615-8261-1c32d6c520a1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 1468 microversion: 2.1 time: 0.394273 Oct 28 18:13:41.713931 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1382/2695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:41 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 1468 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:41.726430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-801018eb-86d2-4388-a516-bde42387cb8d tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:41.730381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801018eb-86d2-4388-a516-bde42387cb8d tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.730874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801018eb-86d2-4388-a516-bde42387cb8d tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.731481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801018eb-86d2-4388-a516-bde42387cb8d tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.732407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801018eb-86d2-4388-a516-bde42387cb8d tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.732868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801018eb-86d2-4388-a516-bde42387cb8d tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.733295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801018eb-86d2-4388-a516-bde42387cb8d tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.758790 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-801018eb-86d2-4388-a516-bde42387cb8d tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862404-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.043627 Oct 28 18:13:41.760003 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1383/2696] 10.222.0.16 () {58 vars in 1194 bytes} [Fri Oct 28 18:13:41 2022] GET /compute/v2.1/os-services?host=n-d-862404-2&binary=xxx => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:13:41.766100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b441bb6-0354-409b-9599-01df1f15efda tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de052310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:41.889759 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b441bb6-0354-409b-9599-01df1f15efda tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-10-28T18%3A11%3A12Z" status: 200 len: 2376 microversion: 2.1 time: 0.128508 Oct 28 18:13:41.890610 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1384/2697] 10.222.0.16 () {58 vars in 1199 bytes} [Fri Oct 28 18:13:41 2022] GET /compute/v2.1/images?changes-since=2022-10-28T18%3A11%3A12Z => generated 2376 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:41.895410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-57a1ac43-8f4a-4580-a6b1-60dd230c8654 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:41.900894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57a1ac43-8f4a-4580-a6b1-60dd230c8654 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.901635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57a1ac43-8f4a-4580-a6b1-60dd230c8654 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.902312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57a1ac43-8f4a-4580-a6b1-60dd230c8654 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.903169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57a1ac43-8f4a-4580-a6b1-60dd230c8654 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:41.903766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57a1ac43-8f4a-4580-a6b1-60dd230c8654 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:41.904319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57a1ac43-8f4a-4580-a6b1-60dd230c8654 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:41.930249 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-57a1ac43-8f4a-4580-a6b1-60dd230c8654 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.038303 Oct 28 18:13:41.938195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1385/2698] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:13:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:41.943576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9623a385-cb3f-4375-a415-9c3200c1b656 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e23d9790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.032614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9623a385-cb3f-4375-a415-9c3200c1b656 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-283887333" status: 200 len: 484 microversion: 2.1 time: 0.100074 Oct 28 18:13:42.033331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1386/2699] 10.222.0.16 () {58 vars in 1229 bytes} [Fri Oct 28 18:13:41 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-283887333 => generated 484 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:42.042043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-159e6b51-53dd-4bde-9485-9424da97b981 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.043056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=45 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:42.046243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-159e6b51-53dd-4bde-9485-9424da97b981 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.046852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-159e6b51-53dd-4bde-9485-9424da97b981 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.047548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-159e6b51-53dd-4bde-9485-9424da97b981 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.048556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-159e6b51-53dd-4bde-9485-9424da97b981 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.049114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-159e6b51-53dd-4bde-9485-9424da97b981 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.049637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-159e6b51-53dd-4bde-9485-9424da97b981 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.076144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-159e6b51-53dd-4bde-9485-9424da97b981 tempest-ServicesAdminNegativeTestJSON-1654131360 tempest-ServicesAdminNegativeTestJSON-1654131360-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.041486 Oct 28 18:13:42.077599 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1387/2700] 10.222.0.16 () {58 vars in 1198 bytes} [Fri Oct 28 18:13:42 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:13:42.083334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.084315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:42.093879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.094457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.095394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.096323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.096879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.100697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.193208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:42.203174 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02f717a3-1ec1-4a7b-b9be-cbe9108afca2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1277 microversion: 2.1 time: 0.124249 Oct 28 18:13:42.205165 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1388/2701] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:42 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:42.212296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01f904a5-9337-422e-901b-69d74c6a8670 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2466160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.329958 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01f904a5-9337-422e-901b-69d74c6a8670 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images?server=8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 957 microversion: 2.1 time: 0.122838 Oct 28 18:13:42.330838 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1389/2702] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 18:13:42 2022] GET /compute/v2.1/images?server=8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 957 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:42.380296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:42.389632 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f35a6b4-a9c5-4a89-817d-6f89e65fb3b6 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1518 microversion: 2.1 time: 0.799361 Oct 28 18:13:42.408079 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1314/2703] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:41 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1518 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:42.469258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6fbee5ac-2514-45b6-bbee-c989e555edcc tempest-ServicesAdminNegativeTestJSON-1026260923 tempest-ServicesAdminNegativeTestJSON-1026260923-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.473365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6fbee5ac-2514-45b6-bbee-c989e555edcc tempest-ServicesAdminNegativeTestJSON-1026260923 tempest-ServicesAdminNegativeTestJSON-1026260923-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '88bcd4c92e414efe94af499b02b67bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af627f88fa474cfb8e8e735e121f7105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6fbee5ac-2514-45b6-bbee-c989e555edcc tempest-ServicesAdminNegativeTestJSON-1026260923 tempest-ServicesAdminNegativeTestJSON-1026260923-project] Request method failure captured: Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvRomtgJLWLt0Jtx00KS7Z6jqp3e0_zovaQRTi8O-0hVMwSVHwEvUaQcYLANMSz6erXCnX26MXC_o0Mi5Ra0epYXzoso1-7gTHjCKehsCtmHOlBB_D0avUUnnyik85rvxG9IzCIMiysNDX5A8B8Q9SZSB3CqUnPvj4E2BVcThMNNjE Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: af627f88fa474cfb8e8e735e121f7105 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1026260923 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af627f88fa474cfb8e8e735e121f7105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/af627f88fa474cfb8e8e735e121f7105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_af627f88fa474cfb8e8e735e121f7105", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/af627f88fa474cfb8e8e735e121f7105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1026260923 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: af627f88fa474cfb8e8e735e121f7105 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1026260923 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServicesAdminNegativeTestJSON-1026260923-project Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 88bcd4c92e414efe94af499b02b67bb2 Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1026260923-project Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: action_args: {} Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 18:13:42.478497 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 18:13:42.482265 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:42.484449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-99af8fc6-9ebc-4ebf-b1ba-6a9220f3e2e4 req-7d14970f-db07-4fe2-b7e1-7ae597654928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "044272e7-257b-4504-ab1b-90435d93d21d", "tag": "5dbb710a-7d49-4881-9824-24c2aa5ca847"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:42.492729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6fbee5ac-2514-45b6-bbee-c989e555edcc tempest-ServicesAdminNegativeTestJSON-1026260923 tempest-ServicesAdminNegativeTestJSON-1026260923-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:42.493614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6fbee5ac-2514-45b6-bbee-c989e555edcc tempest-ServicesAdminNegativeTestJSON-1026260923 tempest-ServicesAdminNegativeTestJSON-1026260923-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.161550 Oct 28 18:13:42.498521 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1390/2704] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:13:42 2022] GET /compute/v2.1/os-services => generated 112 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:42.505221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.505852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 71391770-4b79-4140-9753-5708e93caf27] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:42.506872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-99af8fc6-9ebc-4ebf-b1ba-6a9220f3e2e4 req-7d14970f-db07-4fe2-b7e1-7ae597654928 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.507369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-99af8fc6-9ebc-4ebf-b1ba-6a9220f3e2e4 req-7d14970f-db07-4fe2-b7e1-7ae597654928 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.507803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-99af8fc6-9ebc-4ebf-b1ba-6a9220f3e2e4 req-7d14970f-db07-4fe2-b7e1-7ae597654928 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.512237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.512988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.513353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.514070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.514537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.514973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.538689 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-99af8fc6-9ebc-4ebf-b1ba-6a9220f3e2e4 req-7d14970f-db07-4fe2-b7e1-7ae597654928 service nova] Creating event network-changed:5dbb710a-7d49-4881-9824-24c2aa5ca847 for instance 044272e7-257b-4504-ab1b-90435d93d21d on n-h1-862404-2 Oct 28 18:13:42.540927 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] HTTP exception thrown: Instance 71391770-4b79-4140-9753-5708e93caf27 could not be found. Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Request method failure captured: Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 HTTP/1.1 Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBslXIQJ5loOz7l6_tEqr0gumfOJA0PbG3BoU-1rcbqQ4KXGw1O8_DOxNLVCZmYutlGq0j-iXfrK85Bpcq2S20Tw9ew6uUM5lqMIEuhNZ4i1fHrSboznlo1JJ_qxW1Nj3DqoGEwpidD_yFyDbN_RE1tnhIcfJAuMFQbNjf2EicmWMso Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6aa20e2a97184d9e93c88bd42520667e Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6aa20e2a97184d9e93c88bd42520667e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6aa20e2a97184d9e93c88bd42520667e Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdminTestJSON-397311428-project Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 375f8887d73d4adbabe4ac06d48ccc70 Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdminTestJSON-397311428-project Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 71391770-4b79-4140-9753-5708e93caf27 could not be found. Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '71391770-4b79-4140-9753-5708e93caf27'} Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71391770-4b79-4140-9753-5708e93caf27 could not be found. Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71391770-4b79-4140-9753-5708e93caf27 could not be found. Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:42.542486 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:42.546074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:42.546074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:42.546074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:42.546074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:42.546074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:42.546074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71391770-4b79-4140-9753-5708e93caf27 could not be found. Oct 28 18:13:42.546074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:42.546074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Returning 404 to user: Instance 71391770-4b79-4140-9753-5708e93caf27 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:42.548660 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5136bad7-5036-42ab-b1d4-e1115df6e48e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27" status: 404 len: 111 microversion: 2.1 time: 0.044374 Oct 28 18:13:42.553217 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-99af8fc6-9ebc-4ebf-b1ba-6a9220f3e2e4 req-7d14970f-db07-4fe2-b7e1-7ae597654928 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141848 Oct 28 18:13:42.554071 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1391/2705] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:42 2022] GET /compute/v2.1/servers/71391770-4b79-4140-9753-5708e93caf27 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:42.560611 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1315/2706] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:42.568982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.569774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:42.573810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48a70a7c-6a55-4841-9552-e49b91041c14 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2518c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.576956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.577614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.578184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.579309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.579966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.580622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.615264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:13:42.656095 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48a70a7c-6a55-4841-9552-e49b91041c14 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 485 microversion: 2.1 time: 0.100814 Oct 28 18:13:42.659955 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1392/2707] 10.222.0.16 () {58 vars in 1317 bytes} [Fri Oct 28 18:13:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F88c6fd04-db62-4518-9726-de061cb29c49 => generated 485 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:42.683311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:42.685470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:42.721164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.724635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.725150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.725924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:42.733222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:42.733767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:42.834918 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f98b5799-65ef-4b85-b156-bdede9488fde tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 204 len: 0 microversion: 2.1 time: 0.272310 Oct 28 18:13:42.840108 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1316/2708] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:13:42 2022] DELETE /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:42.853227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-468bccce-7b23-4018-9d64-b7d286e48099 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e2541160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:43.006581 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-468bccce-7b23-4018-9d64-b7d286e48099 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 485 microversion: 2.1 time: 0.158759 Oct 28 18:13:43.007721 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1317/2709] 10.222.0.16 () {58 vars in 1303 bytes} [Fri Oct 28 18:13:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F88c6fd04-db62-4518-9726-de061cb29c49 => generated 485 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:43.036941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:43.037918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:43.053252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:43.053809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:43.054275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:43.054983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:43.055437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:43.055886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:43.206711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:43.216616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:43.218072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:43.221024 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d585c60f-5960-4b44-ab16-6d0ff608bbdb tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.557961 Oct 28 18:13:43.224283 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1393/2710] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:42 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:43.227497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=7 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:43.248421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6738ee78-60d2-4bce-a456-a424d0e78c78 req-f3fb8905-ec02-438e-b7ee-07ae943c8e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "tag": "7d7ae5e3-3f70-4637-8a50-c637d361ee01"}, {"name": "network-changed", "server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "tag": "273d1c49-3383-47fd-aa8d-f805a87da16e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:43.280675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6738ee78-60d2-4bce-a456-a424d0e78c78 req-f3fb8905-ec02-438e-b7ee-07ae943c8e10 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:43.281312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6738ee78-60d2-4bce-a456-a424d0e78c78 req-f3fb8905-ec02-438e-b7ee-07ae943c8e10 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:43.281859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6738ee78-60d2-4bce-a456-a424d0e78c78 req-f3fb8905-ec02-438e-b7ee-07ae943c8e10 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:43.296901 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6738ee78-60d2-4bce-a456-a424d0e78c78 req-f3fb8905-ec02-438e-b7ee-07ae943c8e10 service nova] Creating event network-changed:7d7ae5e3-3f70-4637-8a50-c637d361ee01 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:13:43.297520 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6738ee78-60d2-4bce-a456-a424d0e78c78 req-f3fb8905-ec02-438e-b7ee-07ae943c8e10 service nova] Creating event network-changed:273d1c49-3383-47fd-aa8d-f805a87da16e for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:13:43.303337 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6738ee78-60d2-4bce-a456-a424d0e78c78 req-f3fb8905-ec02-438e-b7ee-07ae943c8e10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077434 Oct 28 18:13:43.304530 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1394/2711] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:43.315687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-abfccb89-41ee-4480-abe6-5ee54b5e5d64 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e23d9d30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:43.480695 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-abfccb89-41ee-4480-abe6-5ee54b5e5d64 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.174703 Oct 28 18:13:43.481889 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1395/2712] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:13:43 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:43.722912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-69e587f8-96e2-4d19-86bf-3142563404f2 req-969b8eb0-f84b-4bfb-a8f4-8e6d6697101a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8148f1bc-d908-4fa0-bd92-aad5464fe069", "name": "network-vif-unplugged", "status": "completed", "tag": "b21e0da3-68f8-41b1-9a87-d0036283bcfe"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:43.746267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-69e587f8-96e2-4d19-86bf-3142563404f2 req-969b8eb0-f84b-4bfb-a8f4-8e6d6697101a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:43.746739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-69e587f8-96e2-4d19-86bf-3142563404f2 req-969b8eb0-f84b-4bfb-a8f4-8e6d6697101a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:43.747174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-69e587f8-96e2-4d19-86bf-3142563404f2 req-969b8eb0-f84b-4bfb-a8f4-8e6d6697101a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:43.758598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-69e587f8-96e2-4d19-86bf-3142563404f2 req-969b8eb0-f84b-4bfb-a8f4-8e6d6697101a service nova] Creating event network-vif-unplugged:b21e0da3-68f8-41b1-9a87-d0036283bcfe for instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 on n-h1-862404-2 Oct 28 18:13:43.767438 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-69e587f8-96e2-4d19-86bf-3142563404f2 req-969b8eb0-f84b-4bfb-a8f4-8e6d6697101a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.283846 Oct 28 18:13:43.773361 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1396/2713] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:43.780807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:43.781744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:43.789096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:43.789588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:43.790037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:43.790725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:43.791180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:43.791607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:44.021961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:44.050279 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ab28c79-d3e9-434f-9505-ddbb58b3fe8f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1470 microversion: 2.1 time: 1.033658 Oct 28 18:13:44.050873 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1318/2714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:43 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1470 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:44.102588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:44.105363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:44.120368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:44.120878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:44.121525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:44.124070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:44.127075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:44.127899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:44.365780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:44.380901 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9af30a3-7e49-452d-bade-85fb7012bdbd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.604133 Oct 28 18:13:44.383075 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1397/2715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:43 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:44.395556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8be65da0-976d-406e-a705-ee2d814c9684 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dd74d040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:44.489958 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8be65da0-976d-406e-a705-ee2d814c9684 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.104895 Oct 28 18:13:44.491193 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1398/2716] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:13:44 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:44.499107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:44.500148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:44.511162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:44.513465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:44.514182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:44.515711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:44.516316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:44.518011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:44.791010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:44.808446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:44.812486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:44.815177 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73d29f70-a4c1-422f-b8e0-2c27a0c206ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.322434 Oct 28 18:13:44.816707 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1399/2717] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:44 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:44.824579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dec42c0b-1da7-4d26-b611-0124686b505e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dd851430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:44.911017 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dec42c0b-1da7-4d26-b611-0124686b505e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.092254 Oct 28 18:13:44.920145 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1400/2718] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:13:44 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:44.924619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f1c45d50-060b-4b56-a364-77fd96740430 req-cd4ee70a-f696-4708-a3b4-344202aa6d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6", "tag": "f5fcb9bc-34ba-42a9-8fe8-cebeedcb5338"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:44.935970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1c45d50-060b-4b56-a364-77fd96740430 req-cd4ee70a-f696-4708-a3b4-344202aa6d50 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:44.936882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1c45d50-060b-4b56-a364-77fd96740430 req-cd4ee70a-f696-4708-a3b4-344202aa6d50 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:44.937484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1c45d50-060b-4b56-a364-77fd96740430 req-cd4ee70a-f696-4708-a3b4-344202aa6d50 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:44.959097 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f1c45d50-060b-4b56-a364-77fd96740430 req-cd4ee70a-f696-4708-a3b4-344202aa6d50 service nova] Creating event network-changed:f5fcb9bc-34ba-42a9-8fe8-cebeedcb5338 for instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 on n-h1-862404-2 Oct 28 18:13:44.968705 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f1c45d50-060b-4b56-a364-77fd96740430 req-cd4ee70a-f696-4708-a3b4-344202aa6d50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055828 Oct 28 18:13:44.969360 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1401/2719] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:44.978098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38c56703-8fd8-4626-b306-83b4a4c0eef2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dd73bb80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:45.101910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38c56703-8fd8-4626-b306-83b4a4c0eef2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-10-28T18%3A11%3A08Z" status: 200 len: 6334 microversion: 2.1 time: 0.129866 Oct 28 18:13:45.115845 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1402/2720] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Oct 28 18:13:44 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-28T18%3A11%3A08Z => generated 6334 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:45.126984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:45.128070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:45.137221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:45.137741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:45.138211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:45.139198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:45.139679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:45.140497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:45.431382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:45.445449 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc4177fb-06c3-4cac-965b-5cf072d2a7df tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1470 microversion: 2.1 time: 0.341436 Oct 28 18:13:45.447552 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1403/2721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:45 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1470 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:45.457260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61006086-1dde-485f-a502-ab968424601d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dd74dca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:45.528557 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61006086-1dde-485f-a502-ab968424601d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-283887333" status: 200 len: 664 microversion: 2.1 time: 0.077379 Oct 28 18:13:45.529736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1404/2722] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Oct 28 18:13:45 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-283887333 => generated 664 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:45.544499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:45.545345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:45.559567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:45.560878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:45.561596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:45.562665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:45.563402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:45.564756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:45.639450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:45.652514 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-be0a1fda-73cd-4797-83d9-a731700d4ef0 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1524 microversion: 2.1 time: 1.560777 Oct 28 18:13:45.655248 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1319/2723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:44 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1524 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:45.664505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da2485e8-80c2-4923-adc5-d2471871b63a tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de2d7f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:45.773328 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-da2485e8-80c2-4923-adc5-d2471871b63a tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1467 microversion: 2.1 time: 0.116529 Oct 28 18:13:45.788299 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1320/2724] 10.222.0.16 () {58 vars in 1338 bytes} [Fri Oct 28 18:13:45 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F88c6fd04-db62-4518-9726-de061cb29c49 => generated 1467 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:45.796054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9f140470-f0c4-40b2-9c0c-f2f60a668726 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de148a60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:45.815361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:45.831699 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47835e22-0b62-43c3-9a3a-36cf8678cfbb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.297707 Oct 28 18:13:45.832574 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1405/2725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:45 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:45.843073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:45.846259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:45.860377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:45.864319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:45.864806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:45.865563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:45.868285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:45.868749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:45.869044 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9f140470-f0c4-40b2-9c0c-f2f60a668726 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1467 microversion: 2.1 time: 0.079122 Oct 28 18:13:45.869709 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1321/2726] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Oct 28 18:13:45 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F88c6fd04-db62-4518-9726-de061cb29c49 => generated 1467 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:45.886757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2fb1bf0e-968c-43b2-8b16-ca486820bea3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de148550>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:46.057961 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2fb1bf0e-968c-43b2-8b16-ca486820bea3 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.175145 Oct 28 18:13:46.080434 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1322/2727] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 18:13:45 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:46.088426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29650a0f-7ee4-4202-964d-659855aaac45 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de2673a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:46.223683 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-29650a0f-7ee4-4202-964d-659855aaac45 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.141497 Oct 28 18:13:46.242750 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1323/2728] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 18:13:46 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:46.249277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ba878c88-01e5-4e74-8e7c-e9079de133eb tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78e256a040>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:46.303742 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ba878c88-01e5-4e74-8e7c-e9079de133eb tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/f17ba65f-a473-4179-8631-ca52e11cfd46" status: 200 len: 784 microversion: 2.1 time: 0.059216 Oct 28 18:13:46.314762 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1324/2729] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:13:46 2022] GET /compute/v2.1/images/f17ba65f-a473-4179-8631-ca52e11cfd46 => generated 784 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:46.321887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08812c5d-6618-429d-9ac8-f154bf740ccc tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de267310>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:46.404201 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08812c5d-6618-429d-9ac8-f154bf740ccc tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.087972 Oct 28 18:13:46.404795 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1325/2730] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:13:46 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:46.422387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fd8d49bb-17bc-454c-ad8b-a8f86304b6b6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de7f6160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:46.701012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:46.724175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:46.732090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:46.737147 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b6d55e7-9a11-428e-a771-6925714ec6a2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.898049 Oct 28 18:13:46.753147 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1406/2731] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:45 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:46.771564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:46.778523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:46.790281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:46.792347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:46.800147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:46.800925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:46.801410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:46.801848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:47.081829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:47.098732 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b43c3ce7-b4f7-43d9-8715-d3956065dc1f tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1470 microversion: 2.1 time: 0.337044 Oct 28 18:13:47.099741 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1407/2732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:46 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:47.105119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:47.105782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:47.121277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:47.121976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:47.122609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:47.123619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:47.124283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:47.124869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:47.573759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:47.588354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-746e0157-62b0-4769-a810-5d956a06bccf tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1524 microversion: 2.1 time: 0.485621 Oct 28 18:13:47.591532 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1408/2733] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:47 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1524 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:47.597884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:47.598511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:47.606641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:47.607247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:47.607686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:47.612874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:47.613414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:47.613885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:47.634888 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fd8d49bb-17bc-454c-ad8b-a8f86304b6b6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "DELETE /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5" status: 204 len: 0 microversion: 2.1 time: 1.216910 Oct 28 18:13:47.636211 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1326/2734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:46 2022] DELETE /compute/v2.1/images/b83a058c-7d73-4239-966f-18c234f7e4a5 => generated 0 bytes in 1219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:47.645089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ac6e87f0-0207-4706-b23e-784919e9b27c req-a5ef24ea-328e-4661-b1fb-c2261d092a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09b4345-86e2-477d-a81e-f3c0c69aa329", "name": "network-vif-unplugged", "status": "completed", "tag": "5a0dbef9-5dc4-41f9-816a-6e013f850f4e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:47.664142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ac6e87f0-0207-4706-b23e-784919e9b27c req-a5ef24ea-328e-4661-b1fb-c2261d092a5a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:47.667227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ac6e87f0-0207-4706-b23e-784919e9b27c req-a5ef24ea-328e-4661-b1fb-c2261d092a5a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:47.667659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ac6e87f0-0207-4706-b23e-784919e9b27c req-a5ef24ea-328e-4661-b1fb-c2261d092a5a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:47.695608 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ac6e87f0-0207-4706-b23e-784919e9b27c req-a5ef24ea-328e-4661-b1fb-c2261d092a5a service nova] Creating event network-vif-unplugged:5a0dbef9-5dc4-41f9-816a-6e013f850f4e for instance c09b4345-86e2-477d-a81e-f3c0c69aa329 on n-h1-862404-2 Oct 28 18:13:47.702739 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ac6e87f0-0207-4706-b23e-784919e9b27c req-a5ef24ea-328e-4661-b1fb-c2261d092a5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064307 Oct 28 18:13:47.703450 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1327/2735] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:47.710413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0993a5a2-a460-47a7-928c-c4595ce242e0 req-c0095bbd-19f1-49a2-988c-fb25c223d04f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "tag": "ad067f57-087c-42da-93dc-9dfd4efd49b3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:47.728196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0993a5a2-a460-47a7-928c-c4595ce242e0 req-c0095bbd-19f1-49a2-988c-fb25c223d04f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:47.728808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0993a5a2-a460-47a7-928c-c4595ce242e0 req-c0095bbd-19f1-49a2-988c-fb25c223d04f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:47.729321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0993a5a2-a460-47a7-928c-c4595ce242e0 req-c0095bbd-19f1-49a2-988c-fb25c223d04f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:47.748122 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0993a5a2-a460-47a7-928c-c4595ce242e0 req-c0095bbd-19f1-49a2-988c-fb25c223d04f service nova] Creating event network-changed:ad067f57-087c-42da-93dc-9dfd4efd49b3 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:13:47.754821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0993a5a2-a460-47a7-928c-c4595ce242e0 req-c0095bbd-19f1-49a2-988c-fb25c223d04f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049615 Oct 28 18:13:47.756387 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1328/2736] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:47.762559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b05a0bb4-243f-4779-b4e0-abd6a39e0a02 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78de1e7700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:47.854700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:47.863987 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3d59d83-e282-4f6e-97bf-9aced9a44db9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.271160 Oct 28 18:13:47.864826 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1409/2737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:47 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:47.876730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:47.877602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:47.886259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:47.887474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:47.887948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:47.889360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:47.889826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:47.890252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.120059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:48.122519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:48.133879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:48.136683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:48.139112 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f1d8cb8c-038f-4d62-b89d-d443258257ed tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.268149 Oct 28 18:13:48.140032 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1410/2738] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:47 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:48.301068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Action: 'update', calling method: .version_select at 0x7f78e23d9700>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:48.305301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.305818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.307370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.330395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.331111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.331534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.340936 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] HTTP exception thrown: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Request method failure captured: Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc HTTP/1.1 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 56 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvb2dQyJ3gY9iBMxw5BRtZPdW4tqncZZxo3Ye96qNiAbfiOumQLUL9Qm7cqtmMcqRfxgtJWNUte5-J7CsYTyqxc29Pzxxd1C3-3BiZkMJWOvOgIAy2IT8JzSXsELMHpvRQOoCtE_d1p2J2KFq4vteDbVR-tHixWIeTBMRWMj7N0yD0 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 9fab85bf10804f5faff816f6316e1bc6 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9fab85bf10804f5faff816f6316e1bc6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 9fab85bf10804f5faff816f6316e1bc6 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: f8e5b910d4144826b541fbaf71f8f7af Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: exception: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f368a5b3-08be-48c6-bf9f-6960bfa1c8cc', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:48.342897 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Returning 404 to user: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8f8d8ca-3cc3-4837-a25f-7af97a23022f tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc" status: 404 len: 110 microversion: 2.53 time: 0.203020 Oct 28 18:13:48.348314 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1411/2739] 10.222.0.16 () {62 vars in 1309 bytes} [Fri Oct 28 18:13:48 2022] PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc => generated 110 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:13:48.350811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:48.351699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:48.359660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.368000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.369340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.370284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.371145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.371781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.518667 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b05a0bb4-243f-4779-b4e0-abd6a39e0a02 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "DELETE /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad" status: 204 len: 0 microversion: 2.1 time: 0.760882 Oct 28 18:13:48.522790 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1329/2740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:47 2022] DELETE /compute/v2.1/images/16243c26-beeb-4e81-84b0-31d4f77235ad => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:48.529609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Action: 'update', calling method: .version_select at 0x7f78de1e7dc0>, body: {"status": "disabled"} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:48.534674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.535466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.536129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.550614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=23 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:48.555303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.555803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.556453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.562059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:48.565377 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] HTTP exception thrown: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Request method failure captured: Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: request: PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc HTTP/1.1 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 22 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvb2dQyJ3gY9iBMxw5BRtZPdW4tqncZZxo3Ye96qNiAbfiOumQLUL9Qm7cqtmMcqRfxgtJWNUte5-J7CsYTyqxc29Pzxxd1C3-3BiZkMJWOvOgIAy2IT8JzSXsELMHpvRQOoCtE_d1p2J2KFq4vteDbVR-tHixWIeTBMRWMj7N0yD0 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 9fab85bf10804f5faff816f6316e1bc6 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9fab85bf10804f5faff816f6316e1bc6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 9fab85bf10804f5faff816f6316e1bc6 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: f8e5b910d4144826b541fbaf71f8f7af Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: {"status": "disabled"} Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: exception: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f368a5b3-08be-48c6-bf9f-6960bfa1c8cc', 'body': {'status': 'disabled'}} Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:48.567462 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.571424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.572162 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2cd250f9-e2fa-438e-bd05-5591c36ba27e tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1470 microversion: 2.1 time: 0.224096 Oct 28 18:13:48.572162 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1412/2741] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:48 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:48.573524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Returning 404 to user: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:48.574548 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f651ad51-de92-4246-90b2-b54302e0463c tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc" status: 404 len: 110 microversion: 2.53 time: 0.050616 Oct 28 18:13:48.575123 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1330/2742] 10.222.0.16 () {62 vars in 1309 bytes} [Fri Oct 28 18:13:48 2022] PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:13:48.584038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Action: 'update', calling method: .version_select at 0x7f78de1e7310>, body: {"status": "enabled"} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:48.584619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a103571e-70d8-494a-958c-c651fcbee5a2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dd752550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:48.590615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.591112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.591574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.599062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.599908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.601220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.607995 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] HTTP exception thrown: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Request method failure captured: Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: request: PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc HTTP/1.1 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 21 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvb2dQyJ3gY9iBMxw5BRtZPdW4tqncZZxo3Ye96qNiAbfiOumQLUL9Qm7cqtmMcqRfxgtJWNUte5-J7CsYTyqxc29Pzxxd1C3-3BiZkMJWOvOgIAy2IT8JzSXsELMHpvRQOoCtE_d1p2J2KFq4vteDbVR-tHixWIeTBMRWMj7N0yD0 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 9fab85bf10804f5faff816f6316e1bc6 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9fab85bf10804f5faff816f6316e1bc6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9fab85bf10804f5faff816f6316e1bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 9fab85bf10804f5faff816f6316e1bc6 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053 Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: f8e5b910d4144826b541fbaf71f8f7af Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: {"status": "enabled"} Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: exception: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f368a5b3-08be-48c6-bf9f-6960bfa1c8cc', 'body': {'status': 'enabled'}} Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:13:48.611136 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. Oct 28 18:13:48.614883 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:48.617962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Returning 404 to user: Service f368a5b3-08be-48c6-bf9f-6960bfa1c8cc could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:48.618658 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3e311b20-7e54-4b6c-a742-385a49ea62e7 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc" status: 404 len: 110 microversion: 2.53 time: 0.038136 Oct 28 18:13:48.619768 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1331/2743] 10.222.0.16 () {62 vars in 1309 bytes} [Fri Oct 28 18:13:48 2022] PUT /compute/v2.1/os-services/f368a5b3-08be-48c6-bf9f-6960bfa1c8cc => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:13:48.635959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:48.636826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:48.645641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.646456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.648133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:48.649092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:48.649781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:48.650409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.135408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:49.147115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-acbc9b4e-e291-46e7-b548-662306732784 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1524 microversion: 2.1 time: 0.526246 Oct 28 18:13:49.151012 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1332/2744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:48 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1524 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:49.171040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79e04a50-2a15-4ce2-83c4-050c0776c705 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:49.189505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e04a50-2a15-4ce2-83c4-050c0776c705 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.190002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e04a50-2a15-4ce2-83c4-050c0776c705 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.203849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e04a50-2a15-4ce2-83c4-050c0776c705 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.220990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e04a50-2a15-4ce2-83c4-050c0776c705 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.226100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e04a50-2a15-4ce2-83c4-050c0776c705 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.226918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e04a50-2a15-4ce2-83c4-050c0776c705 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.261471 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a103571e-70d8-494a-958c-c651fcbee5a2 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "DELETE /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be" status: 204 len: 0 microversion: 2.1 time: 0.689127 Oct 28 18:13:49.262374 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1413/2745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:48 2022] DELETE /compute/v2.1/images/59ff4818-9fd1-4a06-9cbf-5218232ce4be => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:49.270656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:49.275762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:49.290590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.291100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.292642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.293308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.293514 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79e04a50-2a15-4ce2-83c4-050c0776c705 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.140729 Oct 28 18:13:49.293770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.294209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.303059 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1333/2746] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 18:13:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:49.314760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:49.315398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:49.352679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.354557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.360213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.364620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.365525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.366815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.708851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:49.718512 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a54abaf8-6f77-4a53-9b56-c2a0959c4116 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.454565 Oct 28 18:13:49.732538 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1414/2747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:49 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:49.741049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:49.741855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:49.750034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.750515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.750989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.751714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.752196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.752790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.793167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:13:49.916107 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2fcfece-f944-4163-a123-3e19c7f2a6d1 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 204 len: 0 microversion: 2.1 time: 0.181735 Oct 28 18:13:49.917558 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1415/2748] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:13:49 2022] DELETE /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:49.924591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d44efbf3-68dc-4608-8ac3-f709355ba6fd tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:49.928936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44efbf3-68dc-4608-8ac3-f709355ba6fd tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.929603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44efbf3-68dc-4608-8ac3-f709355ba6fd tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.930202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44efbf3-68dc-4608-8ac3-f709355ba6fd tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.931376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44efbf3-68dc-4608-8ac3-f709355ba6fd tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.932318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44efbf3-68dc-4608-8ac3-f709355ba6fd tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.932896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44efbf3-68dc-4608-8ac3-f709355ba6fd tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.971184 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d44efbf3-68dc-4608-8ac3-f709355ba6fd tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.052162 Oct 28 18:13:49.972357 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1416/2749] 10.222.0.16 () {60 vars in 1211 bytes} [Fri Oct 28 18:13:49 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:49.977232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:49.978167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:49.990615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.991618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.992685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.993578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.994177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.994793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.036920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.037622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.038340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.038944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lazy-loading 'fault' on Instance uuid 8790e29d-c2d9-479a-a1fc-13096df78fce {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:13:50.103464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.112835 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b5de7b4-9c62-47ee-bcb8-bc04dc2c4c21 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 200 len: 1304 microversion: 2.1 time: 0.139250 Oct 28 18:13:50.113659 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1417/2750] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:49 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:50.121134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e4c3fe0e-32b0-4dd2-a9e2-5f54fbc22aa5 req-5affa7e3-b869-43fc-b715-d35528a11a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8790e29d-c2d9-479a-a1fc-13096df78fce", "name": "network-vif-deleted", "tag": "ba56f280-40be-4d22-bda1-d0453d7cf79d"}, {"name": "network-changed", "server_uuid": "0074c72c-bbb0-4ab2-8aee-079cb1aef133", "tag": "0b0d747a-b6c8-4925-b3ce-f5f4c717489c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:50.134984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e4c3fe0e-32b0-4dd2-a9e2-5f54fbc22aa5 req-5affa7e3-b869-43fc-b715-d35528a11a24 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.135782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e4c3fe0e-32b0-4dd2-a9e2-5f54fbc22aa5 req-5affa7e3-b869-43fc-b715-d35528a11a24 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.136365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e4c3fe0e-32b0-4dd2-a9e2-5f54fbc22aa5 req-5affa7e3-b869-43fc-b715-d35528a11a24 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.150040 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e4c3fe0e-32b0-4dd2-a9e2-5f54fbc22aa5 req-5affa7e3-b869-43fc-b715-d35528a11a24 service nova] Creating event network-vif-deleted:ba56f280-40be-4d22-bda1-d0453d7cf79d for instance 8790e29d-c2d9-479a-a1fc-13096df78fce on n-h1-862404-2 Oct 28 18:13:50.150541 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e4c3fe0e-32b0-4dd2-a9e2-5f54fbc22aa5 req-5affa7e3-b869-43fc-b715-d35528a11a24 service nova] Creating event network-changed:0b0d747a-b6c8-4925-b3ce-f5f4c717489c for instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 on n-h1-862404-2 Oct 28 18:13:50.158406 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e4c3fe0e-32b0-4dd2-a9e2-5f54fbc22aa5 req-5affa7e3-b869-43fc-b715-d35528a11a24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042027 Oct 28 18:13:50.159298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1418/2751] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:50.164838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:50.165828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:50.174300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.175062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.175688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.176616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.177262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.177870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.415258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.424468 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-825dfbf0-2814-4b71-bb01-b33d43881f0e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1473 microversion: 2.1 time: 0.263671 Oct 28 18:13:50.425651 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1419/2752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:50 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1473 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:50.430427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-911ad9b3-45b8-40c3-8205-1fe44445cf33 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:50.434055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-911ad9b3-45b8-40c3-8205-1fe44445cf33 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.434724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-911ad9b3-45b8-40c3-8205-1fe44445cf33 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.435354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-911ad9b3-45b8-40c3-8205-1fe44445cf33 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.436279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-911ad9b3-45b8-40c3-8205-1fe44445cf33 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.436966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-911ad9b3-45b8-40c3-8205-1fe44445cf33 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.437562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-911ad9b3-45b8-40c3-8205-1fe44445cf33 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.465317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-911ad9b3-45b8-40c3-8205-1fe44445cf33 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038376 Oct 28 18:13:50.465953 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1420/2753] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 18:13:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:50.470891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:50.471526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:50.477914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.478434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.479063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.479770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.480254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.480684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.499558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.510285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.511979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.513215 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2555366d-d22a-4785-9a9f-81090a734220 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 1.208841 Oct 28 18:13:50.513859 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1334/2754] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:49 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:50.519069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-856c4bfa-7dd2-44ac-9967-62d784d1881b tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:50.522929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-856c4bfa-7dd2-44ac-9967-62d784d1881b tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.523642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-856c4bfa-7dd2-44ac-9967-62d784d1881b tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.524454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-856c4bfa-7dd2-44ac-9967-62d784d1881b tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.525411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-856c4bfa-7dd2-44ac-9967-62d784d1881b tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.526084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-856c4bfa-7dd2-44ac-9967-62d784d1881b tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.526745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-856c4bfa-7dd2-44ac-9967-62d784d1881b tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.553920 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-856c4bfa-7dd2-44ac-9967-62d784d1881b tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862404-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038739 Oct 28 18:13:50.555186 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1335/2755] 10.222.0.16 () {60 vars in 1235 bytes} [Fri Oct 28 18:13:50 2022] GET /compute/v2.1/os-services?host=n-d-862404-2&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:50.567527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a8b4b82-2c18-402f-b021-62cf68c32ed1 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:50.571220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a8b4b82-2c18-402f-b021-62cf68c32ed1 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.571708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a8b4b82-2c18-402f-b021-62cf68c32ed1 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.572209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a8b4b82-2c18-402f-b021-62cf68c32ed1 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.572946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a8b4b82-2c18-402f-b021-62cf68c32ed1 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.573573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a8b4b82-2c18-402f-b021-62cf68c32ed1 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.574006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a8b4b82-2c18-402f-b021-62cf68c32ed1 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.593695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:50.603581 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a8b4b82-2c18-402f-b021-62cf68c32ed1 tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040781 Oct 28 18:13:50.605019 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1336/2756] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 18:13:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:50.618761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49b49540-9ceb-4b4b-b036-a323cbce64cf tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:50.622874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b49540-9ceb-4b4b-b036-a323cbce64cf tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.623473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b49540-9ceb-4b4b-b036-a323cbce64cf tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.624169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b49540-9ceb-4b4b-b036-a323cbce64cf tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.625154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b49540-9ceb-4b4b-b036-a323cbce64cf tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.627337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b49540-9ceb-4b4b-b036-a323cbce64cf tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.628185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49b49540-9ceb-4b4b-b036-a323cbce64cf tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.638381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:50.655593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.669955 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f0f433a-15d6-4bfd-813f-8d656dd60656 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1524 microversion: 2.1 time: 0.201472 Oct 28 18:13:50.671009 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49b49540-9ceb-4b4b-b036-a323cbce64cf tempest-ServicesAdminNegativeV253TestJSON-408958053 tempest-ServicesAdminNegativeV253TestJSON-408958053-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.056091 Oct 28 18:13:50.672010 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1337/2757] 10.222.0.16 () {60 vars in 1239 bytes} [Fri Oct 28 18:13:50 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:50.679412 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1421/2758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:50 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1524 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:50.746470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:50.747092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:50.750155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:50.755252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.755753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.756226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.756928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.757619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.758053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.809492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77fa232f-9cc3-4b14-97e4-74c675022534 tempest-ServicesAdminNegativeV253TestJSON-2143966838 tempest-ServicesAdminNegativeV253TestJSON-2143966838-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:50.815456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-77fa232f-9cc3-4b14-97e4-74c675022534 tempest-ServicesAdminNegativeV253TestJSON-2143966838 tempest-ServicesAdminNegativeV253TestJSON-2143966838-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '69d4374524674f86a676d021156b3988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ce86030366479aa7721dd75ecbdff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77fa232f-9cc3-4b14-97e4-74c675022534 tempest-ServicesAdminNegativeV253TestJSON-2143966838 tempest-ServicesAdminNegativeV253TestJSON-2143966838-project] Request method failure captured: Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvarfysi5tQ0Ezq3KswEbmLKLAuwmyKmd5HstcTlzkTTpaG3ynQ38s7sNuwO7iA7WXQ_O7n_HWeFFdRKFGhFVENvv8zxUizJDJBK6Wuhpvw7Dn9ztgx4tl03KTNmuO9Ub-d1mureXrLVE0_XdSdVEI-wG9i5HBJ6N6_O7FMte8p6wU Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 66ce86030366479aa7721dd75ecbdff5 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2143966838 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66ce86030366479aa7721dd75ecbdff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66ce86030366479aa7721dd75ecbdff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66ce86030366479aa7721dd75ecbdff5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66ce86030366479aa7721dd75ecbdff5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2143966838 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 66ce86030366479aa7721dd75ecbdff5 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2143966838 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2143966838-project Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 69d4374524674f86a676d021156b3988 Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2143966838-project Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: action_args: {} Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 18:13:50.817367 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 18:13:50.821730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:50.823409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77fa232f-9cc3-4b14-97e4-74c675022534 tempest-ServicesAdminNegativeV253TestJSON-2143966838 tempest-ServicesAdminNegativeV253TestJSON-2143966838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:50.825588 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-77fa232f-9cc3-4b14-97e4-74c675022534 tempest-ServicesAdminNegativeV253TestJSON-2143966838 tempest-ServicesAdminNegativeV253TestJSON-2143966838-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.143260 Oct 28 18:13:50.827943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1338/2759] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 18:13:50 2022] GET /compute/v2.1/os-services => generated 112 bytes in 145 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:13:50.914314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.925459 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4433414-251b-45a2-9353-94d382d0acf1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.182770 Oct 28 18:13:50.926498 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1422/2760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:50 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:51.138363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:51.138994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 8790e29d-c2d9-479a-a1fc-13096df78fce] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:51.159558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.160090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.160543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.161264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.161729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.162165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.181253 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] HTTP exception thrown: Instance 8790e29d-c2d9-479a-a1fc-13096df78fce could not be found. Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Request method failure captured: Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce HTTP/1.1 Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBslXIQJ5loOz7l6_tEqr0gumfOJA0PbG3BoU-1rcbqQ4KXGw1O8_DOxNLVCZmYutlGq0j-iXfrK85Bpcq2S20Tw9ew6uUM5lqMIEuhNZ4i1fHrSboznlo1JJ_qxW1Nj3DqoGEwpidD_yFyDbN_RE1tnhIcfJAuMFQbNjf2EicmWMso Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 6aa20e2a97184d9e93c88bd42520667e Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6aa20e2a97184d9e93c88bd42520667e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 6aa20e2a97184d9e93c88bd42520667e Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersAdminTestJSON-397311428-project Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 375f8887d73d4adbabe4ac06d48ccc70 Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersAdminTestJSON-397311428-project Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 8790e29d-c2d9-479a-a1fc-13096df78fce could not be found. Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8790e29d-c2d9-479a-a1fc-13096df78fce'} Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8790e29d-c2d9-479a-a1fc-13096df78fce could not be found. Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8790e29d-c2d9-479a-a1fc-13096df78fce could not be found. Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:51.183686 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:51.189064 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:51.189064 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:51.189064 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:51.189064 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:51.189064 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:51.189064 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8790e29d-c2d9-479a-a1fc-13096df78fce could not be found. Oct 28 18:13:51.189064 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:13:51.198996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Returning 404 to user: Instance 8790e29d-c2d9-479a-a1fc-13096df78fce could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:51.201796 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-652e0c65-9b8d-4595-8915-7ee381fde30d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce" status: 404 len: 111 microversion: 2.1 time: 0.067219 Oct 28 18:13:51.202390 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1339/2761] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:51 2022] GET /compute/v2.1/servers/8790e29d-c2d9-479a-a1fc-13096df78fce => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:51.212938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:51.214340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:51.224794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.232333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-68738c31-d46a-47ac-9158-abc87f791d6f req-472de3d9-2e88-4d7e-a964-90ae956ed958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09b4345-86e2-477d-a81e-f3c0c69aa329", "name": "network-vif-plugged", "status": "completed", "tag": "5a0dbef9-5dc4-41f9-816a-6e013f850f4e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:51.233519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.234154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.236543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.242712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.243319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.262414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-68738c31-d46a-47ac-9158-abc87f791d6f req-472de3d9-2e88-4d7e-a964-90ae956ed958 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.263397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-68738c31-d46a-47ac-9158-abc87f791d6f req-472de3d9-2e88-4d7e-a964-90ae956ed958 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.263963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-68738c31-d46a-47ac-9158-abc87f791d6f req-472de3d9-2e88-4d7e-a964-90ae956ed958 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.290418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-68738c31-d46a-47ac-9158-abc87f791d6f req-472de3d9-2e88-4d7e-a964-90ae956ed958 service nova] Creating event network-vif-plugged:5a0dbef9-5dc4-41f9-816a-6e013f850f4e for instance c09b4345-86e2-477d-a81e-f3c0c69aa329 on n-h1-862404-2 Oct 28 18:13:51.311792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:13:51.314348 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-68738c31-d46a-47ac-9158-abc87f791d6f req-472de3d9-2e88-4d7e-a964-90ae956ed958 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085023 Oct 28 18:13:51.326462 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1340/2762] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:13:51.438678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c684bfa-6a9a-4468-b046-d09c8e0ad54d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 204 len: 0 microversion: 2.1 time: 0.230371 Oct 28 18:13:51.443914 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1423/2763] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:13:51 2022] DELETE /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:51.452580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:51.453299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:51.465111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.465618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.466070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.466789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.467270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.467674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.469355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:51.474276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:51.489485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.489998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.490666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.491437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.491923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.492355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.723264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:51.723754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:51.741036 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbe1076d-f436-4f75-ba34-5fc04052880e tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1473 microversion: 2.1 time: 0.295460 Oct 28 18:13:51.756832 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1341/2764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:51 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1473 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:51.762934 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e09a04fd-0c98-4668-b170-5a07bbb5ea3d tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1470 microversion: 2.1 time: 0.302023 Oct 28 18:13:51.763567 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1424/2765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:51 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:51.764583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:51.765299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:51.769880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:51.770692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:51.780714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.781401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.781655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.785123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.785623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.786064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.793636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.794130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.794581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.795303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.795764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.800838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.031534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:52.051087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:52.070684 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39ab602c-8ea0-448a-9fd6-b74d0c8490b9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1524 microversion: 2.1 time: 0.304503 Oct 28 18:13:52.073513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:52.073895 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1425/2766] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:51 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1524 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:52.078013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:52.082044 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d54b2e24-7a16-4222-a12f-129ae9e3f302 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.335891 Oct 28 18:13:52.108165 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1342/2767] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:51 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:52.116683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:52.117394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:52.124253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.125173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.125962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.128350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.129590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.130518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.306329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:52.316740 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6b8a43e6-df61-4764-a618-395c386035e5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.204304 Oct 28 18:13:52.317511 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1343/2768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:52 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:52.424433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd0840fe-4e5e-42f1-8fa3-e6e1f148832b tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78dd70d1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-894167184", "description": "tempest-description-1081857091"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:52.703282 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd0840fe-4e5e-42f1-8fa3-e6e1f148832b tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.627762 Oct 28 18:13:52.705392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1426/2769] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:13:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:52.719257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aed05bec-cec1-4212-86e8-48653e1d429d tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78e2557310>, body: {"security_group_rule": {"parent_group_id": "20246a0c-3c1e-4a5e-ab66-ec4d73fd1847", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:52.769090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:52.770106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:52.781332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.782011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.783780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.784797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.786166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.786760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.970196 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aed05bec-cec1-4212-86e8-48653e1d429d tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.254631 Oct 28 18:13:52.970935 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1344/2770] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:13:52 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:13:52.983733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:52.985028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:52.994876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.995897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.996691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.997618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.998285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.998919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:53.006059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:53.019742 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f27a5ca-997f-4136-b939-2e1341027937 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1473 microversion: 2.1 time: 0.256785 Oct 28 18:13:53.021244 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1427/2771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:52 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:53.027873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0049f921-2ffa-4e54-90a4-c6f18d7d5e21 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78de4e08b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-626588476", "description": "tempest-description-1898255026"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:53.282728 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0049f921-2ffa-4e54-90a4-c6f18d7d5e21 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.259603 Oct 28 18:13:53.284138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1428/2772] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:13:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:53.289185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:53.289806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:53.296945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:53.297448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:53.298775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:53.299600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:53.300088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:53.300521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:53.325706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:53.390311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:53.399027 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f789fb6-aee4-4c50-ba73-373bc204310a tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1470 microversion: 2.1 time: 0.426111 Oct 28 18:13:53.399618 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1345/2773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:52 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:53.415993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:53.416615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:53.431422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:53.431946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:53.432751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:53.433708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:53.434435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:53.435181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:53.721065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:53.746406 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1043117a-b95d-4e49-8a45-f726750ebd81 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1524 microversion: 2.1 time: 0.460621 Oct 28 18:13:53.773040 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1429/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:53 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1524 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:53.798026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef3df0ba-3713-4f42-927d-17ca1c484403 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78dd70d160>, body: {"security_group_rule": {"parent_group_id": "1dc7b246-0ac8-45b4-bdbf-ad08537e4f93", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:54.193556 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef3df0ba-3713-4f42-927d-17ca1c484403 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.417182 Oct 28 18:13:54.194205 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1430/2775] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:13:53 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:54.198747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:54.202176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:54.219936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:54.222968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:54.234274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:54.235421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:54.236435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:54.237101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:54.309535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:54.323798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:54.337834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:54.339269 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffcc511b-5b03-4b3d-aba4-10d61b803684 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.938692 Oct 28 18:13:54.340346 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1346/2776] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:53 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:54.346267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-bf60d282-731d-43ac-b7d3-08d7adf1bd19 req-2517d2e6-1688-408b-ac35-f10ed28ece1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6", "name": "network-vif-plugged", "status": "completed", "tag": "f5fcb9bc-34ba-42a9-8fe8-cebeedcb5338"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:54.374918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bf60d282-731d-43ac-b7d3-08d7adf1bd19 req-2517d2e6-1688-408b-ac35-f10ed28ece1e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:54.378153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bf60d282-731d-43ac-b7d3-08d7adf1bd19 req-2517d2e6-1688-408b-ac35-f10ed28ece1e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:54.378757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bf60d282-731d-43ac-b7d3-08d7adf1bd19 req-2517d2e6-1688-408b-ac35-f10ed28ece1e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:54.401301 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-bf60d282-731d-43ac-b7d3-08d7adf1bd19 req-2517d2e6-1688-408b-ac35-f10ed28ece1e service nova] Creating event network-vif-plugged:f5fcb9bc-34ba-42a9-8fe8-cebeedcb5338 for instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 on n-h1-862404-2 Oct 28 18:13:54.407316 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-bf60d282-731d-43ac-b7d3-08d7adf1bd19 req-2517d2e6-1688-408b-ac35-f10ed28ece1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065485 Oct 28 18:13:54.408379 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1347/2777] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:54.427316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:54.448399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:54.458714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:54.467942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:54.468628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:54.475696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:54.482067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:54.482780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:54.659997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:54.674946 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e963ee69-d14e-4a04-906f-6789338ba530 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.479650 Oct 28 18:13:54.678444 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1431/2778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:54 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:54.693133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43f643c8-f48a-4fb7-a927-1592daf4a2ba tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78dd701160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-636540170", "description": "tempest-description-87073041"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:55.138388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43f643c8-f48a-4fb7-a927-1592daf4a2ba tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.460173 Oct 28 18:13:55.139770 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1432/2779] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:13:54 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:55.146017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:55.146869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:55.169784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.170516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.171145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.172544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.173382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.174327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.216438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.217822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.218469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.219267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lazy-loading 'fault' on Instance uuid 9701323d-b2b2-48a1-baf9-4ee8521c95be {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:13:55.332573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375f8887d73d4adbabe4ac06d48ccc70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa20e2a97184d9e93c88bd42520667e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:55.343634 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0ca406e9-aefb-49cb-b5a5-41f936cd51ee tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 200 len: 1304 microversion: 2.1 time: 0.202500 Oct 28 18:13:55.347131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1433/2780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:55 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:55.369105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ccdf2c32-9992-45f1-a930-92a0e6996ce3 req-bc16c950-48c0-4ce2-a7c3-db2b89866445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9701323d-b2b2-48a1-baf9-4ee8521c95be", "name": "network-vif-deleted", "tag": "6b4f741f-8159-46fb-a039-2ded83b18128"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:55.398555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ccdf2c32-9992-45f1-a930-92a0e6996ce3 req-bc16c950-48c0-4ce2-a7c3-db2b89866445 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.400251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ccdf2c32-9992-45f1-a930-92a0e6996ce3 req-bc16c950-48c0-4ce2-a7c3-db2b89866445 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.400698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ccdf2c32-9992-45f1-a930-92a0e6996ce3 req-bc16c950-48c0-4ce2-a7c3-db2b89866445 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.445729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:55.447851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ccdf2c32-9992-45f1-a930-92a0e6996ce3 req-bc16c950-48c0-4ce2-a7c3-db2b89866445 service nova] Creating event network-vif-deleted:6b4f741f-8159-46fb-a039-2ded83b18128 for instance 9701323d-b2b2-48a1-baf9-4ee8521c95be on n-h2-862404-2 Oct 28 18:13:55.455805 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ccdf2c32-9992-45f1-a930-92a0e6996ce3 req-bc16c950-48c0-4ce2-a7c3-db2b89866445 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104332 Oct 28 18:13:55.456902 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1434/2781] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:55.459788 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ebda8b57-86e0-4ec2-8ce3-8d3379740e9f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1473 microversion: 2.1 time: 1.041785 Oct 28 18:13:55.460729 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1348/2782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:54 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1473 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:55.464751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:55.466020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:55.474759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.475972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.476665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.478856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.479676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.481446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.488216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-412e587b-62ec-4413-ba15-bdb42a255107 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78de262820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-615698423", "description": "tempest-description-1470171569"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:55.842000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:55.853286 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8f4f9ad-ed7b-4f08-9bea-643579ce49a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1524 microversion: 2.1 time: 0.392911 Oct 28 18:13:55.854756 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1435/2783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:55 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1524 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:55.883085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:55.883706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:55.904375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.904951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.906024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.909239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.909982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.911649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.195025 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-412e587b-62ec-4413-ba15-bdb42a255107 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.717665 Oct 28 18:13:56.197117 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1349/2784] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:13:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:56.203113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:56.203805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:56.244930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.250295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.250772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.252089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.252556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.254136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.254574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:56.266429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:56.268642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:56.277360 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-143a97c0-068b-45f5-a664-787388b803c9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.422478 Oct 28 18:13:56.278621 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1436/2785] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:55 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:56.285831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0a67eeb9-25af-4d8e-8a62-668fe3c82100 req-ff6af4a6-d5cc-42cd-a884-110f02b3af12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c6fd04-db62-4518-9726-de061cb29c49", "name": "network-vif-deleted", "tag": "e328e141-4427-4198-8fef-00dcd59707ab"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:56.301944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a67eeb9-25af-4d8e-8a62-668fe3c82100 req-ff6af4a6-d5cc-42cd-a884-110f02b3af12 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.303951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a67eeb9-25af-4d8e-8a62-668fe3c82100 req-ff6af4a6-d5cc-42cd-a884-110f02b3af12 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.305868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a67eeb9-25af-4d8e-8a62-668fe3c82100 req-ff6af4a6-d5cc-42cd-a884-110f02b3af12 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.324787 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0a67eeb9-25af-4d8e-8a62-668fe3c82100 req-ff6af4a6-d5cc-42cd-a884-110f02b3af12 service nova] Creating event network-vif-deleted:e328e141-4427-4198-8fef-00dcd59707ab for instance 88c6fd04-db62-4518-9726-de061cb29c49 on n-h2-862404-2 Oct 28 18:13:56.331831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0a67eeb9-25af-4d8e-8a62-668fe3c82100 req-ff6af4a6-d5cc-42cd-a884-110f02b3af12 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051467 Oct 28 18:13:56.334137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1437/2786] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:56.344398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-916eddf4-2b25-4b52-89ca-47717af4174a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78dd74d1f0>, body: {"security_group_rule": {"parent_group_id": "c9694d7f-e885-47b3-8278-a3605e75f359", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "aa40a5d3-8748-4910-8866-6b17410ffce9"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:56.731324 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-916eddf4-2b25-4b52-89ca-47717af4174a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.395683 Oct 28 18:13:56.731996 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1438/2787] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:13:56 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:56.737800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:56.738568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] [instance: 9701323d-b2b2-48a1-baf9-4ee8521c95be] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:56.748982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.749673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.750278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.752208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.752848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.753292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.768579 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] HTTP exception thrown: Instance 9701323d-b2b2-48a1-baf9-4ee8521c95be could not be found. Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Request method failure captured: Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be HTTP/1.1 Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBslXIQJ5loOz7l6_tEqr0gumfOJA0PbG3BoU-1rcbqQ4KXGw1O8_DOxNLVCZmYutlGq0j-iXfrK85Bpcq2S20Tw9ew6uUM5lqMIEuhNZ4i1fHrSboznlo1JJ_qxW1Nj3DqoGEwpidD_yFyDbN_RE1tnhIcfJAuMFQbNjf2EicmWMso Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 6aa20e2a97184d9e93c88bd42520667e Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6aa20e2a97184d9e93c88bd42520667e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6aa20e2a97184d9e93c88bd42520667e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 6aa20e2a97184d9e93c88bd42520667e Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdminTestJSON-397311428 Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdminTestJSON-397311428-project Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 375f8887d73d4adbabe4ac06d48ccc70 Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdminTestJSON-397311428-project Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 9701323d-b2b2-48a1-baf9-4ee8521c95be could not be found. Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '9701323d-b2b2-48a1-baf9-4ee8521c95be'} Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9701323d-b2b2-48a1-baf9-4ee8521c95be could not be found. Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9701323d-b2b2-48a1-baf9-4ee8521c95be could not be found. Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:56.770645 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.774870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:56.774870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:56.774870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:56.774870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:56.774870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:56.774870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9701323d-b2b2-48a1-baf9-4ee8521c95be could not be found. Oct 28 18:13:56.774870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.776400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] Returning 404 to user: Instance 9701323d-b2b2-48a1-baf9-4ee8521c95be could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:56.777570 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cdca1a3-e312-4c06-a1c1-9da4bfa8dba7 tempest-ServersAdminTestJSON-397311428 tempest-ServersAdminTestJSON-397311428-project] 10.222.0.16 "GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be" status: 404 len: 111 microversion: 2.1 time: 0.044426 Oct 28 18:13:56.778279 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1439/2788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:56 2022] GET /compute/v2.1/servers/9701323d-b2b2-48a1-baf9-4ee8521c95be => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:56.785854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:56.786641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:56.793395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.793894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.794344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.795243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.795980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.796790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.846666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.847392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.848111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.848894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lazy-loading 'fault' on Instance uuid 88c6fd04-db62-4518-9726-de061cb29c49 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:13:56.914158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:56.925011 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69801d38-64f5-4319-bffa-362ec4020fc4 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 200 len: 1307 microversion: 2.1 time: 0.144958 Oct 28 18:13:56.926391 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1440/2789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:56 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:56.931470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4eb7a12-ded0-4a6a-ba09-bd24598e1932 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78dd701790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-321610966", "description": "tempest-description-1941771138"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:57.075212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:57.102036 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59c118a4-0717-466f-ab97-0a1e0749cfdc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.903130 Oct 28 18:13:57.119856 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1350/2790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:56 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:57.127600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:57.129530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:57.145832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:57.146984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:57.148738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:57.149478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:57.151101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:57.152887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:57.213199 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4eb7a12-ded0-4a6a-ba09-bd24598e1932 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.284773 Oct 28 18:13:57.214699 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1441/2791] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:13:56 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:57.227696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c457ac48-7b23-4512-9e08-1b6758476827 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78dd824670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1355312643", "description": "tempest-description-280019402"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:57.499282 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c457ac48-7b23-4512-9e08-1b6758476827 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.275594 Oct 28 18:13:57.500580 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1442/2792] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:13:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:57.505548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:57.506392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:57.518370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:57.519102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:57.519792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:57.521726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:57.522260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:57.522763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:57.725275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:57.756542 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e58046e6-1c47-44cd-9100-cc9b0c5aa372 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1509 microversion: 2.1 time: 0.628704 Oct 28 18:13:57.759170 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1351/2793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:57 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1509 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:57.767455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-712c5576-acda-41df-89e5-61ba2143aacd tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78ddbd61f0>, body: {"security_group_rule": {"parent_group_id": "0a36e3d2-0c21-4659-ae2d-c5d1eed0313f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "10d402fb-770e-4afb-ab24-12f29d532910"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:57.913684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:57.933785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:57.935464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:57.939344 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8278e8c0-b9d6-4207-b851-772835057560 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.436966 Oct 28 18:13:57.940792 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1443/2794] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:57 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:13:57.976142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-060564b1-b59d-416e-b783-1e86f2ba0176 req-8c20c628-81e3-4fa1-bba7-be27f0933c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0074c72c-bbb0-4ab2-8aee-079cb1aef133", "name": "network-vif-plugged", "status": "completed", "tag": "0b0d747a-b6c8-4925-b3ce-f5f4c717489c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:57.998517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-060564b1-b59d-416e-b783-1e86f2ba0176 req-8c20c628-81e3-4fa1-bba7-be27f0933c1d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.000593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-060564b1-b59d-416e-b783-1e86f2ba0176 req-8c20c628-81e3-4fa1-bba7-be27f0933c1d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.001665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-060564b1-b59d-416e-b783-1e86f2ba0176 req-8c20c628-81e3-4fa1-bba7-be27f0933c1d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.022607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-060564b1-b59d-416e-b783-1e86f2ba0176 req-8c20c628-81e3-4fa1-bba7-be27f0933c1d service nova] Creating event network-vif-plugged:0b0d747a-b6c8-4925-b3ce-f5f4c717489c for instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 on n-h1-862404-2 Oct 28 18:13:58.030755 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-060564b1-b59d-416e-b783-1e86f2ba0176 req-8c20c628-81e3-4fa1-bba7-be27f0933c1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087963 Oct 28 18:13:58.031594 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1444/2795] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:58.043127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:58.043871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:58.052052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.052551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.053233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.053947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.054660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.055627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.230298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:58.240218 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68a7f9d3-9a16-4beb-8fcb-01c1f6ec671a tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 200 len: 1509 microversion: 2.1 time: 0.202131 Oct 28 18:13:58.241419 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1445/2796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:58 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:58.246993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:58.248811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 88c6fd04-db62-4518-9726-de061cb29c49] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:58.258285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.259716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.260920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.262159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.262908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.263749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.283520 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] HTTP exception thrown: Instance 88c6fd04-db62-4518-9726-de061cb29c49 could not be found. Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Request method failure captured: Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 HTTP/1.1 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBs7oKPSdOVN7pHkKII_-0k1ayb_3_fYaqiJCpntQZ9bEQa19QPFb8S7aA0Vx7JrhtUnseqqyr_TVVhuJ-7W8kUUo6CTqCVtGoDL5Mltp-TfCHaWQTUlnxvMnyN3qwa6_P1zlXWaKTW20afuEQhuoQnBZFAll3LRkyIL4APq7hBglw8 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ba3e97eeba9c4e0fa876db71cacafc89 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListImageFiltersTestJSON-1469853683 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba3e97eeba9c4e0fa876db71cacafc89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba3e97eeba9c4e0fa876db71cacafc89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba3e97eeba9c4e0fa876db71cacafc89", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba3e97eeba9c4e0fa876db71cacafc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListImageFiltersTestJSON-1469853683 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ba3e97eeba9c4e0fa876db71cacafc89 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1469853683 Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListImageFiltersTestJSON-1469853683-project Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 055d46cc8b314ec7a76710fbffa71a9c Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListImageFiltersTestJSON-1469853683-project Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 88c6fd04-db62-4518-9726-de061cb29c49 could not be found. Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '88c6fd04-db62-4518-9726-de061cb29c49'} Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c6fd04-db62-4518-9726-de061cb29c49 could not be found. Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c6fd04-db62-4518-9726-de061cb29c49 could not be found. Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:58.286250 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c6fd04-db62-4518-9726-de061cb29c49 could not be found. Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Returning 404 to user: Instance 88c6fd04-db62-4518-9726-de061cb29c49 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c6cbd6d-6e5f-4e1f-b68d-d9c044d74934 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49" status: 404 len: 111 microversion: 2.1 time: 0.046228 Oct 28 18:13:58.293696 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1446/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:58 2022] GET /compute/v2.1/servers/88c6fd04-db62-4518-9726-de061cb29c49 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:58.296753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:58.297565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:58.305862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.306399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.307084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.307763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.308319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.308867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.453241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:58.461456 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-423956c7-36e8-4c61-91d8-c74a1eef2e4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.169836 Oct 28 18:13:58.462317 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1447/2798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:58 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:58.467067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:58.467570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:58.474663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.475159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.475609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.476357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.476818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.477248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.504808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:13:58.598600 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ed36d08-383a-4da8-8f16-3cbcb8fbce4e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 204 len: 0 microversion: 2.1 time: 0.134901 Oct 28 18:13:58.599773 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1448/2799] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:13:58 2022] DELETE /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:58.606207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:58.607209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:58.618245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.619210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.619976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.621386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:58.622250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:58.623184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:58.659765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:13:58.772959 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ebb23b4d-d4b9-4e0e-a617-e2f708cdec7c tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 204 len: 0 microversion: 2.1 time: 0.170781 Oct 28 18:13:58.774053 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1449/2800] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:13:58 2022] DELETE /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:58.784137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-868202127", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "eb145875-a83f-4638-a01f-ece8f5867a2a"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:58.849360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] validate_networks() for [('eb145875-a83f-4638-a01f-ece8f5867a2a', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:13:59.114934 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-712c5576-acda-41df-89e5-61ba2143aacd tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.352630 Oct 28 18:13:59.116193 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1352/2801] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:13:57 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:59.127674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:59.128830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:59.137831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:59.138636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:59.139129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:59.140559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:59.141189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:59.143187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:59.505144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:13:59.505624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:13:59.506787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:13:59.507206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:13:59.507624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:13:59.519501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:59.520369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:59.521174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:59.522121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:59.522865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:59.523484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:59.544292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Getting quotas for project c5344e62d39b463da80ea567fc1265ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:13:59.550549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Getting quotas for user ce8b396d3fca4ec5bb085fb1404328f4 and project c5344e62d39b463da80ea567fc1265ce. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:13:59.563787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:13:59.566889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:13:59.588599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:59.601590 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9c8f25a-b6b8-4d12-a893-ce220b78cf53 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 1474 microversion: 2.1 time: 0.483998 Oct 28 18:13:59.618124 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1353/2802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:59 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 1474 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:59.628766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:59.629649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:13:59.636120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:59.636876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:59.637755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:59.638650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:59.639268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:59.639876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:59.646022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-de5cab7d-6a56-4d3f-8863-68f3e7f537fa tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869077 Oct 28 18:13:59.647000 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1450/2803] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:13:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:13:59.659670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8964215-f861-4137-a308-253f349f17b9 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78dd722940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:00.009176 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8964215-f861-4137-a308-253f349f17b9 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/10d402fb-770e-4afb-ab24-12f29d532910" status: 202 len: 0 microversion: 2.1 time: 0.360910 Oct 28 18:14:00.013416 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1451/2804] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:13:59 2022] DELETE /compute/v2.1/os-security-groups/10d402fb-770e-4afb-ab24-12f29d532910 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:00.019324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:00.020164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:00.028379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:00.029413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:00.029413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:00.030019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:00.030519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:00.030930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:00.038747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:00.137332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:00.164439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:00.168155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:00.170146 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-54eb2f25-56c4-4dc8-bd66-ffbf900e84ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.550445 Oct 28 18:14:00.171001 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1354/2805] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:13:59 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:00.175873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8791bb3b-aa1d-4fa7-9bea-95d9c0700514 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:00.176704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8791bb3b-aa1d-4fa7-9bea-95d9c0700514 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:00.250562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:00.265922 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a44095f-1da4-4efb-9d18-37c7c2cd82f6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.251187 Oct 28 18:14:00.267888 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1452/2806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:00 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:00.274523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2adfef6b-c9ed-40f1-9dbd-aba8d0ebeedf tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78dd851790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:00.298915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8791bb3b-aa1d-4fa7-9bea-95d9c0700514 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:00.310901 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8791bb3b-aa1d-4fa7-9bea-95d9c0700514 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1217 microversion: 2.1 time: 0.138071 Oct 28 18:14:00.312415 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1355/2807] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:00 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:00.347144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2adfef6b-c9ed-40f1-9dbd-aba8d0ebeedf tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/0a36e3d2-0c21-4659-ae2d-c5d1eed0313f" status: 200 len: 247 microversion: 2.1 time: 0.077049 Oct 28 18:14:00.349277 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1453/2808] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:14:00 2022] GET /compute/v2.1/os-security-groups/0a36e3d2-0c21-4659-ae2d-c5d1eed0313f => generated 247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:00.365769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9916fe64-7794-4b71-b1dc-34492f2799cd tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78e2362e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1721245908", "description": "tempest-description-344844341"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:00.632032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:00.633057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:00.639119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:00.639386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=11 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:00.639766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:00.640916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:00.643341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:00.644035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:00.644659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:00.702313 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9916fe64-7794-4b71-b1dc-34492f2799cd tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.342264 Oct 28 18:14:00.702925 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1356/2809] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:00.716649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-84b53ee1-7c59-440e-b21a-a140e00f81da tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78e2362af0>, body: {"security_group_rule": {"parent_group_id": "ef6a2996-5421-4f96-b8ba-3e4bc989648d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:00.831917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:00.843477 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd7d64db-4106-446e-a0d0-2d0cb1fdecab tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 1474 microversion: 2.1 time: 0.215862 Oct 28 18:14:00.851240 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1454/2810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:00 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 1474 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:01.210978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:01.212885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:01.226697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:01.227529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:01.228160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:01.229516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:01.230126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:01.231439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:01.380874 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-84b53ee1-7c59-440e-b21a-a140e00f81da tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.667948 Oct 28 18:14:01.393357 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1357/2811] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:00 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:14:01.414649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:01.415433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:01.425553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:01.426234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:01.426847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:01.427708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:01.428340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:01.429028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:01.769237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:01.780382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:01.783935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:01.785394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-494756bd-d917-47e3-b4a1-bf4089333233 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.586442 Oct 28 18:14:01.786642 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1455/2812] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:01 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:14:01.791408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:01.792383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:01.804832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:01.807131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:01.809028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:01.810017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:01.812241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:01.812887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:01.960488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:01.974497 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90b801e2-960e-4cf7-9248-d49aea383888 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1287 microversion: 2.1 time: 0.186570 Oct 28 18:14:01.975440 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1456/2813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:01 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1287 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:01.992191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2fc88774-145d-4a51-907f-b1b06dd7273f tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Action: 'create', calling method: .version_select at 0x7f78dd752af0>, body: {"security_group_rule": {"parent_group_id": "ef6a2996-5421-4f96-b8ba-3e4bc989648d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:02.294106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:02.303358 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad0c9006-e7f3-4150-8a7e-060b0ffb2f17 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1319 microversion: 2.1 time: 0.907065 Oct 28 18:14:02.303991 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1358/2814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:01 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1319 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:02.555855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1af17d88-07cf-4b8a-a03e-d80baefb2ae4 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:02.559787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1af17d88-07cf-4b8a-a03e-d80baefb2ae4 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:02.564064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1af17d88-07cf-4b8a-a03e-d80baefb2ae4 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:02.564745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1af17d88-07cf-4b8a-a03e-d80baefb2ae4 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:02.566101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1af17d88-07cf-4b8a-a03e-d80baefb2ae4 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:02.566763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1af17d88-07cf-4b8a-a03e-d80baefb2ae4 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:02.572601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1af17d88-07cf-4b8a-a03e-d80baefb2ae4 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:02.628836 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1af17d88-07cf-4b8a-a03e-d80baefb2ae4 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.313211 Oct 28 18:14:02.636093 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1359/2815] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:14:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:02.641902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:02.642719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:02.651412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:02.652272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:02.652918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:02.653829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:02.654509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:02.655136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.052480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:03.075682 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bc18dd01-2e63-4a8b-aedd-1a0f3cc0db8f tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 1474 microversion: 2.1 time: 0.436368 Oct 28 18:14:03.076526 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1360/2816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:02 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 1474 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:03.089402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-313e1dfc-6674-4914-ae1a-3e490947d181 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:03.098798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-313e1dfc-6674-4914-ae1a-3e490947d181 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.100255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-313e1dfc-6674-4914-ae1a-3e490947d181 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.102331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-313e1dfc-6674-4914-ae1a-3e490947d181 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.103468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-313e1dfc-6674-4914-ae1a-3e490947d181 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.104346 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2fc88774-145d-4a51-907f-b1b06dd7273f tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.127473 Oct 28 18:14:03.104955 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1457/2817] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:01 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:03.105338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-313e1dfc-6674-4914-ae1a-3e490947d181 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.105871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-313e1dfc-6674-4914-ae1a-3e490947d181 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.110757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:03.111582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:03.124623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.125127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.125568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.131082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.131792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.133647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.161450 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-313e1dfc-6674-4914-ae1a-3e490947d181 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-862404-2" status: 200 len: 578 microversion: 2.1 time: 0.083005 Oct 28 18:14:03.165749 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1361/2818] 10.222.0.16 () {58 vars in 1172 bytes} [Fri Oct 28 18:14:03 2022] GET /compute/v2.1/os-services?host=n-d-862404-2 => generated 578 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:03.176628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:03.177433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:03.188106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.189373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.189989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.190877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.191494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.192428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.359244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:03.373042 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e0282ff8-b930-45ef-95da-aa035749c9ce tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1275 microversion: 2.1 time: 0.205266 Oct 28 18:14:03.373741 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1362/2819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:03 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:03.378848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d87ece0d-2f23-4ba8-94f1-840bff825219 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78ddbc4790>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:03.553604 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d87ece0d-2f23-4ba8-94f1-840bff825219 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/ef6a2996-5421-4f96-b8ba-3e4bc989648d" status: 200 len: 664 microversion: 2.1 time: 0.178535 Oct 28 18:14:03.565219 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1363/2820] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:14:03 2022] GET /compute/v2.1/os-security-groups/ef6a2996-5421-4f96-b8ba-3e4bc989648d => generated 664 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:03.572394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f1513a7-cec4-4c71-8937-4ebca3159c71 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:03.577456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1513a7-cec4-4c71-8937-4ebca3159c71 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.578151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1513a7-cec4-4c71-8937-4ebca3159c71 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.578820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1513a7-cec4-4c71-8937-4ebca3159c71 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.579920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1513a7-cec4-4c71-8937-4ebca3159c71 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.580558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1513a7-cec4-4c71-8937-4ebca3159c71 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.581167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1513a7-cec4-4c71-8937-4ebca3159c71 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.612460 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f1513a7-cec4-4c71-8937-4ebca3159c71 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045251 Oct 28 18:14:03.613187 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1364/2821] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:14:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:03.620290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:03.621119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:03.629309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.630043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.630661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.631545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.632191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.632770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.704666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:03.718514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:03.721036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:03.722468 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47976fe1-27dc-4004-ab06-06ce4a5447b4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.615821 Oct 28 18:14:03.723047 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1458/2822] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:03 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:03.727698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bab21817-91cb-4141-a5c6-1872de312031 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78dd6c33a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:03.986370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:03.997923 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5f009f9-0642-4a87-9d1f-2d237ed49471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1468 microversion: 2.1 time: 0.383449 Oct 28 18:14:03.998767 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1365/2823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:03 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:04.023012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffea6455-2915-4eb6-84b5-3045673b04b9 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:04.027300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffea6455-2915-4eb6-84b5-3045673b04b9 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.028133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffea6455-2915-4eb6-84b5-3045673b04b9 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.028823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffea6455-2915-4eb6-84b5-3045673b04b9 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.030051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffea6455-2915-4eb6-84b5-3045673b04b9 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.030760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffea6455-2915-4eb6-84b5-3045673b04b9 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.031420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffea6455-2915-4eb6-84b5-3045673b04b9 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.078286 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffea6455-2915-4eb6-84b5-3045673b04b9 tempest-ServicesAdminTestJSON-2092296727 tempest-ServicesAdminTestJSON-2092296727-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.064722 Oct 28 18:14:04.081883 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1366/2824] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:14:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:04.118226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b164e184-4584-4ce7-b342-4c31e5310b61 req-c162428a-0855-4a87-a10e-5ab388108b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c09b4345-86e2-477d-a81e-f3c0c69aa329", "name": "network-vif-deleted", "tag": "5a0dbef9-5dc4-41f9-816a-6e013f850f4e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:04.131193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b164e184-4584-4ce7-b342-4c31e5310b61 req-c162428a-0855-4a87-a10e-5ab388108b23 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.132069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b164e184-4584-4ce7-b342-4c31e5310b61 req-c162428a-0855-4a87-a10e-5ab388108b23 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.132657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b164e184-4584-4ce7-b342-4c31e5310b61 req-c162428a-0855-4a87-a10e-5ab388108b23 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.148078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:04.173292 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b164e184-4584-4ce7-b342-4c31e5310b61 req-c162428a-0855-4a87-a10e-5ab388108b23 service nova] Creating event network-vif-deleted:5a0dbef9-5dc4-41f9-816a-6e013f850f4e for instance c09b4345-86e2-477d-a81e-f3c0c69aa329 on n-h1-862404-2 Oct 28 18:14:04.181039 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b164e184-4584-4ce7-b342-4c31e5310b61 req-c162428a-0855-4a87-a10e-5ab388108b23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097732 Oct 28 18:14:04.181600 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1367/2825] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:04.193828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:04.194995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:04.204841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.209179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.209813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.210964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.211716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.212580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.443108 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bab21817-91cb-4141-a5c6-1872de312031 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/81777c0b-d87e-4398-ab8c-19f70ae212a6" status: 202 len: 0 microversion: 2.1 time: 0.718817 Oct 28 18:14:04.443724 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1459/2826] 10.222.0.16 () {58 vars in 1287 bytes} [Fri Oct 28 18:14:03 2022] DELETE /compute/v2.1/os-security-group-rules/81777c0b-d87e-4398-ab8c-19f70ae212a6 => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:04.449026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:04.450377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:04.464418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.465012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.465554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.466381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.466953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.467489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.508362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:04.521026 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0c450dce-1a6a-452b-b2e8-a91ba9b27ccd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 200 len: 1469 microversion: 2.1 time: 0.337964 Oct 28 18:14:04.533218 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1368/2827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:04 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:04.545449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:04.546352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:04.571736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.575091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.577784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.579429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:04.583047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:04.583663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:04.619699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055d46cc8b314ec7a76710fbffa71a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3e97eeba9c4e0fa876db71cacafc89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:04.631678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-783e9806-9063-4160-b5ba-539eec9d104d tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 200 len: 1432 microversion: 2.1 time: 0.186465 Oct 28 18:14:04.632299 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1460/2828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:04 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 1432 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:04.648891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9be6007d-9d66-45c9-a43f-7ba008b4572b tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78dd6c39d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:05.018566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:05.030512 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a30ad82-51be-4f6f-8596-b6fb59b537e7 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1317 microversion: 2.1 time: 0.495964 Oct 28 18:14:05.031130 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1369/2829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:04 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:05.049575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:05.055373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:05.105453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Searching by: {'reservation_id': 'r-jmca5h6d', 'deleted': False, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:14:05.120361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:05.127718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:05.128699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:05.129755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:05.130458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:05.132689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:05.433160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:14:05.526498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:05.533769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:05.534254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:05.534866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:05.691111 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9be6007d-9d66-45c9-a43f-7ba008b4572b tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/ef6a2996-5421-4f96-b8ba-3e4bc989648d" status: 202 len: 0 microversion: 2.1 time: 1.045867 Oct 28 18:14:05.692289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1461/2830] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:04 2022] DELETE /compute/v2.1/os-security-groups/ef6a2996-5421-4f96-b8ba-3e4bc989648d => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:05.701813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:05.703672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:05.720388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:05.721411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:05.722075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:05.723579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:05.724379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:05.724961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:05.879845 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45a54a6b-a839-4048-91db-a219b5ca3a2e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-jmca5h6d" status: 200 len: 2930 microversion: 2.1 time: 0.847362 Oct 28 18:14:05.880793 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1370/2831] 10.222.0.16 () {58 vars in 1197 bytes} [Fri Oct 28 18:14:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jmca5h6d => generated 2930 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:05.898759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c8f73c0d-7f39-4cb9-b40c-fad338140a05 req-7833c2cf-78c2-4f8b-8693-4bdf63a64222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8148f1bc-d908-4fa0-bd92-aad5464fe069", "name": "network-vif-deleted", "tag": "b21e0da3-68f8-41b1-9a87-d0036283bcfe"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:05.913700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c8f73c0d-7f39-4cb9-b40c-fad338140a05 req-7833c2cf-78c2-4f8b-8693-4bdf63a64222 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:05.914261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c8f73c0d-7f39-4cb9-b40c-fad338140a05 req-7833c2cf-78c2-4f8b-8693-4bdf63a64222 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:05.914757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c8f73c0d-7f39-4cb9-b40c-fad338140a05 req-7833c2cf-78c2-4f8b-8693-4bdf63a64222 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:05.928211 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c8f73c0d-7f39-4cb9-b40c-fad338140a05 req-7833c2cf-78c2-4f8b-8693-4bdf63a64222 service nova] Creating event network-vif-deleted:b21e0da3-68f8-41b1-9a87-d0036283bcfe for instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 on n-h1-862404-2 Oct 28 18:14:05.935527 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c8f73c0d-7f39-4cb9-b40c-fad338140a05 req-7833c2cf-78c2-4f8b-8693-4bdf63a64222 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052867 Oct 28 18:14:05.936954 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1371/2832] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:05.945266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:05.946206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] [instance: 8148f1bc-d908-4fa0-bd92-aad5464fe069] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:05.955186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:05.955967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:05.956620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:05.957543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:05.958069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:05.958562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:05.974187 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] HTTP exception thrown: Instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 could not be found. Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Request method failure captured: Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 HTTP/1.1 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBs7oKPSdOVN7pHkKII_-0k1ayb_3_fYaqiJCpntQZ9bEQa19QPFb8S7aA0Vx7JrhtUnseqqyr_TVVhuJ-7W8kUUo6CTqCVtGoDL5Mltp-TfCHaWQTUlnxvMnyN3qwa6_P1zlXWaKTW20afuEQhuoQnBZFAll3LRkyIL4APq7hBglw8 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: ba3e97eeba9c4e0fa876db71cacafc89 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ListImageFiltersTestJSON-1469853683 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba3e97eeba9c4e0fa876db71cacafc89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ba3e97eeba9c4e0fa876db71cacafc89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ba3e97eeba9c4e0fa876db71cacafc89", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ba3e97eeba9c4e0fa876db71cacafc89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ListImageFiltersTestJSON-1469853683 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: ba3e97eeba9c4e0fa876db71cacafc89 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1469853683 Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ListImageFiltersTestJSON-1469853683-project Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 055d46cc8b314ec7a76710fbffa71a9c Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ListImageFiltersTestJSON-1469853683-project Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 could not be found. Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8148f1bc-d908-4fa0-bd92-aad5464fe069'} Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 could not be found. Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 could not be found. Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:05.976184 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 could not be found. Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Returning 404 to user: Instance 8148f1bc-d908-4fa0-bd92-aad5464fe069 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:05.980640 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-274232bf-3e55-4b65-8be1-71533ce22fb0 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069" status: 404 len: 111 microversion: 2.1 time: 0.040558 Oct 28 18:14:05.983322 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1372/2833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:05 2022] GET /compute/v2.1/servers/8148f1bc-d908-4fa0-bd92-aad5464fe069 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:05.988621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e9f3199-7dff-4d83-abc3-1c63b8a5927a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78de2abdc0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:06.035220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-0e9f3199-7dff-4d83-abc3-1c63b8a5927a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 10d402fb-770e-4afb-ab24-12f29d532910 does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:14:06.035951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-0e9f3199-7dff-4d83-abc3-1c63b8a5927a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Neutron security group 10d402fb-770e-4afb-ab24-12f29d532910 not found {{(pid=120679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:14:06.036541 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-0e9f3199-7dff-4d83-abc3-1c63b8a5927a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] HTTP exception thrown: Security group 10d402fb-770e-4afb-ab24-12f29d532910 does not exist Oct 28 18:14:06.036541 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-22361b87-90dd-4f0d-8074-ade346a4b13d'] Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e9f3199-7dff-4d83-abc3-1c63b8a5927a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Request method failure captured: Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-security-groups/10d402fb-770e-4afb-ab24-12f29d532910 HTTP/1.1 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvfzdQcU5-0fa7s0u4a08J633Nf7FOghsRlGefnI7XDu37F_YGxV99U3e-BtRi6n9fLV7WRJz_Av9Btk2YcPJLmCQMn8k1Gb4oRqduAWyM6CR05sXzjo3sVnuMfim5V6Fsbl-xQBHbhJ2R6rzJbBHH2Sl9BqmuGLaW2mfuyPncDhqU Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 58b04f8fb0264b6bbda91798603c0a55 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-291547860 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b04f8fb0264b6bbda91798603c0a55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/58b04f8fb0264b6bbda91798603c0a55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_58b04f8fb0264b6bbda91798603c0a55", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/58b04f8fb0264b6bbda91798603c0a55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupRulesTestJSON-291547860 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 58b04f8fb0264b6bbda91798603c0a55 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-291547860 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupRulesTestJSON-291547860-project Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: d41312fa7a4b46d98a318d479751e05a Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupRulesTestJSON-291547860-project Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group 10d402fb-770e-4afb-ab24-12f29d532910 does not exist Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-22361b87-90dd-4f0d-8074-ade346a4b13d'] Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '10d402fb-770e-4afb-ab24-12f29d532910'} Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:14:06.038645 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 10d402fb-770e-4afb-ab24-12f29d532910 does not exist Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22361b87-90dd-4f0d-8074-ade346a4b13d'] Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 10d402fb-770e-4afb-ab24-12f29d532910 does not exist Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22361b87-90dd-4f0d-8074-ade346a4b13d'] Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 10d402fb-770e-4afb-ab24-12f29d532910 does not exist Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22361b87-90dd-4f0d-8074-ade346a4b13d'] Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 10d402fb-770e-4afb-ab24-12f29d532910 does not exist Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22361b87-90dd-4f0d-8074-ade346a4b13d'] Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e9f3199-7dff-4d83-abc3-1c63b8a5927a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Returning 404 to user: Security group 10d402fb-770e-4afb-ab24-12f29d532910 does not exist Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-22361b87-90dd-4f0d-8074-ade346a4b13d'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e9f3199-7dff-4d83-abc3-1c63b8a5927a tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/10d402fb-770e-4afb-ab24-12f29d532910" status: 404 len: 194 microversion: 2.1 time: 0.056213 Oct 28 18:14:06.042172 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1373/2834] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:05 2022] DELETE /compute/v2.1/os-security-groups/10d402fb-770e-4afb-ab24-12f29d532910 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:06.049625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5d33b573-a278-4717-bc81-afaef2b514ae tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:06.070550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:06.082454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.compute.server_groups [None req-5d33b573-a278-4717-bc81-afaef2b514ae tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Querying cell 43f74929-bc21-41df-9120-e6be09c18015(cell1) for 2 instances {{(pid=120679) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 18:14:06.083244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d33b573-a278-4717-bc81-afaef2b514ae tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:06.083739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d33b573-a278-4717-bc81-afaef2b514ae tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:06.084214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d33b573-a278-4717-bc81-afaef2b514ae tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:06.103451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:06.106648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:06.106648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0da0ae0-870f-4405-ba37-784e0b07f97a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.412881 Oct 28 18:14:06.112547 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1462/2835] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:05 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:06.121568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9fc9bd87-20f1-4dce-ae33-f90595aaa261 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78dd6c38b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:06.148721 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5d33b573-a278-4717-bc81-afaef2b514ae tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/73160af1-6986-4ffe-a141-fa77e5515ff6" status: 200 len: 266 microversion: 2.1 time: 0.106024 Oct 28 18:14:06.149889 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1374/2836] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:14:06 2022] GET /compute/v2.1/os-server-groups/73160af1-6986-4ffe-a141-fa77e5515ff6 => generated 266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:06.160971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-34992d6c-e94c-4009-8411-134ad5a7de41 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78de772160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:06.463564 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-34992d6c-e94c-4009-8411-134ad5a7de41 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/0a36e3d2-0c21-4659-ae2d-c5d1eed0313f" status: 202 len: 0 microversion: 2.1 time: 0.312303 Oct 28 18:14:06.464482 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1375/2837] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:06 2022] DELETE /compute/v2.1/os-security-groups/0a36e3d2-0c21-4659-ae2d-c5d1eed0313f => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:06.471964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:06.472914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:06.491449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:06.492285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:06.493594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:06.499852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:06.500323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:06.502147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:06.782729 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9fc9bd87-20f1-4dce-ae33-f90595aaa261 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "DELETE /compute/v2.1/images/925d40fc-6977-4464-9876-bb25f4864edb" status: 204 len: 0 microversion: 2.1 time: 0.668219 Oct 28 18:14:06.783339 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1463/2838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:06 2022] DELETE /compute/v2.1/images/925d40fc-6977-4464-9876-bb25f4864edb => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:14:06.789077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:06.789694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:06.805036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:06.805528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:06.805963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:06.806667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:06.807121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:06.807544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:06.949697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:06.966067 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-786a43f2-fc00-4c77-9583-9a769c8f90a2 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1317 microversion: 2.1 time: 0.500281 Oct 28 18:14:06.968014 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1376/2839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:06 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:06.973354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-970aec4a-1e78-4946-9753-d6eb0195f72f req-7f74461c-ca70-485e-b5d4-c11c9dafa332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c205e304-2b1b-43d8-ae04-dc535702238d", "tag": "2b13314c-8643-4b37-ace1-7f0c5930dd3d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:06.990738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-970aec4a-1e78-4946-9753-d6eb0195f72f req-7f74461c-ca70-485e-b5d4-c11c9dafa332 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:06.991576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-970aec4a-1e78-4946-9753-d6eb0195f72f req-7f74461c-ca70-485e-b5d4-c11c9dafa332 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:06.992208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-970aec4a-1e78-4946-9753-d6eb0195f72f req-7f74461c-ca70-485e-b5d4-c11c9dafa332 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:06.995515 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41c77533-de62-4841-b4e4-ede3bc1a4e39 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 200 len: 1619 microversion: 2.1 time: 0.210654 Oct 28 18:14:06.996228 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1464/2840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:06 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 1619 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:07.010731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8edad46e-2900-47fe-b6e6-bd5562cdfa7e tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78dd6c3c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:07.030151 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-970aec4a-1e78-4946-9753-d6eb0195f72f req-7f74461c-ca70-485e-b5d4-c11c9dafa332 service nova] Creating event network-changed:2b13314c-8643-4b37-ace1-7f0c5930dd3d for instance c205e304-2b1b-43d8-ae04-dc535702238d on n-h2-862404-2 Oct 28 18:14:07.037057 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-970aec4a-1e78-4946-9753-d6eb0195f72f req-7f74461c-ca70-485e-b5d4-c11c9dafa332 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067385 Oct 28 18:14:07.039127 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1377/2841] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:07.047013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-258fa72e-99c1-4444-b9e2-d52bc0222ff6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78ddbc4940>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:07.290642 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8edad46e-2900-47fe-b6e6-bd5562cdfa7e tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/aa40a5d3-8748-4910-8866-6b17410ffce9" status: 202 len: 0 microversion: 2.1 time: 0.293285 Oct 28 18:14:07.291398 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1465/2842] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:06 2022] DELETE /compute/v2.1/os-security-groups/aa40a5d3-8748-4910-8866-6b17410ffce9 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:07.476280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72d1603e-83c3-404f-9d00-f230705cbcda tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78dd705f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-189624363", "description": "tempest-description-982329401"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:07.614490 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-258fa72e-99c1-4444-b9e2-d52bc0222ff6 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "DELETE /compute/v2.1/images/461c44f7-9259-4c11-93d7-b80491505692" status: 204 len: 0 microversion: 2.1 time: 0.573691 Oct 28 18:14:07.615573 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1378/2843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:07 2022] DELETE /compute/v2.1/images/461c44f7-9259-4c11-93d7-b80491505692 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:14:07.620640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:07.621746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:07.630073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:07.630956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:07.631544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:07.633073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:07.633699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:07.634328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:07.677126 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72d1603e-83c3-404f-9d00-f230705cbcda tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.384428 Oct 28 18:14:07.678224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1466/2844] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:07 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:07.684190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:07.685644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:07.697359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:07.697871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:07.699434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:07.703787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:07.705014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:07.705513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:07.945278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:07.957432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:07.959182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:07.960609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6b33550-28a3-4e8e-9b0b-6123263e34a4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.281209 Oct 28 18:14:07.962129 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1467/2845] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:07 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:07.967357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb0ba4de-3ca9-4405-a9b2-08bc1f2da072 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78dd6c3160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:08.100610 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1988e33-e9c7-408b-863a-df63c0c3d8b6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 200 len: 1620 microversion: 2.1 time: 0.483612 Oct 28 18:14:08.101755 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1379/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:07 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 1620 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:08.106911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-31e64f5c-8b11-4ed2-ba51-6a4931fa2833 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] Calling method '.version_select at 0x7f78ddbc4280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:08.221072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb0ba4de-3ca9-4405-a9b2-08bc1f2da072 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c9694d7f-e885-47b3-8278-a3605e75f359" status: 202 len: 0 microversion: 2.1 time: 0.257460 Oct 28 18:14:08.226632 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1468/2847] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:07 2022] DELETE /compute/v2.1/os-security-groups/c9694d7f-e885-47b3-8278-a3605e75f359 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:08.238986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8b3111f-51da-42bc-8c74-aa7a29869438 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78de087790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-6299751", "description": "tempest-description-1656899349"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:08.446198 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8b3111f-51da-42bc-8c74-aa7a29869438 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.218107 Oct 28 18:14:08.447587 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1469/2848] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:08 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:08.453685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:08.456331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:08.478175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:08.479317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:08.481435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:08.482675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:08.483157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:08.483583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:08.597579 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-31e64f5c-8b11-4ed2-ba51-6a4931fa2833 tempest-ListImageFiltersTestJSON-1469853683 tempest-ListImageFiltersTestJSON-1469853683-project] 10.222.0.16 "DELETE /compute/v2.1/images/652cabf4-da3e-4cf0-ae2d-cb9c45a22d1d" status: 204 len: 0 microversion: 2.1 time: 0.494648 Oct 28 18:14:08.598429 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1380/2849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:08 2022] DELETE /compute/v2.1/images/652cabf4-da3e-4cf0-ae2d-cb9c45a22d1d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:14:08.606252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b0037c3-e29f-4b26-bd14-09c3fd19395f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Action: 'create', calling method: .version_select at 0x7f78ddbc43a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1777032901", "policies": ["anti-affinity"]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:08.640673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6b0037c3-e29f-4b26-bd14-09c3fd19395f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_groups'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:08.653217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6b0037c3-e29f-4b26-bd14-09c3fd19395f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_groups'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:08.730259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:08.751406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6b0037c3-e29f-4b26-bd14-09c3fd19395f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_groups'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:08.759458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6b0037c3-e29f-4b26-bd14-09c3fd19395f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_groups'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:08.760975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:08.770474 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-770e6702-e28e-4b5a-9c6d-db72659e8f13 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1317 microversion: 2.1 time: 0.320790 Oct 28 18:14:08.781100 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6b0037c3-e29f-4b26-bd14-09c3fd19395f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.181466 Oct 28 18:14:08.782647 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1381/2850] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 18:14:08 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:08.784680 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1470/2851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:08 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:08.789802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b4f9e963-ffbc-461a-8a91-3e20f83720cf tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78e2362dc0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:08.793647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1532060559", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "5d1d0346-9ff4-48a8-9e14-6d5a6fc26119"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:08.817709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:08.869980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] validate_networks() for [('5d1d0346-9ff4-48a8-9e14-6d5a6fc26119', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:09.409846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:09.410524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:09.410735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:09.411148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:09.411566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:09.421514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.422023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.422822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.424063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.425081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.425712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.446098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Getting quotas for project 67daef63361f4374b7562dd1029e6a64. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:09.452210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Getting quotas for user 4e3c71f336ac403cb508c00d17c0ee07 and project 67daef63361f4374b7562dd1029e6a64. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:09.467293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:09.471032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:09.525743 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-acb92a10-d993-4ada-8835-72630b4bcb0f tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739890 Oct 28 18:14:09.526855 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1471/2852] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:14:09.532428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:09.533050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:09.546843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.547355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.550234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.551194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.551844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.552435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.675684 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b4f9e963-ffbc-461a-8a91-3e20f83720cf tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/1dc7b246-0ac8-45b4-bdbf-ad08537e4f93" status: 202 len: 0 microversion: 2.1 time: 0.890882 Oct 28 18:14:09.676784 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1382/2853] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:08 2022] DELETE /compute/v2.1/os-security-groups/1dc7b246-0ac8-45b4-bdbf-ad08537e4f93 => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:09.683576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-984569770", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e05c82c7-d4ec-4017-ad58-68fb7e5552cd"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:09.830858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:09.877903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:09.890233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:09.894369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:09.895589 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-993329d2-e1e4-4ad8-aff9-a7b3783a29b7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.367590 Oct 28 18:14:09.910038 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1472/2854] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:09 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:09.939270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-890fb51f-15a8-44ed-9616-906bb210cd8e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:09.940529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-890fb51f-15a8-44ed-9616-906bb210cd8e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:10.034385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-890fb51f-15a8-44ed-9616-906bb210cd8e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:10.048425 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-890fb51f-15a8-44ed-9616-906bb210cd8e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1216 microversion: 2.1 time: 0.127913 Oct 28 18:14:10.049256 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1473/2855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:09 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:10.067162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b53ff7b-2037-4091-9536-9aea1cdd42a8 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] Calling method '.version_select at 0x7f78dd722040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:10.493033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b53ff7b-2037-4091-9536-9aea1cdd42a8 tempest-SecurityGroupRulesTestJSON-291547860 tempest-SecurityGroupRulesTestJSON-291547860-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/20246a0c-3c1e-4a5e-ab66-ec4d73fd1847" status: 202 len: 0 microversion: 2.1 time: 0.442318 Oct 28 18:14:10.495222 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1474/2856] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:10 2022] DELETE /compute/v2.1/os-security-groups/20246a0c-3c1e-4a5e-ab66-ec4d73fd1847 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:10.501494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:10.502547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:10.521175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:10.522008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:10.522556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:10.523379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:10.524353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:10.524947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:10.671735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:10.672184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:10.673311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:10.673894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:10.674462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:10.724613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:10.728437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:10.729066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:10.729984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:10.731983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:10.732566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:10.785315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:10.805337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:10.838773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Going to run 2 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:10.843772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:10.959028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:10.965189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:11.047038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:11.053780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:11.079987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=88a6ffc8-fd33-4acf-b318-897c0bbfcb56,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:11.221842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:11.227483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:11.313869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:11.322408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'server_group_members'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:11.371810 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28016064-0877-476c-b350-a57e056e53be tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.693564 Oct 28 18:14:11.372773 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1383/2857] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 1695 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:14:11.380085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:11.381215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:11.393477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.394328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.395715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.396761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.397471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.398055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.405018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:11.419176 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bcf0df04-6a9a-435f-992f-a02ac32ffa6f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1317 microversion: 2.1 time: 0.920335 Oct 28 18:14:11.422137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1475/2858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:10 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1317 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:11.434789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:11.435685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:11.451495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.452030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.452491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.453234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.453694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.455028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.701107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:11.714208 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ff7421a-e091-446b-b137-f70665489dd3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1268 microversion: 2.1 time: 0.287702 Oct 28 18:14:11.732531 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1476/2859] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:11 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1268 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:11.953337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:11.964034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75f6a4ff-36f2-47d9-90d1-a8612fd1bc8b tempest-ListImageFiltersNegativeTestJSON-2101004175 tempest-ListImageFiltersNegativeTestJSON-2101004175-project] Calling method '.version_select at 0x7f78dd71a670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:11.977702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:11.979762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:11.982079 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86bb941e-fb82-426d-b765-f57f03a25528 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.608027 Oct 28 18:14:11.986087 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1384/2860] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:11 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:11.996942 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-75f6a4ff-36f2-47d9-90d1-a8612fd1bc8b tempest-ListImageFiltersNegativeTestJSON-2101004175 tempest-ListImageFiltersNegativeTestJSON-2101004175-project] HTTP exception thrown: Image not found. Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75f6a4ff-36f2-47d9-90d1-a8612fd1bc8b tempest-ListImageFiltersNegativeTestJSON-2101004175 tempest-ListImageFiltersNegativeTestJSON-2101004175-project] Request method failure captured: Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/images/d80ecc82-be59-43d6-a534-b2c9b4c9733d HTTP/1.1 Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvzmmiV3bbbyQh2yaJKVgl4nRIdrJpdORSIL62Y8gbOgEdtXJqNQh0b-5sY2FyzpTpsv3BgBQwWfggG7YETzwyzue5TF1czfAhgNAl1HW9KTVEjUFLzDHrAJqx-ZM71TuNNsWKzG2O0-m78iXf-PmSSGrEcAMbnuxQ84nw6YfhamMw Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a3c1d66bf0fa4ae7943a942f6f90bbab Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2101004175 Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3c1d66bf0fa4ae7943a942f6f90bbab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a3c1d66bf0fa4ae7943a942f6f90bbab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a3c1d66bf0fa4ae7943a942f6f90bbab", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a3c1d66bf0fa4ae7943a942f6f90bbab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2101004175 Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a3c1d66bf0fa4ae7943a942f6f90bbab Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2101004175 Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListImageFiltersNegativeTestJSON-2101004175-project Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c4d3f496ae634a8198c7a356ed75fe5c Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2101004175-project Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: exception: Image not found. Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'd80ecc82-be59-43d6-a534-b2c9b4c9733d'} Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d80ecc82-be59-43d6-a534-b2c9b4c9733d Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 18:14:11.999278 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d80ecc82-be59-43d6-a534-b2c9b4c9733d could not be found. Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 18:14:12.005124 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.009013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:12.012204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:12.013048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Searching by: {'deleted': False, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:14:12.015675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75f6a4ff-36f2-47d9-90d1-a8612fd1bc8b tempest-ListImageFiltersNegativeTestJSON-2101004175 tempest-ListImageFiltersNegativeTestJSON-2101004175-project] Returning 404 to user: Image not found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:12.016719 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75f6a4ff-36f2-47d9-90d1-a8612fd1bc8b tempest-ListImageFiltersNegativeTestJSON-2101004175 tempest-ListImageFiltersNegativeTestJSON-2101004175-project] 10.222.0.16 "GET /compute/v2.1/images/d80ecc82-be59-43d6-a534-b2c9b4c9733d" status: 404 len: 62 microversion: 2.1 time: 0.281653 Oct 28 18:14:12.025365 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1477/2861] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:14:11 2022] GET /compute/v2.1/images/d80ecc82-be59-43d6-a534-b2c9b4c9733d => generated 62 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:14:12.054312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.054827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.055269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.060833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.061545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.062324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.126971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:14:12.205215 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cc71362c-bef6-4178-9369-783526a03cbf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.214367 Oct 28 18:14:12.207376 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1385/2862] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:14:11 2022] GET /compute/v2.1/servers => generated 1664 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:12.224614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ecb94fb4-fff0-4132-9534-86bc5f8189e2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:12.229484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ecb94fb4-fff0-4132-9534-86bc5f8189e2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:12.342214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ecb94fb4-fff0-4132-9534-86bc5f8189e2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:12.352763 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ecb94fb4-fff0-4132-9534-86bc5f8189e2 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1218 microversion: 2.1 time: 0.136496 Oct 28 18:14:12.356166 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1478/2863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:12 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:12.450237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:12.451659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:12.463917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.464441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.464888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.465603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.468278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.468739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.738329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:12.742669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:12.743385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:12.749281 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-54047d3f-1edd-4868-a242-a5b61374e9ba tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1317 microversion: 2.1 time: 0.302854 Oct 28 18:14:12.764852 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1386/2864] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:12 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:12.764852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2442d8fe-0676-46c3-9c8b-00fd317fd25e req-d0eb0ee9-1146-4d50-8b1d-dacb56902aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c205e304-2b1b-43d8-ae04-dc535702238d", "name": "network-vif-plugged", "status": "completed", "tag": "2b13314c-8643-4b37-ace1-7f0c5930dd3d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:12.773195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.773713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.777803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.779729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.781071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.781524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.783785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2442d8fe-0676-46c3-9c8b-00fd317fd25e req-d0eb0ee9-1146-4d50-8b1d-dacb56902aa7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.787532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2442d8fe-0676-46c3-9c8b-00fd317fd25e req-d0eb0ee9-1146-4d50-8b1d-dacb56902aa7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.788068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2442d8fe-0676-46c3-9c8b-00fd317fd25e req-d0eb0ee9-1146-4d50-8b1d-dacb56902aa7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.834052 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2442d8fe-0676-46c3-9c8b-00fd317fd25e req-d0eb0ee9-1146-4d50-8b1d-dacb56902aa7 service nova] Creating event network-vif-plugged:2b13314c-8643-4b37-ace1-7f0c5930dd3d for instance c205e304-2b1b-43d8-ae04-dc535702238d on n-h2-862404-2 Oct 28 18:14:12.846049 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2442d8fe-0676-46c3-9c8b-00fd317fd25e req-d0eb0ee9-1146-4d50-8b1d-dacb56902aa7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089305 Oct 28 18:14:12.847800 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1387/2865] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:13.015199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:13.015955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:13.037304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:13.037797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:13.038246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:13.038980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:13.039503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:13.046465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:13.410613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:13.421416 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34e9bff8-a7b2-42b8-9b7e-1cc973d2cba8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1274 microversion: 2.1 time: 0.686091 Oct 28 18:14:13.422485 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1479/2866] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:12 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1274 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:13.427504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:13.428489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:13.459643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:13.460782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:13.462999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:13.464459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:13.466390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:13.467747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:13.575787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:13.592311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-500ce005-76e1-44c8-9612-0d8964052fe5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1270 microversion: 2.1 time: 0.167805 Oct 28 18:14:13.593456 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1480/2867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:13 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:13.669730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:13.692664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:13.694738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:13.696784 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-51060c5d-9f5c-4dc4-9093-a88341e6fb37 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.686867 Oct 28 18:14:13.708730 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1388/2868] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:13 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:13.778253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:13.778645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:13.790999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:13.791522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:13.792194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:13.793071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:13.793752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:13.796064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:14.447002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:14.448395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:14.456025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:14.456835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:14.457538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:14.458481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:14.459087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:14.460248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:14.631026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:14.647311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-292a32f1-0be4-451a-a9d5-35182c29adfe tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1317 microversion: 2.1 time: 0.873955 Oct 28 18:14:14.667433 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1481/2869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:13 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1317 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:14.680588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:14.681470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:14.698083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:14.699347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:14.700452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:14.702076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:14.704147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:14.706293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:14.744022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:14.896945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:14.908648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b63547b-09ca-48f3-adbd-9e1f87f98e16 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1276 microversion: 2.1 time: 0.237337 Oct 28 18:14:14.911701 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1482/2870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:14 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:14.932409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:14.933039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:14.941287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:14.943659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:14.944208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:14.946093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:14.947996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:14.952847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:15.522877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:15.535405 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-27575d96-a3cb-45de-96dc-ca0609787253 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 1.092453 Oct 28 18:14:15.535858 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1389/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:14 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:15.551883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:15.558426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:15.559417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:15.560612 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38fe2e43-012b-4022-b9d5-e6f43e077c72 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.648588 Oct 28 18:14:15.561400 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1483/2872] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:14 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:15.675077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:15.675699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:15.691446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:15.691942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:15.692627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:15.693564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:15.694190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:15.694882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:15.935052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:15.936390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:15.948408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:15.952062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:15.954891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:15.957980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:15.962566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:15.966700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:16.194076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:16.210716 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36760301-11c2-41cd-b4ea-12d59468c48d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1276 microversion: 2.1 time: 0.276871 Oct 28 18:14:16.226276 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1484/2873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:15 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1276 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:16.292835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:16.304189 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed1e30cd-a537-4ba7-acdb-135d3e8b4054 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1507 microversion: 2.1 time: 0.633692 Oct 28 18:14:16.304796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1390/2874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:15 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:16.326917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:16.327943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:16.341832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:16.345354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:16.348901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:16.349862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:16.350497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:16.357329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:16.570405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:16.573100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:16.597858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:16.599573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:16.600084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:16.604664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:16.606290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:16.609327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.029473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:17.038944 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-092d1881-6d5b-4ff1-8674-7c40321c7c92 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1507 microversion: 2.1 time: 0.715957 Oct 28 18:14:17.039555 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1485/2875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:16 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1507 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:17.053383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:17.054460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:17.067149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:17.068188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:17.068978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.070870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:17.072158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:17.072930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.311850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:17.320610 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4b014c0d-8e24-468d-8c83-ecb35cb397d0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 0.764568 Oct 28 18:14:17.325908 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1391/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:16 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:17.331641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:17.346892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:17.363506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:17.364235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:17.364739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.365993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:17.366626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:17.367199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.487073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:17.532821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-838e6f77-6575-465c-9405-26eab94e7929 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "PUT /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1079 microversion: 2.1 time: 0.204594 Oct 28 18:14:17.534348 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1392/2877] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:14:17 2022] PUT /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1079 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:17.540271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:17.541388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:17.545006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:17.552033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:17.552844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:17.559636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.560610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:17.561102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:17.561543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.990565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:18.010498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:18.016283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:18.019517 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f23ddf9b-20e3-4ca3-a281-9d9a6c4a437a tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.978812 Oct 28 18:14:18.032468 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1486/2878] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:17 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:18.045498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:18.046128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:18.060890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.061738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.062589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:18.063808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.064534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.065192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:18.129623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:18.138133 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fae45829-e5f5-47a6-9960-9e022fa8c242 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.602257 Oct 28 18:14:18.138881 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1393/2879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:17 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:18.143703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8ef65ce3-7ba0-434b-8438-b405f67dae5d req-b678c0c5-197a-4a41-a6c0-4c6b619e68bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af47463-f00f-41e3-b23a-bd68c7309c1f", "tag": "4c54577c-77d7-4ddc-929c-687b5890d4d0"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:18.153625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ef65ce3-7ba0-434b-8438-b405f67dae5d req-b678c0c5-197a-4a41-a6c0-4c6b619e68bb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.154258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ef65ce3-7ba0-434b-8438-b405f67dae5d req-b678c0c5-197a-4a41-a6c0-4c6b619e68bb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.154863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ef65ce3-7ba0-434b-8438-b405f67dae5d req-b678c0c5-197a-4a41-a6c0-4c6b619e68bb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:18.168398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8ef65ce3-7ba0-434b-8438-b405f67dae5d req-b678c0c5-197a-4a41-a6c0-4c6b619e68bb service nova] Creating event network-changed:4c54577c-77d7-4ddc-929c-687b5890d4d0 for instance 7af47463-f00f-41e3-b23a-bd68c7309c1f on n-h1-862404-2 Oct 28 18:14:18.174903 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8ef65ce3-7ba0-434b-8438-b405f67dae5d req-b678c0c5-197a-4a41-a6c0-4c6b619e68bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034665 Oct 28 18:14:18.175761 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1394/2880] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:18.350393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:18.351344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:18.357715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.358438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.359031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:18.359901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.360625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.361423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:18.762241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:18.776269 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1a98123c-822d-47bd-ab2d-d66860f71823 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1505 microversion: 2.1 time: 0.741073 Oct 28 18:14:18.780727 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1487/2881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:18 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1505 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:18.801982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:18.802977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:18.818015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.819129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.821602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:18.822440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.827720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.828324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.161481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:19.184203 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-515b9aa4-dffd-45f2-b0b2-8c97f72d0990 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 0.834608 Oct 28 18:14:19.188829 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1395/2882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:18 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:19.204490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:19.207279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:19.223368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.224302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.227128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.229654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.230913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.233078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.359041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:19.368419 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-208406c8-80a1-4320-b177-41b6ba7a58cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1505 microversion: 2.1 time: 0.571787 Oct 28 18:14:19.377130 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1488/2883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:18 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1505 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:19.392688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:19.393590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:19.405849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.406809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.408162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.409468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.410348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.411033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.441267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=18 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:19.792660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:19.806074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03967258-42d4-4d9e-9984-3ffbe216c718 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.427439 Oct 28 18:14:19.807859 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1489/2884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:19 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:19.814825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:19.827977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:19.843899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.844726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.845395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.846375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.847138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.847755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.868147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:19.892925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:19.897343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:19.898614 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ed5e394-a259-4da2-b822-1dc58a92edfe tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.707843 Oct 28 18:14:19.899669 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1396/2885] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:19 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:19.934125 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d57ee749-980c-4931-abf1-50998139b6cc tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "PUT /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1081 microversion: 2.1 time: 0.124838 Oct 28 18:14:19.944736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1490/2886] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:14:19 2022] PUT /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1081 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:19.955851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:19.956587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:19.963315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.963808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.964266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.964968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.965418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.965833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:20.212600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:20.213448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:20.224950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:20.225749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:20.226362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:20.227245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:20.227895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:20.228475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:20.854727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:20.868021 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5f6ff28-8f4b-4c1e-931d-ddba360ee319 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1507 microversion: 2.1 time: 0.915876 Oct 28 18:14:20.869700 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1397/2887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:19 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1507 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:20.875036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:20.877608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:20.884607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:20.885904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:20.887226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:20.888246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:20.888960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:20.889865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.079999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:21.091454 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26845c5c-e755-4ea4-8032-611ed2b822d8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 0.885117 Oct 28 18:14:21.092425 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1491/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:20 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:21.103562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:21.106123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:21.117749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.118675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.120321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.121254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.121913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.122788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.334328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=34 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:21.389845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:21.401885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:21.409710 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f20c90ae-a6d8-4735-b751-d94a78037549 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.538269 Oct 28 18:14:21.411854 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1398/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:20 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:21.444576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:21.444917 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-052626b1-7798-44a6-a949-97ca59712b50 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1507 microversion: 2.1 time: 0.340783 Oct 28 18:14:21.449988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1492/2890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:21 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:21.452810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:21.460145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7f94af50-6bd5-402f-b92a-75ba997deb11 req-3aee83d7-1fbb-44c1-916e-242d65da6bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4", "tag": "688d9718-ad07-478f-bce3-450b34064388"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:21.491183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.495643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.496379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.499515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.504061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.504832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.514586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7f94af50-6bd5-402f-b92a-75ba997deb11 req-3aee83d7-1fbb-44c1-916e-242d65da6bcb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.515456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7f94af50-6bd5-402f-b92a-75ba997deb11 req-3aee83d7-1fbb-44c1-916e-242d65da6bcb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.516120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7f94af50-6bd5-402f-b92a-75ba997deb11 req-3aee83d7-1fbb-44c1-916e-242d65da6bcb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.538627 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7f94af50-6bd5-402f-b92a-75ba997deb11 req-3aee83d7-1fbb-44c1-916e-242d65da6bcb service nova] Creating event network-changed:688d9718-ad07-478f-bce3-450b34064388 for instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 on n-h1-862404-2 Oct 28 18:14:21.544693 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7f94af50-6bd5-402f-b92a-75ba997deb11 req-3aee83d7-1fbb-44c1-916e-242d65da6bcb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093179 Oct 28 18:14:21.546148 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1493/2891] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:21.553232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:21.554536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:21.562359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.566516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.567262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.568302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.568990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.569662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.619645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:14:21.782415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8f1ad7e-8bac-4e73-8f50-9c4724baaa44 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 204 len: 0 microversion: 2.1 time: 0.234054 Oct 28 18:14:21.784126 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1494/2892] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:14:21 2022] DELETE /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:14:21.799865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:21.801015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:21.808827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.809757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.810438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.811540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.812270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.812924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.846239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:14:21.933519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.compute.api [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Instance is already in deleting state, ignoring this request Oct 28 18:14:21.940467 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c12c722-cfcd-4d85-83a3-d1258250217d tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 204 len: 0 microversion: 2.1 time: 0.143025 Oct 28 18:14:21.942946 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1495/2893] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:14:21 2022] DELETE /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:14:21.955251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:21.956224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:21.965015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.965520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.971853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.973658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.973658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.973658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:22.018173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:22.092768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=14 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:22.347952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=16 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:22.384143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:22.417188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:22.419492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:22.420952 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0c1011ce-78c1-4395-9834-cf441a6509ce tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.991203 Oct 28 18:14:22.424932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1399/2894] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:21 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:22.433299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:22.435913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:22.447093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:22.449435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:22.451050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:22.452458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:22.453465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:22.456375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:22.502461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:22.519877 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc77ed15-0741-46dd-9135-559beea14443 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1513 microversion: 2.1 time: 0.572839 Oct 28 18:14:22.520481 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1496/2895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:21 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1513 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:22.571695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:22.575333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:22.598026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:22.600420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:22.601042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:22.604326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:22.605144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:22.605732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:23.230529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:23.245886 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c95e717-7df4-4166-a345-1b3aa1c2d3ed tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.704554 Oct 28 18:14:23.253189 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1497/2896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:22 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:23.458861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:23.461763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:23.476393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:23.478290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:23.482366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:23.486786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:23.487568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:23.488436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:23.848271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:23.862054 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a9a8de59-d937-4826-ad9d-51276da8d898 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 1.435798 Oct 28 18:14:23.862640 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1400/2897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:22 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:23.888264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:23.888893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:23.898565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:23.899050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:23.899492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:23.900226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:23.904536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:23.906076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:24.026182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:24.077169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:24.079342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:24.083690 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb317445-2ba5-4177-b2e7-3c81de13a366 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.635088 Oct 28 18:14:24.085928 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1498/2898] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:23 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:24.116240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-600cf321-7a8a-40b5-911d-da7ad6847317 req-9ad8cf95-83d7-41f5-a39f-81c486cd8e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a6ffc8-fd33-4acf-b318-897c0bbfcb56", "tag": "b8b4269d-c2f8-4a2e-9f91-2f32717778f0"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:24.139869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-600cf321-7a8a-40b5-911d-da7ad6847317 req-9ad8cf95-83d7-41f5-a39f-81c486cd8e07 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:24.143668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-600cf321-7a8a-40b5-911d-da7ad6847317 req-9ad8cf95-83d7-41f5-a39f-81c486cd8e07 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:24.144316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-600cf321-7a8a-40b5-911d-da7ad6847317 req-9ad8cf95-83d7-41f5-a39f-81c486cd8e07 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:24.170772 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-600cf321-7a8a-40b5-911d-da7ad6847317 req-9ad8cf95-83d7-41f5-a39f-81c486cd8e07 service nova] Creating event network-changed:b8b4269d-c2f8-4a2e-9f91-2f32717778f0 for instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 on n-h2-862404-2 Oct 28 18:14:24.180833 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-600cf321-7a8a-40b5-911d-da7ad6847317 req-9ad8cf95-83d7-41f5-a39f-81c486cd8e07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083522 Oct 28 18:14:24.183996 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1499/2899] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:24.281634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:24.282842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:24.294896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:24.295394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:24.295862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:24.309850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:24.310341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:24.310783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:24.972603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:24.982604 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-502e1f7e-8784-42ba-9bbb-a90593c13f1f tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1513 microversion: 2.1 time: 1.105132 Oct 28 18:14:24.983869 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1401/2900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:23 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1513 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:24.997161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:25.005003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:25.018983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:25.019492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:25.019956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:25.020674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:25.021128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:25.021560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:25.634475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:25.655296 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92824e81-025c-41f1-a88d-dffb7132ce9a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 1.377595 Oct 28 18:14:25.677556 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1500/2901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:24 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:25.694458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:25.698656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:25.717744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:25.718668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:25.720456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:25.722469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:25.725875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:25.728559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:25.729252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:25.736857 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3f22b4ad-83e3-487c-bfc1-b5ea0add2f2d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 0.746705 Oct 28 18:14:25.738238 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1402/2902] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:24 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:26.000045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1756221182", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "267d2301-3717-4887-aee2-82012863ff35"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:26.103486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] validate_networks() for [('267d2301-3717-4887-aee2-82012863ff35', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:26.166928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:26.179180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:26.180677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:26.181877 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b9e0113d-984b-4d26-8dde-5da7ea6a461e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.502053 Oct 28 18:14:26.186247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1501/2903] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:25 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:26.193744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:26.194568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:26.214714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:26.215280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:26.215733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:26.218440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:26.218924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:26.219391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:26.345044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:26.353274 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-634b4768-ec00-4c29-9d54-8a17b65a6254 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1471 microversion: 2.1 time: 0.163202 Oct 28 18:14:26.364195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1502/2904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:26 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:26.588548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-68167b81-e8bf-4c34-83d7-1c9a00ed8857 req-a7ef13ec-6483-4db0-b8b0-e350e5f95636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c205e304-2b1b-43d8-ae04-dc535702238d", "name": "network-vif-deleted", "tag": "2b13314c-8643-4b37-ace1-7f0c5930dd3d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:26.606695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-68167b81-e8bf-4c34-83d7-1c9a00ed8857 req-a7ef13ec-6483-4db0-b8b0-e350e5f95636 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:26.611187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-68167b81-e8bf-4c34-83d7-1c9a00ed8857 req-a7ef13ec-6483-4db0-b8b0-e350e5f95636 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:26.611929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-68167b81-e8bf-4c34-83d7-1c9a00ed8857 req-a7ef13ec-6483-4db0-b8b0-e350e5f95636 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:26.647887 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-68167b81-e8bf-4c34-83d7-1c9a00ed8857 req-a7ef13ec-6483-4db0-b8b0-e350e5f95636 service nova] Creating event network-vif-deleted:2b13314c-8643-4b37-ace1-7f0c5930dd3d for instance c205e304-2b1b-43d8-ae04-dc535702238d on n-h2-862404-2 Oct 28 18:14:26.659237 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-68167b81-e8bf-4c34-83d7-1c9a00ed8857 req-a7ef13ec-6483-4db0-b8b0-e350e5f95636 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075989 Oct 28 18:14:26.677777 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1503/2905] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:14:26.703477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:26.705071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:26.733198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:26.733963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:26.734556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:26.738262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:26.744947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:26.745431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.226241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:27.244773 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ba9a397-a551-4c33-bd6d-397f77e13a31 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.551015 Oct 28 18:14:27.245700 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1504/2906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:26 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:27.250525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:27.251190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:27.265826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.266815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.267365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.268122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.268587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.269012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.696967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:27.714883 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-846ff5d3-2b63-486e-b57e-785af40803ad tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 0.467107 Oct 28 18:14:27.716058 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1505/2907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:27 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:27.727083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:27.733087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:27.744811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.746712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.747349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.749692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.750347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.751049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.837774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:27.838244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:27.838658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:27.839069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:27.839482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:27.868717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.869957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.871597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.872644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.873339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.874032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.910841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Getting quotas for project 9aff6baa638641ffafc9f46981c8e465. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:27.918030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Getting quotas for user 6f3ce763c739446186720e457592ce96 and project 9aff6baa638641ffafc9f46981c8e465. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:27.937693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:27.941491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:27.999873 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-daed1001-e6de-4936-bd45-97e387a58dcf tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.260468 Oct 28 18:14:28.008703 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1403/2908] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:14:28.014770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:28.015647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:28.024556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.025778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.026513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.027926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.028898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.029875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.074869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.075614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.076579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.077181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lazy-loading 'fault' on Instance uuid c205e304-2b1b-43d8-ae04-dc535702238d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:14:28.287957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8b396d3fca4ec5bb085fb1404328f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5344e62d39b463da80ea567fc1265ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:28.301737 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5d7eb343-d595-4621-b385-7ac058eaccb9 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 200 len: 1307 microversion: 2.1 time: 0.288861 Oct 28 18:14:28.302377 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1404/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:28 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:28.317407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3791c645-4fec-4f4b-b93d-79a52e99661d req-f3804bfb-3620-432e-bdb5-8408363bac4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-plugged", "status": "completed", "tag": "0d561e16-be60-4fcd-9838-adb440165e4d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:28.343278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3791c645-4fec-4f4b-b93d-79a52e99661d req-f3804bfb-3620-432e-bdb5-8408363bac4f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.343780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3791c645-4fec-4f4b-b93d-79a52e99661d req-f3804bfb-3620-432e-bdb5-8408363bac4f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.346465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3791c645-4fec-4f4b-b93d-79a52e99661d req-f3804bfb-3620-432e-bdb5-8408363bac4f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.392589 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3791c645-4fec-4f4b-b93d-79a52e99661d req-f3804bfb-3620-432e-bdb5-8408363bac4f service nova] Creating event network-vif-plugged:0d561e16-be60-4fcd-9838-adb440165e4d for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:14:28.399919 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3791c645-4fec-4f4b-b93d-79a52e99661d req-f3804bfb-3620-432e-bdb5-8408363bac4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096208 Oct 28 18:14:28.400986 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1405/2910] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:28.409534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6efee16d-fe8f-4316-87a4-c3ef4cccb2f3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:28.411140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6efee16d-fe8f-4316-87a4-c3ef4cccb2f3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:28.480604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:28.520611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:28.541933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:28.551331 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee220b90-1cab-419c-b297-ff2ce3663cc3 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.833948 Oct 28 18:14:28.560534 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1506/2911] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:27 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:28.582009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:28.586168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:28.615041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.615567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.617854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.618653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.619116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.623607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.874404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6efee16d-fe8f-4316-87a4-c3ef4cccb2f3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:28.900259 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6efee16d-fe8f-4316-87a4-c3ef4cccb2f3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1224 microversion: 2.1 time: 0.497336 Oct 28 18:14:28.900871 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1406/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:28 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1224 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:28.915122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:28.915122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:28.923836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.928834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.929474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.930077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.930666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.930973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.185125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:29.196065 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0674cb3-bdaf-4ebe-8a04-bb4b41e72dac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.634272 Oct 28 18:14:29.197673 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1507/2913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:28 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:29.334660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:29.335460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c205e304-2b1b-43d8-ae04-dc535702238d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:29.379472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.383600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.384333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.385847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.388104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.388788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.413577 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] HTTP exception thrown: Instance c205e304-2b1b-43d8-ae04-dc535702238d could not be found. Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Request method failure captured: Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d HTTP/1.1 Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBtEB964bESuEpT7UTKcRhTh8EQ_IGR8V1xBTzNf0qMTNpEnzgqKig-zTLPvAmEcESZnvh4Aq0HTIKd9BQqW17RS_hTuJbl0j7IYvlCS8BMRWve6X4ga9t-vAL7Pd6qPqfL-KfDGcbZniD1omc1UfTZhCxfKYIFwqXUzUtzi3YtMUrI Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5344e62d39b463da80ea567fc1265ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: ce8b396d3fca4ec5bb085fb1404328f4 Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance c205e304-2b1b-43d8-ae04-dc535702238d could not be found. Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'c205e304-2b1b-43d8-ae04-dc535702238d'} Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c205e304-2b1b-43d8-ae04-dc535702238d could not be found. Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c205e304-2b1b-43d8-ae04-dc535702238d could not be found. Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:29.419969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c205e304-2b1b-43d8-ae04-dc535702238d could not be found. Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Returning 404 to user: Instance c205e304-2b1b-43d8-ae04-dc535702238d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca79805f-dd83-4284-805d-61fc65aaf2c1 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d" status: 404 len: 111 microversion: 2.1 time: 0.094716 Oct 28 18:14:29.429190 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1508/2914] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:29 2022] GET /compute/v2.1/servers/c205e304-2b1b-43d8-ae04-dc535702238d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:29.444459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:29.445008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:29.457755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.460432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.461081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.461998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.467011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.467712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.501949 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] HTTP exception thrown: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Request method failure captured: Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 HTTP/1.1 Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBtEB964bESuEpT7UTKcRhTh8EQ_IGR8V1xBTzNf0qMTNpEnzgqKig-zTLPvAmEcESZnvh4Aq0HTIKd9BQqW17RS_hTuJbl0j7IYvlCS8BMRWve6X4ga9t-vAL7Pd6qPqfL-KfDGcbZniD1omc1UfTZhCxfKYIFwqXUzUtzi3YtMUrI Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5344e62d39b463da80ea567fc1265ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: ce8b396d3fca4ec5bb085fb1404328f4 Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'c09b4345-86e2-477d-a81e-f3c0c69aa329'} Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:14:29.510024 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.513696 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.521234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Returning 404 to user: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:29.522596 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a28d65f4-87bc-408d-918e-5cdb1f586f72 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 404 len: 111 microversion: 2.1 time: 0.092663 Oct 28 18:14:29.525429 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1509/2915] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:14:29 2022] DELETE /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:29.635538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84930651-51fb-493f-9032-0daba5fe46c0 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd6784c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1426739555", "description": "tempest-description-463146061"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:29.700602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:29.720395 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d04e8f4a-71e2-48fe-a62d-fd509a26443c tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 0.818012 Oct 28 18:14:29.721023 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1407/2916] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:28 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:29.729960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:29.730586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: c09b4345-86e2-477d-a81e-f3c0c69aa329] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:29.755719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.760624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.761182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.762117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.762754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.763342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.794076 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] HTTP exception thrown: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Request method failure captured: Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 HTTP/1.1 Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBtEB964bESuEpT7UTKcRhTh8EQ_IGR8V1xBTzNf0qMTNpEnzgqKig-zTLPvAmEcESZnvh4Aq0HTIKd9BQqW17RS_hTuJbl0j7IYvlCS8BMRWve6X4ga9t-vAL7Pd6qPqfL-KfDGcbZniD1omc1UfTZhCxfKYIFwqXUzUtzi3YtMUrI Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5344e62d39b463da80ea567fc1265ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: ce8b396d3fca4ec5bb085fb1404328f4 Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'c09b4345-86e2-477d-a81e-f3c0c69aa329'} Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:29.796096 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.801670 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.801670 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:29.801670 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:29.801670 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:29.801670 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:29.801670 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. Oct 28 18:14:29.801670 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.802926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Returning 404 to user: Instance c09b4345-86e2-477d-a81e-f3c0c69aa329 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:29.803994 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-217d0230-31b0-408f-8183-5f3335179d87 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329" status: 404 len: 111 microversion: 2.1 time: 0.082009 Oct 28 18:14:29.805028 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1408/2917] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:29 2022] GET /compute/v2.1/servers/c09b4345-86e2-477d-a81e-f3c0c69aa329 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:29.810551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:29.811329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:29.818889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.819373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.820019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.821545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.822398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.822982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.915520 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84930651-51fb-493f-9032-0daba5fe46c0 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.388260 Oct 28 18:14:29.924134 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1510/2918] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:29 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:29.937117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:29.938000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:29.947233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.948319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.949003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.949931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.950639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.951119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.966151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] HTTP exception thrown: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Request method failure captured: Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 HTTP/1.1 Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBtEB964bESuEpT7UTKcRhTh8EQ_IGR8V1xBTzNf0qMTNpEnzgqKig-zTLPvAmEcESZnvh4Aq0HTIKd9BQqW17RS_hTuJbl0j7IYvlCS8BMRWve6X4ga9t-vAL7Pd6qPqfL-KfDGcbZniD1omc1UfTZhCxfKYIFwqXUzUtzi3YtMUrI Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5344e62d39b463da80ea567fc1265ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: ce8b396d3fca4ec5bb085fb1404328f4 Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'e10ed602-8749-474d-a2e1-46b84ecb86d8'} Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:14:29.970412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:29.974208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:29.978166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Returning 404 to user: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:29.979327 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e21c48b-f93a-402b-b744-c96064d66282 tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 404 len: 111 microversion: 2.1 time: 0.053275 Oct 28 18:14:29.980154 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1511/2919] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:14:29 2022] DELETE /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:29.990609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:29.991583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:29.998819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:30.001517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.002366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.003071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:30.004041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.004722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.005443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:30.099229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:30.112702 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-365fd4fd-cd61-4642-8754-c0480578b380 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1276 microversion: 2.1 time: 0.127005 Oct 28 18:14:30.113512 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1512/2920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:29 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:30.129375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fc917a2c-3504-48e1-a5db-523a1b820305 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd6780d0>, body: {"security_group_rule": {"parent_group_id": "9d60c629-867c-4b75-82cc-2c242208ab57", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:30.459940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:30.502461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:30.508718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:30.512460 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c02687c3-eb1d-483e-8ef5-3020293f828e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.705879 Oct 28 18:14:30.514288 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1409/2921] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:29 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:30.538006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:30.540074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] [instance: e10ed602-8749-474d-a2e1-46b84ecb86d8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:30.552660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.554216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.555309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:30.556930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.558305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.559399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:30.624447 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] HTTP exception thrown: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:30.624670 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fc917a2c-3504-48e1-a5db-523a1b820305 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.507385 Oct 28 18:14:30.627052 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1513/2922] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Request method failure captured: Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 HTTP/1.1 Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBtEB964bESuEpT7UTKcRhTh8EQ_IGR8V1xBTzNf0qMTNpEnzgqKig-zTLPvAmEcESZnvh4Aq0HTIKd9BQqW17RS_hTuJbl0j7IYvlCS8BMRWve6X4ga9t-vAL7Pd6qPqfL-KfDGcbZniD1omc1UfTZhCxfKYIFwqXUzUtzi3YtMUrI Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c5344e62d39b463da80ea567fc1265ce", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c5344e62d39b463da80ea567fc1265ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c5344e62d39b463da80ea567fc1265ce Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-95795981 Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: ce8b396d3fca4ec5bb085fb1404328f4 Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerDiskConfigTestJSON-95795981-project Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'e10ed602-8749-474d-a2e1-46b84ecb86d8'} Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:30.633196 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] Returning 404 to user: Instance e10ed602-8749-474d-a2e1-46b84ecb86d8 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:30.640980 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0931cf9a-76e0-4158-8e5f-705a0fd7e77e tempest-ServerDiskConfigTestJSON-95795981 tempest-ServerDiskConfigTestJSON-95795981-project] 10.222.0.16 "GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8" status: 404 len: 111 microversion: 2.1 time: 0.121463 Oct 28 18:14:30.651102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:30.654874 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1410/2923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:30 2022] GET /compute/v2.1/servers/e10ed602-8749-474d-a2e1-46b84ecb86d8 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:30.656305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:30.671108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3b123842-2e44-460d-b2e3-920dda8dfd40 req-9b21df62-36b5-4ee6-b341-e33214fca771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af47463-f00f-41e3-b23a-bd68c7309c1f", "name": "network-vif-plugged", "status": "completed", "tag": "4c54577c-77d7-4ddc-929c-687b5890d4d0"}, {"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-plugged", "status": "completed", "tag": "24d57195-2b05-4d20-a213-c277be41e78e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:30.686316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.689896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.696768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:30.698258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.699317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.700382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:30.728847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3b123842-2e44-460d-b2e3-920dda8dfd40 req-9b21df62-36b5-4ee6-b341-e33214fca771 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.729719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3b123842-2e44-460d-b2e3-920dda8dfd40 req-9b21df62-36b5-4ee6-b341-e33214fca771 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.731248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3b123842-2e44-460d-b2e3-920dda8dfd40 req-9b21df62-36b5-4ee6-b341-e33214fca771 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:30.752310 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3b123842-2e44-460d-b2e3-920dda8dfd40 req-9b21df62-36b5-4ee6-b341-e33214fca771 service nova] Creating event network-vif-plugged:4c54577c-77d7-4ddc-929c-687b5890d4d0 for instance 7af47463-f00f-41e3-b23a-bd68c7309c1f on n-h1-862404-2 Oct 28 18:14:30.753046 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3b123842-2e44-460d-b2e3-920dda8dfd40 req-9b21df62-36b5-4ee6-b341-e33214fca771 service nova] Creating event network-vif-plugged:24d57195-2b05-4d20-a213-c277be41e78e for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:14:30.764594 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3b123842-2e44-460d-b2e3-920dda8dfd40 req-9b21df62-36b5-4ee6-b341-e33214fca771 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103817 Oct 28 18:14:30.765932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1411/2924] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:30.772684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28f483fb-249b-421b-bfba-c00971faedf4 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd7ae820>, body: {"security_group_rule": {"parent_group_id": "9d60c629-867c-4b75-82cc-2c242208ab57", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:31.008498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:31.016967 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9c9cec1-a772-4e1d-bac6-513d6263076a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.386985 Oct 28 18:14:31.017734 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1514/2925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:30 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:31.040454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:31.041397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:31.049679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:31.050614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:31.051276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:31.052345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:31.053053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:31.053696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:31.078492 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-28f483fb-249b-421b-bfba-c00971faedf4 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] HTTP exception thrown: This rule already exists in group 9d60c629-867c-4b75-82cc-2c242208ab57 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28f483fb-249b-421b-bfba-c00971faedf4 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Request method failure captured: Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 138 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwFizpKCliXpi5JDRlzWBD-MDAaQSGOzrXIOWip-7NoVP8dQgeIVuwUk-27LoacjmO1UsUCaM6gntgvaY_lYwbxWxRBDZNxofy1A-fZb9bGbQKY8anqx5KvXcefRv0kjoDq9PxGJ4O6m9D2xhxoqNJ2Td91pMrSpz5hMfmeT9U9_II Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aad207ecfe4d491c8409fee987839d5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 14e64e02142945a1a895a420c65d4777 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: {"security_group_rule": {"parent_group_id": "9d60c629-867c-4b75-82cc-2c242208ab57", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: exception: This rule already exists in group 9d60c629-867c-4b75-82cc-2c242208ab57 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9d60c629-867c-4b75-82cc-2c242208ab57', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 9d60c629-867c-4b75-82cc-2c242208ab57 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 9d60c629-867c-4b75-82cc-2c242208ab57 Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:31.081054 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:31.085334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:31.085334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:31.085334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 9d60c629-867c-4b75-82cc-2c242208ab57 Oct 28 18:14:31.085334 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:31.085334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28f483fb-249b-421b-bfba-c00971faedf4 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Returning 400 to user: This rule already exists in group 9d60c629-867c-4b75-82cc-2c242208ab57 {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:31.085334 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28f483fb-249b-421b-bfba-c00971faedf4 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.314406 Oct 28 18:14:31.085334 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1412/2926] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:30 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:14:31.091443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79447824-61e9-4a99-99a3-9948eaaab3e3 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Calling method '.version_select at 0x7f78dd825ca0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:31.386836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:31.397785 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c93371c2-47f5-4bd3-9b15-53ce7e355948 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 0.361433 Oct 28 18:14:31.401103 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1515/2927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:31 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:31.423124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:31.427784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:31.446238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:31.447191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:31.449532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:31.450708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:31.451399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:31.453114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:31.589798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:31.602464 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00778663-7eef-4bbc-b16e-e96c70960121 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1282 microversion: 2.1 time: 0.197980 Oct 28 18:14:31.607403 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1516/2928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:31 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:31.625022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:31.625877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:31.639137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:31.641541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:31.642703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:31.643576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:31.644869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:31.645406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:32.138154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:32.143926 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79447824-61e9-4a99-99a3-9948eaaab3e3 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/d75b528d-d1e2-475f-941a-e4446ea9a56f" status: 202 len: 0 microversion: 2.1 time: 1.056371 Oct 28 18:14:32.151882 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1413/2929] 10.222.0.16 () {58 vars in 1287 bytes} [Fri Oct 28 18:14:31 2022] DELETE /compute/v2.1/os-security-group-rules/d75b528d-d1e2-475f-941a-e4446ea9a56f => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:32.152349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:32.153481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:32.170265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:32.171242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:32.174303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:32.175988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:32.177259 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0203d2a1-e90c-4579-810e-0a31c981d3af tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.568500 Oct 28 18:14:32.177857 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1517/2930] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:31 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:32.178174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:32.179196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:32.179920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:32.184686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:32.198254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb47d5e6-1d57-4bfd-9d2a-79c23a8ecbe9 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd851280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1878410549", "description": "tempest-description-1631956263"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:32.720825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:32.734750 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7cc39c0d-3240-402a-b96a-386bc09c6de5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.588794 Oct 28 18:14:32.746332 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1414/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:32 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:32.753392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:32.764357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:32.785914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:32.786420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:32.786859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:32.787575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:32.788203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:32.788629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.043275 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb47d5e6-1d57-4bfd-9d2a-79c23a8ecbe9 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.857128 Oct 28 18:14:33.044785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1518/2932] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:32 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:33.050396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:33.051230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:33.066636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.067410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.068431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.075787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.076743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.077390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.083192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:33.492936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:33.504242 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9d43db0-6506-4d0f-9489-9f02fcd153e9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1324 microversion: 2.1 time: 0.457594 Oct 28 18:14:33.506699 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1519/2933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:33 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:33.522859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07aaa6bd-6181-4798-a0f6-18f3b26123a0 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd851790>, body: {"security_group_rule": {"parent_group_id": "19158fa7-6bf9-4de4-95d5-96eb73192d4a", "ip_protocol": "tcp", "from_port": 1708383781, "to_port": 22}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:33.616143 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-07aaa6bd-6181-4798-a0f6-18f3b26123a0 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] HTTP exception thrown: Invalid port range 1708383781:22. Former value cannot be greater than the later Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07aaa6bd-6181-4798-a0f6-18f3b26123a0 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Request method failure captured: Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 146 Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwFizpKCliXpi5JDRlzWBD-MDAaQSGOzrXIOWip-7NoVP8dQgeIVuwUk-27LoacjmO1UsUCaM6gntgvaY_lYwbxWxRBDZNxofy1A-fZb9bGbQKY8anqx5KvXcefRv0kjoDq9PxGJ4O6m9D2xhxoqNJ2Td91pMrSpz5hMfmeT9U9_II Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aad207ecfe4d491c8409fee987839d5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 14e64e02142945a1a895a420c65d4777 Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: {"security_group_rule": {"parent_group_id": "19158fa7-6bf9-4de4-95d5-96eb73192d4a", "ip_protocol": "tcp", "from_port": 1708383781, "to_port": 22}} Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid port range 1708383781:22. Former value cannot be greater than the later Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'security_group_rule': {'parent_group_id': '19158fa7-6bf9-4de4-95d5-96eb73192d4a', 'ip_protocol': 'tcp', 'from_port': 1708383781, 'to_port': 22}}} Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1708383781:22. Former value cannot be greater than the later Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1708383781:22. Former value cannot be greater than the later Oct 28 18:14:33.617750 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1708383781:22. Former value cannot be greater than the later Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07aaa6bd-6181-4798-a0f6-18f3b26123a0 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Returning 400 to user: Invalid port range 1708383781:22. Former value cannot be greater than the later {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07aaa6bd-6181-4798-a0f6-18f3b26123a0 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.111431 Oct 28 18:14:33.621472 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1520/2934] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:33 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:14:33.624660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:33.625155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:33.638506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.639265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.639901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.641072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.641951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.642558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.780692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:33.784512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:33.795502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-66a6a74e-1471-45b0-91c7-7eb77dcf0281 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1316 microversion: 2.1 time: 1.046283 Oct 28 18:14:33.796716 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1415/2935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:32 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1316 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:33.808686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-fe6fc4bd-8dc3-4ac9-b0b8-f6113117462a req-4e3aac56-afab-40d7-bdf5-7e4dae02f117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-plugged", "status": "completed", "tag": "2408e0e9-b9b2-4b3e-b910-5848a5a8660c"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:33.833817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-fe6fc4bd-8dc3-4ac9-b0b8-f6113117462a req-4e3aac56-afab-40d7-bdf5-7e4dae02f117 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.834796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-fe6fc4bd-8dc3-4ac9-b0b8-f6113117462a req-4e3aac56-afab-40d7-bdf5-7e4dae02f117 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.836416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-fe6fc4bd-8dc3-4ac9-b0b8-f6113117462a req-4e3aac56-afab-40d7-bdf5-7e4dae02f117 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.853636 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-fe6fc4bd-8dc3-4ac9-b0b8-f6113117462a req-4e3aac56-afab-40d7-bdf5-7e4dae02f117 service nova] Creating event network-vif-plugged:2408e0e9-b9b2-4b3e-b910-5848a5a8660c for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:14:33.867345 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-fe6fc4bd-8dc3-4ac9-b0b8-f6113117462a req-4e3aac56-afab-40d7-bdf5-7e4dae02f117 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068304 Oct 28 18:14:33.868742 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1416/2936] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:33.874927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-744f61b5-9f5f-48e9-81dc-d8a4b410755e tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78de772160>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1689037955", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:33.878689 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-744f61b5-9f5f-48e9-81dc-d8a4b410755e tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] HTTP exception thrown: Security group id should be uuid Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-744f61b5-9f5f-48e9-81dc-d8a4b410755e tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Request method failure captured: Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 131 Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwFizpKCliXpi5JDRlzWBD-MDAaQSGOzrXIOWip-7NoVP8dQgeIVuwUk-27LoacjmO1UsUCaM6gntgvaY_lYwbxWxRBDZNxofy1A-fZb9bGbQKY8anqx5KvXcefRv0kjoDq9PxGJ4O6m9D2xhxoqNJ2Td91pMrSpz5hMfmeT9U9_II Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aad207ecfe4d491c8409fee987839d5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 14e64e02142945a1a895a420c65d4777 Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1689037955", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group id should be uuid Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1689037955', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:33.880632 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:33.885579 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 28 18:14:33.885579 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:33.888021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-744f61b5-9f5f-48e9-81dc-d8a4b410755e tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Returning 400 to user: Security group id should be uuid {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:33.889123 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-744f61b5-9f5f-48e9-81dc-d8a4b410755e tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.019126 Oct 28 18:14:33.890450 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1417/2937] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:33 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:14:33.896247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:33.898629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:33.917448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.918027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.924074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.924868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.925351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.925786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:34.147494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:34.178220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:34.180797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:34.184537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c5e7bcc-191e-4dd4-816a-508efdf4ab65 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.563573 Oct 28 18:14:34.202698 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1521/2938] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:33 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:34.214504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e3b9da1-4960-4214-88b6-aafdee6d533e tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd851ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-120311035", "description": "tempest-description-1726438785"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:34.342371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:34.354515 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ada1c037-1370-45d5-81d7-51f462b60431 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.462131 Oct 28 18:14:34.355344 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1418/2939] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:33 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:34.544046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:34.548965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:34.575152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:34.577037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:34.578285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:34.581514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:34.584308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:34.586537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:34.840211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e3b9da1-4960-4214-88b6-aafdee6d533e tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.636210 Oct 28 18:14:34.852224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1522/2940] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:34.857864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:34.858921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:34.883095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:34.884008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:34.884645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:34.886404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:34.887074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:34.887710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:34.993954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:35.008420 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e57b1cd-9ec5-4c00-a6ff-f02feedb3810 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1324 microversion: 2.1 time: 0.481615 Oct 28 18:14:35.028261 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1419/2941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:34 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:35.045088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3028a817-27d6-4f36-8a88-d2bcbacec8ab tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd80fee0>, body: {"security_group_rule": {"parent_group_id": "a643edf0-72fa-4a4b-b195-aef2ce96c0be", "ip_protocol": "tempest-999-1353764316", "from_port": 22, "to_port": 22}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:35.574031 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3028a817-27d6-4f36-8a88-d2bcbacec8ab tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] HTTP exception thrown: Invalid IP protocol tempest-999-1353764316. Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3028a817-27d6-4f36-8a88-d2bcbacec8ab tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Request method failure captured: Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 157 Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwFizpKCliXpi5JDRlzWBD-MDAaQSGOzrXIOWip-7NoVP8dQgeIVuwUk-27LoacjmO1UsUCaM6gntgvaY_lYwbxWxRBDZNxofy1A-fZb9bGbQKY8anqx5KvXcefRv0kjoDq9PxGJ4O6m9D2xhxoqNJ2Td91pMrSpz5hMfmeT9U9_II Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aad207ecfe4d491c8409fee987839d5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 14e64e02142945a1a895a420c65d4777 Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: {"security_group_rule": {"parent_group_id": "a643edf0-72fa-4a4b-b195-aef2ce96c0be", "ip_protocol": "tempest-999-1353764316", "from_port": 22, "to_port": 22}} Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid IP protocol tempest-999-1353764316. Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a643edf0-72fa-4a4b-b195-aef2ce96c0be', 'ip_protocol': 'tempest-999-1353764316', 'from_port': 22, 'to_port': 22}}} Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1353764316. Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1353764316. Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:35.575762 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:35.580837 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:35.580837 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:35.580837 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:35.580837 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:35.580837 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:35.580837 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:35.580837 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1353764316. Oct 28 18:14:35.580837 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:35.582215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3028a817-27d6-4f36-8a88-d2bcbacec8ab tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Returning 400 to user: Invalid IP protocol tempest-999-1353764316. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:35.583230 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3028a817-27d6-4f36-8a88-d2bcbacec8ab tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.552051 Oct 28 18:14:35.584299 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1420/2942] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:35 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 555 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:14:35.593771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-307e991b-e9d9-4cdb-bf99-91edd62e0773 req-6b9ae4a0-f380-4ef8-95d7-9ba3b1802c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db87eca6-1a77-4d03-845a-bef6c5cc172a", "tag": "48244433-9e7a-4603-b111-c631d5ca8a7b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:35.622377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-307e991b-e9d9-4cdb-bf99-91edd62e0773 req-6b9ae4a0-f380-4ef8-95d7-9ba3b1802c68 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:35.623134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-307e991b-e9d9-4cdb-bf99-91edd62e0773 req-6b9ae4a0-f380-4ef8-95d7-9ba3b1802c68 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:35.626915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-307e991b-e9d9-4cdb-bf99-91edd62e0773 req-6b9ae4a0-f380-4ef8-95d7-9ba3b1802c68 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:35.647851 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-307e991b-e9d9-4cdb-bf99-91edd62e0773 req-6b9ae4a0-f380-4ef8-95d7-9ba3b1802c68 service nova] Creating event network-changed:48244433-9e7a-4603-b111-c631d5ca8a7b for instance db87eca6-1a77-4d03-845a-bef6c5cc172a on n-h2-862404-2 Oct 28 18:14:35.673188 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-307e991b-e9d9-4cdb-bf99-91edd62e0773 req-6b9ae4a0-f380-4ef8-95d7-9ba3b1802c68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075691 Oct 28 18:14:35.673951 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1421/2943] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:35.680292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:35.681002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:35.694893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:35.695388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:35.695840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:35.700439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:35.701326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:35.702111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:35.768416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:35.780702 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df51435d-e225-4ea1-8035-c8f4249bc35e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1504 microversion: 2.1 time: 0.926952 Oct 28 18:14:35.781323 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1523/2944] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:34 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1504 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:35.801999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:35.809431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:35.832339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:35.833122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:35.834823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:35.839540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:35.840935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:35.842261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:36.226560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:36.244177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:36.245846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:36.258862 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08ef10ca-124e-4b64-9bea-f426de9277b9 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.583458 Oct 28 18:14:36.260825 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1422/2945] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:35 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:36.270784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9bd6fb12-4fdb-4fd1-8bc9-7327a7393498 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd7c5ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-285829235", "description": "tempest-description-539307920"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:36.343175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:36.356648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca39b888-8bdc-413c-b954-f039d4588c10 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.571138 Oct 28 18:14:36.358734 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1524/2946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:35 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:36.372029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-189624363"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:36.372832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:36.394208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:36.396118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:36.396780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:36.398453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:36.400934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:36.401574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:36.589957 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9bd6fb12-4fdb-4fd1-8bc9-7327a7393498 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.327735 Oct 28 18:14:36.590589 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1423/2947] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:36 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:36.597282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d5467bda-3d34-4d98-99d4-510785152690 req-0ec7d4e1-5fdb-4b97-aab8-fbb5c92c6a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-plugged", "status": "completed", "tag": "7d7ae5e3-3f70-4637-8a50-c637d361ee01"}, {"server_uuid": "c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4", "name": "network-vif-plugged", "status": "completed", "tag": "688d9718-ad07-478f-bce3-450b34064388"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:36.615054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d5467bda-3d34-4d98-99d4-510785152690 req-0ec7d4e1-5fdb-4b97-aab8-fbb5c92c6a29 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:36.616331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d5467bda-3d34-4d98-99d4-510785152690 req-0ec7d4e1-5fdb-4b97-aab8-fbb5c92c6a29 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:36.616925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d5467bda-3d34-4d98-99d4-510785152690 req-0ec7d4e1-5fdb-4b97-aab8-fbb5c92c6a29 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:36.636485 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d5467bda-3d34-4d98-99d4-510785152690 req-0ec7d4e1-5fdb-4b97-aab8-fbb5c92c6a29 service nova] Creating event network-vif-plugged:7d7ae5e3-3f70-4637-8a50-c637d361ee01 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:14:36.642989 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d5467bda-3d34-4d98-99d4-510785152690 req-0ec7d4e1-5fdb-4b97-aab8-fbb5c92c6a29 service nova] Creating event network-vif-plugged:688d9718-ad07-478f-bce3-450b34064388 for instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 on n-h1-862404-2 Oct 28 18:14:36.654817 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d5467bda-3d34-4d98-99d4-510785152690 req-0ec7d4e1-5fdb-4b97-aab8-fbb5c92c6a29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062635 Oct 28 18:14:36.656200 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1424/2948] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:36.663619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:36.664825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:36.674178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:36.675086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:36.675739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:36.676970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:36.679582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:36.681116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:36.931581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:36.939794 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2f8f6d26-9d0d-4ac7-8659-e92f83f605d5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1324 microversion: 2.1 time: 0.280921 Oct 28 18:14:36.940666 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1425/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:36 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1324 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:36.946022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b2779a0-89c0-4875-a27a-242cc4932569 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78dd7c5790>, body: {"security_group_rule": {"parent_group_id": "39f8ef8f-7216-494a-ac82-a4a719c34900", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:37.002645 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-1b2779a0-89c0-4875-a27a-242cc4932569 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b2779a0-89c0-4875-a27a-242cc4932569 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Request method failure captured: Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 138 Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwFizpKCliXpi5JDRlzWBD-MDAaQSGOzrXIOWip-7NoVP8dQgeIVuwUk-27LoacjmO1UsUCaM6gntgvaY_lYwbxWxRBDZNxofy1A-fZb9bGbQKY8anqx5KvXcefRv0kjoDq9PxGJ4O6m9D2xhxoqNJ2Td91pMrSpz5hMfmeT9U9_II Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aad207ecfe4d491c8409fee987839d5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 14e64e02142945a1a895a420c65d4777 Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: {"security_group_rule": {"parent_group_id": "39f8ef8f-7216-494a-ac82-a4a719c34900", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'security_group_rule': {'parent_group_id': '39f8ef8f-7216-494a-ac82-a4a719c34900', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 18:14:37.004607 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 18:14:37.008277 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.013408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b2779a0-89c0-4875-a27a-242cc4932569 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:37.014702 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1b2779a0-89c0-4875-a27a-242cc4932569 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.072764 Oct 28 18:14:37.015515 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1426/2950] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:36 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:14:37.025458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2230a890-12d0-4e89-8fc4-5ef465f7fce4 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78e253edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1893391736", "description": "tempest-description-1464811437"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:37.174293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Adding security group 1862202e-b1f5-4e41-a884-b1b0949c25d0 to port 4c54577c-77d7-4ddc-929c-687b5890d4d0 Oct 28 18:14:37.196538 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2230a890-12d0-4e89-8fc4-5ef465f7fce4 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.173498 Oct 28 18:14:37.198319 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1427/2951] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:37 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:37.214847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b8a18f3-85d5-4b50-a846-21cd9e715bc5 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78de1e7160>, body: {"security_group_rule": {"parent_group_id": "760a9b32-f5c7-4c54-8826-9314ba33a3ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 2029515968}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:37.299730 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4b8a18f3-85d5-4b50-a846-21cd9e715bc5 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] HTTP exception thrown: Invalid port range 22:2029515968. Valid TCP ports should be between 1-65535 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b8a18f3-85d5-4b50-a846-21cd9e715bc5 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Request method failure captured: Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 146 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwFizpKCliXpi5JDRlzWBD-MDAaQSGOzrXIOWip-7NoVP8dQgeIVuwUk-27LoacjmO1UsUCaM6gntgvaY_lYwbxWxRBDZNxofy1A-fZb9bGbQKY8anqx5KvXcefRv0kjoDq9PxGJ4O6m9D2xhxoqNJ2Td91pMrSpz5hMfmeT9U9_II Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aad207ecfe4d491c8409fee987839d5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 14e64e02142945a1a895a420c65d4777 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: {"security_group_rule": {"parent_group_id": "760a9b32-f5c7-4c54-8826-9314ba33a3ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 2029515968}} Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid port range 22:2029515968. Valid TCP ports should be between 1-65535 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'security_group_rule': {'parent_group_id': '760a9b32-f5c7-4c54-8826-9314ba33a3ac', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2029515968}}} Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2029515968. Valid TCP ports should be between 1-65535 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2029515968. Valid TCP ports should be between 1-65535 Oct 28 18:14:37.302126 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2029515968. Valid TCP ports should be between 1-65535 Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b8a18f3-85d5-4b50-a846-21cd9e715bc5 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Returning 400 to user: Invalid port range 22:2029515968. Valid TCP ports should be between 1-65535 {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4b8a18f3-85d5-4b50-a846-21cd9e715bc5 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.095867 Oct 28 18:14:37.308011 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1428/2952] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:37 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:14:37.317239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:37.317875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:37.326421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:37.327073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:37.327594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:37.328355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:37.329540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:37.330618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:37.770262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:37.780373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:37.783043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:37.786438 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-66f31cee-2c9a-41a0-985b-d97762924ab7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.475182 Oct 28 18:14:37.787861 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1429/2953] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:37 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:37.793970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-db2bbdb6-ea5e-4dc2-83e8-2a4fcdc03e6c tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Action: 'create', calling method: .version_select at 0x7f78e2309160>, body: {"security_group_rule": {"parent_group_id": "a7411f48-3888-4ce9-8451-4fec904b1c45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:37.902121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:37.911528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-db2bbdb6-ea5e-4dc2-83e8-2a4fcdc03e6c tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7411f48-3888-4ce9-8451-4fec904b1c45 does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:14:37.912364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-db2bbdb6-ea5e-4dc2-83e8-2a4fcdc03e6c tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Neutron security group a7411f48-3888-4ce9-8451-4fec904b1c45 not found {{(pid=120679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:14:37.913816 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-db2bbdb6-ea5e-4dc2-83e8-2a4fcdc03e6c tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] HTTP exception thrown: Security group a7411f48-3888-4ce9-8451-4fec904b1c45 does not exist Oct 28 18:14:37.913816 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-eb80df47-fe09-4ad3-993e-144fbcb9999a'] Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-db2bbdb6-ea5e-4dc2-83e8-2a4fcdc03e6c tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Request method failure captured: Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 138 Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwFizpKCliXpi5JDRlzWBD-MDAaQSGOzrXIOWip-7NoVP8dQgeIVuwUk-27LoacjmO1UsUCaM6gntgvaY_lYwbxWxRBDZNxofy1A-fZb9bGbQKY8anqx5KvXcefRv0kjoDq9PxGJ4O6m9D2xhxoqNJ2Td91pMrSpz5hMfmeT9U9_II Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aad207ecfe4d491c8409fee987839d5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 14e64e02142945a1a895a420c65d4777 Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: {"security_group_rule": {"parent_group_id": "a7411f48-3888-4ce9-8451-4fec904b1c45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group a7411f48-3888-4ce9-8451-4fec904b1c45 does not exist Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-eb80df47-fe09-4ad3-993e-144fbcb9999a'] Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a7411f48-3888-4ce9-8451-4fec904b1c45', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:14:37.916010 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7411f48-3888-4ce9-8451-4fec904b1c45 does not exist Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb80df47-fe09-4ad3-993e-144fbcb9999a'] Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7411f48-3888-4ce9-8451-4fec904b1c45 does not exist Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb80df47-fe09-4ad3-993e-144fbcb9999a'] Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7411f48-3888-4ce9-8451-4fec904b1c45 does not exist Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb80df47-fe09-4ad3-993e-144fbcb9999a'] Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7411f48-3888-4ce9-8451-4fec904b1c45 does not exist Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb80df47-fe09-4ad3-993e-144fbcb9999a'] Oct 28 18:14:37.920138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:37.924998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-db2bbdb6-ea5e-4dc2-83e8-2a4fcdc03e6c tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Returning 404 to user: Security group a7411f48-3888-4ce9-8451-4fec904b1c45 does not exist Oct 28 18:14:37.924998 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-eb80df47-fe09-4ad3-993e-144fbcb9999a'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:37.926477 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-db2bbdb6-ea5e-4dc2-83e8-2a4fcdc03e6c tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.137160 Oct 28 18:14:37.928634 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1430/2954] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 18:14:37 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:37.943231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:37.944175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:37.954644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:37.955151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:37.955739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:37.956481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:37.958033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:37.958612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:38.482404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:38.494325 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5b8fdf6c-49d3-42af-a43c-186ad06db533 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1318 microversion: 2.1 time: 0.563798 Oct 28 18:14:38.497630 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1431/2955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:37 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:38.517443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7410542-c14e-42b0-9faa-666afad72232 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Calling method '.version_select at 0x7f78de148040>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:38.574618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-d7410542-c14e-42b0-9faa-666afad72232 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule df491516-bc82-43ce-98b0-8a2540d16e07 does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:14:38.575266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-d7410542-c14e-42b0-9faa-666afad72232 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Neutron security group rule df491516-bc82-43ce-98b0-8a2540d16e07 not found {{(pid=120679) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 28 18:14:38.575789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d7410542-c14e-42b0-9faa-666afad72232 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] HTTP exception thrown: Security group rule df491516-bc82-43ce-98b0-8a2540d16e07 does not exist Oct 28 18:14:38.575789 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-7a44d264-0454-4c89-988e-0ad154c978b4'] Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7410542-c14e-42b0-9faa-666afad72232 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Request method failure captured: Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-security-group-rules/df491516-bc82-43ce-98b0-8a2540d16e07 HTTP/1.1 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwFizpKCliXpi5JDRlzWBD-MDAaQSGOzrXIOWip-7NoVP8dQgeIVuwUk-27LoacjmO1UsUCaM6gntgvaY_lYwbxWxRBDZNxofy1A-fZb9bGbQKY8anqx5KvXcefRv0kjoDq9PxGJ4O6m9D2xhxoqNJ2Td91pMrSpz5hMfmeT9U9_II Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aad207ecfe4d491c8409fee987839d5c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aad207ecfe4d491c8409fee987839d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: aad207ecfe4d491c8409fee987839d5c Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 14e64e02142945a1a895a420c65d4777 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group rule df491516-bc82-43ce-98b0-8a2540d16e07 does not exist Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-7a44d264-0454-4c89-988e-0ad154c978b4'] Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'df491516-bc82-43ce-98b0-8a2540d16e07'} Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:14:38.577630 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule df491516-bc82-43ce-98b0-8a2540d16e07 does not exist Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a44d264-0454-4c89-988e-0ad154c978b4'] Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule df491516-bc82-43ce-98b0-8a2540d16e07 does not exist Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a44d264-0454-4c89-988e-0ad154c978b4'] Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule df491516-bc82-43ce-98b0-8a2540d16e07 does not exist Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a44d264-0454-4c89-988e-0ad154c978b4'] Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule df491516-bc82-43ce-98b0-8a2540d16e07 does not exist Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a44d264-0454-4c89-988e-0ad154c978b4'] Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7410542-c14e-42b0-9faa-666afad72232 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Returning 404 to user: Security group rule df491516-bc82-43ce-98b0-8a2540d16e07 does not exist Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-7a44d264-0454-4c89-988e-0ad154c978b4'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d7410542-c14e-42b0-9faa-666afad72232 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/df491516-bc82-43ce-98b0-8a2540d16e07" status: 404 len: 199 microversion: 2.1 time: 0.080832 Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1432/2956] 10.222.0.16 () {58 vars in 1287 bytes} [Fri Oct 28 18:14:38 2022] DELETE /compute/v2.1/os-security-group-rules/df491516-bc82-43ce-98b0-8a2540d16e07 => generated 199 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:38.586693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:38.605167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:38.605665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:38.606101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:38.606813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:38.607269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:38.607903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:38.844031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:38.860674 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49bbe93b-853a-4e32-9f80-9b0ff5fb1360 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1324 microversion: 2.1 time: 0.277310 Oct 28 18:14:38.862052 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1433/2957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:38 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:38.867360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2188c6ee-ddba-46eb-8eaf-3338eb208a53 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Calling method '.version_select at 0x7f78de248e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:38.868827 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6aac2e27-bdfb-4757-9709-d4f94a564681 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f/action" status: 202 len: 0 microversion: 2.1 time: 2.506872 Oct 28 18:14:38.869864 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1525/2958] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:14:36 2022] POST /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f/action => generated 0 bytes in 2510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:38.874809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c2d10704-bccf-4918-a8c8-c03270a90e15 req-765036be-55a8-47e4-a45a-ddae0800efd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-plugged", "status": "completed", "tag": "273d1c49-3383-47fd-aa8d-f805a87da16e"}, {"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-plugged", "status": "completed", "tag": "7f0322f3-5f52-4071-9bb2-531a91aebf45"}, {"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-plugged", "status": "completed", "tag": "ad067f57-087c-42da-93dc-9dfd4efd49b3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:38.885768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:38.902483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c2d10704-bccf-4918-a8c8-c03270a90e15 req-765036be-55a8-47e4-a45a-ddae0800efd3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:38.903293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c2d10704-bccf-4918-a8c8-c03270a90e15 req-765036be-55a8-47e4-a45a-ddae0800efd3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:38.905025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c2d10704-bccf-4918-a8c8-c03270a90e15 req-765036be-55a8-47e4-a45a-ddae0800efd3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:38.936257 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c2d10704-bccf-4918-a8c8-c03270a90e15 req-765036be-55a8-47e4-a45a-ddae0800efd3 service nova] Creating event network-vif-plugged:273d1c49-3383-47fd-aa8d-f805a87da16e for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:14:38.937097 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c2d10704-bccf-4918-a8c8-c03270a90e15 req-765036be-55a8-47e4-a45a-ddae0800efd3 service nova] Creating event network-vif-plugged:7f0322f3-5f52-4071-9bb2-531a91aebf45 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:14:38.956233 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c2d10704-bccf-4918-a8c8-c03270a90e15 req-765036be-55a8-47e4-a45a-ddae0800efd3 service nova] Creating event network-vif-plugged:ad067f57-087c-42da-93dc-9dfd4efd49b3 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:14:38.965345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c2d10704-bccf-4918-a8c8-c03270a90e15 req-765036be-55a8-47e4-a45a-ddae0800efd3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093653 Oct 28 18:14:38.972568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1526/2959] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:38.985898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:38.989695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:39.012056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:39.012930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:39.016903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:39.019593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:39.020978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:39.022268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:39.360367 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2188c6ee-ddba-46eb-8eaf-3338eb208a53 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/760a9b32-f5c7-4c54-8826-9314ba33a3ac" status: 202 len: 0 microversion: 2.1 time: 0.496493 Oct 28 18:14:39.361334 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1434/2960] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:38 2022] DELETE /compute/v2.1/os-security-groups/760a9b32-f5c7-4c54-8826-9314ba33a3ac => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:39.366871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-6299751"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:39.367418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:39.401941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:39.402449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:39.402894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:39.403613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:39.404227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:39.404547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:39.606574 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.network.security_group_api [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Adding security group 6fce6742-a834-495f-8bd9-b191f87ddd36 to port 4c54577c-77d7-4ddc-929c-687b5890d4d0 Oct 28 18:14:39.661267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:39.692888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:39.698124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:39.699536 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8c70f0c-bbf9-48a0-86b0-27decfbe7e98 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1874 microversion: 2.32 time: 0.725672 Oct 28 18:14:39.723591 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1527/2961] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:38 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1874 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:39.732763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ba557bf1-595b-4724-8787-11d94f2ac079 req-1738657b-63e4-4797-8c38-7d99dd879e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af47463-f00f-41e3-b23a-bd68c7309c1f", "tag": "4c54577c-77d7-4ddc-929c-687b5890d4d0"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:39.766675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba557bf1-595b-4724-8787-11d94f2ac079 req-1738657b-63e4-4797-8c38-7d99dd879e14 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:39.771417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba557bf1-595b-4724-8787-11d94f2ac079 req-1738657b-63e4-4797-8c38-7d99dd879e14 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:39.772131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba557bf1-595b-4724-8787-11d94f2ac079 req-1738657b-63e4-4797-8c38-7d99dd879e14 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:39.788673 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ba557bf1-595b-4724-8787-11d94f2ac079 req-1738657b-63e4-4797-8c38-7d99dd879e14 service nova] Creating event network-changed:4c54577c-77d7-4ddc-929c-687b5890d4d0 for instance 7af47463-f00f-41e3-b23a-bd68c7309c1f on n-h1-862404-2 Oct 28 18:14:39.801043 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ba557bf1-595b-4724-8787-11d94f2ac079 req-1738657b-63e4-4797-8c38-7d99dd879e14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075603 Oct 28 18:14:39.802448 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1528/2962] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:39.811095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6712845-65b9-45ee-8829-1fc101847d13 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Calling method '.version_select at 0x7f78e2466940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:40.296899 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a4dfd4a8-8b23-49f4-ab33-2331a3d95576 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f/action" status: 202 len: 0 microversion: 2.1 time: 0.933733 Oct 28 18:14:40.297575 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1435/2963] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:14:39 2022] POST /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f/action => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:40.324646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:40.325601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:40.359017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:40.361454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:40.362502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:40.363503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:40.364162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:40.366021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:40.577460 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6712845-65b9-45ee-8829-1fc101847d13 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/39f8ef8f-7216-494a-ac82-a4a719c34900" status: 202 len: 0 microversion: 2.1 time: 0.772967 Oct 28 18:14:40.581429 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1529/2964] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:39 2022] DELETE /compute/v2.1/os-security-groups/39f8ef8f-7216-494a-ac82-a4a719c34900 => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:40.588058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:40.591558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:40.618567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:40.620603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:40.622515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:40.623961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:40.624726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:40.625345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:40.719047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:40.736125 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3692f196-f2dc-4add-9cae-3a20c7865c6b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1467 microversion: 2.1 time: 0.435421 Oct 28 18:14:40.742703 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1436/2965] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:40 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1467 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:40.756814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:40.759574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:40.780654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:40.782288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:40.783457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:40.787770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:40.788635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:40.789105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:40.977569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:40.991576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-892d8f0e-067e-496b-9984-1f1c4759d1c2 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1324 microversion: 2.1 time: 0.408925 Oct 28 18:14:40.992252 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1530/2966] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:40 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:41.007125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9381a4cc-2a61-40d8-a938-aed58ed0f17c req-f29ce07b-a4d6-4546-b9dc-bd8700bb70d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af47463-f00f-41e3-b23a-bd68c7309c1f", "tag": "4c54577c-77d7-4ddc-929c-687b5890d4d0"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:41.024712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9381a4cc-2a61-40d8-a938-aed58ed0f17c req-f29ce07b-a4d6-4546-b9dc-bd8700bb70d9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:41.025077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9381a4cc-2a61-40d8-a938-aed58ed0f17c req-f29ce07b-a4d6-4546-b9dc-bd8700bb70d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:41.025972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9381a4cc-2a61-40d8-a938-aed58ed0f17c req-f29ce07b-a4d6-4546-b9dc-bd8700bb70d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:41.042420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9381a4cc-2a61-40d8-a938-aed58ed0f17c req-f29ce07b-a4d6-4546-b9dc-bd8700bb70d9 service nova] Creating event network-changed:4c54577c-77d7-4ddc-929c-687b5890d4d0 for instance 7af47463-f00f-41e3-b23a-bd68c7309c1f on n-h1-862404-2 Oct 28 18:14:41.048940 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9381a4cc-2a61-40d8-a938-aed58ed0f17c req-f29ce07b-a4d6-4546-b9dc-bd8700bb70d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053001 Oct 28 18:14:41.051877 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1531/2967] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:41.058147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-004e105f-6e27-4547-ae62-62eae0523a3d tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Calling method '.version_select at 0x7f78dd674430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:41.420056 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-004e105f-6e27-4547-ae62-62eae0523a3d tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/a643edf0-72fa-4a4b-b195-aef2ce96c0be" status: 202 len: 0 microversion: 2.1 time: 0.363845 Oct 28 18:14:41.421789 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1532/2968] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:41 2022] DELETE /compute/v2.1/os-security-groups/a643edf0-72fa-4a4b-b195-aef2ce96c0be => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:41.428858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:41.431078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:41.451430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:41.452416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:41.453352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:41.456467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:41.457455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:41.458249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:41.589961 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4cb8013-24a5-4c09-9cef-6c74e0453035 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.845663 Oct 28 18:14:41.590571 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1437/2969] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 18:14:40 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f/os-security-groups => generated 1154 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:41.596233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:41.596851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:41.611864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:41.612583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:41.613219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:41.614096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:41.614704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:41.615287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:41.747994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:41.764897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:41.766618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:41.768153 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ff67b66-6ff9-4b7f-87ac-3c96ca21f758 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 2824 microversion: 2.32 time: 0.344140 Oct 28 18:14:41.768720 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1533/2970] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:14:41 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 2824 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:41.775444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-53632d0a-f6fa-4158-83c2-e2fae7a380c0 req-b9e870c2-cfa4-45a3-877c-a40104d0ef8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a6ffc8-fd33-4acf-b318-897c0bbfcb56", "name": "network-vif-plugged", "status": "completed", "tag": "b8b4269d-c2f8-4a2e-9f91-2f32717778f0"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:41.786909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53632d0a-f6fa-4158-83c2-e2fae7a380c0 req-b9e870c2-cfa4-45a3-877c-a40104d0ef8b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:41.787673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53632d0a-f6fa-4158-83c2-e2fae7a380c0 req-b9e870c2-cfa4-45a3-877c-a40104d0ef8b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:41.788297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53632d0a-f6fa-4158-83c2-e2fae7a380c0 req-b9e870c2-cfa4-45a3-877c-a40104d0ef8b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:41.804864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-53632d0a-f6fa-4158-83c2-e2fae7a380c0 req-b9e870c2-cfa4-45a3-877c-a40104d0ef8b service nova] Creating event network-vif-plugged:b8b4269d-c2f8-4a2e-9f91-2f32717778f0 for instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 on n-h2-862404-2 Oct 28 18:14:41.811086 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-53632d0a-f6fa-4158-83c2-e2fae7a380c0 req-b9e870c2-cfa4-45a3-877c-a40104d0ef8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040970 Oct 28 18:14:41.812677 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1534/2971] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:42.020837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:42.036119 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-734c1b61-c78a-411b-a3af-3bfcce346be9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 200 len: 1318 microversion: 2.1 time: 0.443463 Oct 28 18:14:42.036804 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1438/2972] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:41 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:42.051398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f0c37f58-4908-447e-99b5-1b7980fea2c7 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Calling method '.version_select at 0x7f78dd7d8dc0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:42.119710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8dcf1e4-e449-4100-990c-b9cdcf193985 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Action: 'create', calling method: .version_select at 0x7f78dd6740d0>, body: {"keypair": {"name": "tempest-keypair-1193604293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwnO3M6qo4QJ8HuX4VO1zitQ60BkD1SJkX7usFSXNW5+mkkNqyxDPw/h4oZvpN4cxTe1gCkuZzwS3/e7/QP3mkYv+4KJrjwQAc8WVoe7u0OsLOIIy/JHBwtu2rQ4mp89A=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:42.137934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b8dcf1e4-e449-4100-990c-b9cdcf193985 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Getting quotas for project 0cbc033276dd4b91a0e6bdfd5608b228. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:42.146119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b8dcf1e4-e449-4100-990c-b9cdcf193985 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Getting quotas for user fcbbffbb8d29409ca6f7265593c9f384 and project 0cbc033276dd4b91a0e6bdfd5608b228. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:42.198195 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8dcf1e4-e449-4100-990c-b9cdcf193985 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.383289 Oct 28 18:14:42.201578 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1535/2973] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:14:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:42.214682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b5a5007-7e73-4d29-9903-d02df60b9de0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78de0d18b0>, body: {"security_group": {"name": " tempest-securitygroup -595070638 ", "description": "tempest-description-158842702"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:42.581270 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f0c37f58-4908-447e-99b5-1b7980fea2c7 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/19158fa7-6bf9-4de4-95d5-96eb73192d4a" status: 202 len: 0 microversion: 2.1 time: 0.538848 Oct 28 18:14:42.582000 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1439/2974] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:42 2022] DELETE /compute/v2.1/os-security-groups/19158fa7-6bf9-4de4-95d5-96eb73192d4a => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:42.589824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:42.590376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:42.602373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:42.602866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:42.605158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:42.605888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:42.607917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:42.608515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:42.640024 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b5a5007-7e73-4d29-9903-d02df60b9de0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.436996 Oct 28 18:14:42.640859 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1536/2975] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:42 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:42.657393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:42.659515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:42.705060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:42.707466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:42.709342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:42.711929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:42.714323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:42.715484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:42.853175 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4ed870d9-dcd5-431e-93a6-3a3a5839eb24 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.269619 Oct 28 18:14:42.853954 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1440/2976] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 18:14:42 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d/os-interface => generated 1829 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:14:42.859582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aa104136-2bd2-485c-9c8a-c32edaa96c52 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] Calling method '.version_select at 0x7f78ddbde670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:43.074840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:43.090963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbb868dc-2937-46cc-aee0-ee66d2e2b472 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1324 microversion: 2.1 time: 0.448339 Oct 28 18:14:43.092959 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1537/2977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:42 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:43.098524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1f2df779-6f09-4d55-b46d-6ee8448580c5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de0d14c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:43.198751 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1f2df779-6f09-4d55-b46d-6ee8448580c5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1" status: 200 len: 222 microversion: 2.1 time: 0.104244 Oct 28 18:14:43.202179 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1538/2978] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:14:43 2022] GET /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1 => generated 222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:43.216877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:43.217843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:43.229033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:43.229559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:43.230126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:43.230970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:43.231432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:43.232012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:43.661678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:43.673326 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d00ef8f5-0366-4397-9f85-f153c050f25c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 200 len: 1318 microversion: 2.1 time: 0.468740 Oct 28 18:14:43.677822 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1539/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:43 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:43.685322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89841b74-a122-4d21-9a4b-e0e1ca8f59ff tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de0d15e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:43.964167 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aa104136-2bd2-485c-9c8a-c32edaa96c52 tempest-SecurityGroupRulesNegativeTestJSON-1847260748 tempest-SecurityGroupRulesNegativeTestJSON-1847260748-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9d60c629-867c-4b75-82cc-2c242208ab57" status: 202 len: 0 microversion: 2.1 time: 1.107815 Oct 28 18:14:43.972190 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1441/2980] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:42 2022] DELETE /compute/v2.1/os-security-groups/9d60c629-867c-4b75-82cc-2c242208ab57 => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:43.979099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-41c27c30-fa55-4144-8edd-2ffc34fa6a5d req-01fa3e7f-b0a0-40a1-8195-bffb413ca01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db87eca6-1a77-4d03-845a-bef6c5cc172a", "name": "network-vif-plugged", "status": "completed", "tag": "48244433-9e7a-4603-b111-c631d5ca8a7b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:43.998919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-41c27c30-fa55-4144-8edd-2ffc34fa6a5d req-01fa3e7f-b0a0-40a1-8195-bffb413ca01b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:43.999805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-41c27c30-fa55-4144-8edd-2ffc34fa6a5d req-01fa3e7f-b0a0-40a1-8195-bffb413ca01b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:44.004261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-41c27c30-fa55-4144-8edd-2ffc34fa6a5d req-01fa3e7f-b0a0-40a1-8195-bffb413ca01b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:44.018304 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-41c27c30-fa55-4144-8edd-2ffc34fa6a5d req-01fa3e7f-b0a0-40a1-8195-bffb413ca01b service nova] Creating event network-vif-plugged:48244433-9e7a-4603-b111-c631d5ca8a7b for instance db87eca6-1a77-4d03-845a-bef6c5cc172a on n-h2-862404-2 Oct 28 18:14:44.023749 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-41c27c30-fa55-4144-8edd-2ffc34fa6a5d req-01fa3e7f-b0a0-40a1-8195-bffb413ca01b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049434 Oct 28 18:14:44.025404 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1442/2981] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:44.120637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:44.123103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:44.144053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:44.144558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:44.149741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:44.152446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:44.152976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:44.153575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:44.442812 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-89841b74-a122-4d21-9a4b-e0e1ca8f59ff tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1" status: 202 len: 0 microversion: 2.1 time: 0.761281 Oct 28 18:14:44.443630 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1540/2982] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:43 2022] DELETE /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1 => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:44.456583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-580ce8ea-1fb9-4aa9-802a-39662c8ea9d4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de0d19d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:44.592135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-580ce8ea-1fb9-4aa9-802a-39662c8ea9d4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:14:44.593177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.security_group_api [None req-580ce8ea-1fb9-4aa9-802a-39662c8ea9d4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 352fb761-bad0-4136-b6f0-ca6793776cf1 not found {{(pid=120680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:14:44.595194 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-580ce8ea-1fb9-4aa9-802a-39662c8ea9d4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:14:44.595194 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-39a49de3-b36d-4f5a-afd6-a0c608e230a0'] Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-580ce8ea-1fb9-4aa9-802a-39662c8ea9d4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1 HTTP/1.1 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: exception: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-39a49de3-b36d-4f5a-afd6-a0c608e230a0'] Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '352fb761-bad0-4136-b6f0-ca6793776cf1'} Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:14:44.599690 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39a49de3-b36d-4f5a-afd6-a0c608e230a0'] Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39a49de3-b36d-4f5a-afd6-a0c608e230a0'] Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39a49de3-b36d-4f5a-afd6-a0c608e230a0'] Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39a49de3-b36d-4f5a-afd6-a0c608e230a0'] Oct 28 18:14:44.603529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:14:44.611806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-580ce8ea-1fb9-4aa9-802a-39662c8ea9d4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:14:44.611806 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-39a49de3-b36d-4f5a-afd6-a0c608e230a0'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:44.613376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-580ce8ea-1fb9-4aa9-802a-39662c8ea9d4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1" status: 404 len: 194 microversion: 2.1 time: 0.165525 Oct 28 18:14:44.614095 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1541/2983] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:14:44 2022] GET /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1 => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:14:44.628487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a91b38a-5858-4d38-a019-a6444502f06d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78de1140d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-137481358", "description": "tempest-description-800906552"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:45.008623 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a91b38a-5858-4d38-a019-a6444502f06d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.388429 Oct 28 18:14:45.010890 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1542/2984] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:44 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:14:45.018036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:45.020348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:45.022259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:45.041777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:45.042552 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-669866de-35e1-482c-8589-546460882ec5 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1324 microversion: 2.1 time: 0.920805 Oct 28 18:14:45.043559 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1443/2985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:44 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1324 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:45.045004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:45.045703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:45.050713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:45.051357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-673cd4e4-c614-451f-858e-59609e42149b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78de267700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-268905971", "description": "tempest-description-79686102"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:45.051639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:45.052255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:45.313469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:45.324300 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbfcbe50-d39b-40fb-8025-119eed1c3dc0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 200 len: 1467 microversion: 2.1 time: 0.311645 Oct 28 18:14:45.325524 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1543/2986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:45 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 1467 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:45.349957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:45.356343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:45.357788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Searching by: {'reservation_id': 'r-bwb3jyo7', 'deleted': False, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:14:45.367035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:45.367933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:45.369553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:45.371086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:45.372998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:45.374184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:45.495356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:14:45.602866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:45.614389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:45.615103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:45.615721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:45.760248 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-427dd8b6-0c0b-4190-a842-85a672ef296a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-bwb3jyo7" status: 200 len: 2927 microversion: 2.1 time: 0.414812 Oct 28 18:14:45.760917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1544/2987] 10.222.0.16 () {58 vars in 1197 bytes} [Fri Oct 28 18:14:45 2022] GET /compute/v2.1/servers/detail?reservation_id=r-bwb3jyo7 => generated 2927 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:45.769557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1606190514", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1577849e-593c-46a5-9d1c-2807530e9f6b"}], "security_groups": [{"name": "tempest-securitygroup--1888418301"}], "key_name": "tempest-keypair-1193604293", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:45.837984 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-673cd4e4-c614-451f-858e-59609e42149b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.792826 Oct 28 18:14:45.839314 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1444/2988] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:45 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:45.845253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-621fa269-8b2c-4a52-bc0c-66de54c10693 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:45.864400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.compute.server_groups [None req-621fa269-8b2c-4a52-bc0c-66de54c10693 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Querying cell 43f74929-bc21-41df-9120-e6be09c18015(cell1) for 2 instances {{(pid=120679) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 18:14:45.865497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-621fa269-8b2c-4a52-bc0c-66de54c10693 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:45.866200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-621fa269-8b2c-4a52-bc0c-66de54c10693 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:45.866854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-621fa269-8b2c-4a52-bc0c-66de54c10693 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:45.887855 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-621fa269-8b2c-4a52-bc0c-66de54c10693 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/e05c82c7-d4ec-4017-ad58-68fb7e5552cd" status: 200 len: 271 microversion: 2.1 time: 0.046850 Oct 28 18:14:45.895435 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1445/2989] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:14:45 2022] GET /compute/v2.1/os-server-groups/e05c82c7-d4ec-4017-ad58-68fb7e5552cd => generated 271 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:45.901278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eab789f8-1ec2-4467-b1c3-663fee4605ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78de553790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-737162094", "description": "tempest-description-1159915069"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:45.901527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] validate_networks() for [('1577849e-593c-46a5-9d1c-2807530e9f6b', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:46.377859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Getting quotas for project 0cbc033276dd4b91a0e6bdfd5608b228. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:46.383292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Getting quotas for user fcbbffbb8d29409ca6f7265593c9f384 and project 0cbc033276dd4b91a0e6bdfd5608b228. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:46.397323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:46.398089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:46.398685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:46.399534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:46.400141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:46.409796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:46.410283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:46.410722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:46.411454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:46.411935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:46.412539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:46.431109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Getting quotas for project 0cbc033276dd4b91a0e6bdfd5608b228. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:46.436363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Getting quotas for user fcbbffbb8d29409ca6f7265593c9f384 and project 0cbc033276dd4b91a0e6bdfd5608b228. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:46.450305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:46.452773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:46.505317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c7f2f8e1-76e3-40f7-aab8-babb220afac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.740957 Oct 28 18:14:46.506482 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1545/2990] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:45 2022] POST /compute/v2.1/servers => generated 407 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:14:46.510878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:46.511544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:46.520910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:46.521579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:46.522255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:46.523356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:46.524243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:46.524828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:46.671334 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eab789f8-1ec2-4467-b1c3-663fee4605ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.774311 Oct 28 18:14:46.673616 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1446/2991] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:46.683202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:46.684202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:46.706224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:46.715456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:46.716327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:46.717321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:46.718369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:46.719714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:46.803471 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52dace1a-5ad4-4e38-adc1-fba610e3aa6d tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 200 len: 1618 microversion: 2.1 time: 0.296234 Oct 28 18:14:46.804781 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1546/2992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:46 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 1618 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:46.810732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5d31f71-9b93-456c-b87f-4b4eb0bd5c97 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:46.811765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5d31f71-9b93-456c-b87f-4b4eb0bd5c97 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:47.042485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5d31f71-9b93-456c-b87f-4b4eb0bd5c97 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:47.054202 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5d31f71-9b93-456c-b87f-4b4eb0bd5c97 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1270 microversion: 2.1 time: 0.248019 Oct 28 18:14:47.059776 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1547/2993] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:46 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:47.075974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-58080c5c-60a0-4987-81be-b214d3357550 req-0d3b3f7b-ea4c-41f8-af42-9b95526282b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "tag": "24d57195-2b05-4d20-a213-c277be41e78e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:47.113192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-58080c5c-60a0-4987-81be-b214d3357550 req-0d3b3f7b-ea4c-41f8-af42-9b95526282b7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:47.113828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-58080c5c-60a0-4987-81be-b214d3357550 req-0d3b3f7b-ea4c-41f8-af42-9b95526282b7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:47.115395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-58080c5c-60a0-4987-81be-b214d3357550 req-0d3b3f7b-ea4c-41f8-af42-9b95526282b7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:47.139864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-58080c5c-60a0-4987-81be-b214d3357550 req-0d3b3f7b-ea4c-41f8-af42-9b95526282b7 service nova] Creating event network-changed:24d57195-2b05-4d20-a213-c277be41e78e for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:14:47.156072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-58080c5c-60a0-4987-81be-b214d3357550 req-0d3b3f7b-ea4c-41f8-af42-9b95526282b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094292 Oct 28 18:14:47.158278 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1548/2994] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:47.193494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d85afa66-c157-4f07-963b-f27b157ec8cd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78dd6780d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:47.678386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:47.692350 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4291de93-7393-42c9-9bc4-429140e58770 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1520 microversion: 2.1 time: 1.016538 Oct 28 18:14:47.694769 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1447/2995] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:46 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1520 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:47.708902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:47.711057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:47.727285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:47.731947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:47.732728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:47.735467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:47.736406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:47.738092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:47.739503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:48.150110 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d85afa66-c157-4f07-963b-f27b157ec8cd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1826 microversion: 2.1 time: 0.990339 Oct 28 18:14:48.150730 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1549/2996] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:14:47 2022] GET /compute/v2.1/os-security-groups => generated 1826 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:48.155595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ff787de-9ae3-4183-998b-9df1486a1398 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'create', calling method: .version_select at 0x7f78dd7865e0>, body: {"pool": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:48.322626 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6cc8ad38-328f-46f9-9b45-d39811097ff6 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 200 len: 1618 microversion: 2.1 time: 0.626142 Oct 28 18:14:48.324891 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1448/2997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:47 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 1618 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:48.333865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:48.334543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:48.386554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:48.387381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:48.391587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:48.392802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:48.393484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:48.394119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:48.454930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:48.574294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:48.593519 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f170695d-9aec-4d1d-b495-7171fd598a90 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1322 microversion: 2.1 time: 0.264158 Oct 28 18:14:48.600317 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1449/2998] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:48 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:48.611169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c835a4c8-d096-4f18-950f-445e0ed80ec9 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78ddbc4820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:49.690540 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c835a4c8-d096-4f18-950f-445e0ed80ec9 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/811a6ed1-4f71-413a-a997-0d31ccb7ca52" status: 202 len: 0 microversion: 2.1 time: 1.093513 Oct 28 18:14:49.695148 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1450/2999] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:48 2022] DELETE /compute/v2.1/os-security-groups/811a6ed1-4f71-413a-a997-0d31ccb7ca52 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:49.709260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-139072567", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "482db24a-f4e1-401d-8ace-4a3c5b673e66"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:49.831965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:50.709059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:50.710558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:50.712133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:50.713575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:50.714778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:50.743918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:50.745574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:50.746401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:50.747578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:50.749044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:50.750104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:50.809007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:50.832388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:50.878305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:50.883745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:51.027371 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f26c5c8c-b71e-4772-88d8-cfa3b4011384 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330867 Oct 28 18:14:51.036503 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1451/3000] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:14:51.041780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:51.042980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:51.056575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:51.057072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:51.081253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:51.082343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:51.082901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:51.083347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:51.322864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:51.334214 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-af53727f-1f25-41d7-bd21-232bb8ca7e81 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1328 microversion: 2.1 time: 0.296227 Oct 28 18:14:51.340396 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1452/3001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:51 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1328 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:51.348537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a204c79-829c-4007-b0f1-8e38e80be115 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78dd7e4e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:51.462385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-9a204c79-829c-4007-b0f1-8e38e80be115 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:14:51.463247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-9a204c79-829c-4007-b0f1-8e38e80be115 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 not found {{(pid=120679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:14:51.463772 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9a204c79-829c-4007-b0f1-8e38e80be115 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:14:51.463772 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-1a9c0c11-6e86-43b7-ae29-a33cef7c405a'] Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a204c79-829c-4007-b0f1-8e38e80be115 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-security-groups/811a6ed1-4f71-413a-a997-0d31ccb7ca52 HTTP/1.1 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-1a9c0c11-6e86-43b7-ae29-a33cef7c405a'] Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '811a6ed1-4f71-413a-a997-0d31ccb7ca52'} Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:14:51.465749 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a9c0c11-6e86-43b7-ae29-a33cef7c405a'] Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a9c0c11-6e86-43b7-ae29-a33cef7c405a'] Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a9c0c11-6e86-43b7-ae29-a33cef7c405a'] Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a9c0c11-6e86-43b7-ae29-a33cef7c405a'] Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a204c79-829c-4007-b0f1-8e38e80be115 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-1a9c0c11-6e86-43b7-ae29-a33cef7c405a'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:51.470188 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9a204c79-829c-4007-b0f1-8e38e80be115 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/811a6ed1-4f71-413a-a997-0d31ccb7ca52" status: 404 len: 194 microversion: 2.1 time: 0.125485 Oct 28 18:14:51.479808 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1453/3002] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:14:51 2022] GET /compute/v2.1/os-security-groups/811a6ed1-4f71-413a-a997-0d31ccb7ca52 => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:51.496180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-90193206-db7e-4abc-8740-cbc550970fa8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:51.496793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-90193206-db7e-4abc-8740-cbc550970fa8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:51.650056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-90193206-db7e-4abc-8740-cbc550970fa8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:51.659137 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-90193206-db7e-4abc-8740-cbc550970fa8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1216 microversion: 2.1 time: 0.177892 Oct 28 18:14:51.674571 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1454/3003] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:51 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1216 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:51.674571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1f1ca4f1-d580-4edf-a191-2e61cf30737b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78dd7e4280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:51.901850 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ff787de-9ae3-4183-998b-9df1486a1398 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.750028 Oct 28 18:14:51.902458 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1550/3004] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:14:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:52.263926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1739108890", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "267d2301-3717-4887-aee2-82012863ff35"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:52.408736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] validate_networks() for [('267d2301-3717-4887-aee2-82012863ff35', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:52.979286 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1f1ca4f1-d580-4edf-a191-2e61cf30737b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8f93294a-ef8d-41d2-b2c7-183dd7509250" status: 202 len: 0 microversion: 2.1 time: 1.316310 Oct 28 18:14:52.980949 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1455/3005] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:51 2022] DELETE /compute/v2.1/os-security-groups/8f93294a-ef8d-41d2-b2c7-183dd7509250 => generated 0 bytes in 1319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:52.989343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:52.990455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:53.003405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:53.004297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:53.004984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:53.006120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:53.007072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:53.007882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:53.524421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:53.553915 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4d85a99-dfaa-4019-81bd-204a381cf4b4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1396 microversion: 2.1 time: 0.569966 Oct 28 18:14:53.555999 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1456/3006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:52 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1396 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:53.568392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:53.570291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:53.588733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:53.590173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:53.591688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:53.592793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:53.593427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:53.594951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:53.763596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:53.773469 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a01823a6-028c-4ca3-9227-6c0fec243020 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1274 microversion: 2.1 time: 0.216454 Oct 28 18:14:53.775632 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1457/3007] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:53 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1274 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:53.782533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5842da9e-9d2a-47f0-8a54-79fb8d13675d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de267e50>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:53.879623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-5842da9e-9d2a-47f0-8a54-79fb8d13675d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:14:53.880305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-5842da9e-9d2a-47f0-8a54-79fb8d13675d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 not found {{(pid=120679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:14:53.880834 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-5842da9e-9d2a-47f0-8a54-79fb8d13675d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:14:53.880834 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-901c8b41-efe9-4789-b2fb-697b671218a7'] Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5842da9e-9d2a-47f0-8a54-79fb8d13675d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-security-groups/8f93294a-ef8d-41d2-b2c7-183dd7509250 HTTP/1.1 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-901c8b41-efe9-4789-b2fb-697b671218a7'] Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8f93294a-ef8d-41d2-b2c7-183dd7509250'} Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:14:53.885784 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-901c8b41-efe9-4789-b2fb-697b671218a7'] Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-901c8b41-efe9-4789-b2fb-697b671218a7'] Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-901c8b41-efe9-4789-b2fb-697b671218a7'] Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-901c8b41-efe9-4789-b2fb-697b671218a7'] Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5842da9e-9d2a-47f0-8a54-79fb8d13675d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-901c8b41-efe9-4789-b2fb-697b671218a7'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:53.889588 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5842da9e-9d2a-47f0-8a54-79fb8d13675d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/8f93294a-ef8d-41d2-b2c7-183dd7509250" status: 404 len: 194 microversion: 2.1 time: 0.110236 Oct 28 18:14:53.894137 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1458/3008] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:14:53 2022] GET /compute/v2.1/os-security-groups/8f93294a-ef8d-41d2-b2c7-183dd7509250 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:53.900167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be0ddea7-f8ff-44d0-ba58-2eaa72b7c845 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78dd81df70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:54.345107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:54.346250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:54.346754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:54.347170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:54.347609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:54.359424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:54.360003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:54.360447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:54.361184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:54.361646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:54.362072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:54.396403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Getting quotas for project 9aff6baa638641ffafc9f46981c8e465. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:54.414558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Getting quotas for user 6f3ce763c739446186720e457592ce96 and project 9aff6baa638641ffafc9f46981c8e465. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:54.427162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:54.432413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:54.434827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:54.517331 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81842c35-0e08-4c9f-ac47-925df48c2976 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.260377 Oct 28 18:14:54.519782 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1551/3009] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:14:54.537060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4f9c10b-a7ea-4a7b-aae7-938ebfacc7af tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:54.537705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4f9c10b-a7ea-4a7b-aae7-938ebfacc7af tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:54.564681 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-be0ddea7-f8ff-44d0-ba58-2eaa72b7c845 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8a780918-f366-4dd6-abc3-098b02ebd1cf" status: 202 len: 0 microversion: 2.1 time: 0.669098 Oct 28 18:14:54.565557 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1459/3010] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:14:53 2022] DELETE /compute/v2.1/os-security-groups/8a780918-f366-4dd6-abc3-098b02ebd1cf => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:14:54.573816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-617070f2-7fda-45c9-b5e8-93f478c65cbd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78dd7c0ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:54.686063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f4f9c10b-a7ea-4a7b-aae7-938ebfacc7af tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:54.700432 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4f9c10b-a7ea-4a7b-aae7-938ebfacc7af tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1224 microversion: 2.1 time: 0.168729 Oct 28 18:14:54.701047 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1552/3011] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:54 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1224 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:54.718091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:54.723491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:54.731531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:54.733124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:54.733567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:54.734290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:54.734922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:54.735416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:54.881175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-617070f2-7fda-45c9-b5e8-93f478c65cbd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:14:54.882061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-617070f2-7fda-45c9-b5e8-93f478c65cbd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 8a780918-f366-4dd6-abc3-098b02ebd1cf not found {{(pid=120679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:14:54.882766 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-617070f2-7fda-45c9-b5e8-93f478c65cbd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:14:54.882766 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-50d93bed-8999-4794-b7d2-25be734e890a'] Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-617070f2-7fda-45c9-b5e8-93f478c65cbd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/os-security-groups/8a780918-f366-4dd6-abc3-098b02ebd1cf HTTP/1.1 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-50d93bed-8999-4794-b7d2-25be734e890a'] Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8a780918-f366-4dd6-abc3-098b02ebd1cf'} Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:14:54.885412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50d93bed-8999-4794-b7d2-25be734e890a'] Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50d93bed-8999-4794-b7d2-25be734e890a'] Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50d93bed-8999-4794-b7d2-25be734e890a'] Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50d93bed-8999-4794-b7d2-25be734e890a'] Oct 28 18:14:54.889209 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:14:54.894731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-617070f2-7fda-45c9-b5e8-93f478c65cbd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:14:54.894731 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-50d93bed-8999-4794-b7d2-25be734e890a'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:54.896051 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-617070f2-7fda-45c9-b5e8-93f478c65cbd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/8a780918-f366-4dd6-abc3-098b02ebd1cf" status: 404 len: 194 microversion: 2.1 time: 0.326590 Oct 28 18:14:54.901460 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1460/3012] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:14:54 2022] GET /compute/v2.1/os-security-groups/8a780918-f366-4dd6-abc3-098b02ebd1cf => generated 194 bytes in 332 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:14:54.909391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0f3cc31e-eb9a-4047-a6e8-5d64049869bd req-2f0a90f6-ca23-4eed-9183-38212f4ee9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440b2b69-5998-49f9-aa5d-6b2cc75a7954", "tag": "7f9cab0b-7a3f-4709-b7bf-17d55642d800"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:54.935747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0f3cc31e-eb9a-4047-a6e8-5d64049869bd req-2f0a90f6-ca23-4eed-9183-38212f4ee9da service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:54.936260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0f3cc31e-eb9a-4047-a6e8-5d64049869bd req-2f0a90f6-ca23-4eed-9183-38212f4ee9da service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:54.936692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0f3cc31e-eb9a-4047-a6e8-5d64049869bd req-2f0a90f6-ca23-4eed-9183-38212f4ee9da service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:54.967139 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0f3cc31e-eb9a-4047-a6e8-5d64049869bd req-2f0a90f6-ca23-4eed-9183-38212f4ee9da service nova] Creating event network-changed:7f9cab0b-7a3f-4709-b7bf-17d55642d800 for instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 on n-h1-862404-2 Oct 28 18:14:54.979732 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0f3cc31e-eb9a-4047-a6e8-5d64049869bd req-2f0a90f6-ca23-4eed-9183-38212f4ee9da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077091 Oct 28 18:14:54.980526 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1461/3013] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:54.991302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:54.992057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:55.025450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:55.025807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:55.026251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:55.026967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:55.027423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:55.044297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:55.192398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:55.220632 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3742350-6517-4d62-a97b-480c3f71ac80 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1396 microversion: 2.1 time: 0.518452 Oct 28 18:14:55.226522 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1553/3014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:54 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1396 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:55.249367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:55.253215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6fd86fe-3a64-4932-ba40-bf82a63d572d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de0e2d30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:55.259600 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fba305b2-8b46-4abb-b691-82fc7f3b2e46 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1274 microversion: 2.1 time: 0.277523 Oct 28 18:14:55.279772 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1462/3015] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:54 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1274 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:55.729980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:55.730623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:55.753950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:55.754793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:55.755798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:55.757477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:55.758173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:55.758805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:55.905763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:55.930274 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-35a97c5d-b762-474a-b54f-487117a697fc tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1220 microversion: 2.1 time: 0.204786 Oct 28 18:14:55.933216 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1463/3016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:55 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1220 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:56.157480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1828156071", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f82fe855-0375-439d-a750-8e3e8fa17c0d"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:56.214838 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6fd86fe-3a64-4932-ba40-bf82a63d572d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.967867 Oct 28 18:14:56.226329 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1554/3017] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:14:55 2022] GET /compute/v2.1/os-security-groups => generated 1154 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:56.231586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6821fc28-2683-45cd-8ada-a6c2499edda6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78de087040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2059115154", "description": "tempest-description-767208588"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:56.239656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] validate_networks() for [('f82fe855-0375-439d-a750-8e3e8fa17c0d', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:56.879102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:56.879726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:56.880513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:56.881035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:56.881547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:56.904325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:56.905077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:56.905631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:56.908954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:56.909552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:56.910123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:56.966216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Getting quotas for project 11f6ba6ec4174bd592c3bd43dad948c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:56.995012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Getting quotas for user 2cb7037d2702444cbc9acc2004641abf and project 11f6ba6ec4174bd592c3bd43dad948c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:57.043734 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6821fc28-2683-45cd-8ada-a6c2499edda6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.816259 Oct 28 18:14:57.045183 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1555/3018] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:14:57.056299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Going to run 2 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:57.059351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:57.060392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:57.062339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fbe6c92c-5fcb-4abd-abcf-d78acafac7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:57.080989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:57.082094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:57.082892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:57.083870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:57.084576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:57.085276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:57.098257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:57.146054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=fbe6c92c-5fcb-4abd-abcf-d78acafac7ba,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:57.279902 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-80212a90-fa4e-4aba-b049-2d7a89cb029f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342668 Oct 28 18:14:57.284225 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1464/3019] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:14:57.308214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:57.310260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:57.323494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:57.324925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:57.326826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:57.328966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:57.329837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:57.330597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:57.543301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:57.556177 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-28507e4a-3759-44f7-8deb-e9b326e59cec tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1396 microversion: 2.1 time: 0.509489 Oct 28 18:14:57.568255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1556/3020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:57 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1396 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:57.583576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:57.584301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:57.597576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:57.598622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:57.600265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:57.602090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:57.603291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:57.604221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:57.719737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:57.729340 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a90134e1-74c8-40d6-a450-9dc0ac857c30 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1282 microversion: 2.1 time: 0.159485 Oct 28 18:14:57.730185 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1557/3021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:57 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:57.745994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02da0a0c-4ab9-4757-85c8-5cdf8983acc3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78dd678670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1335149565", "description": "tempest-description-2064233669"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:57.783770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:57.794587 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f5720b83-2a2b-4bbc-ac18-08d29fcefac6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.508547 Oct 28 18:14:57.818635 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1465/3022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:57 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:57.826120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:57.832367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:57.833556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Searching by: {'deleted': False, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:14:57.862650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:57.863407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:57.863961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:57.888928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:57.891109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:57.894156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:57.980786 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-224c34e2-e338-44d4-b079-3cad302e8ac7 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.160088 Oct 28 18:14:57.982526 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1466/3023] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:14:57 2022] GET /compute/v2.1/servers => generated 677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:57.996983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42090c5a-cd61-4bb4-a789-cd653cd7db98 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:57.999581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42090c5a-cd61-4bb4-a789-cd653cd7db98 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:58.064932 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02da0a0c-4ab9-4757-85c8-5cdf8983acc3 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.333114 Oct 28 18:14:58.065969 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1558/3024] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:14:57 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:58.146591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42090c5a-cd61-4bb4-a789-cd653cd7db98 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:58.154412 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42090c5a-cd61-4bb4-a789-cd653cd7db98 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1220 microversion: 2.1 time: 0.162739 Oct 28 18:14:58.160225 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1467/3025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:57 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:58.306610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1267202325", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "5d1d0346-9ff4-48a8-9e14-6d5a6fc26119"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:58.408960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] validate_networks() for [('5d1d0346-9ff4-48a8-9e14-6d5a6fc26119', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:58.598479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:58.599561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:58.622041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:58.631721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:58.632627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:58.636693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:58.638243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:58.645039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:59.278628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:59.298562 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a3ab92d-9a60-4740-b05b-07d6231beeab tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1396 microversion: 2.1 time: 0.706220 Oct 28 18:14:59.317689 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1468/3026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:58 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1396 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:59.331333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:59.331994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:59.355632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:59.361347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:59.362088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:59.363333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:59.366803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:59.368960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:59.927228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:59.938591 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b90890f-8a25-420b-9717-f54425ce4a7d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.618420 Oct 28 18:14:59.945510 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1469/3027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:59 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:59.960458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:59.961594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:14:59.979958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:59.980711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:59.981442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:59.982515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:59.983252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:59.983903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:59.999644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:15:00.000456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:15:00.001311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:15:00.003630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:15:00.004201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:15:00.034782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:00.041265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:00.042949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:00.044588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:00.045645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:00.048374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:00.052331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:00.107100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Getting quotas for project 67daef63361f4374b7562dd1029e6a64. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:15:00.122813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Getting quotas for user 4e3c71f336ac403cb508c00d17c0ee07 and project 67daef63361f4374b7562dd1029e6a64. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:15:00.158219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:15:00.166403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:15:00.227381 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fd874c7a-0411-4e95-9481-0c37268ffdf3 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "DELETE /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 204 len: 0 microversion: 2.1 time: 0.280174 Oct 28 18:15:00.227981 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1470/3028] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:14:59 2022] DELETE /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:00.236616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:00.237585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:00.243918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:00.244622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:00.245259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:00.246118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:00.246744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:00.247326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:00.298518 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6aa34bf3-f956-4946-9830-85deb07b56e6 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.996248 Oct 28 18:15:00.313704 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1559/3029] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:15:00.328842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:00.330762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:00.341915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:00.342602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:00.343273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:00.345831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:00.346440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:00.347051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:00.726717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:00.738857 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2be24c10-40cb-4dc4-88a8-727fb7246178 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.506500 Oct 28 18:15:00.740305 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1471/3030] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:00 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:00.758942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:00.760417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:00.787227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:00.789004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:00.789477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:00.791796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:00.794260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:00.796091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:00.870284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:00.881019 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04506057-9aff-43fc-99a2-5de45cbb2944 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1272 microversion: 2.1 time: 0.565480 Oct 28 18:15:00.898925 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1560/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:00 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1272 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:00.904284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-375f6ab2-271c-4e9e-bd20-af6726d85ac4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:00.905113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-375f6ab2-271c-4e9e-bd20-af6726d85ac4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:01.006845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-375f6ab2-271c-4e9e-bd20-af6726d85ac4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:01.017513 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-375f6ab2-271c-4e9e-bd20-af6726d85ac4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1216 microversion: 2.1 time: 0.115568 Oct 28 18:15:01.019484 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1561/3032] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:00 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:01.026614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:01.027505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:01.051108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.054236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.055106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.059315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.060256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.060953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.178517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:01.186347 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0186798f-bea7-4984-9815-9e4cb87d5926 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1666 microversion: 2.1 time: 0.444483 Oct 28 18:15:01.187166 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1472/3033] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:00 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1666 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:01.209777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-07c4e5db-5eee-4222-92c0-d8f75b4f0486 req-57b8a9e5-7a6a-49ba-b328-56cc6d92c22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f358d61-64bf-4efb-908b-5ba233a11fb2", "tag": "9934cfed-52db-450e-a30f-a1166d12ec61"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:01.223747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-07c4e5db-5eee-4222-92c0-d8f75b4f0486 req-57b8a9e5-7a6a-49ba-b328-56cc6d92c22f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.236635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-07c4e5db-5eee-4222-92c0-d8f75b4f0486 req-57b8a9e5-7a6a-49ba-b328-56cc6d92c22f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.237336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-07c4e5db-5eee-4222-92c0-d8f75b4f0486 req-57b8a9e5-7a6a-49ba-b328-56cc6d92c22f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.252643 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-07c4e5db-5eee-4222-92c0-d8f75b4f0486 req-57b8a9e5-7a6a-49ba-b328-56cc6d92c22f service nova] Creating event network-changed:9934cfed-52db-450e-a30f-a1166d12ec61 for instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 on n-h1-862404-2 Oct 28 18:15:01.261543 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-07c4e5db-5eee-4222-92c0-d8f75b4f0486 req-57b8a9e5-7a6a-49ba-b328-56cc6d92c22f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060143 Oct 28 18:15:01.265407 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1473/3034] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:01.278564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:01.279205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:01.286550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.287252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.288009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.288957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.289638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.290290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.659702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:01.676998 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-428b1200-1fe3-4177-8ac6-a3d75d2f711d tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1396 microversion: 2.1 time: 0.654907 Oct 28 18:15:01.679884 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1562/3035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:01 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1396 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:01.697215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0b184083-5e77-4484-8d4b-973bc2acc92b req-185197ad-6be0-437c-825d-33183625aef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c6a475b-2b26-4b32-8364-5dc0c5816bd9", "tag": "f35774df-6561-4412-a129-0b537e118ded"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:01.727598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b184083-5e77-4484-8d4b-973bc2acc92b req-185197ad-6be0-437c-825d-33183625aef9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.730125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b184083-5e77-4484-8d4b-973bc2acc92b req-185197ad-6be0-437c-825d-33183625aef9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.730567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b184083-5e77-4484-8d4b-973bc2acc92b req-185197ad-6be0-437c-825d-33183625aef9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.776124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0b184083-5e77-4484-8d4b-973bc2acc92b req-185197ad-6be0-437c-825d-33183625aef9 service nova] Creating event network-changed:f35774df-6561-4412-a129-0b537e118ded for instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 on n-h2-862404-2 Oct 28 18:15:01.794635 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0b184083-5e77-4484-8d4b-973bc2acc92b req-185197ad-6be0-437c-825d-33183625aef9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108967 Oct 28 18:15:01.799024 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1563/3036] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:01.815809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:01.820900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:01.846594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.847894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.848757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.849702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.850367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.851285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.854294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:01.869078 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c5f1b4fd-829e-4896-8456-cf8b967ab32b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.601461 Oct 28 18:15:01.872199 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1474/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:01 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:01.908304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:01.909189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:01.915750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.916738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.917383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:01.930576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:01.933241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:01.933944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:02.213813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:02.216619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:02.233346 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e109fac9-4948-4926-a1f5-3de990d4795e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1278 microversion: 2.1 time: 0.330491 Oct 28 18:15:02.234662 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1475/3038] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:01 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1278 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:02.254537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:02.257177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:02.280034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:02.280696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:02.281464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:02.282667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:02.283345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:02.283750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:02.551581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:02.569010 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c16bdc44-5ad5-427e-8daa-3035dec06aba tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.765581 Oct 28 18:15:02.569630 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1564/3039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:01 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:02.590750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:02.591387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:02.610193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:02.611563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:02.613567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:02.614749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:02.615735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:02.617312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:02.902096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:02.913280 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6b8cb0d7-6780-4875-a45d-b0da011285e1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1268 microversion: 2.1 time: 0.676933 Oct 28 18:15:02.921071 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1476/3040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:02 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1268 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:02.933600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:02.934834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:02.951545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:02.952491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:02.953235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:02.954590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:02.955779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:02.957458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:03.277901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:03.287260 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-549e0d6a-fa3a-47d4-b4ad-a28e32b001dd tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1666 microversion: 2.1 time: 0.702198 Oct 28 18:15:03.291428 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1565/3041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:02 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1666 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:03.299468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:03.300129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:03.318073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:03.322012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:03.322562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:03.323378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:03.323880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:03.325512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:03.626183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:03.636803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ab5e1cf-0e44-43d2-b0e6-3650dc492532 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.344157 Oct 28 18:15:03.643784 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1566/3042] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:03 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:03.648929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:03.656770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:03.667315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:03.669462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:03.672584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:03.674395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:03.680740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:03.681449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.094149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:04.105607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8801a8de-f8bd-49f0-8020-a2de8698d0e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.460378 Oct 28 18:15:04.106785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1567/3043] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:03 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:04.112926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9da1989f-4bd1-4634-9998-524f52c8606c req-b8a83404-3d92-484f-915f-fa7def9ccac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440b2b69-5998-49f9-aa5d-6b2cc75a7954", "name": "network-vif-plugged", "status": "completed", "tag": "7f9cab0b-7a3f-4709-b7bf-17d55642d800"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:04.129270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9da1989f-4bd1-4634-9998-524f52c8606c req-b8a83404-3d92-484f-915f-fa7def9ccac4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.133914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9da1989f-4bd1-4634-9998-524f52c8606c req-b8a83404-3d92-484f-915f-fa7def9ccac4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.134441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9da1989f-4bd1-4634-9998-524f52c8606c req-b8a83404-3d92-484f-915f-fa7def9ccac4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.148455 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9da1989f-4bd1-4634-9998-524f52c8606c req-b8a83404-3d92-484f-915f-fa7def9ccac4 service nova] Creating event network-vif-plugged:7f9cab0b-7a3f-4709-b7bf-17d55642d800 for instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 on n-h1-862404-2 Oct 28 18:15:04.160269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:04.161323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9da1989f-4bd1-4634-9998-524f52c8606c req-b8a83404-3d92-484f-915f-fa7def9ccac4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052093 Oct 28 18:15:04.162159 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1568/3044] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:04.174952 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e29f517e-8250-4d5a-be39-337083865511 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1396 microversion: 2.1 time: 1.251819 Oct 28 18:15:04.175223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:04.175985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:04.177781 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1477/3045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:02 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1396 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:04.188708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.191105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:04.192387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.192843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:04.192985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.193599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.194074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.194512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.205636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.211049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.211562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.212346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.212816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.213501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.431900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:04.445724 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-69d93194-8ccf-4805-bbca-d1b9a05485ae tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1274 microversion: 2.1 time: 0.265122 Oct 28 18:15:04.448934 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1478/3046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:04 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:04.461847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:04.463159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:04.473873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.474869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.475928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.477655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.479060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.479933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.535183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:04.555013 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2e37e9d-30ea-4b7c-889d-f92f323caf68 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.388700 Oct 28 18:15:04.556333 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1569/3047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:04 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:04.670682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:04.671318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:04.677840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.678336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.679069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.679983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.684548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.685704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.953567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:04.962598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8d700ef3-2ca4-444d-855c-d5dfdd213dc9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.295551 Oct 28 18:15:04.977390 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1570/3048] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:04 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:05.131191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:05.132590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:05.143385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.144301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.145558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.146523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.147220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.148096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.377221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:05.385298 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d082b927-66f7-402e-a838-979028597b9b tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.259963 Oct 28 18:15:05.385898 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1571/3049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:05 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:05.390729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:05.391481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:05.399219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.400124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.400788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.401848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.402519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.403152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.476319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:05.484820 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f26c8bdf-f127-46e0-9058-5066dc377e56 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1666 microversion: 2.1 time: 1.033726 Oct 28 18:15:05.486043 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1479/3050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:04 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1666 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:05.491137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-08a824e9-a972-4b36-b84a-c4123a1002e1 req-3e0454ec-23d5-4a85-bc07-9c48c0bf9ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa71b206-4ae5-495c-8ebf-f03508e924b0", "tag": "0c2c3bdc-331f-4411-abd4-ca3381b84f41"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:05.508590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-08a824e9-a972-4b36-b84a-c4123a1002e1 req-3e0454ec-23d5-4a85-bc07-9c48c0bf9ac0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.509478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-08a824e9-a972-4b36-b84a-c4123a1002e1 req-3e0454ec-23d5-4a85-bc07-9c48c0bf9ac0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.510235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-08a824e9-a972-4b36-b84a-c4123a1002e1 req-3e0454ec-23d5-4a85-bc07-9c48c0bf9ac0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.526469 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-08a824e9-a972-4b36-b84a-c4123a1002e1 req-3e0454ec-23d5-4a85-bc07-9c48c0bf9ac0 service nova] Creating event network-changed:0c2c3bdc-331f-4411-abd4-ca3381b84f41 for instance fa71b206-4ae5-495c-8ebf-f03508e924b0 on n-h2-862404-2 Oct 28 18:15:05.533114 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-08a824e9-a972-4b36-b84a-c4123a1002e1 req-3e0454ec-23d5-4a85-bc07-9c48c0bf9ac0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045645 Oct 28 18:15:05.534395 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1480/3051] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:05.539925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:05.540902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:05.548639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.549466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.550171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.551115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.551804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.552456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.576153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:05.592440 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81e8f003-4d65-49c3-b48f-31174c0386dd tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1396 microversion: 2.1 time: 0.205111 Oct 28 18:15:05.593382 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1572/3052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:05 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1396 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:05.614682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:05.615303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:05.623605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.624382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.625637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.626968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:05.627681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:05.628283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:05.772338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:05.797870 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9076f2ea-3520-4ca1-a9b8-f637ea86b9ed tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1274 microversion: 2.1 time: 0.261888 Oct 28 18:15:05.798859 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1481/3053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:05 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:05.896734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:05.906814 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-398485f1-6778-4643-883d-3d48aff7e954 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.311692 Oct 28 18:15:05.907549 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1573/3054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:05 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:05.992764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:05.993422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:05.999725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.001719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.002325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.003453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.004091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.004695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.409187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:06.409826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:06.416369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.416862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.417297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.418030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.418507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.418904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.559619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:06.568392 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bcce8ddb-bd69-4f44-97f3-207aedee2f2e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.163898 Oct 28 18:15:06.568997 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1574/3055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:06 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:06.588351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:06.589063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:06.596185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.596998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.597449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.598251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.598720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.599148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.711384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:06.726558 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2aa6324a-8697-46a3-a77a-039a67118bc7 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.742027 Oct 28 18:15:06.727969 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1482/3056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:05 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:06.734157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:06.735145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:06.738154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:06.747396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.748323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.748965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.751254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.751988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.752819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.933967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:06.947539 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2025e075-1e18-4902-a7da-23a3ebadb864 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1599 microversion: 2.1 time: 0.377023 Oct 28 18:15:06.965233 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1575/3057] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:06 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1599 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:06.975772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:06.977771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:06.987391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.988067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.988892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.989839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.990522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.991202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.185346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:07.187783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:07.196139 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5debd790-ae88-46f6-bab6-60b6051b0e24 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.229320 Oct 28 18:15:07.213323 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1576/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:06 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:07.218552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:07.219796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:07.226118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.226815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.227443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.228544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.229159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.229739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.408031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:07.409177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:07.418696 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a98a6a90-c15b-45cb-a2a2-46e8869631fb tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.203414 Oct 28 18:15:07.419908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1577/3059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:07 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:07.426157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ff680e42-e5cd-4b22-8843-4ef883baade5 req-b63af535-3254-4d6a-9bcf-04eac2c5d268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044272e7-257b-4504-ab1b-90435d93d21d", "name": "network-vif-deleted", "tag": "5dbb710a-7d49-4881-9824-24c2aa5ca847"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:07.437286 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d7a9163-3f9d-49b5-acd6-a5f51e35658f tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1396 microversion: 2.1 time: 0.707320 Oct 28 18:15:07.438818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ff680e42-e5cd-4b22-8843-4ef883baade5 req-b63af535-3254-4d6a-9bcf-04eac2c5d268 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.439502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ff680e42-e5cd-4b22-8843-4ef883baade5 req-b63af535-3254-4d6a-9bcf-04eac2c5d268 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.440163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ff680e42-e5cd-4b22-8843-4ef883baade5 req-b63af535-3254-4d6a-9bcf-04eac2c5d268 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.457125 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1483/3060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:06 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1396 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:07.464625 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ff680e42-e5cd-4b22-8843-4ef883baade5 req-b63af535-3254-4d6a-9bcf-04eac2c5d268 service nova] Creating event network-vif-deleted:5dbb710a-7d49-4881-9824-24c2aa5ca847 for instance 044272e7-257b-4504-ab1b-90435d93d21d on n-h1-862404-2 Oct 28 18:15:07.471500 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ff680e42-e5cd-4b22-8843-4ef883baade5 req-b63af535-3254-4d6a-9bcf-04eac2c5d268 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050137 Oct 28 18:15:07.472713 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1578/3061] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:07.595465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:07.596624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:07.604977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.605477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.605944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.606684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.607149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.607572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.751016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:07.752030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:07.760746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.761669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.762321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.763312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.763914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.765267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.925797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:07.941498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:07.950264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c566b52-7003-4368-8c95-1daabd429120 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.204036 Oct 28 18:15:07.950861 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1579/3062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:07 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:07.981760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:07.983324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:07.997825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.001076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.001921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.003097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.004567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.005223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.098418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.099051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.100158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.100915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lazy-loading 'fault' on Instance uuid 044272e7-257b-4504-ab1b-90435d93d21d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:08.151240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=16 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:08.186651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4e90ef137492fac6fcecbed44ee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dce2688e04f4361a8b53cc82365cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:08.206778 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6513be0-562c-42d7-812a-4ec02e43bc6f tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 200 len: 1316 microversion: 2.1 time: 0.229809 Oct 28 18:15:08.219639 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1580/3063] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:07 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:08.238355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:08.239116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:08.272426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.273161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.273621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.274368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.275392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.275841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.308527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:08.317698 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9a85db21-0700-46fd-8ae9-cd7481b4f26f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.726431 Oct 28 18:15:08.318923 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1484/3064] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:07 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:08.445050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:08.445828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:08.455732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.456770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.457467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.458817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.459537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.460278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.577292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:08.589163 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-932492a2-ff3a-4a86-b8c5-6654f2c96385 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.365170 Oct 28 18:15:08.608746 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1581/3065] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:08 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:08.615164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:08.616283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:08.624220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.625765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.626500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.627487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.628483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.629185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.799875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:08.808991 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-335be8da-273d-4cb3-9f0b-5458f12c8eef tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1577 microversion: 2.1 time: 0.198031 Oct 28 18:15:08.853107 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1582/3066] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:08 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1577 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:08.859163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:08.860602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:08.884519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.885559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.885708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.887446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.887446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.887914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.013417 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0dbaa52b-7db6-4ef5-9006-3e6b31daf61e tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157842 Oct 28 18:15:09.017005 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1583/3067] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:15:08 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:09.024865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:09.026221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:09.042627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.043437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.043938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.044711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.045274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.045766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.127894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:09.137932 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-41025e3c-a519-430f-869d-336e7fe5d8ac tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.696723 Oct 28 18:15:09.138790 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1485/3068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:08 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:09.232913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:09.233544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] [instance: 044272e7-257b-4504-ab1b-90435d93d21d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:09.245472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.246251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.246882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.248089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.248722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.249461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.436914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:09.452257 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf9f2037-36fa-427c-b5a5-4be9275c7abb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.433434 Oct 28 18:15:09.457293 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1584/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:09 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:09.472021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:09.472748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:09.486575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.487160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.487673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.488938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.488938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.489489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.646212 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] HTTP exception thrown: Instance 044272e7-257b-4504-ab1b-90435d93d21d could not be found. Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Request method failure captured: Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d HTTP/1.1 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBuwFQFpw0kHEaKv_jhi7aG-rDJKFO2AFZenye2gWDZzLV0O57EY7i5sWdE9kzk0XVmoi23VRlctJNeB5F-iZysYaNW2dAppvgG3-y_HOpu0DCOt0pkkunWWdTLNgNqkqOukhulXbHCKGyguR0M8l6EffNIhK4uRJMJxhzEN3eboa2Q Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 1dce2688e04f4361a8b53cc82365cc36 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersTestFqdnHostnames-129670633 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dce2688e04f4361a8b53cc82365cc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dce2688e04f4361a8b53cc82365cc36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dce2688e04f4361a8b53cc82365cc36", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dce2688e04f4361a8b53cc82365cc36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersTestFqdnHostnames-129670633 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 1dce2688e04f4361a8b53cc82365cc36 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-129670633 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersTestFqdnHostnames-129670633-project Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 9be4e90ef137492fac6fcecbed44ee92 Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersTestFqdnHostnames-129670633-project Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 044272e7-257b-4504-ab1b-90435d93d21d could not be found. Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '044272e7-257b-4504-ab1b-90435d93d21d'} Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044272e7-257b-4504-ab1b-90435d93d21d could not be found. Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044272e7-257b-4504-ab1b-90435d93d21d could not be found. Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:09.648551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:09.652668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:09.652668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:09.652668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:09.652668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:09.652668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:09.652668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044272e7-257b-4504-ab1b-90435d93d21d could not be found. Oct 28 18:15:09.652668 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:09.654323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Returning 404 to user: Instance 044272e7-257b-4504-ab1b-90435d93d21d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:09.655433 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ff0dd84-5f72-404f-b7d0-0bd3e52efc25 tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d" status: 404 len: 111 microversion: 2.1 time: 0.427155 Oct 28 18:15:09.656915 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1486/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:09 2022] GET /compute/v2.1/servers/044272e7-257b-4504-ab1b-90435d93d21d => generated 111 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:15:09.663031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9c83e2c7-de81-4feb-aaf3-a88c967037ca req-420f4afc-cd7a-463d-9835-74c738535303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe6c92c-5fcb-4abd-abcf-d78acafac7ba", "tag": "f3bc8ec5-848b-481b-ba78-ac6074e5b98f"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:09.673989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9c83e2c7-de81-4feb-aaf3-a88c967037ca req-420f4afc-cd7a-463d-9835-74c738535303 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.674535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9c83e2c7-de81-4feb-aaf3-a88c967037ca req-420f4afc-cd7a-463d-9835-74c738535303 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.674969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9c83e2c7-de81-4feb-aaf3-a88c967037ca req-420f4afc-cd7a-463d-9835-74c738535303 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.692140 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9c83e2c7-de81-4feb-aaf3-a88c967037ca req-420f4afc-cd7a-463d-9835-74c738535303 service nova] Creating event network-changed:f3bc8ec5-848b-481b-ba78-ac6074e5b98f for instance fbe6c92c-5fcb-4abd-abcf-d78acafac7ba on n-h2-862404-2 Oct 28 18:15:09.697398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9c83e2c7-de81-4feb-aaf3-a88c967037ca req-420f4afc-cd7a-463d-9835-74c738535303 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038842 Oct 28 18:15:09.698132 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1487/3071] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:09.704111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:09.711835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:09.720848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.721817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.722477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.723400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.724154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.724943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.810508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:09.823525 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8558d293-23a8-4025-af2b-6a3da841726e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.364926 Oct 28 18:15:09.824178 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1585/3072] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:09 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:09.830155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d132a65-910d-4a28-8668-beb6e46ca2cb tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] Calling method '.version_select at 0x7f78dd786e50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:09.851889 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d132a65-910d-4a28-8668-beb6e46ca2cb tempest-ServersTestFqdnHostnames-129670633 tempest-ServersTestFqdnHostnames-129670633-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112323796" status: 202 len: 0 microversion: 2.1 time: 0.026371 Oct 28 18:15:09.853251 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1586/3073] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112323796 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:09.962232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:09.972479 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-32a81938-4d36-4e11-9dff-ce693186af03 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.273088 Oct 28 18:15:09.973721 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1488/3074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:09 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:10.167828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:10.169400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:10.173138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:10.185353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.186586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.187257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.189577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.190445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.191523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.483114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:10.490399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:10.501140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.502023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.502905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.503910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.504572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.505223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.555842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:10.564275 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-803b3436-0aa2-43c3-9400-9715db231064 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.404317 Oct 28 18:15:10.576199 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1587/3075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:10 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:10.853457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:10.854390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:10.866268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.869983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.871808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.875567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.876342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.878895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.012274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=34 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:11.151667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:11.174031 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-902de842-298e-44cd-a77c-9ee274f45404 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.326490 Oct 28 18:15:11.182657 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1588/3076] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:10 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:11.195758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:11.196691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:11.213513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.214474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.217123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.218066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.219365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.219895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.341533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:11.356764 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0786663-d0ad-4aa4-b97d-964391184ca9 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.879854 Oct 28 18:15:11.357356 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1489/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:10 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:11.362463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ee3004d7-1f64-46b8-a630-b85e3f328f36 req-ee32d484-eb45-449c-a634-a447ac3cb3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440b2b69-5998-49f9-aa5d-6b2cc75a7954", "tag": "7f9cab0b-7a3f-4709-b7bf-17d55642d800"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:11.389500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ee3004d7-1f64-46b8-a630-b85e3f328f36 req-ee32d484-eb45-449c-a634-a447ac3cb3d2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.391875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ee3004d7-1f64-46b8-a630-b85e3f328f36 req-ee32d484-eb45-449c-a634-a447ac3cb3d2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.392597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ee3004d7-1f64-46b8-a630-b85e3f328f36 req-ee32d484-eb45-449c-a634-a447ac3cb3d2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.411126 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ee3004d7-1f64-46b8-a630-b85e3f328f36 req-ee32d484-eb45-449c-a634-a447ac3cb3d2 service nova] Creating event network-changed:7f9cab0b-7a3f-4709-b7bf-17d55642d800 for instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 on n-h1-862404-2 Oct 28 18:15:11.427453 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ee3004d7-1f64-46b8-a630-b85e3f328f36 req-ee32d484-eb45-449c-a634-a447ac3cb3d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068594 Oct 28 18:15:11.428230 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1490/3078] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:11.440568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:11.441646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:11.458123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.459577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.460263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.461232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.461882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.462576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.476561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:11.490185 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-252d27cc-fbc0-48b3-b376-34c4f92649db tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1577 microversion: 2.1 time: 0.306021 Oct 28 18:15:11.492715 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1589/3079] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:11 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1577 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:11.504113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ebad4925-f9e2-485f-b456-487548305a3f req-8771bece-2145-42ad-97f0-b3978241c6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f358d61-64bf-4efb-908b-5ba233a11fb2", "name": "network-vif-plugged", "status": "completed", "tag": "9934cfed-52db-450e-a30f-a1166d12ec61"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:11.535255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ebad4925-f9e2-485f-b456-487548305a3f req-8771bece-2145-42ad-97f0-b3978241c6f9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.535884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ebad4925-f9e2-485f-b456-487548305a3f req-8771bece-2145-42ad-97f0-b3978241c6f9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.539316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ebad4925-f9e2-485f-b456-487548305a3f req-8771bece-2145-42ad-97f0-b3978241c6f9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.570103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ebad4925-f9e2-485f-b456-487548305a3f req-8771bece-2145-42ad-97f0-b3978241c6f9 service nova] Creating event network-vif-plugged:9934cfed-52db-450e-a30f-a1166d12ec61 for instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 on n-h1-862404-2 Oct 28 18:15:11.581644 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ebad4925-f9e2-485f-b456-487548305a3f req-8771bece-2145-42ad-97f0-b3978241c6f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083564 Oct 28 18:15:11.583353 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1590/3080] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:11.600024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:11.602019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:11.612082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:11.626549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.627111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.627618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.630280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.630768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.631514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:12.024239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:12.040050 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-36c62d2a-a66b-43a5-a287-0fb386c670b7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.610105 Oct 28 18:15:12.040824 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1491/3081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:11 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:12.051642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e9713379-3a22-437c-b07d-e58115211e7c req-2aaa0bd0-7b9c-45a5-83d2-8d8cdd7b8feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61aba0cb-8e75-4f77-8d49-f5a452d41cd2", "tag": "bd51dc99-644e-4322-a676-6c680781d054"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:12.073264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e9713379-3a22-437c-b07d-e58115211e7c req-2aaa0bd0-7b9c-45a5-83d2-8d8cdd7b8feb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:12.076531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e9713379-3a22-437c-b07d-e58115211e7c req-2aaa0bd0-7b9c-45a5-83d2-8d8cdd7b8feb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:12.077971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e9713379-3a22-437c-b07d-e58115211e7c req-2aaa0bd0-7b9c-45a5-83d2-8d8cdd7b8feb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:12.122365 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e9713379-3a22-437c-b07d-e58115211e7c req-2aaa0bd0-7b9c-45a5-83d2-8d8cdd7b8feb service nova] Creating event network-changed:bd51dc99-644e-4322-a676-6c680781d054 for instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 on n-h1-862404-2 Oct 28 18:15:12.128577 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e9713379-3a22-437c-b07d-e58115211e7c req-2aaa0bd0-7b9c-45a5-83d2-8d8cdd7b8feb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084103 Oct 28 18:15:12.129617 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1492/3082] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:12.208057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:12.209987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:12.221400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:12.228517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:12.229152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:12.230078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:12.230665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:12.232269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:12.349964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:12.360116 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9e864a28-4856-4b46-8dfd-51df0630838f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.773825 Oct 28 18:15:12.361537 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1591/3083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:11 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:12.389856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:12.390770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:12.397244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:12.398307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:12.398914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:12.399786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:12.400499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:12.401085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:12.513579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:12.522234 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ee3f9c2-1aaa-4009-b007-d38bcd80a49a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.319014 Oct 28 18:15:12.550695 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1493/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:12 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:12.690158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:12.701264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8669fa3f-dc05-400d-88a4-3de7d2802887 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.319871 Oct 28 18:15:12.702721 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1592/3085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:12 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:13.072631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:13.073377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:13.093033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:13.096284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:13.097001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:13.099412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:13.100640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:13.102175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:13.387744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:13.389048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:13.399091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:13.399917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:13.400519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:13.401458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:13.402188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:13.402864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:13.808387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:13.817169 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0af062e6-c176-4ad0-a0c3-d594abe2ae40 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.433882 Oct 28 18:15:13.834686 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1593/3086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:13 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:13.840363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:13.841273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:13.854068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:13.856451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:13.857058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:13.858493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:13.859214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:13.859966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:13.956755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:13.970514 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65dc7464-d4b6-4010-b5f6-7c45c84a59d7 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.909299 Oct 28 18:15:13.972392 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1494/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:13 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:13.982951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-1c6440bd-a7b8-4b13-8f62-beca2000bf7f req-7b778d76-ef1c-46f6-956c-c8175a735793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c6a475b-2b26-4b32-8364-5dc0c5816bd9", "name": "network-vif-plugged", "status": "completed", "tag": "f35774df-6561-4412-a129-0b537e118ded"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:14.000451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c6440bd-a7b8-4b13-8f62-beca2000bf7f req-7b778d76-ef1c-46f6-956c-c8175a735793 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:14.001541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c6440bd-a7b8-4b13-8f62-beca2000bf7f req-7b778d76-ef1c-46f6-956c-c8175a735793 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:14.002431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1c6440bd-a7b8-4b13-8f62-beca2000bf7f req-7b778d76-ef1c-46f6-956c-c8175a735793 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:14.035107 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-1c6440bd-a7b8-4b13-8f62-beca2000bf7f req-7b778d76-ef1c-46f6-956c-c8175a735793 service nova] Creating event network-vif-plugged:f35774df-6561-4412-a129-0b537e118ded for instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 on n-h2-862404-2 Oct 28 18:15:14.043028 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-1c6440bd-a7b8-4b13-8f62-beca2000bf7f req-7b778d76-ef1c-46f6-956c-c8175a735793 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068985 Oct 28 18:15:14.046283 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1495/3088] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:14.054752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:14.057756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:14.067195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:14.082152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:14.084794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:14.087617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:14.088915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:14.089630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:14.123594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:14.152579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:14.163641 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d0639617-addb-45d7-ad6d-10e332a0a6f6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.327311 Oct 28 18:15:14.165042 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1594/3089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:13 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:14.705906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:14.725378 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2bde552d-2001-4b02-a387-363299b4a31d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.676594 Oct 28 18:15:14.728367 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1496/3090] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:14 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:14.844011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:14.844877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:14.867375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:14.870861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:14.871901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:14.872846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:14.873519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:14.874248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:14.997495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:14.998441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:15.008743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:15.009610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:15.011258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:15.012155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:15.013345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:15.016014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:15.286349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:15.290546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:15.303656 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba3f06c4-b49d-4cd5-9fbe-113573e1f261 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.463536 Oct 28 18:15:15.306247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1595/3091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:14 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:15.315064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:15.315767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:15.322881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:15.324275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:15.325420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:15.326400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:15.327032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:15.327630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:15.455357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:15.464862 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a6175297-06c6-4e69-8142-f8a96d4a55ab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.472407 Oct 28 18:15:15.479978 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1497/3092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:14 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:15.675907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:15.693606 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8f3aeac7-b2d7-4acf-a289-51ac2d6dff0f tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.386060 Oct 28 18:15:15.709333 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1596/3093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:15 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:15.756951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:15.757754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:15.775211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:15.775722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:15.776229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:15.777075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:15.778122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:15.778568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:16.014619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:16.032749 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9a05fc8-ff0e-462c-81e2-b6cebb86968b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1324 microversion: 2.1 time: 0.281780 Oct 28 18:15:16.033897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-935681919", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "70c5abb7-d4bd-4b29-a58f-099ce9f71832"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:16.043785 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1498/3094] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:15 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:16.134559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] validate_networks() for [('70c5abb7-d4bd-4b29-a58f-099ce9f71832', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:15:16.330898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:16.331568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:16.339143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:16.340055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:16.340951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:16.341759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:16.342211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:16.343127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:16.669135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:16.707455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8c79310c-44b0-4c83-8f5e-75bde995f1c4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1316 microversion: 2.1 time: 0.381628 Oct 28 18:15:16.708580 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1499/3095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:16 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:16.716317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:16.717252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:16.726820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:16.727997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:16.728937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:16.731067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:16.732417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:16.733168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:16.899091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:15:16.899532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:15:16.900104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:15:16.900526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:15:16.901019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:15:16.916808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:16.920281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:16.921221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:16.933462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:16.934348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:16.935685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:16.976072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:15:16.985453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for user 84bb8a18e9264efbaef518e6a5ae0e32 and project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:15:17.004336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:15:17.022894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:15:17.133084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:17.142641 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71521be2-8deb-4ff4-b33c-4df7e661cdde tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310273 Oct 28 18:15:17.144769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1597/3096] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:15:17.157968 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b68d24c6-40e0-482d-b106-e7afdcfaa9f0 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.448015 Oct 28 18:15:17.158576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:17.172247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:17.172247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.172247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.172247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:17.172247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.172247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.172247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:17.175850 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1500/3097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:16 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:17.185646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8f885eaf-56f2-406e-acf8-ba7850b16057 req-4dfafd2a-2043-4f66-bacd-285a238ab7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa71b206-4ae5-495c-8ebf-f03508e924b0", "name": "network-vif-plugged", "status": "completed", "tag": "0c2c3bdc-331f-4411-abd4-ca3381b84f41"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:17.197037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8f885eaf-56f2-406e-acf8-ba7850b16057 req-4dfafd2a-2043-4f66-bacd-285a238ab7ce service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.197868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8f885eaf-56f2-406e-acf8-ba7850b16057 req-4dfafd2a-2043-4f66-bacd-285a238ab7ce service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.198596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8f885eaf-56f2-406e-acf8-ba7850b16057 req-4dfafd2a-2043-4f66-bacd-285a238ab7ce service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:17.222270 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8f885eaf-56f2-406e-acf8-ba7850b16057 req-4dfafd2a-2043-4f66-bacd-285a238ab7ce service nova] Creating event network-vif-plugged:0c2c3bdc-331f-4411-abd4-ca3381b84f41 for instance fa71b206-4ae5-495c-8ebf-f03508e924b0 on n-h2-862404-2 Oct 28 18:15:17.237022 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8f885eaf-56f2-406e-acf8-ba7850b16057 req-4dfafd2a-2043-4f66-bacd-285a238ab7ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059722 Oct 28 18:15:17.237707 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1501/3098] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:17.249319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:17.252381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:17.268648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.272725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.274149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:17.277624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.278807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.281831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:17.693315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:17.701199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-53fea6ab-01c5-4ba4-83d5-3abc098047ff tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 200 len: 1521 microversion: 2.1 time: 0.462115 Oct 28 18:15:17.705303 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1502/3099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:17 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:17.710235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-81e84ed8-9b69-4f59-8e69-5e05f1e8779e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:17.711095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-81e84ed8-9b69-4f59-8e69-5e05f1e8779e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:17.810781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81e84ed8-9b69-4f59-8e69-5e05f1e8779e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:17.821319 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-81e84ed8-9b69-4f59-8e69-5e05f1e8779e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1214 microversion: 2.1 time: 0.114592 Oct 28 18:15:17.823975 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1503/3100] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:17 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:17.831886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'action', calling method: .version_select at 0x7f78dfe87af0>, body: {"addFloatingIp": {"address": "172.25.8.224"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:17.843469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:17.860081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.869706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.870273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:17.871275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.872450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.872960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:17.917630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:17.919731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:15:17.920432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquired lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:15:17.927237 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cf688af-e89a-4578-a54c-b9cf01de3772 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1320 microversion: 2.1 time: 0.781207 Oct 28 18:15:17.944696 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1598/3101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:17 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1320 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:17.953890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:17.954937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:17.961447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.962151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.962814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:17.964063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:17.964759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:17.965363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:18.188378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:18.196968 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d24ca44-acf0-4ab4-bcbc-7315d7110d8a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1465 microversion: 2.1 time: 0.250894 Oct 28 18:15:18.197789 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1599/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:17 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:18.202445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:18.203949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:18.210715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:18.211864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:18.221198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:18.222076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:18.222571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:18.223206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:18.387434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:18.396714 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d774807-21e0-498b-a372-14e323c404ac tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.197663 Oct 28 18:15:18.397493 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1600/3103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:18 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:18.403506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:18.404349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:18.411667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:18.412963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:18.413641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:18.414671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:18.415360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:18.416143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:18.579266 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af422c3b-b266-4781-ae00-88f285d02092 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1616 microversion: 2.1 time: 0.180091 Oct 28 18:15:18.580158 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1601/3104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:18 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1616 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:18.721691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1971306457", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["482db24a-f4e1-401d-8ace-4a3c5b673e66"]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:18.789441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:15:19.164572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:15:19.165239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:15:19.166059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:15:19.166656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:15:19.167249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:15:19.186526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:19.187211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:19.188166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:19.189919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:19.190948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:19.191551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:19.214049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:15:19.221691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:15:19.238734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:15:19.241044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:15:19.313827 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbd9a7b6-70c4-43d3-98d0-66a07c1c1d66 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596546 Oct 28 18:15:19.314513 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1602/3105] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:15:19.325431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:19.326385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:19.334420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:19.335119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:19.335740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:19.336948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:19.337589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:19.338021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:19.467005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:19.477110 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97180007-f589-46f7-8da3-75d9060a0955 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1266 microversion: 2.1 time: 0.155592 Oct 28 18:15:19.478084 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1603/3106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:19 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:19.482882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:19.483680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:19.490820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:19.491650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:19.492527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:19.493477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:19.494091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:19.494667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:19.729538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:19.742274 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe33f5aa-9976-46fe-ba59-3f86e714d002 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 200 len: 1509 microversion: 2.1 time: 0.262382 Oct 28 18:15:19.743164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1604/3107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:19 2022] GET /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:19.748212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a794d52-5184-4143-be4c-fd148047cff1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:19.749093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a794d52-5184-4143-be4c-fd148047cff1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:19.843204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a794d52-5184-4143-be4c-fd148047cff1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:19.852276 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a794d52-5184-4143-be4c-fd148047cff1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1217 microversion: 2.1 time: 0.107537 Oct 28 18:15:19.854952 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1605/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:19 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:19.872816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:19.875596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:19.902850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:19.903584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:19.904236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:19.905324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:19.906766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:19.907481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:20.284987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:20.299238 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52ff6128-9eab-40a3-b804-6db82109dbbe tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.442446 Oct 28 18:15:20.303321 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1606/3109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:19 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:20.317375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:20.319529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fbe6c92c-5fcb-4abd-abcf-d78acafac7ba] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:20.354307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:20.356361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:20.357150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:20.358098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:20.359809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:20.361070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:20.597473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:20.609090 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ee0143e-ed62-48c3-939b-4b50ec1cf3aa tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fbe6c92c-5fcb-4abd-abcf-d78acafac7ba" status: 200 len: 1320 microversion: 2.1 time: 0.303805 Oct 28 18:15:20.625530 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1607/3110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:20 2022] GET /compute/v2.1/servers/fbe6c92c-5fcb-4abd-abcf-d78acafac7ba => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:20.637040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e0cbaa44-0f49-4e0c-954e-1cfbc4145b89 req-1d458dc2-706a-49f5-8b14-4861aaa231cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe6c92c-5fcb-4abd-abcf-d78acafac7ba", "name": "network-vif-plugged", "status": "completed", "tag": "f3bc8ec5-848b-481b-ba78-ac6074e5b98f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:20.653011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0cbaa44-0f49-4e0c-954e-1cfbc4145b89 req-1d458dc2-706a-49f5-8b14-4861aaa231cd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:20.653664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0cbaa44-0f49-4e0c-954e-1cfbc4145b89 req-1d458dc2-706a-49f5-8b14-4861aaa231cd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:20.653969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0cbaa44-0f49-4e0c-954e-1cfbc4145b89 req-1d458dc2-706a-49f5-8b14-4861aaa231cd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:20.675658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Building network info cache for instance {{(pid=120679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:15:20.691527 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e0cbaa44-0f49-4e0c-954e-1cfbc4145b89 req-1d458dc2-706a-49f5-8b14-4861aaa231cd service nova] Creating event network-vif-plugged:f3bc8ec5-848b-481b-ba78-ac6074e5b98f for instance fbe6c92c-5fcb-4abd-abcf-d78acafac7ba on n-h2-862404-2 Oct 28 18:15:20.698201 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e0cbaa44-0f49-4e0c-954e-1cfbc4145b89 req-1d458dc2-706a-49f5-8b14-4861aaa231cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067652 Oct 28 18:15:20.702377 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1608/3111] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:20.710252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:20.710979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:20.752306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:20.753461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:20.754922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:20.759303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:20.761442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:20.762056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:20.878313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:20.890612 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3c3102d-b8dd-41bb-8a80-68f20854a04a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1272 microversion: 2.1 time: 0.185195 Oct 28 18:15:20.911257 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1609/3112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:20 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:20.924194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2bde2c53-e962-4b42-9a52-7d2d0a131fd0 req-583b233f-fbd7-4f36-b9fe-b52a17b04b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db87eca6-1a77-4d03-845a-bef6c5cc172a", "tag": "48244433-9e7a-4603-b111-c631d5ca8a7b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:20.979046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2bde2c53-e962-4b42-9a52-7d2d0a131fd0 req-583b233f-fbd7-4f36-b9fe-b52a17b04b33 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:20.979988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2bde2c53-e962-4b42-9a52-7d2d0a131fd0 req-583b233f-fbd7-4f36-b9fe-b52a17b04b33 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:20.980586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2bde2c53-e962-4b42-9a52-7d2d0a131fd0 req-583b233f-fbd7-4f36-b9fe-b52a17b04b33 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:21.009765 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2bde2c53-e962-4b42-9a52-7d2d0a131fd0 req-583b233f-fbd7-4f36-b9fe-b52a17b04b33 service nova] Creating event network-changed:48244433-9e7a-4603-b111-c631d5ca8a7b for instance db87eca6-1a77-4d03-845a-bef6c5cc172a on n-h2-862404-2 Oct 28 18:15:21.019045 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2bde2c53-e962-4b42-9a52-7d2d0a131fd0 req-583b233f-fbd7-4f36-b9fe-b52a17b04b33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106336 Oct 28 18:15:21.021352 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1610/3113] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:21.032719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:21.036655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:21.052412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:21.052624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:21.052921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:21.053647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:21.054157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:21.054605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:21.366768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:21.393731 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56c92149-1016-416a-acc8-a89c3c586494 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1269 microversion: 2.1 time: 0.360565 Oct 28 18:15:21.394428 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1611/3114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:21 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1269 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:21.418570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:21.426045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:21.459508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:21.461566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:21.464767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:21.466324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:21.467835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:21.468505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:21.981212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:21.990965 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1f5dc582-e3a1-405e-aec0-9eefb3e08285 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.595462 Oct 28 18:15:22.008963 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1612/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:21 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:22.016624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:22.017586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fbe6c92c-5fcb-4abd-abcf-d78acafac7ba] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:22.025686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.026376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.027180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:22.028533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.029425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.030013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:22.405269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Updating instance_info_cache with network_info: [{"id": "48244433-9e7a-4603-b111-c631d5ca8a7b", "address": "fa:16:3e:86:35:b1", "network": {"id": "267d2301-3717-4887-aee2-82012863ff35", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1783252963-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9aff6baa638641ffafc9f46981c8e465", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap48244433-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:15:22.420202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:22.428845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a22b459-638a-4222-8739-7c620e9d3ddd tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fbe6c92c-5fcb-4abd-abcf-d78acafac7ba" status: 200 len: 1320 microversion: 2.1 time: 0.418223 Oct 28 18:15:22.429465 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1613/3116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:22 2022] GET /compute/v2.1/servers/fbe6c92c-5fcb-4abd-abcf-d78acafac7ba => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:22.443536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:22.448738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Releasing lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:15:22.449677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3765a1da-c28e-404f-a3a2-b6a3bac95a32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action" status: 202 len: 0 microversion: 2.1 time: 4.623305 Oct 28 18:15:22.450244 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1504/3117] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:17 2022] POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action => generated 0 bytes in 4626 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:15:22.455047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:22.467876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:22.468830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:22.470470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.471228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.471802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:22.472795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.473380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.473870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:22.478606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.479400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.479856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:22.480574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.482723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.483760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:22.614276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:22.622369 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ce365a56-7f5e-452c-b050-82dc09bd2121 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1275 microversion: 2.1 time: 0.167165 Oct 28 18:15:22.623049 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1505/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:22 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:22.628345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.224"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:22.631174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:22.645423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.646232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.646906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:22.652037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.652959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.653636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:22.688075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "refresh_cache-4c6a475b-2b26-4b32-8364-5dc0c5816bd9" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:15:22.695102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquired lock "refresh_cache-4c6a475b-2b26-4b32-8364-5dc0c5816bd9" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:15:22.892959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:22.922845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0501f99b-e87f-4d33-8ead-2cf3267d7878 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1314 microversion: 2.1 time: 0.484096 Oct 28 18:15:22.923467 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1614/3119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:22 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:22.931065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-be583c11-fef2-4fde-bcfc-0970a46e93f2 req-403c36df-ba2b-4083-a8be-f8f6c231ff14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61aba0cb-8e75-4f77-8d49-f5a452d41cd2", "name": "network-vif-plugged", "status": "completed", "tag": "bd51dc99-644e-4322-a676-6c680781d054"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:22.963654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-be583c11-fef2-4fde-bcfc-0970a46e93f2 req-403c36df-ba2b-4083-a8be-f8f6c231ff14 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:22.984490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-be583c11-fef2-4fde-bcfc-0970a46e93f2 req-403c36df-ba2b-4083-a8be-f8f6c231ff14 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:22.985134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-be583c11-fef2-4fde-bcfc-0970a46e93f2 req-403c36df-ba2b-4083-a8be-f8f6c231ff14 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:23.010551 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-be583c11-fef2-4fde-bcfc-0970a46e93f2 req-403c36df-ba2b-4083-a8be-f8f6c231ff14 service nova] Creating event network-vif-plugged:bd51dc99-644e-4322-a676-6c680781d054 for instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 on n-h1-862404-2 Oct 28 18:15:23.024380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-be583c11-fef2-4fde-bcfc-0970a46e93f2 req-403c36df-ba2b-4083-a8be-f8f6c231ff14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099174 Oct 28 18:15:23.025004 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1615/3120] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:23.030862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:23.032821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:23.041144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:23.041942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:23.042600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:23.043393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:23.044248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:23.044913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:23.600529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:23.603017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:23.612989 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-743208f3-ccf3-4fc7-b2ce-db10a1605731 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.586300 Oct 28 18:15:23.613943 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1616/3121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:23 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:23.626640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:23.629365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fbe6c92c-5fcb-4abd-abcf-d78acafac7ba] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:23.638043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:23.638788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:23.639793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:23.643039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:23.643723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:23.644344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:24.115545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:24.139718 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e733600-b349-437a-bae2-587e226e684e tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/fbe6c92c-5fcb-4abd-abcf-d78acafac7ba" status: 200 len: 1508 microversion: 2.1 time: 0.524196 Oct 28 18:15:24.143574 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1617/3122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:23 2022] GET /compute/v2.1/servers/fbe6c92c-5fcb-4abd-abcf-d78acafac7ba => generated 1508 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:24.165695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:24.166797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:24.174597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:24.175396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:24.176332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:24.177249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:24.178161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:24.178787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:24.455837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:24.467537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e74158ba-7a9f-4444-9dd8-dba97f6d48d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.322156 Oct 28 18:15:24.485727 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1618/3123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:24 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:24.491010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:24.491935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:24.498311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:24.499077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:24.499764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:24.500884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:24.501540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:24.502161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:24.848798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:24.862952 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ab452de-e71b-403a-a40e-1e20bffbeaf1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1314 microversion: 2.1 time: 0.374366 Oct 28 18:15:24.864903 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1619/3124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:24 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:24.871669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:24.872399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fbe6c92c-5fcb-4abd-abcf-d78acafac7ba] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:24.882930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:24.885428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:24.886307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:24.888130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:24.889421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:24.904621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:24.949263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fbe6c92c-5fcb-4abd-abcf-d78acafac7ba] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:25.077816 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6aaf68f-498e-4f52-8eca-91f14aa427ea tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fbe6c92c-5fcb-4abd-abcf-d78acafac7ba" status: 204 len: 0 microversion: 2.1 time: 0.209653 Oct 28 18:15:25.083887 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1620/3125] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:24 2022] DELETE /compute/v2.1/servers/fbe6c92c-5fcb-4abd-abcf-d78acafac7ba => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:25.093141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-53bfdd85-d447-430f-a094-5fed09f4ed7c req-56eea2a8-c7f2-49a9-8d1d-d7e4d8fe688f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60149d17-0678-447c-9e50-6afaaec7c0c9", "tag": "6e35317b-5dd7-482b-8c6b-fb4274dcdaec"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:25.110128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53bfdd85-d447-430f-a094-5fed09f4ed7c req-56eea2a8-c7f2-49a9-8d1d-d7e4d8fe688f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:25.111087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53bfdd85-d447-430f-a094-5fed09f4ed7c req-56eea2a8-c7f2-49a9-8d1d-d7e4d8fe688f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:25.112110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53bfdd85-d447-430f-a094-5fed09f4ed7c req-56eea2a8-c7f2-49a9-8d1d-d7e4d8fe688f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:25.130331 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-53bfdd85-d447-430f-a094-5fed09f4ed7c req-56eea2a8-c7f2-49a9-8d1d-d7e4d8fe688f service nova] Creating event network-changed:6e35317b-5dd7-482b-8c6b-fb4274dcdaec for instance 60149d17-0678-447c-9e50-6afaaec7c0c9 on n-h2-862404-2 Oct 28 18:15:25.139566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-53bfdd85-d447-430f-a094-5fed09f4ed7c req-56eea2a8-c7f2-49a9-8d1d-d7e4d8fe688f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053350 Oct 28 18:15:25.150986 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1621/3126] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:25.160042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:25.161019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:25.170471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:25.171268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:25.172106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:25.173327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:25.174924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:25.175585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:25.689630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:25.698400 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae9f6eee-81af-4ba9-83bf-2949ffb9c067 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1316 microversion: 2.1 time: 0.544826 Oct 28 18:15:25.699025 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1622/3127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:25 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:25.736740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:25.737267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:25.754204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:25.763419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:25.763949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:25.764404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:25.765416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:25.776031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:25.776564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:25.807234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: fa71b206-4ae5-495c-8ebf-f03508e924b0] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:25.923965 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1f584ca4-d5cd-4be9-93d6-7f70c4667fa9 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0" status: 204 len: 0 microversion: 2.1 time: 0.203702 Oct 28 18:15:25.925469 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1623/3128] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:25 2022] DELETE /compute/v2.1/servers/fa71b206-4ae5-495c-8ebf-f03508e924b0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:25.954041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:25.959400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:25.975448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:25.976861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:25.977362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:25.978041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:25.978510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:25.978944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:26.216564 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.network.neutron [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] re-assign floating IP 172.25.8.224 from instance db87eca6-1a77-4d03-845a-bef6c5cc172a Oct 28 18:15:26.263870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Building network info cache for instance {{(pid=120679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:15:26.325364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:26.341478 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f3cf8ca-173f-481d-b03d-3e0a3f10b872 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.399638 Oct 28 18:15:26.343122 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1624/3129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:25 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:26.349084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:26.349824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:26.385881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:26.386630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:26.387784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:26.389524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:26.390030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:26.391163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:26.760290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:26.768676 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ba143b5-18b6-49e4-a4d2-cf6fd184e90d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1314 microversion: 2.1 time: 0.423670 Oct 28 18:15:26.769512 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1625/3130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:26 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:26.783371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-807767656", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f82fe855-0375-439d-a750-8e3e8fa17c0d"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:26.865337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] validate_networks() for [('f82fe855-0375-439d-a750-8e3e8fa17c0d', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:15:26.967497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Updating instance_info_cache with network_info: [{"id": "48244433-9e7a-4603-b111-c631d5ca8a7b", "address": "fa:16:3e:86:35:b1", "network": {"id": "267d2301-3717-4887-aee2-82012863ff35", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1783252963-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9aff6baa638641ffafc9f46981c8e465", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap48244433-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:15:26.985296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Building network info cache for instance {{(pid=120679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:15:27.737460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Updating instance_info_cache with network_info: [{"id": "f35774df-6561-4412-a129-0b537e118ded", "address": "fa:16:3e:8d:49:67", "network": {"id": "267d2301-3717-4887-aee2-82012863ff35", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1783252963-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9aff6baa638641ffafc9f46981c8e465", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf35774df-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:15:27.757640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Releasing lock "refresh_cache-4c6a475b-2b26-4b32-8364-5dc0c5816bd9" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:15:27.759842 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1bbcb8ed-6219-42f1-a5f6-8da423d9182b tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9/action" status: 202 len: 0 microversion: 2.1 time: 5.135542 Oct 28 18:15:27.760862 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1506/3131] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:22 2022] POST /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9/action => generated 0 bytes in 5137 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:15:27.768955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:27.770476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:27.777402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:27.778737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:27.779400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:27.780371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:27.782649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:27.783334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:27.819807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:27.944667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:15:27.945300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:15:27.945788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:15:27.946212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:15:27.946638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:15:27.958861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:27.959403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:27.959991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:27.961014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:27.961481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:27.961914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:27.972132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:27.982960 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fc06f470-d9f2-4225-b2d9-7f53e54a0dc2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1504 microversion: 2.1 time: 0.220343 Oct 28 18:15:27.983987 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1507/3132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:27 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:27.989381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-bcc0a903-d114-445d-8626-e2ed516cc7b2 req-60fba05a-cd2a-484c-880a-3716a786f0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9568c5fb-24a4-40bd-a549-d41a503cc432", "tag": "5897f17d-f134-4969-8c92-54220ef306d4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:28.002819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bcc0a903-d114-445d-8626-e2ed516cc7b2 req-60fba05a-cd2a-484c-880a-3716a786f0ac service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.003468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bcc0a903-d114-445d-8626-e2ed516cc7b2 req-60fba05a-cd2a-484c-880a-3716a786f0ac service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.004063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bcc0a903-d114-445d-8626-e2ed516cc7b2 req-60fba05a-cd2a-484c-880a-3716a786f0ac service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.016936 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-bcc0a903-d114-445d-8626-e2ed516cc7b2 req-60fba05a-cd2a-484c-880a-3716a786f0ac service nova] Creating event network-changed:5897f17d-f134-4969-8c92-54220ef306d4 for instance 9568c5fb-24a4-40bd-a549-d41a503cc432 on n-h1-862404-2 Oct 28 18:15:28.018368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Getting quotas for project 11f6ba6ec4174bd592c3bd43dad948c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:15:28.022867 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-bcc0a903-d114-445d-8626-e2ed516cc7b2 req-60fba05a-cd2a-484c-880a-3716a786f0ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037640 Oct 28 18:15:28.023766 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1508/3133] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:28.025960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Getting quotas for user 2cb7037d2702444cbc9acc2004641abf and project 11f6ba6ec4174bd592c3bd43dad948c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:15:28.030271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-663c6650-f881-4a7d-9b76-5a5114e7a468 req-5d580f77-e3f9-4b99-9768-8f22c133ae77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db87eca6-1a77-4d03-845a-bef6c5cc172a", "tag": "48244433-9e7a-4603-b111-c631d5ca8a7b"}, {"name": "network-changed", "server_uuid": "4c6a475b-2b26-4b32-8364-5dc0c5816bd9", "tag": "f35774df-6561-4412-a129-0b537e118ded"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:28.044077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-663c6650-f881-4a7d-9b76-5a5114e7a468 req-5d580f77-e3f9-4b99-9768-8f22c133ae77 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.044564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-663c6650-f881-4a7d-9b76-5a5114e7a468 req-5d580f77-e3f9-4b99-9768-8f22c133ae77 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.044781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Going to run 2 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:15:28.045021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-663c6650-f881-4a7d-9b76-5a5114e7a468 req-5d580f77-e3f9-4b99-9768-8f22c133ae77 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.048614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:15:28.059866 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-663c6650-f881-4a7d-9b76-5a5114e7a468 req-5d580f77-e3f9-4b99-9768-8f22c133ae77 service nova] Creating event network-changed:48244433-9e7a-4603-b111-c631d5ca8a7b for instance db87eca6-1a77-4d03-845a-bef6c5cc172a on n-h2-862404-2 Oct 28 18:15:28.060542 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-663c6650-f881-4a7d-9b76-5a5114e7a468 req-5d580f77-e3f9-4b99-9768-8f22c133ae77 service nova] Creating event network-changed:f35774df-6561-4412-a129-0b537e118ded for instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 on n-h2-862404-2 Oct 28 18:15:28.068578 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-663c6650-f881-4a7d-9b76-5a5114e7a468 req-5d580f77-e3f9-4b99-9768-8f22c133ae77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043200 Oct 28 18:15:28.073521 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1509/3134] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:28.080277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:28.081001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:28.088623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.089408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.090007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.090907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.091544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.092118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.102467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=2c1794aa-26a9-4355-8105-83220c147e61,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:15:28.198232 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01756f29-a136-4645-90b2-242064848bb4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.427845 Oct 28 18:15:28.202661 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1626/3135] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:15:26 2022] POST /compute/v2.1/servers => generated 32 bytes in 1433 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 18:15:28.222446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.224"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:28.262737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:28.277086 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-486148e6-a5e3-405c-993b-b551bedfc881 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.202172 Oct 28 18:15:28.277689 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1510/3136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:28 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:28.285391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:28.286852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:28.302738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.303533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.304001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.304716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.305177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.305606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.480067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:28.492082 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e1ea32a4-c199-4609-b0a5-191c7a0b9df3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1314 microversion: 2.1 time: 0.212978 Oct 28 18:15:28.492943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1511/3137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:28 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:28.497933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2059115154"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:28.498727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:28.517981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.518803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.519573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.521030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.521767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.522747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.713094 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.network.security_group_api [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Adding security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 to port bd51dc99-644e-4322-a676-6c680781d054 Oct 28 18:15:28.752849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:28.770865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.771659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.772158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:28.776337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:28.777041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:28.777606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.162044 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] HTTP exception thrown: Floating IP 172.25.8.224 is not associated with instance db87eca6-1a77-4d03-845a-bef6c5cc172a. Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Request method failure captured: Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action HTTP/1.1 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 49 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwBo7n6odGwwJgJPS333FbXiLB4-j2fAytMUmJCtpP834D_Y_QelC4wjhasDI-nyZxG2CLwG0jxFeNkcwnUV-txcXb-m79O1UmRpyicSGF4xIt8Xqups8qbT-RBJQwDM9pQU3xsRgLAHei6BmJqL609C9R3FytCab5ncKHPhzuVRmY Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 9aff6baa638641ffafc9f46981c8e465 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9aff6baa638641ffafc9f46981c8e465", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 9aff6baa638641ffafc9f46981c8e465 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPsAssociationTestJSON-1623080635-project Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 6f3ce763c739446186720e457592ce96 Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1623080635-project Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: {"removeFloatingIp": {"address": "172.25.8.224"}} Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: exception: Floating IP 172.25.8.224 is not associated with instance db87eca6-1a77-4d03-845a-bef6c5cc172a. Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'db87eca6-1a77-4d03-845a-bef6c5cc172a', 'body': {'removeFloatingIp': {'address': '172.25.8.224'}}} Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.224 is not associated with instance db87eca6-1a77-4d03-845a-bef6c5cc172a. Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.224 is not associated with instance db87eca6-1a77-4d03-845a-bef6c5cc172a. Oct 28 18:15:29.166346 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.173770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Returning 409 to user: Floating IP 172.25.8.224 is not associated with instance db87eca6-1a77-4d03-845a-bef6c5cc172a. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:29.173898 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5de88f0e-03c0-4338-bcec-2b2ea7ff1bc8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2/action" status: 202 len: 0 microversion: 2.1 time: 0.679611 Oct 28 18:15:29.174531 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1512/3138] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:28 2022] POST /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:29.175688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-092f64f6-4c47-4e0f-9784-1e9ebf2bed49 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action" status: 409 len: 146 microversion: 2.1 time: 0.970268 Oct 28 18:15:29.176445 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1627/3139] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:28 2022] POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action => generated 146 bytes in 973 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:15:29.181142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:29.183340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ac3395d-6278-4c61-a044-62deb6cfde49 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de148c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:29.194706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:29.198949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Searching by: {'deleted': False, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:15:29.206856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.207489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.208223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.209145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.209703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.210309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.232977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:29.261472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:15:29.298752 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-448b1fd2-89de-40fc-8da6-b8d29be39cf2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.122788 Oct 28 18:15:29.299957 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1513/3140] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:15:29 2022] GET /compute/v2.1/servers => generated 1335 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:29.305116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.224"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:29.441836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:29.448014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.448735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.449343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.450263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.450912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.451533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.521044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-5ac3395d-6278-4c61-a044-62deb6cfde49 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 in use.", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:15:29.521761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5ac3395d-6278-4c61-a044-62deb6cfde49 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security Group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 in use. Oct 28 18:15:29.521761 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-99e29339-6a65-4ea6-a2c3-019c380d44ac'] Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ac3395d-6278-4c61-a044-62deb6cfde49 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-security-groups/2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 HTTP/1.1 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: exception: Security Group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 in use. Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-99e29339-6a65-4ea6-a2c3-019c380d44ac'] Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5'} Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:15:29.523623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 in use. Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99e29339-6a65-4ea6-a2c3-019c380d44ac'] Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 in use. Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99e29339-6a65-4ea6-a2c3-019c380d44ac'] Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 in use. Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99e29339-6a65-4ea6-a2c3-019c380d44ac'] Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 in use. Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99e29339-6a65-4ea6-a2c3-019c380d44ac'] Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ac3395d-6278-4c61-a044-62deb6cfde49 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 400 to user: Security Group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 in use. Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-99e29339-6a65-4ea6-a2c3-019c380d44ac'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ac3395d-6278-4c61-a044-62deb6cfde49 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5" status: 400 len: 185 microversion: 2.1 time: 0.346063 Oct 28 18:15:29.527414 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1628/3141] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:29 2022] DELETE /compute/v2.1/os-security-groups/2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 => generated 185 bytes in 347 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:15:29.530321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:29.534949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:29.544793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.545278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.545966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.547549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.548280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.548938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.710229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "refresh_cache-4c6a475b-2b26-4b32-8364-5dc0c5816bd9" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:15:29.710641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquired lock "refresh_cache-4c6a475b-2b26-4b32-8364-5dc0c5816bd9" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:15:29.812102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:29.821276 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c6b340b-02ee-4c68-b92b-bbcebc9fcf23 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.294626 Oct 28 18:15:29.822492 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1629/3142] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:29 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:29.827528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:29.828579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:29.835135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.835981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.836636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.837595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.838602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.839240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.936616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:29.957503 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af045777-a6dc-4933-8018-b64a819d7e60 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1221 microversion: 2.1 time: 0.133517 Oct 28 18:15:29.958995 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1630/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:29 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1221 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:29.964596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:29.965738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:29.979207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.980711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.981238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:29.982038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:29.982685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:29.983494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:30.201147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:30.218508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-921466e4-9ecf-4dd3-9e1f-1786c1037143 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1314 microversion: 2.1 time: 0.257327 Oct 28 18:15:30.220067 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1631/3144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:29 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:30.229130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:30.232896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:30.241748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:30.243061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:30.246725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:30.247949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:30.248596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:30.250781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:30.303129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:30.376173 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c4c078fb-ba94-4270-ae6d-08cbcb8b7860 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2/action" status: 202 len: 0 microversion: 2.1 time: 0.153190 Oct 28 18:15:30.378102 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1632/3145] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:30 2022] POST /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:30.384096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-06be0b47-fb86-4c34-9add-2ca37910622a req-ab620151-cf52-47ac-905a-471f688774f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61aba0cb-8e75-4f77-8d49-f5a452d41cd2", "tag": "bd51dc99-644e-4322-a676-6c680781d054"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:30.396927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-06be0b47-fb86-4c34-9add-2ca37910622a req-ab620151-cf52-47ac-905a-471f688774f6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:30.397758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-06be0b47-fb86-4c34-9add-2ca37910622a req-ab620151-cf52-47ac-905a-471f688774f6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:30.398446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-06be0b47-fb86-4c34-9add-2ca37910622a req-ab620151-cf52-47ac-905a-471f688774f6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:30.418094 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-06be0b47-fb86-4c34-9add-2ca37910622a req-ab620151-cf52-47ac-905a-471f688774f6 service nova] Creating event network-changed:bd51dc99-644e-4322-a676-6c680781d054 for instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 on n-h1-862404-2 Oct 28 18:15:30.424596 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-06be0b47-fb86-4c34-9add-2ca37910622a req-ab620151-cf52-47ac-905a-471f688774f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044812 Oct 28 18:15:30.426020 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1633/3146] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:30.434282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:30.435466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:30.444813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:30.445818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:30.446479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:30.447909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:30.449475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:30.450220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:30.907944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Building network info cache for instance {{(pid=120679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:15:31.545539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:31.558654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86c73e80-9caa-4e36-8a73-2c97943e7fec tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1575 microversion: 2.1 time: 1.131023 Oct 28 18:15:31.562980 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1634/3147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:30 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1575 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:31.579216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:31.580305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:31.588972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:31.589480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:31.589921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:31.590652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:31.591115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:31.591552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:33.455734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:33.476381 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-18f61871-8852-43c8-b49d-08e0dd357caf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 1.903206 Oct 28 18:15:33.477376 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1635/3148] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:31 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:33.482932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:33.485753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:33.507301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:33.508179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:33.508922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:33.509834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:33.510456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:33.511137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:33.763537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Updating instance_info_cache with network_info: [{"id": "f35774df-6561-4412-a129-0b537e118ded", "address": "fa:16:3e:8d:49:67", "network": {"id": "267d2301-3717-4887-aee2-82012863ff35", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1783252963-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9aff6baa638641ffafc9f46981c8e465", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf35774df-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:15:33.790031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Releasing lock "refresh_cache-4c6a475b-2b26-4b32-8364-5dc0c5816bd9" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:15:33.791565 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-673466de-9788-4e3e-a366-5f740f25e441 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9/action" status: 202 len: 0 microversion: 2.1 time: 4.490134 Oct 28 18:15:33.795270 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1514/3149] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:29 2022] POST /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9/action => generated 0 bytes in 4492 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:15:33.808387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:33.811245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:33.826867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:33.829404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:33.830175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:33.832571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:33.834589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:33.835214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.068913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:34.083595 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb45a97b-935e-4553-a767-b597c53d1186 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1275 microversion: 2.1 time: 0.603918 Oct 28 18:15:34.086877 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1636/3150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:33 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1275 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:34.106542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-af7c3101-3665-42c1-a1fc-6d58c7050761 req-49c07ea2-f6c1-41ad-a949-76759c3ee2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c6a475b-2b26-4b32-8364-5dc0c5816bd9", "tag": "f35774df-6561-4412-a129-0b537e118ded"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:34.135429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af7c3101-3665-42c1-a1fc-6d58c7050761 req-49c07ea2-f6c1-41ad-a949-76759c3ee2ed service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.135974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af7c3101-3665-42c1-a1fc-6d58c7050761 req-49c07ea2-f6c1-41ad-a949-76759c3ee2ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.139260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af7c3101-3665-42c1-a1fc-6d58c7050761 req-49c07ea2-f6c1-41ad-a949-76759c3ee2ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.173591 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-af7c3101-3665-42c1-a1fc-6d58c7050761 req-49c07ea2-f6c1-41ad-a949-76759c3ee2ed service nova] Creating event network-changed:f35774df-6561-4412-a129-0b537e118ded for instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 on n-h2-862404-2 Oct 28 18:15:34.186309 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-af7c3101-3665-42c1-a1fc-6d58c7050761 req-49c07ea2-f6c1-41ad-a949-76759c3ee2ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097628 Oct 28 18:15:34.190076 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1637/3151] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:34.205882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:34.216446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:34.226557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.227341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.227983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.232032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.232754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.236575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.397152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:34.413821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cc97a503-d77c-4dfa-8b1e-0e3538c6d601 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1314 microversion: 2.1 time: 0.619965 Oct 28 18:15:34.427855 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1515/3152] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:33 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:34.427855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:34.427855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:34.461983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.464487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.467956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.469263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.470039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.476152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.533131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:34.719056 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-97ee0a2e-1bf4-46ce-b39b-385d373c26bb tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 204 len: 0 microversion: 2.1 time: 0.295515 Oct 28 18:15:34.725279 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1516/3153] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:34 2022] DELETE /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:34.743559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-015efb47-694d-4dc4-a07a-80964d75ad31 req-4c47089c-8692-43a4-8814-44db3e7a7c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa71b206-4ae5-495c-8ebf-f03508e924b0", "name": "network-vif-deleted", "tag": "0c2c3bdc-331f-4411-abd4-ca3381b84f41"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:34.758149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-015efb47-694d-4dc4-a07a-80964d75ad31 req-4c47089c-8692-43a4-8814-44db3e7a7c48 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.758641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-015efb47-694d-4dc4-a07a-80964d75ad31 req-4c47089c-8692-43a4-8814-44db3e7a7c48 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.759085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-015efb47-694d-4dc4-a07a-80964d75ad31 req-4c47089c-8692-43a4-8814-44db3e7a7c48 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.789594 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-015efb47-694d-4dc4-a07a-80964d75ad31 req-4c47089c-8692-43a4-8814-44db3e7a7c48 service nova] Creating event network-vif-deleted:0c2c3bdc-331f-4411-abd4-ca3381b84f41 for instance fa71b206-4ae5-495c-8ebf-f03508e924b0 on n-h2-862404-2 Oct 28 18:15:34.794503 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-015efb47-694d-4dc4-a07a-80964d75ad31 req-4c47089c-8692-43a4-8814-44db3e7a7c48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061339 Oct 28 18:15:34.795111 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1517/3154] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:34.801957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:34.802973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:34.809374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.809949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.810661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.811551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.812917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.813479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.886950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:34.901911 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c7b0ae2-3288-4e9c-bcd0-d92d60364be8 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1575 microversion: 2.1 time: 0.710330 Oct 28 18:15:34.903129 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1638/3155] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:34 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1575 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:34.909420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.224"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:34.912959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:34.924422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.925983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.926704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:34.927544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:34.928934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:34.929561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:35.007617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:15:35.007932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquired lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:15:35.198504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:35.210778 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-101f4b80-66fe-4056-a6b7-9ba0d7578c3a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.412456 Oct 28 18:15:35.229271 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1518/3156] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:34 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:35.240125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:35.241043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:35.249663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:35.251113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:35.251717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:35.253294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:35.253940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:35.254547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:35.368748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:35.380356 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1b048fa-1069-4855-b2d8-477714d5e851 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1275 microversion: 2.1 time: 0.146747 Oct 28 18:15:35.381201 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1519/3157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:35 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:35.447601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:35.448743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:35.457412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:35.458086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:35.458895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:35.459893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:35.460430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:35.460923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:35.819952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:35.849621 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4fd46704-c805-4bcd-bd4e-4ff28f872ad6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1314 microversion: 2.1 time: 0.406562 Oct 28 18:15:35.868831 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1520/3158] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:35 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:35.926768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:35.927684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:35.945058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:35.945577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:35.946023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:35.946753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:35.947217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:35.954126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:36.230772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:36.246894 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ef19714b-d1ba-4521-bbb5-16888b5776cb tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1575 microversion: 2.1 time: 0.324584 Oct 28 18:15:36.256328 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1521/3159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:35 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1575 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:36.276792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5770e92c-af53-4a54-8fb9-e32e06566cbf req-7b2300e1-6c37-4632-97e3-49e7fd60796c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60149d17-0678-447c-9e50-6afaaec7c0c9", "name": "network-vif-plugged", "status": "completed", "tag": "6e35317b-5dd7-482b-8c6b-fb4274dcdaec"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:36.289705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5770e92c-af53-4a54-8fb9-e32e06566cbf req-7b2300e1-6c37-4632-97e3-49e7fd60796c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:36.290691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5770e92c-af53-4a54-8fb9-e32e06566cbf req-7b2300e1-6c37-4632-97e3-49e7fd60796c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:36.291501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5770e92c-af53-4a54-8fb9-e32e06566cbf req-7b2300e1-6c37-4632-97e3-49e7fd60796c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:36.309707 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5770e92c-af53-4a54-8fb9-e32e06566cbf req-7b2300e1-6c37-4632-97e3-49e7fd60796c service nova] Creating event network-vif-plugged:6e35317b-5dd7-482b-8c6b-fb4274dcdaec for instance 60149d17-0678-447c-9e50-6afaaec7c0c9 on n-h2-862404-2 Oct 28 18:15:36.318280 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5770e92c-af53-4a54-8fb9-e32e06566cbf req-7b2300e1-6c37-4632-97e3-49e7fd60796c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059366 Oct 28 18:15:36.322977 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1522/3160] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:36.330144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:36.331056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:36.348984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:36.353103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:36.356336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:36.357143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:36.358123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:36.361017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:36.548719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:36.558348 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a5c1a12f-b8aa-4adf-be4e-b897a05e3aa5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.233917 Oct 28 18:15:36.559026 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1523/3161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:36 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:36.564860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a199cc7b-12a9-4486-b1b5-a7baa424850d req-3173b9cd-8fb4-4232-94d9-1c715c7ba77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe6c92c-5fcb-4abd-abcf-d78acafac7ba", "name": "network-vif-deleted", "tag": "f3bc8ec5-848b-481b-ba78-ac6074e5b98f"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:36.575697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a199cc7b-12a9-4486-b1b5-a7baa424850d req-3173b9cd-8fb4-4232-94d9-1c715c7ba77d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:36.576468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a199cc7b-12a9-4486-b1b5-a7baa424850d req-3173b9cd-8fb4-4232-94d9-1c715c7ba77d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:36.577216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a199cc7b-12a9-4486-b1b5-a7baa424850d req-3173b9cd-8fb4-4232-94d9-1c715c7ba77d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:36.592068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a199cc7b-12a9-4486-b1b5-a7baa424850d req-3173b9cd-8fb4-4232-94d9-1c715c7ba77d service nova] Creating event network-vif-deleted:f3bc8ec5-848b-481b-ba78-ac6074e5b98f for instance fbe6c92c-5fcb-4abd-abcf-d78acafac7ba on n-h2-862404-2 Oct 28 18:15:36.598175 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a199cc7b-12a9-4486-b1b5-a7baa424850d req-3173b9cd-8fb4-4232-94d9-1c715c7ba77d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037916 Oct 28 18:15:36.599362 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1524/3162] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:36.608063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:36.608780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:36.618491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:36.618977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:36.619416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:36.620334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:36.620998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:36.621638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:36.978657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:37.000954 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1aa83e43-801c-4855-91e4-7897fd7d7d33 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1317 microversion: 2.1 time: 0.397640 Oct 28 18:15:37.019921 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1525/3163] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:36 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:37.027489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:37.028585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:37.031168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:37.038774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:37.039730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:37.040510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:37.041465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:37.042198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:37.042835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:37.718005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:37.729014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e51e1796-d9c9-48e5-b893-386868ccd20b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1314 microversion: 2.1 time: 0.706844 Oct 28 18:15:37.730637 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1526/3164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:37 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:37.737427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:37.739210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:37.771497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:37.774360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:37.776580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:37.783401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:37.786826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:37.788914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:37.987245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:38.038572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=20 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:38.161588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:38.170212 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-327c4d9a-3504-47ba-982c-33a8b952a767 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1573 microversion: 2.1 time: 0.437395 Oct 28 18:15:38.184287 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1527/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:37 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1573 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:38.465081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1644343173", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "a45890c9-92d5-4697-9422-b6095c90055a"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:38.571401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] validate_networks() for [('a45890c9-92d5-4697-9422-b6095c90055a', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:15:38.935137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Building network info cache for instance {{(pid=120680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:15:39.217458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:39.819368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:15:39.820874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:15:39.821580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:15:39.822204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:15:39.822836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:15:39.846295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:39.847052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:39.847728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:39.848708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:39.849371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:39.850000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:39.882421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Getting quotas for project 3343ab77692d4ac983ca737d2a6dd74e. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:15:39.888878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Getting quotas for user 00b92c11d657438097a4520f291446d0 and project 3343ab77692d4ac983ca737d2a6dd74e. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:15:39.908529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:15:39.911327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:15:39.983059 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796959 Oct 28 18:15:39.984526 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1528/3166] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:15:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:15:39.994687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:39.995471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:40.004146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.004648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.005143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.006058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.006616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.007057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.242116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:40.249489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:40.252589 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1a3e763c-fdd3-4766-b005-f10e4999e988 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.266777 Oct 28 18:15:40.261426 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1529/3167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:39 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:40.267730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:40.268416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:40.301079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.302896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.303467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.304355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.305334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.305874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.527667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:40.539388 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c41a4124-1f32-4c27-a1cb-82bc7996cec1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1317 microversion: 2.1 time: 0.276649 Oct 28 18:15:40.540105 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1530/3168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:40 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:40.544641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Updating instance_info_cache with network_info: [{"id": "48244433-9e7a-4603-b111-c631d5ca8a7b", "address": "fa:16:3e:86:35:b1", "network": {"id": "267d2301-3717-4887-aee2-82012863ff35", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1783252963-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9aff6baa638641ffafc9f46981c8e465", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap48244433-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:15:40.548491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1335149565"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:40.549380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:40.566777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.567134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Releasing lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:15:40.567542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.568028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.568508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99d89c75-c96b-4b2e-9dd7-5a19f14d94a3 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action" status: 202 len: 0 microversion: 2.1 time: 5.663177 Oct 28 18:15:40.568739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.569308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.570874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.572654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1639/3169] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:34 2022] POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action => generated 0 bytes in 5668 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:15:40.582598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ff6455e3-f9be-4081-9056-1e4f29c16115 req-de22f997-7d07-4673-837c-8f784b62c257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9568c5fb-24a4-40bd-a549-d41a503cc432", "name": "network-vif-plugged", "status": "completed", "tag": "5897f17d-f134-4969-8c92-54220ef306d4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:40.605462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ff6455e3-f9be-4081-9056-1e4f29c16115 req-de22f997-7d07-4673-837c-8f784b62c257 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.607677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ff6455e3-f9be-4081-9056-1e4f29c16115 req-de22f997-7d07-4673-837c-8f784b62c257 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.608335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ff6455e3-f9be-4081-9056-1e4f29c16115 req-de22f997-7d07-4673-837c-8f784b62c257 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.632752 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ff6455e3-f9be-4081-9056-1e4f29c16115 req-de22f997-7d07-4673-837c-8f784b62c257 service nova] Creating event network-vif-plugged:5897f17d-f134-4969-8c92-54220ef306d4 for instance 9568c5fb-24a4-40bd-a549-d41a503cc432 on n-h1-862404-2 Oct 28 18:15:40.644409 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ff6455e3-f9be-4081-9056-1e4f29c16115 req-de22f997-7d07-4673-837c-8f784b62c257 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070175 Oct 28 18:15:40.645495 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1640/3170] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:40.660301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:40.661214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:40.678131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.678646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.679095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.679840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.680310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.680977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.750622 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.network.security_group_api [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Adding security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 to port bd51dc99-644e-4322-a676-6c680781d054 Oct 28 18:15:41.098070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:41.110111 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b8a1b6d-0bde-42fa-916e-6a0c54cdb5e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1501 microversion: 2.1 time: 0.461673 Oct 28 18:15:41.112221 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1641/3171] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:40 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1501 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:41.120704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ea7562fe-ed68-4f62-afdc-c674ed247731 req-c07969ff-cd34-4ef1-a95d-96fa3337b1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6113d4e1-1747-4611-a2c5-fe248ae3ee3a", "tag": "c193b63a-a142-4e22-8ca7-bd865d48b397"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:41.159274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ea7562fe-ed68-4f62-afdc-c674ed247731 req-c07969ff-cd34-4ef1-a95d-96fa3337b1e4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.159759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ea7562fe-ed68-4f62-afdc-c674ed247731 req-c07969ff-cd34-4ef1-a95d-96fa3337b1e4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.160616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ea7562fe-ed68-4f62-afdc-c674ed247731 req-c07969ff-cd34-4ef1-a95d-96fa3337b1e4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.193848 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ea7562fe-ed68-4f62-afdc-c674ed247731 req-c07969ff-cd34-4ef1-a95d-96fa3337b1e4 service nova] Creating event network-changed:c193b63a-a142-4e22-8ca7-bd865d48b397 for instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a on n-h1-862404-2 Oct 28 18:15:41.200546 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ea7562fe-ed68-4f62-afdc-c674ed247731 req-c07969ff-cd34-4ef1-a95d-96fa3337b1e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086164 Oct 28 18:15:41.201772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1642/3172] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:41.208414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b0c4bbf1-b3a7-4290-996e-49fab9256d99 req-33721ab0-33f4-4b7a-ae2e-e87edb08058f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db87eca6-1a77-4d03-845a-bef6c5cc172a", "tag": "48244433-9e7a-4603-b111-c631d5ca8a7b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:41.220782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b0c4bbf1-b3a7-4290-996e-49fab9256d99 req-33721ab0-33f4-4b7a-ae2e-e87edb08058f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.221659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b0c4bbf1-b3a7-4290-996e-49fab9256d99 req-33721ab0-33f4-4b7a-ae2e-e87edb08058f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.222300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b0c4bbf1-b3a7-4290-996e-49fab9256d99 req-33721ab0-33f4-4b7a-ae2e-e87edb08058f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.235050 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b0c4bbf1-b3a7-4290-996e-49fab9256d99 req-33721ab0-33f4-4b7a-ae2e-e87edb08058f service nova] Creating event network-changed:48244433-9e7a-4603-b111-c631d5ca8a7b for instance db87eca6-1a77-4d03-845a-bef6c5cc172a on n-h2-862404-2 Oct 28 18:15:41.241184 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b0c4bbf1-b3a7-4290-996e-49fab9256d99 req-33721ab0-33f4-4b7a-ae2e-e87edb08058f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037752 Oct 28 18:15:41.242805 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1643/3173] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:41.251237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.252285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:41.259476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.260564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.261162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.262057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.262715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.263264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.298168 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e165f168-829a-4b53-b680-87e680d980f5 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2/action" status: 202 len: 0 microversion: 2.1 time: 0.756931 Oct 28 18:15:41.298807 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1531/3174] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:40 2022] POST /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:41.303934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b401471-58ea-4163-9997-fae66a7d7e4d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '.version_select at 0x7f78de248af0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.367231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:41.377795 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6de05b7-99cc-4ee6-b26a-b0b067f0d168 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1269 microversion: 2.1 time: 0.133520 Oct 28 18:15:41.379143 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1644/3175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:41 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:41.385463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.385966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:41.392202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.392891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.393486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.395342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.396325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.396792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.426456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:41.510341 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-568d2975-66d5-4450-a043-a918d8283671 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 204 len: 0 microversion: 2.1 time: 0.129485 Oct 28 18:15:41.510972 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1645/3176] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:41 2022] DELETE /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:41.518234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.519214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:41.525987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.526929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.528471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.529226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.529664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.530214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.580042 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b401471-58ea-4163-9997-fae66a7d7e4d tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/2e10698d-2e02-45cb-bbab-37d0aa484dbc" status: 200 len: 184 microversion: 2.1 time: 0.279995 Oct 28 18:15:41.580917 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1532/3177] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:15:41 2022] GET /compute/v2.1/os-floating-ips/2e10698d-2e02-45cb-bbab-37d0aa484dbc => generated 184 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:41.585951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d02feceb-d8db-46a8-9c65-4a214de3a37b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de2270d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.692525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-d02feceb-d8db-46a8-9c65-4a214de3a37b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 39ac65c4-0a4f-444a-b312-b8097bdabf14 in use.", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:15:41.693310 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d02feceb-d8db-46a8-9c65-4a214de3a37b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security Group 39ac65c4-0a4f-444a-b312-b8097bdabf14 in use. Oct 28 18:15:41.693310 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-8b2479bb-8148-4b40-99f9-01fe45a674c0'] Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d02feceb-d8db-46a8-9c65-4a214de3a37b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-security-groups/39ac65c4-0a4f-444a-b312-b8097bdabf14 HTTP/1.1 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: exception: Security Group 39ac65c4-0a4f-444a-b312-b8097bdabf14 in use. Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-8b2479bb-8148-4b40-99f9-01fe45a674c0'] Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '39ac65c4-0a4f-444a-b312-b8097bdabf14'} Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:15:41.695621 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 39ac65c4-0a4f-444a-b312-b8097bdabf14 in use. Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b2479bb-8148-4b40-99f9-01fe45a674c0'] Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 39ac65c4-0a4f-444a-b312-b8097bdabf14 in use. Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b2479bb-8148-4b40-99f9-01fe45a674c0'] Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 39ac65c4-0a4f-444a-b312-b8097bdabf14 in use. Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b2479bb-8148-4b40-99f9-01fe45a674c0'] Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 39ac65c4-0a4f-444a-b312-b8097bdabf14 in use. Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b2479bb-8148-4b40-99f9-01fe45a674c0'] Oct 28 18:15:41.700052 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:41.702588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d02feceb-d8db-46a8-9c65-4a214de3a37b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 400 to user: Security Group 39ac65c4-0a4f-444a-b312-b8097bdabf14 in use. Oct 28 18:15:41.702588 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-8b2479bb-8148-4b40-99f9-01fe45a674c0'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:41.703471 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d02feceb-d8db-46a8-9c65-4a214de3a37b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/39ac65c4-0a4f-444a-b312-b8097bdabf14" status: 400 len: 185 microversion: 2.1 time: 0.121250 Oct 28 18:15:41.704943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1533/3178] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:41 2022] DELETE /compute/v2.1/os-security-groups/39ac65c4-0a4f-444a-b312-b8097bdabf14 => generated 185 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:15:41.712125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:41.712617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.714941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:41.721332 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b02fcbc-0b4a-4fd9-ab6c-86fa46279217 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.208720 Oct 28 18:15:41.721552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.721928 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1646/3179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:41 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:41.729879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.729879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.729879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.729879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.729879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.735918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.736832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:41.743887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.744595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.745044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.745929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.746224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.746659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.875729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:41.884894 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e9b3b6bf-3809-487a-8318-dfc3a52ee9fd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1507 microversion: 2.1 time: 0.176081 Oct 28 18:15:41.885926 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1534/3180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:41 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:41.891189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.224"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:41.902358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:41.910938 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5b5cbfd-9ba5-4d3c-a490-ac30e5153f49 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1317 microversion: 2.1 time: 0.179730 Oct 28 18:15:41.911854 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1647/3181] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:41 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:41.917025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.917859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:41.924944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.925720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.926349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.927243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.927919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.928531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.962373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:41.981008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:42.039473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:42.045886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.046402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.047545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.048398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.048887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.049474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.053743 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dd686ebe-4523-41a0-8745-aca4eeffc2ef tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 204 len: 0 microversion: 2.1 time: 0.140291 Oct 28 18:15:42.054356 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1648/3182] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:41 2022] DELETE /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:42.063985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:42.064809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:42.071205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.071714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.072194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.072911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.073427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.073842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.245055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:42.258522 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4725461a-0dcd-4236-82a7-9876a6461840 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1648 microversion: 2.1 time: 0.199157 Oct 28 18:15:42.259447 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1649/3183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:42 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1648 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:42.276792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:15:42.277424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquired lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:15:42.401801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:42.402460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:42.409154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.409652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.410127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.410854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.411313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.411748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.477487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:42.485294 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5946d16f-327b-42ad-834d-134558adebf4 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1269 microversion: 2.1 time: 0.087580 Oct 28 18:15:42.485877 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1650/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:42 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:42.745414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:42.746122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:42.752996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.753583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.754091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.754864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.755398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.755895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.917910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:42.939569 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a83c00e-29a6-4282-9019-50da6086861c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.197840 Oct 28 18:15:42.940608 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1651/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:42 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:42.945492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:42.946167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:42.954485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.954485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.955130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.955942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.956492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.957156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.968773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Building network info cache for instance {{(pid=120679) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:15:43.132047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:43.140508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab174db8-b462-4f11-bfbd-e336d5b2be83 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1507 microversion: 2.1 time: 0.198990 Oct 28 18:15:43.155968 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1652/3186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:42 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:43.155968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:43.155968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:43.155968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:43.155968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:43.155968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.155968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:43.155968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:43.156721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.302561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:43.311202 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d441b781-a45d-4f60-9f82-16e31c777ad2 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1317 microversion: 2.1 time: 0.168529 Oct 28 18:15:43.312800 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1653/3187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:43 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:43.317710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-285a13b0-6a7f-42e7-bbf1-56104a2e2bef req-c06e9819-e03f-4d22-a4ce-cdfb44066b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c6a475b-2b26-4b32-8364-5dc0c5816bd9", "name": "network-vif-deleted", "tag": "f35774df-6561-4412-a129-0b537e118ded"}, {"name": "network-changed", "server_uuid": "61aba0cb-8e75-4f77-8d49-f5a452d41cd2", "tag": "bd51dc99-644e-4322-a676-6c680781d054"}, {"name": "network-changed", "server_uuid": "db87eca6-1a77-4d03-845a-bef6c5cc172a", "tag": "48244433-9e7a-4603-b111-c631d5ca8a7b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:43.329755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-285a13b0-6a7f-42e7-bbf1-56104a2e2bef req-c06e9819-e03f-4d22-a4ce-cdfb44066b09 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:43.330384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-285a13b0-6a7f-42e7-bbf1-56104a2e2bef req-c06e9819-e03f-4d22-a4ce-cdfb44066b09 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:43.330923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-285a13b0-6a7f-42e7-bbf1-56104a2e2bef req-c06e9819-e03f-4d22-a4ce-cdfb44066b09 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.346791 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-285a13b0-6a7f-42e7-bbf1-56104a2e2bef req-c06e9819-e03f-4d22-a4ce-cdfb44066b09 service nova] Creating event network-vif-deleted:f35774df-6561-4412-a129-0b537e118ded for instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 on n-h2-862404-2 Oct 28 18:15:43.347442 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-285a13b0-6a7f-42e7-bbf1-56104a2e2bef req-c06e9819-e03f-4d22-a4ce-cdfb44066b09 service nova] Creating event network-changed:bd51dc99-644e-4322-a676-6c680781d054 for instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 on n-h1-862404-2 Oct 28 18:15:43.348105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-285a13b0-6a7f-42e7-bbf1-56104a2e2bef req-c06e9819-e03f-4d22-a4ce-cdfb44066b09 service nova] Creating event network-changed:48244433-9e7a-4603-b111-c631d5ca8a7b for instance db87eca6-1a77-4d03-845a-bef6c5cc172a on n-h2-862404-2 Oct 28 18:15:43.359768 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-285a13b0-6a7f-42e7-bbf1-56104a2e2bef req-c06e9819-e03f-4d22-a4ce-cdfb44066b09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.045012 Oct 28 18:15:43.360976 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1654/3188] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:43.366167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4d6d23e0-6200-4cbf-822c-999a3fce0f7e req-aa8f4367-9cf8-4c7b-9fab-4814c976b8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1794aa-26a9-4355-8105-83220c147e61", "tag": "2ad3be5e-421c-4be7-a7a1-c2de9ea3d763"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:43.379010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4d6d23e0-6200-4cbf-822c-999a3fce0f7e req-aa8f4367-9cf8-4c7b-9fab-4814c976b8ce service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:43.379631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4d6d23e0-6200-4cbf-822c-999a3fce0f7e req-aa8f4367-9cf8-4c7b-9fab-4814c976b8ce service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:43.380208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4d6d23e0-6200-4cbf-822c-999a3fce0f7e req-aa8f4367-9cf8-4c7b-9fab-4814c976b8ce service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.391739 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4d6d23e0-6200-4cbf-822c-999a3fce0f7e req-aa8f4367-9cf8-4c7b-9fab-4814c976b8ce service nova] Creating event network-changed:2ad3be5e-421c-4be7-a7a1-c2de9ea3d763 for instance 2c1794aa-26a9-4355-8105-83220c147e61 on n-h2-862404-2 Oct 28 18:15:43.396805 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4d6d23e0-6200-4cbf-822c-999a3fce0f7e req-aa8f4367-9cf8-4c7b-9fab-4814c976b8ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034372 Oct 28 18:15:43.397852 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1655/3189] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:43.403362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:43.404223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:43.407480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:43.413231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:43.413861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:43.414437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.415253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:43.415843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:43.416378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.920658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Updating instance_info_cache with network_info: [{"id": "48244433-9e7a-4603-b111-c631d5ca8a7b", "address": "fa:16:3e:86:35:b1", "network": {"id": "267d2301-3717-4887-aee2-82012863ff35", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1783252963-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9aff6baa638641ffafc9f46981c8e465", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap48244433-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:15:43.937570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Releasing lock "refresh_cache-db87eca6-1a77-4d03-845a-bef6c5cc172a" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:15:43.939211 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-64716a7a-a2b7-48df-a4cf-1a143586b466 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action" status: 202 len: 0 microversion: 2.1 time: 2.051390 Oct 28 18:15:43.944881 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1535/3190] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:41 2022] POST /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a/action => generated 0 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:15:43.951396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:43.952241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:43.961604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:43.962430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:43.964094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.965137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:43.966425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:43.967066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.978905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:43.987625 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a6c35eb-2f8b-4f81-bbfd-3db6b5bef807 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1648 microversion: 2.1 time: 0.588435 Oct 28 18:15:43.988392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1656/3191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:43 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1648 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:43.993011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:43.993506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:43.999666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.000283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.000838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.005106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.005612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.006048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.024614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] HTTP exception thrown: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Request method failure captured: Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 HTTP/1.1 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwBo7n6odGwwJgJPS333FbXiLB4-j2fAytMUmJCtpP834D_Y_QelC4wjhasDI-nyZxG2CLwG0jxFeNkcwnUV-txcXb-m79O1UmRpyicSGF4xIt8Xqups8qbT-RBJQwDM9pQU3xsRgLAHei6BmJqL609C9R3FytCab5ncKHPhzuVRmY Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 9aff6baa638641ffafc9f46981c8e465 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9aff6baa638641ffafc9f46981c8e465", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 9aff6baa638641ffafc9f46981c8e465 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPsAssociationTestJSON-1623080635-project Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 6f3ce763c739446186720e457592ce96 Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1623080635-project Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4c6a475b-2b26-4b32-8364-5dc0c5816bd9'} Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:44.026301 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Returning 404 to user: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3bd3a5c7-f6bb-4950-b88b-641400d3b8b6 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 404 len: 111 microversion: 2.1 time: 0.038733 Oct 28 18:15:44.032936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1657/3192] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:43 2022] DELETE /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:44.034651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:44.035278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:44.041637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.042122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.042555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.043251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.043702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.044158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.058416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:44.071765 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-24466db1-69eb-43f7-84e7-7f202b5103a2 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1269 microversion: 2.1 time: 0.125381 Oct 28 18:15:44.072572 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1536/3193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:43 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:44.077956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:44.079157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: 4c6a475b-2b26-4b32-8364-5dc0c5816bd9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:44.085766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.086487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.087653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.089008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.089632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.090942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.114455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] HTTP exception thrown: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Request method failure captured: Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 HTTP/1.1 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwBo7n6odGwwJgJPS333FbXiLB4-j2fAytMUmJCtpP834D_Y_QelC4wjhasDI-nyZxG2CLwG0jxFeNkcwnUV-txcXb-m79O1UmRpyicSGF4xIt8Xqups8qbT-RBJQwDM9pQU3xsRgLAHei6BmJqL609C9R3FytCab5ncKHPhzuVRmY Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 9aff6baa638641ffafc9f46981c8e465 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9aff6baa638641ffafc9f46981c8e465", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 9aff6baa638641ffafc9f46981c8e465 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FloatingIPsAssociationTestJSON-1623080635-project Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 6f3ce763c739446186720e457592ce96 Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1623080635-project Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '4c6a475b-2b26-4b32-8364-5dc0c5816bd9'} Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.129134 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:44.133833 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.133833 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:44.133833 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:44.133833 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:44.133833 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:44.133833 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:44.133833 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. Oct 28 18:15:44.133833 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:44.136847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Returning 404 to user: Instance 4c6a475b-2b26-4b32-8364-5dc0c5816bd9 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:44.145978 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e9c012b7-81d9-4dc6-9b78-d77d0dbe29ef tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9" status: 404 len: 111 microversion: 2.1 time: 0.071982 Oct 28 18:15:44.146809 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1537/3194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:44 2022] GET /compute/v2.1/servers/4c6a475b-2b26-4b32-8364-5dc0c5816bd9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:44.157492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a14c5053-386e-46c6-ae48-cbd3e995648a tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '.version_select at 0x7f78dd7c5dc0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:44.712774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:44.721559 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-19ea4bf4-332f-45ab-89c3-6ae5955327d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1317 microversion: 2.1 time: 0.691606 Oct 28 18:15:44.722381 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1658/3195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:44 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:44.727550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:44.740978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:44.748317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.749094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.750606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.751803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.752566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.753164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:45.252018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:45.265139 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3631a384-f00f-4d68-abff-2fd4a5107495 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 200 len: 1507 microversion: 2.1 time: 0.541475 Oct 28 18:15:45.267588 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1659/3196] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:44 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 1507 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:45.274781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:45.275732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:45.287272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:45.289931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:45.290704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:45.292195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:45.293260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:45.293951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:45.787935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:45.801800 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe023ee5-9100-4eb3-afc5-bc8b4abfb647 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1317 microversion: 2.1 time: 0.531784 Oct 28 18:15:45.816943 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1660/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:45 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:45.818977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:45.820488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:45.829710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:45.830441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:45.831197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:45.832249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:45.833009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:45.833821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:46.287490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:46.301105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50722bf9-3af0-411b-9261-8a1555a0444d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1648 microversion: 2.1 time: 0.487831 Oct 28 18:15:46.302155 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1661/3198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:45 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1648 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:46.310585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:46.311210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:46.326112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:46.326632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:46.328409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:46.329980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:46.330523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:46.331026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.100941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:47.112552 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba8b531e-551a-4834-8978-5c0910bf6117 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.809059 Oct 28 18:15:47.123929 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1662/3199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:46 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:47.157328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c75548c2-adbc-409c-8b30-1d274683f84c req-d8174f93-8dab-4232-b6f7-0bc456aec9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6113d4e1-1747-4611-a2c5-fe248ae3ee3a", "name": "network-vif-plugged", "status": "completed", "tag": "c193b63a-a142-4e22-8ca7-bd865d48b397"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:47.191982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c75548c2-adbc-409c-8b30-1d274683f84c req-d8174f93-8dab-4232-b6f7-0bc456aec9df service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.192850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c75548c2-adbc-409c-8b30-1d274683f84c req-d8174f93-8dab-4232-b6f7-0bc456aec9df service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.193711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c75548c2-adbc-409c-8b30-1d274683f84c req-d8174f93-8dab-4232-b6f7-0bc456aec9df service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.221464 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c75548c2-adbc-409c-8b30-1d274683f84c req-d8174f93-8dab-4232-b6f7-0bc456aec9df service nova] Creating event network-vif-plugged:c193b63a-a142-4e22-8ca7-bd865d48b397 for instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a on n-h1-862404-2 Oct 28 18:15:47.227466 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c75548c2-adbc-409c-8b30-1d274683f84c req-d8174f93-8dab-4232-b6f7-0bc456aec9df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084595 Oct 28 18:15:47.228530 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1663/3200] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:47.236198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:47.237134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:47.245148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.245891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.246523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.247517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.248121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.248560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.388777 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a14c5053-386e-46c6-ae48-cbd3e995648a tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/2e10698d-2e02-45cb-bbab-37d0aa484dbc" status: 202 len: 0 microversion: 2.1 time: 3.237535 Oct 28 18:15:47.393566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1538/3201] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:15:44 2022] DELETE /compute/v2.1/os-floating-ips/2e10698d-2e02-45cb-bbab-37d0aa484dbc => generated 0 bytes in 3243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:47.406527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a2947871-93d0-4336-8ead-e32b86e38e32 req-08673815-2c92-45e0-9d72-7e01db63a171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60149d17-0678-447c-9e50-6afaaec7c0c9", "name": "network-vif-deleted", "tag": "6e35317b-5dd7-482b-8c6b-fb4274dcdaec"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:47.426142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a2947871-93d0-4336-8ead-e32b86e38e32 req-08673815-2c92-45e0-9d72-7e01db63a171 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.426850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a2947871-93d0-4336-8ead-e32b86e38e32 req-08673815-2c92-45e0-9d72-7e01db63a171 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.427465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a2947871-93d0-4336-8ead-e32b86e38e32 req-08673815-2c92-45e0-9d72-7e01db63a171 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.439744 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a2947871-93d0-4336-8ead-e32b86e38e32 req-08673815-2c92-45e0-9d72-7e01db63a171 service nova] Creating event network-vif-deleted:6e35317b-5dd7-482b-8c6b-fb4274dcdaec for instance 60149d17-0678-447c-9e50-6afaaec7c0c9 on n-h2-862404-2 Oct 28 18:15:47.445446 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a2947871-93d0-4336-8ead-e32b86e38e32 req-08673815-2c92-45e0-9d72-7e01db63a171 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050338 Oct 28 18:15:47.446732 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1539/3202] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:47.451981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:47.453319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:47.460076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.460814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.461428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.462238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.462711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.463145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.479670 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 HTTP/1.1 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '60149d17-0678-447c-9e50-6afaaec7c0c9'} Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:47.481674 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae75a53c-c3b0-4620-a23a-ea69dad5c3b0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 404 len: 111 microversion: 2.1 time: 0.035324 Oct 28 18:15:47.486785 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1540/3203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:47 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:47.492719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:47.493360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:47.500392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.500899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.501438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.502166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.502633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.503071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.611973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:47.620350 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d656ef36-2873-433c-b04a-4f73cd764a65 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1466 microversion: 2.1 time: 0.390210 Oct 28 18:15:47.621667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1664/3204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:47 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1466 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:47.627221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:47.628100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:47.634910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.635635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.636412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.637298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.637912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.639156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.832785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:47.847304 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f07fd4db-7098-4fbd-a919-3442a4e6180e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1468 microversion: 2.1 time: 0.223041 Oct 28 18:15:47.849311 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1665/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:47 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1468 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:47.862862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:47.863381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:47.881382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.881805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.882250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.885247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.888572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.889029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.934432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:47.953939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d232d493-ad42-4032-a47b-9c4ed34751a6 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1317 microversion: 2.1 time: 0.468399 Oct 28 18:15:47.955028 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1541/3206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:47 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:47.962574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:47.968736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-533741365", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "70c5abb7-d4bd-4b29-a58f-099ce9f71832"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:47.972933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:48.075744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] validate_networks() for [('70c5abb7-d4bd-4b29-a58f-099ce9f71832', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:15:48.206739 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6776b41d-0cc1-4573-bd39-71d1e54f1476 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 204 len: 0 microversion: 2.1 time: 0.353401 Oct 28 18:15:48.207727 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1666/3207] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:47 2022] DELETE /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:48.215596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:48.216334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:48.223146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:48.223644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:48.224110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.225045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:48.225659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:48.226240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.520196 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-62c4569d-9f66-4d44-bff3-5f7106829578 tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1617 microversion: 2.1 time: 0.309286 Oct 28 18:15:48.520417 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1667/3208] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:48 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1617 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:48.528051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:48.528825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:48.535424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:48.543311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:48.545484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.548588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:48.549745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:48.550544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.624194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:15:48.624909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:15:48.625385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:15:48.625893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:15:48.626409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:15:48.638093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:48.638881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:48.639409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.640970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:48.641432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:48.641861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.664565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:15:48.670166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for user 84bb8a18e9264efbaef518e6a5ae0e32 and project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:15:48.683055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:15:48.685407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:15:48.738734 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d9eaee9b-e685-404b-a1da-462eaf0086d1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781760 Oct 28 18:15:48.739646 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1542/3209] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:15:48.746042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:48.746963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:48.757481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:48.758412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:48.759159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.759583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:48.760079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:48.760512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.775006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:48.802159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29925fbf-7fa6-4d80-b855-1aceb003500c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.280477 Oct 28 18:15:48.802862 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1668/3210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:48 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:48.810751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-57814968", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "482db24a-f4e1-401d-8ace-4a3c5b673e66"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:48.888198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:15:48.918543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:48.931043 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a867a0f8-9c24-4e59-8cfe-07755bc96c73 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1526 microversion: 2.1 time: 0.190078 Oct 28 18:15:48.939979 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1543/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:48 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1526 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:48.945388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff84b081-1640-41e2-8af5-5f156cd5c58d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:48.946239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff84b081-1640-41e2-8af5-5f156cd5c58d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:49.014668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff84b081-1640-41e2-8af5-5f156cd5c58d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:49.024113 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff84b081-1640-41e2-8af5-5f156cd5c58d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1214 microversion: 2.1 time: 0.082561 Oct 28 18:15:49.024936 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1544/3212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:48 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:49.029971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:49.031786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:49.041955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.042606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.043238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.044124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.044833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.045600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.081400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.081889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.082459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.082955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lazy-loading 'fault' on Instance uuid 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:49.135642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:49.148352 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aebb83f3-2361-4423-86f3-05753c7e9702 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1306 microversion: 2.1 time: 0.121691 Oct 28 18:15:49.149098 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1545/3213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:49 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1306 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:49.154099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9226b9ff-6686-4058-a385-0eb2291fe998 req-f54f4c4b-642d-462d-931f-5743ff425972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f9c52b-b9b0-4187-8452-85217591a00c", "tag": "19244be5-e59e-42be-986d-d73bba85fc24"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:49.172769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9226b9ff-6686-4058-a385-0eb2291fe998 req-f54f4c4b-642d-462d-931f-5743ff425972 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.173719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9226b9ff-6686-4058-a385-0eb2291fe998 req-f54f4c4b-642d-462d-931f-5743ff425972 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.174671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9226b9ff-6686-4058-a385-0eb2291fe998 req-f54f4c4b-642d-462d-931f-5743ff425972 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.192714 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9226b9ff-6686-4058-a385-0eb2291fe998 req-f54f4c4b-642d-462d-931f-5743ff425972 service nova] Creating event network-changed:19244be5-e59e-42be-986d-d73bba85fc24 for instance 70f9c52b-b9b0-4187-8452-85217591a00c on n-h2-862404-2 Oct 28 18:15:49.198662 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9226b9ff-6686-4058-a385-0eb2291fe998 req-f54f4c4b-642d-462d-931f-5743ff425972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048112 Oct 28 18:15:49.199538 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1546/3214] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:49.206863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:49.208406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:49.219476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.220053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.220639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.221473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.221934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.222517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.284431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:15:49.284906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:15:49.285754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:15:49.286172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:15:49.286642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:15:49.297307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.297923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.298359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.299548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.300333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.300949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.321578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:15:49.328331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Getting quotas for user b69293ed019d421aa34dd62c232eb131 and project cdc800102cc1463eab50923ae3bcd9e6. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:15:49.361580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:15:49.364480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:15:49.392557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:49.404894 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b87d1995-2006-4f66-beec-5739e092b54a tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1317 microversion: 2.1 time: 0.202905 Oct 28 18:15:49.407456 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1547/3215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:49 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:49.412443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b836cd87-1c2d-49f0-bda8-a3f1343dafc6 req-d5cf013b-7841-4538-987f-fcec240364f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1794aa-26a9-4355-8105-83220c147e61", "name": "network-vif-plugged", "status": "completed", "tag": "2ad3be5e-421c-4be7-a7a1-c2de9ea3d763"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:49.424859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b836cd87-1c2d-49f0-bda8-a3f1343dafc6 req-d5cf013b-7841-4538-987f-fcec240364f6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.425980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b836cd87-1c2d-49f0-bda8-a3f1343dafc6 req-d5cf013b-7841-4538-987f-fcec240364f6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.426638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b836cd87-1c2d-49f0-bda8-a3f1343dafc6 req-d5cf013b-7841-4538-987f-fcec240364f6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.441017 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b836cd87-1c2d-49f0-bda8-a3f1343dafc6 req-d5cf013b-7841-4538-987f-fcec240364f6 service nova] Creating event network-vif-plugged:2ad3be5e-421c-4be7-a7a1-c2de9ea3d763 for instance 2c1794aa-26a9-4355-8105-83220c147e61 on n-h2-862404-2 Oct 28 18:15:49.444923 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5959d935-e41b-4eee-9abc-cef1a3717b4c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640342 Oct 28 18:15:49.446992 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1669/3216] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:15:49.447353 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b836cd87-1c2d-49f0-bda8-a3f1343dafc6 req-d5cf013b-7841-4538-987f-fcec240364f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038150 Oct 28 18:15:49.448066 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1548/3217] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:49.481658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b929a4fc-1f20-4605-b25d-fc7ef65bc2fe req-c10dc120-d5c6-45ad-9816-360728b6590a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61aba0cb-8e75-4f77-8d49-f5a452d41cd2", "name": "network-vif-deleted", "tag": "bd51dc99-644e-4322-a676-6c680781d054"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:49.485668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2be09e71-a953-459f-a80c-dafc41530325 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:49.486982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2be09e71-a953-459f-a80c-dafc41530325 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:49.517661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b929a4fc-1f20-4605-b25d-fc7ef65bc2fe req-c10dc120-d5c6-45ad-9816-360728b6590a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.518189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b929a4fc-1f20-4605-b25d-fc7ef65bc2fe req-c10dc120-d5c6-45ad-9816-360728b6590a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.518604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b929a4fc-1f20-4605-b25d-fc7ef65bc2fe req-c10dc120-d5c6-45ad-9816-360728b6590a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.533918 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b929a4fc-1f20-4605-b25d-fc7ef65bc2fe req-c10dc120-d5c6-45ad-9816-360728b6590a service nova] Creating event network-vif-deleted:bd51dc99-644e-4322-a676-6c680781d054 for instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 on n-h1-862404-2 Oct 28 18:15:49.539690 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b929a4fc-1f20-4605-b25d-fc7ef65bc2fe req-c10dc120-d5c6-45ad-9816-360728b6590a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061937 Oct 28 18:15:49.541524 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1549/3218] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:15:49.607631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2be09e71-a953-459f-a80c-dafc41530325 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:49.631894 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2be09e71-a953-459f-a80c-dafc41530325 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1215 microversion: 2.1 time: 0.177645 Oct 28 18:15:49.637681 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1670/3219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:49 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:49.833172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:49.834695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:49.853718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.854543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.855342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.857598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.858329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.860584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.958455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:49.961181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:49.970777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.971588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.972484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.973402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.974124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.975175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.103287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:50.117133 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7fcb71aa-48c9-4eeb-aec9-b4db379e588c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.293051 Oct 28 18:15:50.132995 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1550/3220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:49 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:50.142200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:50.143311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:50.154513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.156210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.158494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.159261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.159980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.164232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.333705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:50.344817 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3b23c11-1ad7-47f2-9077-12d158399a1a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1210 microversion: 2.1 time: 0.208989 Oct 28 18:15:50.355403 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1551/3221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:50 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1210 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:50.364277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:50.364617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:50.373122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.373760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.374205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.375529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.376227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.376682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.408639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:50.421979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-faecfe47-5e45-4701-9e89-7d723bdfc2e8 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1526 microversion: 2.1 time: 0.470003 Oct 28 18:15:50.424576 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1671/3222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:49 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1526 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:50.434330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.435014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.435688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.436512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lazy-loading 'fault' on Instance uuid 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:50.437939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:50.438976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:50.455547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.456446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.457194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.458139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.458975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.459698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.499259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:50.512521 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-91d74dfd-8664-471e-84ba-7ae71bfd76c1 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 200 len: 1306 microversion: 2.1 time: 0.158670 Oct 28 18:15:50.513597 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1552/3223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:50 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:50.661376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:50.662123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:50.678042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.679072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.691446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.694902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.697671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.698991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.787387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:50.791286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:50.797798 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e627eeb7-7f26-4cac-a2fa-f600a5f40aad tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1211 microversion: 2.1 time: 0.140382 Oct 28 18:15:50.803864 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1553/3224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:50 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:50.808781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:50.818703 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a0e197f-c11b-459a-a9a5-ae10cecca5c1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1317 microversion: 2.1 time: 0.391736 Oct 28 18:15:50.825725 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1672/3225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:50 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:51.146439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.147259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:51.156189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.156985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.157702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.158609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.159062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.159717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.199748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.202542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:51.222629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.229051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.230741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.235021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.236034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.236774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.384566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:51.400153 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-47ae0773-5498-4504-b15c-82b85af0c9b6 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.258160 Oct 28 18:15:51.405261 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1554/3226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:51.412495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b4a9b693-c76f-4eb4-8c41-06e73eac4547 req-68d05382-5a38-4e21-8637-5e01337ada73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db87eca6-1a77-4d03-845a-bef6c5cc172a", "name": "network-vif-deleted", "tag": "48244433-9e7a-4603-b111-c631d5ca8a7b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:51.438872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b4a9b693-c76f-4eb4-8c41-06e73eac4547 req-68d05382-5a38-4e21-8637-5e01337ada73 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.439784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b4a9b693-c76f-4eb4-8c41-06e73eac4547 req-68d05382-5a38-4e21-8637-5e01337ada73 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.440597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b4a9b693-c76f-4eb4-8c41-06e73eac4547 req-68d05382-5a38-4e21-8637-5e01337ada73 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.458995 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b4a9b693-c76f-4eb4-8c41-06e73eac4547 req-68d05382-5a38-4e21-8637-5e01337ada73 service nova] Creating event network-vif-deleted:48244433-9e7a-4603-b111-c631d5ca8a7b for instance db87eca6-1a77-4d03-845a-bef6c5cc172a on n-h2-862404-2 Oct 28 18:15:51.466115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b4a9b693-c76f-4eb4-8c41-06e73eac4547 req-68d05382-5a38-4e21-8637-5e01337ada73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056932 Oct 28 18:15:51.467302 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1555/3227] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:51.474557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.475630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:51.485269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.485945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.486797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.487870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.488740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.489227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.578645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:51.588357 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-013d8306-442c-49a6-8aa6-9088f6a5a797 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1266 microversion: 2.1 time: 0.118719 Oct 28 18:15:51.589239 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1556/3228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:51.594044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.594862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:51.600996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.601687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.602272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.603204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.604001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.604629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.639271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:51.648617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.649113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.649554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.650644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lazy-loading 'fault' on Instance uuid db87eca6-1a77-4d03-845a-bef6c5cc172a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:51.650840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:51.652816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:51.654402 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f94fc978-a1d7-4ef5-861e-745df17da0e0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 2943 microversion: 2.32 time: 0.459306 Oct 28 18:15:51.668112 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1673/3229] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 2943 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:15:51.685214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.686020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:51.693486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.693963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.694590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.695471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.696078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.696559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.700165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:51.709162 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c0aa1836-77c7-4e67-9d23-e0fba7185622 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1314 microversion: 2.1 time: 0.118814 Oct 28 18:15:51.710073 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1557/3230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1314 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:51.715338 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:51.715592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.716237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 HTTP/1.1 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '61aba0cb-8e75-4f77-8d49-f5a452d41cd2'} Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:51.717608 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:51.723540 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d38de2c6-8d1f-43a1-96a6-1ce8088d9028 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 404 len: 111 microversion: 2.1 time: 0.052238 Oct 28 18:15:51.724175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.724175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.724607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.725508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.726106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.726473 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1674/3231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:51.726757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.731878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e03afc7f-3853-42e6-b309-4a8a73cec00b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de2bd430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.857235 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5cdbe3bf-8917-47f1-aa9a-dd5f0337e506 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.145811 Oct 28 18:15:51.858430 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1558/3232] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d/os-interface => generated 1829 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:15:51.863284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.864106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:51.870696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.871529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.872188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.873165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.873846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.875051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.949363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:51.959661 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a222b1f6-6761-4dc5-9138-6e2560960cb0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1211 microversion: 2.1 time: 0.099629 Oct 28 18:15:51.960577 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1559/3233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:51.965539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.966164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:51.967316 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e03afc7f-3853-42e6-b309-4a8a73cec00b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5" status: 202 len: 0 microversion: 2.1 time: 0.239605 Oct 28 18:15:51.969062 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1675/3234] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:51 2022] DELETE /compute/v2.1/os-security-groups/2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:51.976563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.977055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.977484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.978184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.978564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42c0df7f-ed9d-4f4c-84f3-d7e4307b3d8d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de44ce50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.978702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.979049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.135052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:52.144588 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9f56a33d-3fd8-41a0-95cc-d97e7dfc8127 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 200 len: 1505 microversion: 2.1 time: 0.183140 Oct 28 18:15:52.145368 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1560/3235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:52.167182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.167983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:52.170072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:52.175942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.176441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.176885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.176995 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42c0df7f-ed9d-4f4c-84f3-d7e4307b3d8d tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/39ac65c4-0a4f-444a-b312-b8097bdabf14" status: 202 len: 0 microversion: 2.1 time: 0.203606 Oct 28 18:15:52.177477 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1676/3236] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:51 2022] DELETE /compute/v2.1/os-security-groups/39ac65c4-0a4f-444a-b312-b8097bdabf14 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:15:52.177611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.178045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.178552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.190078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bede3be2-1520-49ad-a434-40c98211a73a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'create', calling method: .version_select at 0x7f78de0ee670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-379269544", "description": "tempest-description-899462332"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:52.334085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:52.342414 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a2e889fb-14f2-4782-86ec-1b7b091db699 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a" status: 200 len: 1505 microversion: 2.1 time: 0.179011 Oct 28 18:15:52.343779 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bede3be2-1520-49ad-a434-40c98211a73a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.157005 Oct 28 18:15:52.345394 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1677/3237] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:15:52 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:52.352088 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1561/3238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:52 2022] GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:52.358780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b47dde97-6e82-4550-a363-99a5b6c48878 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Action: 'update', calling method: .version_select at 0x7f78ddff2af0>, body: {"security_group": {"name": "tempest-sg-hth-1717772465", "description": "tempest-description-hth-878212944"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:52.368578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.369093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:52.376435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.377050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.377413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.378573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.379051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.379482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.410220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:52.496897 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-904f1554-a4b7-4973-bebf-9c17f414ae4d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a" status: 204 len: 0 microversion: 2.1 time: 0.132298 Oct 28 18:15:52.497753 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1562/3239] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:52 2022] DELETE /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:15:52.507118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.507914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:52.515932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.516364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.516842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.517564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.518020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.518451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.531584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b47dde97-6e82-4550-a363-99a5b6c48878 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/71db5a4e-20de-4106-87bf-dde54dfb8716" status: 200 len: 217 microversion: 2.1 time: 0.176933 Oct 28 18:15:52.540614 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1678/3240] 10.222.0.16 () {60 vars in 1290 bytes} [Fri Oct 28 18:15:52 2022] PUT /compute/v2.1/os-security-groups/71db5a4e-20de-4106-87bf-dde54dfb8716 => generated 217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:52.545758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.546494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:52.561502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.562622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.563258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.564009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.567146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.567735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.598146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:52.658743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:52.666890 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b9c6136f-8ff7-47d9-883d-8ea453afb0f3 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.163965 Oct 28 18:15:52.667484 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1563/3241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:52 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:52.672523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e407739e-ea81-4a46-8eed-bda57b9c9eab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de2488b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.685512 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0afd4662-6946-484d-96bb-dbbc2b552834 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 204 len: 0 microversion: 2.1 time: 0.143361 Oct 28 18:15:52.686438 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1679/3242] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:52 2022] DELETE /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:52.692535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.693285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:52.699251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.699741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.700221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.700927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.701388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.701815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.730142 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e407739e-ea81-4a46-8eed-bda57b9c9eab tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/71db5a4e-20de-4106-87bf-dde54dfb8716" status: 200 len: 217 microversion: 2.1 time: 0.061575 Oct 28 18:15:52.730737 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1564/3243] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:15:52 2022] GET /compute/v2.1/os-security-groups/71db5a4e-20de-4106-87bf-dde54dfb8716 => generated 217 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:52.735766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.736454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:52.742768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.743262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.743694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.744435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.744890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.745318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.767718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:52.775799 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3a8e395-733f-49d5-a6e5-3490c4337599 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1274 microversion: 2.1 time: 0.087646 Oct 28 18:15:52.776593 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1680/3244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:52 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:52.787157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.787833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:52.794110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.794738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.795190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.795936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.796434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.796873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.829787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.830501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.830950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.831407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lazy-loading 'fault' on Instance uuid db87eca6-1a77-4d03-845a-bef6c5cc172a {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:52.876493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:52.881437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:52.884373 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24ad021e-edf4-420b-a0be-13f8fbadfa3e tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1314 microversion: 2.1 time: 0.101034 Oct 28 18:15:52.884972 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1681/3245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:52 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1314 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:52.889374 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5af063b0-ea31-4934-ba0e-e0db259b03d3 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a" status: 200 len: 1511 microversion: 2.1 time: 0.157667 Oct 28 18:15:52.889525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-adebd607-d752-4e0b-9467-bf17fa81bb10 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de44c160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.890317 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1565/3246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:52 2022] GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:52.984992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.985564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:52.993097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.993824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.994332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.995121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.995657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.996181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.086958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:53.096086 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f51a1fc5-0e02-4504-a695-b9d0722d79d6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1267 microversion: 2.1 time: 0.115760 Oct 28 18:15:53.106112 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1566/3247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:52 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:53.198405 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-adebd607-d752-4e0b-9467-bf17fa81bb10 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/71db5a4e-20de-4106-87bf-dde54dfb8716" status: 202 len: 0 microversion: 2.1 time: 0.312352 Oct 28 18:15:53.199300 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1682/3248] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:52 2022] DELETE /compute/v2.1/os-security-groups/71db5a4e-20de-4106-87bf-dde54dfb8716 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:53.207255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.207768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:53.215727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.216189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.217431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.218895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.219520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.219975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.235677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 HTTP/1.1 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '61aba0cb-8e75-4f77-8d49-f5a452d41cd2'} Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:53.237404 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17e57820-e15d-4121-9062-15dbe4dc340a tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 404 len: 111 microversion: 2.1 time: 0.035510 Oct 28 18:15:53.241470 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1567/3249] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:53 2022] DELETE /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:53.250690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.251333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 61aba0cb-8e75-4f77-8d49-f5a452d41cd2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:53.259134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.259492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.259977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.260691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.261557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.261856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.276369 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 HTTP/1.1 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '61aba0cb-8e75-4f77-8d49-f5a452d41cd2'} Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.278089 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Instance 61aba0cb-8e75-4f77-8d49-f5a452d41cd2 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2cd3775-66e2-4a42-852a-62cf1ae1a04e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2" status: 404 len: 111 microversion: 2.1 time: 0.033721 Oct 28 18:15:53.283870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1683/3250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:53 2022] GET /compute/v2.1/servers/61aba0cb-8e75-4f77-8d49-f5a452d41cd2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:53.289354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8afa0f2c-5531-4d7c-b9e6-408b14799ae4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78dd80f790>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.314629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-8afa0f2c-5531-4d7c-b9e6-408b14799ae4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:15:53.315382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-8afa0f2c-5531-4d7c-b9e6-408b14799ae4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 not found {{(pid=120679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:15:53.316188 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8afa0f2c-5531-4d7c-b9e6-408b14799ae4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 does not exist Oct 28 18:15:53.316188 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-e41b61ba-a520-4d16-a02a-846e37c6d487'] Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8afa0f2c-5531-4d7c-b9e6-408b14799ae4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-security-groups/39ac65c4-0a4f-444a-b312-b8097bdabf14 HTTP/1.1 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 does not exist Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-e41b61ba-a520-4d16-a02a-846e37c6d487'] Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '39ac65c4-0a4f-444a-b312-b8097bdabf14'} Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:15:53.318219 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 does not exist Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e41b61ba-a520-4d16-a02a-846e37c6d487'] Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 does not exist Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e41b61ba-a520-4d16-a02a-846e37c6d487'] Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 does not exist Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e41b61ba-a520-4d16-a02a-846e37c6d487'] Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 does not exist Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e41b61ba-a520-4d16-a02a-846e37c6d487'] Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8afa0f2c-5531-4d7c-b9e6-408b14799ae4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 39ac65c4-0a4f-444a-b312-b8097bdabf14 does not exist Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-e41b61ba-a520-4d16-a02a-846e37c6d487'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:53.322923 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8afa0f2c-5531-4d7c-b9e6-408b14799ae4 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/39ac65c4-0a4f-444a-b312-b8097bdabf14" status: 404 len: 194 microversion: 2.1 time: 0.035899 Oct 28 18:15:53.326505 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1568/3251] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:53 2022] DELETE /compute/v2.1/os-security-groups/39ac65c4-0a4f-444a-b312-b8097bdabf14 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:53.332018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7be1d6eb-8553-44bb-b4af-2977d41c5f6b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de44c430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.357066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-7be1d6eb-8553-44bb-b4af-2977d41c5f6b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 does not exist", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:15:53.357682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.security_group_api [None req-7be1d6eb-8553-44bb-b4af-2977d41c5f6b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 not found {{(pid=120680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:15:53.358211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7be1d6eb-8553-44bb-b4af-2977d41c5f6b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 does not exist Oct 28 18:15:53.358211 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-7441f502-0fd8-47e7-8eb4-00dea0afa94d'] Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7be1d6eb-8553-44bb-b4af-2977d41c5f6b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-security-groups/2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 HTTP/1.1 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: exception: Security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 does not exist Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-7441f502-0fd8-47e7-8eb4-00dea0afa94d'] Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5'} Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:15:53.360738 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 does not exist Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7441f502-0fd8-47e7-8eb4-00dea0afa94d'] Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 does not exist Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7441f502-0fd8-47e7-8eb4-00dea0afa94d'] Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 does not exist Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7441f502-0fd8-47e7-8eb4-00dea0afa94d'] Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 does not exist Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7441f502-0fd8-47e7-8eb4-00dea0afa94d'] Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7be1d6eb-8553-44bb-b4af-2977d41c5f6b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 does not exist Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-7441f502-0fd8-47e7-8eb4-00dea0afa94d'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7be1d6eb-8553-44bb-b4af-2977d41c5f6b tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5" status: 404 len: 194 microversion: 2.1 time: 0.034447 Oct 28 18:15:53.365111 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1684/3252] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:53 2022] DELETE /compute/v2.1/os-security-groups/2ba1aa38-0b39-4ad2-8362-2785ef7ddbe5 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:53.373739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-628b0653-d6ca-4361-bfbb-315f990bbb3e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de259b80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.398236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-628b0653-d6ca-4361-bfbb-315f990bbb3e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:15:53.398859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-628b0653-d6ca-4361-bfbb-315f990bbb3e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 8a780918-f366-4dd6-abc3-098b02ebd1cf not found {{(pid=120679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:15:53.399548 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-628b0653-d6ca-4361-bfbb-315f990bbb3e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:15:53.399548 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-8d55bd79-9035-4129-aac4-54350173e4a4'] Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-628b0653-d6ca-4361-bfbb-315f990bbb3e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-security-groups/8a780918-f366-4dd6-abc3-098b02ebd1cf HTTP/1.1 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-8d55bd79-9035-4129-aac4-54350173e4a4'] Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '8a780918-f366-4dd6-abc3-098b02ebd1cf'} Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:15:53.401431 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d55bd79-9035-4129-aac4-54350173e4a4'] Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d55bd79-9035-4129-aac4-54350173e4a4'] Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d55bd79-9035-4129-aac4-54350173e4a4'] Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d55bd79-9035-4129-aac4-54350173e4a4'] Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-628b0653-d6ca-4361-bfbb-315f990bbb3e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 8a780918-f366-4dd6-abc3-098b02ebd1cf does not exist Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-8d55bd79-9035-4129-aac4-54350173e4a4'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:53.406576 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-628b0653-d6ca-4361-bfbb-315f990bbb3e tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8a780918-f366-4dd6-abc3-098b02ebd1cf" status: 404 len: 194 microversion: 2.1 time: 0.033058 Oct 28 18:15:53.409700 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1569/3253] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:53 2022] DELETE /compute/v2.1/os-security-groups/8a780918-f366-4dd6-abc3-098b02ebd1cf => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:53.412604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4359cde8-ded6-4ff9-b6a3-b2325eef8ecd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de24c550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.436966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-4359cde8-ded6-4ff9-b6a3-b2325eef8ecd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:15:53.437715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.security_group_api [None req-4359cde8-ded6-4ff9-b6a3-b2325eef8ecd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 not found {{(pid=120680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:15:53.438285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4359cde8-ded6-4ff9-b6a3-b2325eef8ecd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:15:53.438285 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-d6d355a2-6f1d-4a8c-ac1f-ddd75cf1e8b7'] Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4359cde8-ded6-4ff9-b6a3-b2325eef8ecd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-security-groups/8f93294a-ef8d-41d2-b2c7-183dd7509250 HTTP/1.1 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: exception: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-d6d355a2-6f1d-4a8c-ac1f-ddd75cf1e8b7'] Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8f93294a-ef8d-41d2-b2c7-183dd7509250'} Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:15:53.440330 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6d355a2-6f1d-4a8c-ac1f-ddd75cf1e8b7'] Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6d355a2-6f1d-4a8c-ac1f-ddd75cf1e8b7'] Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6d355a2-6f1d-4a8c-ac1f-ddd75cf1e8b7'] Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6d355a2-6f1d-4a8c-ac1f-ddd75cf1e8b7'] Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4359cde8-ded6-4ff9-b6a3-b2325eef8ecd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 8f93294a-ef8d-41d2-b2c7-183dd7509250 does not exist Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-d6d355a2-6f1d-4a8c-ac1f-ddd75cf1e8b7'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:53.444837 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4359cde8-ded6-4ff9-b6a3-b2325eef8ecd tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8f93294a-ef8d-41d2-b2c7-183dd7509250" status: 404 len: 194 microversion: 2.1 time: 0.034739 Oct 28 18:15:53.448698 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1685/3254] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:53 2022] DELETE /compute/v2.1/os-security-groups/8f93294a-ef8d-41d2-b2c7-183dd7509250 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:53.453558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ddb30b67-d25f-4fa0-b551-d04a9bd365e2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78e239f160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.477048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-ddb30b67-d25f-4fa0-b551-d04a9bd365e2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist", "detail": ""}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:15:53.477762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.security_group_api [None req-ddb30b67-d25f-4fa0-b551-d04a9bd365e2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 not found {{(pid=120679) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:15:53.478281 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ddb30b67-d25f-4fa0-b551-d04a9bd365e2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:15:53.478281 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-41d618a0-6500-4935-b360-7d9b2b1a197f'] Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ddb30b67-d25f-4fa0-b551-d04a9bd365e2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-security-groups/811a6ed1-4f71-413a-a997-0d31ccb7ca52 HTTP/1.1 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: exception: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-41d618a0-6500-4935-b360-7d9b2b1a197f'] Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '811a6ed1-4f71-413a-a997-0d31ccb7ca52'} Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:15:53.480229 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d618a0-6500-4935-b360-7d9b2b1a197f'] Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d618a0-6500-4935-b360-7d9b2b1a197f'] Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d618a0-6500-4935-b360-7d9b2b1a197f'] Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41d618a0-6500-4935-b360-7d9b2b1a197f'] Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ddb30b67-d25f-4fa0-b551-d04a9bd365e2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 811a6ed1-4f71-413a-a997-0d31ccb7ca52 does not exist Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: Neutron server returns request_ids: ['req-41d618a0-6500-4935-b360-7d9b2b1a197f'] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ddb30b67-d25f-4fa0-b551-d04a9bd365e2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/811a6ed1-4f71-413a-a997-0d31ccb7ca52" status: 404 len: 194 microversion: 2.1 time: 0.032258 Oct 28 18:15:53.485393 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1570/3255] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:53 2022] DELETE /compute/v2.1/os-security-groups/811a6ed1-4f71-413a-a997-0d31ccb7ca52 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:15:53.492802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a0cf246-b58c-4871-9644-8a15683cf701 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de44c040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.516115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-0a0cf246-b58c-4871-9644-8a15683cf701 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:15:53.516717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.security_group_api [None req-0a0cf246-b58c-4871-9644-8a15683cf701 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Neutron security group 352fb761-bad0-4136-b6f0-ca6793776cf1 not found {{(pid=120680) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 18:15:53.517236 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-0a0cf246-b58c-4871-9644-8a15683cf701 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:15:53.517236 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-221cda70-13d8-4601-bb04-203c18ab4a26'] Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a0cf246-b58c-4871-9644-8a15683cf701 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1 HTTP/1.1 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: exception: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-221cda70-13d8-4601-bb04-203c18ab4a26'] Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '352fb761-bad0-4136-b6f0-ca6793776cf1'} Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:15:53.519097 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-221cda70-13d8-4601-bb04-203c18ab4a26'] Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-221cda70-13d8-4601-bb04-203c18ab4a26'] Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-221cda70-13d8-4601-bb04-203c18ab4a26'] Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-221cda70-13d8-4601-bb04-203c18ab4a26'] Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a0cf246-b58c-4871-9644-8a15683cf701 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Security group 352fb761-bad0-4136-b6f0-ca6793776cf1 does not exist Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: Neutron server returns request_ids: ['req-221cda70-13d8-4601-bb04-203c18ab4a26'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:53.523692 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a0cf246-b58c-4871-9644-8a15683cf701 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1" status: 404 len: 194 microversion: 2.1 time: 0.032310 Oct 28 18:15:53.527264 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1686/3256] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:53 2022] DELETE /compute/v2.1/os-security-groups/352fb761-bad0-4136-b6f0-ca6793776cf1 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:53.533708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.534782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:53.542475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.543259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.543765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.544564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.545028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.545444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.573202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:15:53.652129 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c3cf023d-ce27-40fc-80db-2b52a1822883 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 204 len: 0 microversion: 2.1 time: 0.122158 Oct 28 18:15:53.656425 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1571/3257] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:53 2022] DELETE /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:15:53.668825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.669522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:53.676612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.677138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.677579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.678283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.678923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.679359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.692075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.692989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:53.700236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.700737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.701201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.701867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.702320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.703304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.733324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:53.849233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:53.857099 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-322011b3-3303-44cf-abd2-26fa753f2c71 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1644 microversion: 2.1 time: 0.192463 Oct 28 18:15:53.857673 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1687/3258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:53 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1644 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:53.864468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.865196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:53.871069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.871633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.872195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.872825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:53.873137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.873607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.874037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.882116 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d32b2d97-d163-4e92-9d7f-1576a1aceb33 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.194599 Oct 28 18:15:53.882805 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1572/3259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:53 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:53.907567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.908202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:53.914192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.914673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.915134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.915847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.916304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.916724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.938307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:53.946290 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c46f2068-694c-4ce1-8871-e51e4bdb6c81 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1274 microversion: 2.1 time: 0.086070 Oct 28 18:15:53.946875 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1688/3260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:53 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:53.949255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.949746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.950189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.950973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lazy-loading 'fault' on Instance uuid db87eca6-1a77-4d03-845a-bef6c5cc172a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:53.951279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.951914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:53.958901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.959385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.959847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.960545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.960994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.961416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.996484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:54.004426 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1765e577-2f91-4ba4-aef5-890a1518cf32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1314 microversion: 2.1 time: 0.100656 Oct 28 18:15:54.005015 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1573/3261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:53 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1314 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:54.100454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:54.109089 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5beaa71-d882-4114-9bee-720c060d19b8 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a" status: 200 len: 1511 microversion: 2.1 time: 0.161201 Oct 28 18:15:54.109666 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1689/3262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:53 2022] GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:54.125996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:54.126601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:54.132659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:54.133424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:54.134296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:54.135222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:54.135890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:54.136718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:54.215843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:54.223966 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ab1681b7-e699-4fab-8386-04dfab96a6b5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1267 microversion: 2.1 time: 0.102756 Oct 28 18:15:54.224550 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1574/3263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:54 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:54.882854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:54.883482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:54.891716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:54.904008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:54.904988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:54.906926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:54.907625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:54.908670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:54.909164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:54.909624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:54.922567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:54.924822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:54.925680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:54.928741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:54.929475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:54.931714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.242751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:55.252712 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-52172905-001f-4fe5-9e5d-0513803b699b tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.351161 Oct 28 18:15:55.253696 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1575/3264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:54 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:55.258781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:55.259576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:55.267029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.267516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.268047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.268944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.269400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.269827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.431573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:55.442195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:55.445056 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ead23879-d9c0-46ec-b269-3d0dd987a928 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1644 microversion: 2.1 time: 0.567673 Oct 28 18:15:55.445782 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1690/3265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:54 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1644 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:55.453491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:55.454363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:55.462969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.464203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.464902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.465848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.466527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.467180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.524887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.526484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.527231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.527802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lazy-loading 'fault' on Instance uuid db87eca6-1a77-4d03-845a-bef6c5cc172a {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:55.632011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:55.634610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3ce763c739446186720e457592ce96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff6baa638641ffafc9f46981c8e465', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:55.644745 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1705f187-3dea-46f1-8653-d60fbc0629f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1314 microversion: 2.1 time: 0.389776 Oct 28 18:15:55.645597 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60ffc7bc-ed18-48be-a3cb-1de42b3d1f32 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 200 len: 1314 microversion: 2.1 time: 0.198068 Oct 28 18:15:55.645956 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1576/3266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:55 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:55.647101 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1691/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:55 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:55.654743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:55.655947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:55.662283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.663049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.663735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.665390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.666163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.666817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.668108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:55.668676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:55.675726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.676349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.676794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.677513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.677974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.678405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.758754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:55.771064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c9e51c0-777f-484b-86da-a7c7365ba03f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1273 microversion: 2.1 time: 0.119248 Oct 28 18:15:55.773003 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1692/3268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:55 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:56.226608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-40eeaf53-4385-40b3-9039-ca01cdf69ed5 req-961de216-3c7a-4e3e-bd3a-f9ad9f2f60ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1794aa-26a9-4355-8105-83220c147e61", "name": "network-vif-deleted", "tag": "2ad3be5e-421c-4be7-a7a1-c2de9ea3d763"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:56.257561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40eeaf53-4385-40b3-9039-ca01cdf69ed5 req-961de216-3c7a-4e3e-bd3a-f9ad9f2f60ce service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.258257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40eeaf53-4385-40b3-9039-ca01cdf69ed5 req-961de216-3c7a-4e3e-bd3a-f9ad9f2f60ce service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.258899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40eeaf53-4385-40b3-9039-ca01cdf69ed5 req-961de216-3c7a-4e3e-bd3a-f9ad9f2f60ce service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.278502 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-40eeaf53-4385-40b3-9039-ca01cdf69ed5 req-961de216-3c7a-4e3e-bd3a-f9ad9f2f60ce service nova] Creating event network-vif-deleted:2ad3be5e-421c-4be7-a7a1-c2de9ea3d763 for instance 2c1794aa-26a9-4355-8105-83220c147e61 on n-h2-862404-2 Oct 28 18:15:56.305375 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-40eeaf53-4385-40b3-9039-ca01cdf69ed5 req-961de216-3c7a-4e3e-bd3a-f9ad9f2f60ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082820 Oct 28 18:15:56.310237 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1693/3269] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:56.319899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:56.322410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:56.344289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.344972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.345626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.346511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.347132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.347721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.413395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:56.432899 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c864f73-6595-4dfb-bc1b-8c50ef7505ae tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a" status: 200 len: 1511 microversion: 2.1 time: 0.785809 Oct 28 18:15:56.433831 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1577/3270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:55 2022] GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a => generated 1511 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:56.475440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:56.476358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:56.484635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.485241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.485765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.487360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.487953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.488467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.757897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:56.771909 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0af90361-47d9-4657-957d-b18a0e14f11d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.460267 Oct 28 18:15:56.789730 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1694/3271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:56 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:56.798330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:56.799615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] [instance: db87eca6-1a77-4d03-845a-bef6c5cc172a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:56.806339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.807211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.808727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.810033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.811272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.811961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.832611 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] HTTP exception thrown: Instance db87eca6-1a77-4d03-845a-bef6c5cc172a could not be found. Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Request method failure captured: Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a HTTP/1.1 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwBo7n6odGwwJgJPS333FbXiLB4-j2fAytMUmJCtpP834D_Y_QelC4wjhasDI-nyZxG2CLwG0jxFeNkcwnUV-txcXb-m79O1UmRpyicSGF4xIt8Xqups8qbT-RBJQwDM9pQU3xsRgLAHei6BmJqL609C9R3FytCab5ncKHPhzuVRmY Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 9aff6baa638641ffafc9f46981c8e465 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9aff6baa638641ffafc9f46981c8e465", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9aff6baa638641ffafc9f46981c8e465"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 9aff6baa638641ffafc9f46981c8e465 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1623080635 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPsAssociationTestJSON-1623080635-project Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 6f3ce763c739446186720e457592ce96 Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1623080635-project Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance db87eca6-1a77-4d03-845a-bef6c5cc172a could not be found. Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'db87eca6-1a77-4d03-845a-bef6c5cc172a'} Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db87eca6-1a77-4d03-845a-bef6c5cc172a could not be found. Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db87eca6-1a77-4d03-845a-bef6c5cc172a could not be found. Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:56.835493 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:56.841371 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:56.841371 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:56.841371 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:56.841371 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:56.841371 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:56.841371 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:56.841371 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db87eca6-1a77-4d03-845a-bef6c5cc172a could not be found. Oct 28 18:15:56.841371 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:56.856922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] Returning 404 to user: Instance db87eca6-1a77-4d03-845a-bef6c5cc172a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:56.861028 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b672205-1df6-462a-b81b-296f24b68725 tempest-FloatingIPsAssociationTestJSON-1623080635 tempest-FloatingIPsAssociationTestJSON-1623080635-project] 10.222.0.16 "GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a" status: 404 len: 111 microversion: 2.1 time: 0.069428 Oct 28 18:15:56.868306 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1695/3272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:56 2022] GET /compute/v2.1/servers/db87eca6-1a77-4d03-845a-bef6c5cc172a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:56.885713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:56.887983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:56.901404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:56.917293 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-16012402-9962-49df-bee0-932b902a8167 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1644 microversion: 2.1 time: 0.444950 Oct 28 18:15:56.918759 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1578/3273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:56 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1644 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:56.920447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.924007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.924692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.927591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.931619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.932436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.942809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:56.946294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:56.960021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.960530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.964193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.966290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.971420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.972103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.403294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:57.416824 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-719efb98-7872-4956-af4d-da7323dc29a6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.490688 Oct 28 18:15:57.419123 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1579/3274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:56 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:57.438474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-24ec0d5c-4a22-47ae-8c6e-b80bbcf650cb req-855f04b0-9c59-4da3-801a-972507d92799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af47463-f00f-41e3-b23a-bd68c7309c1f", "name": "network-vif-deleted", "tag": "4c54577c-77d7-4ddc-929c-687b5890d4d0"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:57.451680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-24ec0d5c-4a22-47ae-8c6e-b80bbcf650cb req-855f04b0-9c59-4da3-801a-972507d92799 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.453029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-24ec0d5c-4a22-47ae-8c6e-b80bbcf650cb req-855f04b0-9c59-4da3-801a-972507d92799 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.453957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-24ec0d5c-4a22-47ae-8c6e-b80bbcf650cb req-855f04b0-9c59-4da3-801a-972507d92799 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.469099 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-24ec0d5c-4a22-47ae-8c6e-b80bbcf650cb req-855f04b0-9c59-4da3-801a-972507d92799 service nova] Creating event network-vif-deleted:4c54577c-77d7-4ddc-929c-687b5890d4d0 for instance 7af47463-f00f-41e3-b23a-bd68c7309c1f on n-h1-862404-2 Oct 28 18:15:57.476059 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-24ec0d5c-4a22-47ae-8c6e-b80bbcf650cb req-855f04b0-9c59-4da3-801a-972507d92799 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043391 Oct 28 18:15:57.477285 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1580/3275] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:57.483534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:57.485880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:57.493278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.494047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.494488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.495206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.495665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.496134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.565296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.566104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.566522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.567170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lazy-loading 'fault' on Instance uuid 6113d4e1-1747-4611-a2c5-fe248ae3ee3a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:57.628026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:57.652644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb7037d2702444cbc9acc2004641abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f6ba6ec4174bd592c3bd43dad948c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:57.661956 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2a82b01-6c64-44b3-a263-a48d0217763b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1314 microversion: 2.1 time: 0.792727 Oct 28 18:15:57.668021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1696/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:56 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:57.675370 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6667db73-617a-46bf-b075-78d04e0d10d4 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a" status: 200 len: 1307 microversion: 2.1 time: 0.196647 Oct 28 18:15:57.676507 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1581/3277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:57 2022] GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:57.803452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:57.804248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:57.829044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.830111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.830748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.831793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.832440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.834300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.949330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:57.950085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:57.970539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.971098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.971550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.974158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.974646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.975122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.060935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.061744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.063252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.064008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lazy-loading 'fault' on Instance uuid 7af47463-f00f-41e3-b23a-bd68c7309c1f {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:15:58.154125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3c71f336ac403cb508c00d17c0ee07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67daef63361f4374b7562dd1029e6a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:58.167695 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e717e75e-41dc-4e64-b014-5520328f3529 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 200 len: 1306 microversion: 2.1 time: 0.223969 Oct 28 18:15:58.180107 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1582/3278] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:57 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 1306 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:58.225113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:58.240681 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1cb6b26c-0324-41ce-85a7-2f5849eabc43 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.447012 Oct 28 18:15:58.257480 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1697/3279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:57 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:58.341350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f0a8a485-9db4-4282-bcc8-80d22177ce3b req-89074a76-5883-4eb8-82ad-bc5ad64c20ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6113d4e1-1747-4611-a2c5-fe248ae3ee3a", "name": "network-vif-deleted", "tag": "c193b63a-a142-4e22-8ca7-bd865d48b397"}, {"name": "network-changed", "server_uuid": "1f49b0af-abe0-4242-9f3d-1d789b7965dc", "tag": "bbfe69b9-90a5-4025-9383-d47f8e337e61"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:58.360048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f0a8a485-9db4-4282-bcc8-80d22177ce3b req-89074a76-5883-4eb8-82ad-bc5ad64c20ff service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.362483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f0a8a485-9db4-4282-bcc8-80d22177ce3b req-89074a76-5883-4eb8-82ad-bc5ad64c20ff service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.366008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f0a8a485-9db4-4282-bcc8-80d22177ce3b req-89074a76-5883-4eb8-82ad-bc5ad64c20ff service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.385297 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f0a8a485-9db4-4282-bcc8-80d22177ce3b req-89074a76-5883-4eb8-82ad-bc5ad64c20ff service nova] Creating event network-vif-deleted:c193b63a-a142-4e22-8ca7-bd865d48b397 for instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a on n-h1-862404-2 Oct 28 18:15:58.386135 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f0a8a485-9db4-4282-bcc8-80d22177ce3b req-89074a76-5883-4eb8-82ad-bc5ad64c20ff service nova] Creating event network-changed:bbfe69b9-90a5-4025-9383-d47f8e337e61 for instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc on n-h2-862404-2 Oct 28 18:15:58.397780 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f0a8a485-9db4-4282-bcc8-80d22177ce3b req-89074a76-5883-4eb8-82ad-bc5ad64c20ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061055 Oct 28 18:15:58.398299 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1583/3280] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:58.445966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:58.448122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:58.458661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:58.461948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.462916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.465159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.466437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.467469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.469506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.698834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:58.705162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:58.706044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:58.713959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.714625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.715255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.716199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.716843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.717270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.819163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:58.830295 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42c7b005-ea28-4c0d-b46e-ed9f396602d4 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.391205 Oct 28 18:15:58.844940 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1698/3281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:58 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:58.844940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:58.844940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 6113d4e1-1747-4611-a2c5-fe248ae3ee3a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:58.869099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.869851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.870734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.871829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.872445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.873024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.890556 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] HTTP exception thrown: Instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a could not be found. Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Request method failure captured: Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a HTTP/1.1 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwfQDo-IPPu7NjnN9NTEo5RhpZE0YTpAIqu3ehYeVtHkCH_vNoKLY40Qv3z8c0dHopuLTnshNMCVJVRjc98u4t8wzfeQZF4wuPbtWVO5dTqeshiwuX74Q6L8TlyakEjy6-EqvCzlTuDw4G7T5nTtU1FAegXWBlH0r6hhfFrOfAQuYg Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 11f6ba6ec4174bd592c3bd43dad948c5 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MultipleCreateTestJSON-747296003 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11f6ba6ec4174bd592c3bd43dad948c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11f6ba6ec4174bd592c3bd43dad948c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11f6ba6ec4174bd592c3bd43dad948c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11f6ba6ec4174bd592c3bd43dad948c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MultipleCreateTestJSON-747296003 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 11f6ba6ec4174bd592c3bd43dad948c5 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MultipleCreateTestJSON-747296003 Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MultipleCreateTestJSON-747296003-project Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2cb7037d2702444cbc9acc2004641abf Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MultipleCreateTestJSON-747296003-project Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a could not be found. Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '6113d4e1-1747-4611-a2c5-fe248ae3ee3a'} Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a could not be found. Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a could not be found. Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:58.892520 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.898091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:58.898091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:58.898091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:58.898091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:58.898091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:58.898091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a could not be found. Oct 28 18:15:58.898091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.900524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Returning 404 to user: Instance 6113d4e1-1747-4611-a2c5-fe248ae3ee3a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:58.901692 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4939d1cc-53fa-468f-93d1-0b7a17de04e1 tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a" status: 404 len: 111 microversion: 2.1 time: 0.068334 Oct 28 18:15:58.903359 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1699/3282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:58 2022] GET /compute/v2.1/servers/6113d4e1-1747-4611-a2c5-fe248ae3ee3a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:58.910257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:58.910882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] [instance: 2c1794aa-26a9-4355-8105-83220c147e61] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:58.916830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.917323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.917769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.918479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.918939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.919397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.936061 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] HTTP exception thrown: Instance 2c1794aa-26a9-4355-8105-83220c147e61 could not be found. Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Request method failure captured: Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 HTTP/1.1 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwfQDo-IPPu7NjnN9NTEo5RhpZE0YTpAIqu3ehYeVtHkCH_vNoKLY40Qv3z8c0dHopuLTnshNMCVJVRjc98u4t8wzfeQZF4wuPbtWVO5dTqeshiwuX74Q6L8TlyakEjy6-EqvCzlTuDw4G7T5nTtU1FAegXWBlH0r6hhfFrOfAQuYg Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 11f6ba6ec4174bd592c3bd43dad948c5 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MultipleCreateTestJSON-747296003 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11f6ba6ec4174bd592c3bd43dad948c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/11f6ba6ec4174bd592c3bd43dad948c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_11f6ba6ec4174bd592c3bd43dad948c5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/11f6ba6ec4174bd592c3bd43dad948c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MultipleCreateTestJSON-747296003 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 11f6ba6ec4174bd592c3bd43dad948c5 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MultipleCreateTestJSON-747296003 Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MultipleCreateTestJSON-747296003-project Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2cb7037d2702444cbc9acc2004641abf Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MultipleCreateTestJSON-747296003-project Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2c1794aa-26a9-4355-8105-83220c147e61 could not be found. Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2c1794aa-26a9-4355-8105-83220c147e61'} Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1794aa-26a9-4355-8105-83220c147e61 could not be found. Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1794aa-26a9-4355-8105-83220c147e61 could not be found. Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:58.938518 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1794aa-26a9-4355-8105-83220c147e61 could not be found. Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] Returning 404 to user: Instance 2c1794aa-26a9-4355-8105-83220c147e61 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:58.943073 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04d75b07-20a1-4cfb-ab9a-ca0e4578664d tempest-MultipleCreateTestJSON-747296003 tempest-MultipleCreateTestJSON-747296003-project] 10.222.0.16 "GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61" status: 404 len: 111 microversion: 2.1 time: 0.033482 Oct 28 18:15:58.944087 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1700/3283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:58 2022] GET /compute/v2.1/servers/2c1794aa-26a9-4355-8105-83220c147e61 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:15:59.022214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=14 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:59.042190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:59.051807 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cc7f4a96-916b-44d7-b7ff-0253579682c5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1314 microversion: 2.1 time: 0.353855 Oct 28 18:15:59.052629 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1584/3284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:58 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:59.192413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:59.193532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] [instance: 7af47463-f00f-41e3-b23a-bd68c7309c1f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:59.200316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.200841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.201267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.201995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.203488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.203980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.220316 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] HTTP exception thrown: Instance 7af47463-f00f-41e3-b23a-bd68c7309c1f could not be found. Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Request method failure captured: Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f HTTP/1.1 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBvuN4bVHVrkKH-p_f3xVfSQQFZ6eS1TAj3Dq5jIzjp66aWPmO0Yw1iDDbLHhbtdErggN4jjXrRe_73cOmaEMNvSCtA0_y-H8fTTVT0qc_c0ROSiYx05ySGWn9TISpltsTCkvhh_K0_FiSWYsTDfjwS9I29ucfb7jLrLgVk54mgR6W4 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67daef63361f4374b7562dd1029e6a64", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67daef63361f4374b7562dd1029e6a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 67daef63361f4374b7562dd1029e6a64 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1437044256 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4e3c71f336ac403cb508c00d17c0ee07 Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-SecurityGroupsTestJSON-1437044256-project Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 7af47463-f00f-41e3-b23a-bd68c7309c1f could not be found. Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '7af47463-f00f-41e3-b23a-bd68c7309c1f'} Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af47463-f00f-41e3-b23a-bd68c7309c1f could not be found. Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af47463-f00f-41e3-b23a-bd68c7309c1f could not be found. Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:59.222566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af47463-f00f-41e3-b23a-bd68c7309c1f could not be found. Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Returning 404 to user: Instance 7af47463-f00f-41e3-b23a-bd68c7309c1f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8da425c5-249c-4e9b-83f4-fe52d9f67b38 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f" status: 404 len: 111 microversion: 2.1 time: 0.036083 Oct 28 18:15:59.228743 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1701/3285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:59 2022] GET /compute/v2.1/servers/7af47463-f00f-41e3-b23a-bd68c7309c1f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:15:59.236989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22b77ae0-f4fc-4a94-b2b4-503b86f30025 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de819700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:59.266768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:59.267502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:59.274014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.274836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.275508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.276337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.276897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.277395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.311189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:59.506914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:59.527464 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b73abbce-9ecf-42f0-8da3-94f11b65ee6c tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.266046 Oct 28 18:15:59.541534 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1702/3286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:59 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:59.555654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-97da7ada-53a1-4970-a03d-048e8d120d86 req-6fa00067-9196-48d8-9a84-ce33ced668bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87446121-3f48-49ed-b9a4-9d0507d245e8", "tag": "44766d28-9b12-411d-ad5a-4d1a7784fd20"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:59.570081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-97da7ada-53a1-4970-a03d-048e8d120d86 req-6fa00067-9196-48d8-9a84-ce33ced668bd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.570918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-97da7ada-53a1-4970-a03d-048e8d120d86 req-6fa00067-9196-48d8-9a84-ce33ced668bd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.571734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-97da7ada-53a1-4970-a03d-048e8d120d86 req-6fa00067-9196-48d8-9a84-ce33ced668bd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.588694 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-97da7ada-53a1-4970-a03d-048e8d120d86 req-6fa00067-9196-48d8-9a84-ce33ced668bd service nova] Creating event network-changed:44766d28-9b12-411d-ad5a-4d1a7784fd20 for instance 87446121-3f48-49ed-b9a4-9d0507d245e8 on n-h2-862404-2 Oct 28 18:15:59.596465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-97da7ada-53a1-4970-a03d-048e8d120d86 req-6fa00067-9196-48d8-9a84-ce33ced668bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047547 Oct 28 18:15:59.597655 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1703/3287] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:59.604001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3942429e-3766-434a-b3ec-f35db878d488 req-ef9aed85-3421-4f90-8a76-472782d3b0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f9c52b-b9b0-4187-8452-85217591a00c", "name": "network-vif-plugged", "status": "completed", "tag": "19244be5-e59e-42be-986d-d73bba85fc24"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:59.617928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3942429e-3766-434a-b3ec-f35db878d488 req-ef9aed85-3421-4f90-8a76-472782d3b0a5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.618876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3942429e-3766-434a-b3ec-f35db878d488 req-ef9aed85-3421-4f90-8a76-472782d3b0a5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.619808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3942429e-3766-434a-b3ec-f35db878d488 req-ef9aed85-3421-4f90-8a76-472782d3b0a5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.624915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:59.642713 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3942429e-3766-434a-b3ec-f35db878d488 req-ef9aed85-3421-4f90-8a76-472782d3b0a5 service nova] Creating event network-vif-plugged:19244be5-e59e-42be-986d-d73bba85fc24 for instance 70f9c52b-b9b0-4187-8452-85217591a00c on n-h2-862404-2 Oct 28 18:15:59.660293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3942429e-3766-434a-b3ec-f35db878d488 req-ef9aed85-3421-4f90-8a76-472782d3b0a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059571 Oct 28 18:15:59.663285 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1704/3288] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:59.732293 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22b77ae0-f4fc-4a94-b2b4-503b86f30025 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/6fce6742-a834-495f-8bd9-b191f87ddd36" status: 202 len: 0 microversion: 2.1 time: 0.500858 Oct 28 18:15:59.736528 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1585/3289] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:59 2022] DELETE /compute/v2.1/os-security-groups/6fce6742-a834-495f-8bd9-b191f87ddd36 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:59.742714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79134f12-6bcc-4ce9-b82f-fcffcdd0f9c2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] Calling method '.version_select at 0x7f78de0d1940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:59.861485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:59.863411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:15:59.875140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.876076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.877539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.879046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.879690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.880314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:00.134761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:00.149076 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed1e3b24-31be-4a85-ad8f-51a51a9ff18f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.292544 Oct 28 18:16:00.166289 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1586/3290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:59 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:00.166289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:00.166289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:00.173657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:00.174533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:00.175240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:00.176429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:00.177133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:00.177791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:00.254425 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79134f12-6bcc-4ce9-b82f-fcffcdd0f9c2 tempest-SecurityGroupsTestJSON-1437044256 tempest-SecurityGroupsTestJSON-1437044256-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/1862202e-b1f5-4e41-a884-b1b0949c25d0" status: 202 len: 0 microversion: 2.1 time: 0.516504 Oct 28 18:16:00.256781 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1705/3291] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:15:59 2022] DELETE /compute/v2.1/os-security-groups/1862202e-b1f5-4e41-a884-b1b0949c25d0 => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:16:00.562300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:00.568796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:00.590608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:00.591438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:00.592077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:00.592961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:00.594538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:00.595169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:00.803401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:00.814087 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-66db00f8-2279-492e-bd64-223b0b2fa5f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1314 microversion: 2.1 time: 0.653823 Oct 28 18:16:00.818179 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1587/3292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:00 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:00.967309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:00.982298 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc0893c2-6bfe-4498-b14a-ad45f02d613e tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.425974 Oct 28 18:16:00.983633 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1706/3293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:00 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:01.175063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:01.175696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:01.186293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:01.188608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:01.189288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:01.190388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:01.191124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:01.191757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:01.650722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:01.675208 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f7a15b10-0458-4754-a2fa-c8fa6600f471 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.505132 Oct 28 18:16:01.676508 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1588/3294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:01 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:01.848789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:01.851569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:01.877051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:01.878797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:01.880678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:01.881580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:01.883686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:01.884337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:02.007401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:02.008736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:02.016071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:02.019859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:02.021889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:02.023224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:02.023974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:02.024646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:02.075784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:02.098917 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13de2445-ef5a-4fe6-bae6-aac91a3127e6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1314 microversion: 2.1 time: 0.256341 Oct 28 18:16:02.101345 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1707/3295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:01 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:02.397681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:02.408471 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13af2bbf-940b-41c7-83bd-a3e03957b1ed tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1317 microversion: 2.1 time: 0.405222 Oct 28 18:16:02.419930 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1589/3296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:02 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:02.699582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:02.700668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:02.709380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:02.709890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:02.713142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:02.716142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:02.716805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:02.717418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:02.982880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:03.012089 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d043658d-4111-432c-9f1c-c8a47bf5b414 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.316849 Oct 28 18:16:03.013327 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1708/3297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:02 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:03.126927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:03.128237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:03.143620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.144628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.145487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.149151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.149887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.150549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.229060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:03.435781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:03.437257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:03.448604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.450672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.451429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.457652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.458500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.459152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.807714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:03.819752 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-28aef330-06a2-4456-97f7-d65b0db98096 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1505 microversion: 2.1 time: 0.388166 Oct 28 18:16:03.820576 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1709/3298] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:03 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:03.847166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:03.847734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:03.868616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.869539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.870029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.870965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.871596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.872278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.922096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:03.923841 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95830e86-ae31-4ded-bfb2-39fb100618bd tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c/os-instance-actions/req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f" status: 200 len: 313 microversion: 2.1 time: 0.081100 Oct 28 18:16:03.925258 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1710/3299] 10.222.0.16 () {58 vars in 1419 bytes} [Fri Oct 28 18:16:03 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c/os-instance-actions/req-719cebe7-7d03-47fd-9ec7-8d09b3e2e45f => generated 313 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:03.941647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:03.945656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:03.955528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.956663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.957308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.958332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.958956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.959566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:04.044367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:04.057790 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5250caf-de57-4c5d-8c94-a6280f6d2e04 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "POST /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c/action" status: 202 len: 0 microversion: 2.1 time: 0.121436 Oct 28 18:16:04.059362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1711/3300] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:16:03 2022] POST /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:16:04.081784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:04.087037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:04.115481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:04.116063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:04.116653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:04.117496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:04.119071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:04.119071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:04.263877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:04.281163 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-51ffe6f9-2fb7-494c-9b89-e1d24c56ea08 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1314 microversion: 2.1 time: 1.158722 Oct 28 18:16:04.290065 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1590/3301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:03 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1314 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:04.299477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:04.300151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:04.306993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:04.307721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:04.308535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:04.309488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:04.310149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:04.310778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:04.386785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:04.405235 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-946104e5-1cd5-4349-a793-aace66ba138f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.344391 Oct 28 18:16:04.407224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1712/3302] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:04 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:04.870696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:04.882852 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9bda1787-0feb-417d-ba94-d77167e57192 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1507 microversion: 2.1 time: 0.590743 Oct 28 18:16:04.884374 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1591/3303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:04 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1507 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:05.282571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a03d6dec-2dcc-4ebb-ad5b-85037aa4b050 req-b2e5d7e3-c5cc-4f93-89a8-c88800cf9a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f49b0af-abe0-4242-9f3d-1d789b7965dc", "name": "network-vif-plugged", "status": "completed", "tag": "bbfe69b9-90a5-4025-9383-d47f8e337e61"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:05.297958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a03d6dec-2dcc-4ebb-ad5b-85037aa4b050 req-b2e5d7e3-c5cc-4f93-89a8-c88800cf9a81 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.301899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a03d6dec-2dcc-4ebb-ad5b-85037aa4b050 req-b2e5d7e3-c5cc-4f93-89a8-c88800cf9a81 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.302542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a03d6dec-2dcc-4ebb-ad5b-85037aa4b050 req-b2e5d7e3-c5cc-4f93-89a8-c88800cf9a81 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:05.305171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:05.305795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:05.320625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.321128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.321571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:05.322288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.322467 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a03d6dec-2dcc-4ebb-ad5b-85037aa4b050 req-b2e5d7e3-c5cc-4f93-89a8-c88800cf9a81 service nova] Creating event network-vif-plugged:bbfe69b9-90a5-4025-9383-d47f8e337e61 for instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc on n-h2-862404-2 Oct 28 18:16:05.322747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.323179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:05.334233 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a03d6dec-2dcc-4ebb-ad5b-85037aa4b050 req-b2e5d7e3-c5cc-4f93-89a8-c88800cf9a81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055159 Oct 28 18:16:05.336521 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1713/3304] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:05.430115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:05.430838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:05.447663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.448533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.449180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:05.450265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.450925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.451552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:05.647696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:05.656772 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0fa416d6-41f7-4985-befa-928ac7f7aff5 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.230732 Oct 28 18:16:05.657734 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1714/3305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:05 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:05.809887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:05.820634 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1632c656-ad2d-47c3-ae33-0aface08c19f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1314 microversion: 2.1 time: 0.519169 Oct 28 18:16:05.822039 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1592/3306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:05 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:05.906931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:05.908050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:05.914427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.915251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.915986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:05.916909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.917601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.918126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.164933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:06.175923 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-992f8bb8-948d-420c-bf97-1f271ea18704 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1505 microversion: 2.1 time: 0.272804 Oct 28 18:16:06.176891 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1715/3307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:05 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:06.200043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '.version_select at 0x7f78de227f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:06.200608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:06.207356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.207876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.208510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.209216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.210030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.210462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.288469 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9fdd7654-9c3c-477e-842b-f397e0950b1d tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.092474 Oct 28 18:16:06.305527 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1593/3308] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 18:16:06 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c/os-instance-actions => generated 611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:06.313667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:06.314312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:06.323914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.329912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.330708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.332225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.332994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.333727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.371738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:06.519221 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-427546cd-ea31-4cfb-9f3a-0c084135bd49 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 204 len: 0 microversion: 2.1 time: 0.210668 Oct 28 18:16:06.523717 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1716/3309] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:06 2022] DELETE /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:06.528536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:06.529169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:06.539071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.539627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.540353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.541234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.541841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.542544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.681339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:06.682375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:06.690113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.690603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.691246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.692506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.693125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.693892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.913364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:06.922688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-365288e8-aacc-455a-a0a3-d858b8da84ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.245494 Oct 28 18:16:06.943334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:06.953238 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f63cce9d-e6d3-4ecb-9cd3-dd9d286acecb tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1511 microversion: 2.1 time: 0.427824 Oct 28 18:16:06.954165 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1717/3310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:06 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:06.960274 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1594/3311] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:06 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:06.964215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:06.965608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:06.980404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.980902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.981414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.983221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.985973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.986573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:07.201845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:07.214465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82fdd87b-0d96-4955-8e10-7b5bc44b1183 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1314 microversion: 2.1 time: 0.256851 Oct 28 18:16:07.217555 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1718/3312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:06 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:07.952109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:07.953541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:07.959956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:07.960670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:07.961480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:07.962268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:07.962809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:07.963507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:07.988004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:07.990788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:08.008434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:08.009163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:08.009705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:08.010632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:08.011313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:08.011941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:08.212635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:08.221275 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55eb5b3c-dc8e-4621-a929-81c343046751 tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1511 microversion: 2.1 time: 0.241951 Oct 28 18:16:08.221964 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1719/3313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:07 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1511 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:08.237937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:08.238586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:08.244721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:08.245371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:08.245853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:08.247058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:08.247657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:08.248277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:08.388061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:08.396670 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-15a251f2-3c06-4cf7-8ebd-f8799837f6f4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1500 microversion: 2.1 time: 0.163484 Oct 28 18:16:08.407992 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1720/3314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:08 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:08.566245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:08.578698 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22fd45c1-8a99-46bb-8da8-29371e084769 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.631233 Oct 28 18:16:08.587332 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1595/3315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:07 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:09.179777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-123e636f-f5a0-47f1-98a6-04294363ab2a req-920ae61f-c7bc-4ee8-9366-d5d14e31674a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f9c52b-b9b0-4187-8452-85217591a00c", "name": "network-vif-deleted", "tag": "19244be5-e59e-42be-986d-d73bba85fc24"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:09.219473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-123e636f-f5a0-47f1-98a6-04294363ab2a req-920ae61f-c7bc-4ee8-9366-d5d14e31674a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:09.220070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-123e636f-f5a0-47f1-98a6-04294363ab2a req-920ae61f-c7bc-4ee8-9366-d5d14e31674a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:09.222936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-123e636f-f5a0-47f1-98a6-04294363ab2a req-920ae61f-c7bc-4ee8-9366-d5d14e31674a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:09.244873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:09.246301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:09.258707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-123e636f-f5a0-47f1-98a6-04294363ab2a req-920ae61f-c7bc-4ee8-9366-d5d14e31674a service nova] Creating event network-vif-deleted:19244be5-e59e-42be-986d-d73bba85fc24 for instance 70f9c52b-b9b0-4187-8452-85217591a00c on n-h2-862404-2 Oct 28 18:16:09.258972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:09.259355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:09.259914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:09.260703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:09.262205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:09.267122 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-123e636f-f5a0-47f1-98a6-04294363ab2a req-920ae61f-c7bc-4ee8-9366-d5d14e31674a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093187 Oct 28 18:16:09.267848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:09.268559 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1721/3316] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:09.370528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:09.371450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:09.372138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:09.372719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lazy-loading 'fault' on Instance uuid 70f9c52b-b9b0-4187-8452-85217591a00c {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:09.465501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b92c11d657438097a4520f291446d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3343ab77692d4ac983ca737d2a6dd74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:09.495068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49f388a7-55c4-4636-9f80-91129f01051a tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 200 len: 1307 microversion: 2.1 time: 0.253974 Oct 28 18:16:09.515413 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1596/3317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:09 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 1307 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:09.616111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b213e9fd-ebeb-4986-affc-32d835d5bdda req-8bfd0a58-c59e-41f4-a97a-6e34d1c235c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87446121-3f48-49ed-b9a4-9d0507d245e8", "name": "network-vif-plugged", "status": "completed", "tag": "44766d28-9b12-411d-ad5a-4d1a7784fd20"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:09.620460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:09.623270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:09.643335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:09.646101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:09.647730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:09.648567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b213e9fd-ebeb-4986-affc-32d835d5bdda req-8bfd0a58-c59e-41f4-a97a-6e34d1c235c7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:09.650381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:09.650551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b213e9fd-ebeb-4986-affc-32d835d5bdda req-8bfd0a58-c59e-41f4-a97a-6e34d1c235c7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:09.651910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b213e9fd-ebeb-4986-affc-32d835d5bdda req-8bfd0a58-c59e-41f4-a97a-6e34d1c235c7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:09.652434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:09.653039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:09.682508 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b213e9fd-ebeb-4986-affc-32d835d5bdda req-8bfd0a58-c59e-41f4-a97a-6e34d1c235c7 service nova] Creating event network-vif-plugged:44766d28-9b12-411d-ad5a-4d1a7784fd20 for instance 87446121-3f48-49ed-b9a4-9d0507d245e8 on n-h2-862404-2 Oct 28 18:16:09.690924 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b213e9fd-ebeb-4986-affc-32d835d5bdda req-8bfd0a58-c59e-41f4-a97a-6e34d1c235c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084481 Oct 28 18:16:09.696537 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1597/3318] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:09.941105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:09.951989 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-138dc3b9-8d24-4189-9d3e-2f7c2e8499a9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.349979 Oct 28 18:16:09.953185 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1722/3319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:09 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:10.540071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:10.545927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] [instance: 70f9c52b-b9b0-4187-8452-85217591a00c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:10.583192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:10.595747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:10.599958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:10.600956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:10.606761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:10.608452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:10.649817 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] HTTP exception thrown: Instance 70f9c52b-b9b0-4187-8452-85217591a00c could not be found. Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Request method failure captured: Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c HTTP/1.1 Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBxJ8NKr4rD9jC1Idr5y4VpCDe6lB6KwWeCPiMVQo2ETu-QrlcxQKI-cS0i7wflyCGMT1kIYd8ngLV97G8hSIOlzRnhXLj9JTukXyk-qC1NSAm8TUzU-yN4AHiVY70bKSWXkX-TDygMyrPcz3Q2QCIEQTGY5i-4WepaUO1hrlL_cNZo Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 3343ab77692d4ac983ca737d2a6dd74e Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceActionsTestJSON-544878522 Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3343ab77692d4ac983ca737d2a6dd74e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3343ab77692d4ac983ca737d2a6dd74e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3343ab77692d4ac983ca737d2a6dd74e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3343ab77692d4ac983ca737d2a6dd74e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceActionsTestJSON-544878522 Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 3343ab77692d4ac983ca737d2a6dd74e Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceActionsTestJSON-544878522 Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceActionsTestJSON-544878522-project Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 00b92c11d657438097a4520f291446d0 Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceActionsTestJSON-544878522-project Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 70f9c52b-b9b0-4187-8452-85217591a00c could not be found. Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '70f9c52b-b9b0-4187-8452-85217591a00c'} Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f9c52b-b9b0-4187-8452-85217591a00c could not be found. Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f9c52b-b9b0-4187-8452-85217591a00c could not be found. Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:10.652991 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:10.658633 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:10.658633 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:10.658633 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:10.658633 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:10.658633 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:10.658633 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f9c52b-b9b0-4187-8452-85217591a00c could not be found. Oct 28 18:16:10.658633 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:10.660090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] Returning 404 to user: Instance 70f9c52b-b9b0-4187-8452-85217591a00c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:10.661355 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09c68ce2-1ff6-4870-810f-ea1df443d6ae tempest-InstanceActionsTestJSON-544878522 tempest-InstanceActionsTestJSON-544878522-project] 10.222.0.16 "GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c" status: 404 len: 111 microversion: 2.1 time: 0.143995 Oct 28 18:16:10.662599 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1598/3320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:10 2022] GET /compute/v2.1/servers/70f9c52b-b9b0-4187-8452-85217591a00c => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:10.977436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:10.978251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:10.992344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:10.994989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:10.995879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:10.997074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:10.998532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:11.000725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:11.162988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db3d614a-5529-480d-9bdb-92f2d838165e"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:11.165379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:11.183458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:11.184225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:11.184831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:11.185543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:11.185998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:11.186422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:11.317832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:11.328956 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d639591-3109-4527-ae49-59e32c4491b8 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1315 microversion: 2.1 time: 0.356342 Oct 28 18:16:11.331755 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1723/3321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:10 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:11.711168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1119400674", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": "none"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:11.843449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:16:11.844211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:16:11.844699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:16:11.845107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:16:11.845523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:16:11.877154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:11.881295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:11.881751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:11.884390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:11.892504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:11.893017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:11.900048 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-717663c2-94fc-48f6-b097-4aafb366fa1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740741 Oct 28 18:16:11.921947 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1599/3322] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:16:11 2022] POST /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:11.945235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Getting quotas for project d4b201c0812844e6b295e2377d5d424e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:11.960511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Getting quotas for user 2e3632d4ee1b44d99a326322d7859a4e and project d4b201c0812844e6b295e2377d5d424e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:11.992809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:16:11.995146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:16:12.107485 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c3cfe18-9545-4ec2-835d-bb464725b9c8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.697113 Oct 28 18:16:12.110168 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1724/3323] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:16:12.122209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e91a60d-5fb0-40e6-85e7-af8eacd0cfd6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:12.122943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e91a60d-5fb0-40e6-85e7-af8eacd0cfd6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:12.361324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:12.362461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:12.380348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:12.382809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:12.384611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:12.386190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:12.387469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:12.388712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:12.562773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2e91a60d-5fb0-40e6-85e7-af8eacd0cfd6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:12.578251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2e91a60d-5fb0-40e6-85e7-af8eacd0cfd6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:12.582090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2e91a60d-5fb0-40e6-85e7-af8eacd0cfd6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:12.586975 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e91a60d-5fb0-40e6-85e7-af8eacd0cfd6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1278 microversion: 2.54 time: 0.469358 Oct 28 18:16:12.606104 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1600/3324] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:12 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1278 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:12.976049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:12.992920 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64bec81d-9786-4b18-aa28-ffce87c3debd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1465 microversion: 2.1 time: 0.640041 Oct 28 18:16:12.994563 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1725/3325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:12 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1465 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:13.021769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:13.023289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:13.053806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:13.060571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:13.061124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:13.064636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:13.065160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:13.065853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:13.531215 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-06f9a791-87af-461d-9200-b19e22e9234f tempest-ServersOnMultiNodesTest-813115005 tempest-ServersOnMultiNodesTest-813115005-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1616 microversion: 2.1 time: 0.515635 Oct 28 18:16:13.533509 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1601/3326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:13 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1616 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:13.568552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:13.569261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:13.582585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:13.587398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:13.588258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:13.590042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:13.590748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:13.591386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:13.614388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:13.615151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:13.637713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:13.638697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:13.639244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:13.640606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:13.641345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:13.644338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:13.677446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:13.851414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:13.860667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:13.867043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:13.877248 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23854607-3a59-4aa4-9979-99a0827429b8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1330 microversion: 2.54 time: 0.266599 Oct 28 18:16:13.878612 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2716c09f-7af5-4cb4-bec4-17ec1d9201ca tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 204 len: 0 microversion: 2.1 time: 0.313867 Oct 28 18:16:13.880125 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1602/3328] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:13 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1330 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:13.883995 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1726/3328] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:13 2022] DELETE /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:13.888677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:13.897214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:13.915363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:13.917891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:13.927089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:13.930097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:13.930795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:13.931425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:14.435331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:14.450160 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-da666184-9dd9-4af3-af94-020e64fa293e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1471 microversion: 2.1 time: 0.565212 Oct 28 18:16:14.450788 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1603/3329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:13 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1471 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:14.910341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:14.911595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:14.935568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:14.939678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:14.942825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:14.943878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:14.945675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:14.950460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:15.040718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:15.196448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:15.217203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:15.224491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:15.228996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ae1e07f-56a4-427e-866a-08cdadaed08c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1336 microversion: 2.54 time: 0.321032 Oct 28 18:16:15.230556 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1727/3330] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:14 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1336 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:15.482658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:15.484548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:15.494488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:15.500617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:15.501306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:15.502239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:15.502764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:15.503166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:16.012999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:16.027249 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78f478f6-0be9-4359-968f-855a684d66e6 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1471 microversion: 2.1 time: 0.547957 Oct 28 18:16:16.029173 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1604/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:15 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1471 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:16.261881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:16.262539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:16.277829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:16.278673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:16.279299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:16.282066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:16.282795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:16.283927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:16.538469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:16.551174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:16.552776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:16.556439 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50b133b3-ca60-4d35-9b3b-08f774baa488 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1336 microversion: 2.54 time: 0.299401 Oct 28 18:16:16.558028 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1728/3332] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:16 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1336 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:17.055600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:17.056717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:17.068934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:17.074987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:17.076676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:17.079037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:17.080903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:17.082528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:17.095719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:17.584420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:17.585119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:17.610493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:17.610996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:17.611442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:17.612200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:17.612659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:17.613086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:17.791159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:17.805082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:17.806547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:17.807704 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9207494b-e542-45fe-a173-26473954c476 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1336 microversion: 2.54 time: 0.227549 Oct 28 18:16:17.819361 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1729/3333] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:17 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1336 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:17.824275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2dbef7d0-42fa-4275-916c-e5fb0b22f9ac req-bee56028-f55e-44b7-adc4-6c4246d816b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87446121-3f48-49ed-b9a4-9d0507d245e8", "name": "network-vif-deleted", "tag": "44766d28-9b12-411d-ad5a-4d1a7784fd20"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:17.856199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2dbef7d0-42fa-4275-916c-e5fb0b22f9ac req-bee56028-f55e-44b7-adc4-6c4246d816b3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:17.856606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2dbef7d0-42fa-4275-916c-e5fb0b22f9ac req-bee56028-f55e-44b7-adc4-6c4246d816b3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:17.857039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2dbef7d0-42fa-4275-916c-e5fb0b22f9ac req-bee56028-f55e-44b7-adc4-6c4246d816b3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:17.896445 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2dbef7d0-42fa-4275-916c-e5fb0b22f9ac req-bee56028-f55e-44b7-adc4-6c4246d816b3 service nova] Creating event network-vif-deleted:44766d28-9b12-411d-ad5a-4d1a7784fd20 for instance 87446121-3f48-49ed-b9a4-9d0507d245e8 on n-h2-862404-2 Oct 28 18:16:17.915669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:17.917757 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2dbef7d0-42fa-4275-916c-e5fb0b22f9ac req-bee56028-f55e-44b7-adc4-6c4246d816b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097009 Oct 28 18:16:17.918953 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1730/3334] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:17.929578 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-83f7cd11-ee11-489e-91d0-bd37a2303ac3 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 200 len: 1471 microversion: 2.1 time: 0.877758 Oct 28 18:16:17.933943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1605/3335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:17 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 1471 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:18.847137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:18.847962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:18.857277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:18.857277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:18.857277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:18.857277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:18.857619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:18.857927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:18.935881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:18.945505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:18.947261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:18.955193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:18.956650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 87446121-3f48-49ed-b9a4-9d0507d245e8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:18.962272 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0dcb14e8-fa7d-428f-9502-707f17aab7ef tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1336 microversion: 2.54 time: 0.120826 Oct 28 18:16:18.964785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1731/3336] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:18 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:18.966657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:18.967369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:18.968070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:18.969014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:18.969699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:18.970188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:18.995301 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] HTTP exception thrown: Instance 87446121-3f48-49ed-b9a4-9d0507d245e8 could not be found. Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Request method failure captured: Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 HTTP/1.1 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBurlOSG2IkxF_LFDThlwSF8-psoTn5bLcQiKk9MOMxAiWlXeohGSygCPKbDCEff41uIJcPcyTPOlyxgB4loykYiHuQaNN31z5a5ufRihUue4O7472OMbwLQ8O0Xb9K9UC1doM_rwL5_2_Zslcqv3cDFEXSglhCqgMTHtCGHiquBslo Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc800102cc1463eab50923ae3bcd9e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: b69293ed019d421aa34dd62c232eb131 Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 87446121-3f48-49ed-b9a4-9d0507d245e8 could not be found. Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '87446121-3f48-49ed-b9a4-9d0507d245e8'} Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87446121-3f48-49ed-b9a4-9d0507d245e8 could not be found. Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87446121-3f48-49ed-b9a4-9d0507d245e8 could not be found. Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:19.000692 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:19.004842 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:19.004842 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:19.004842 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:19.004842 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:19.004842 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:19.004842 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87446121-3f48-49ed-b9a4-9d0507d245e8 could not be found. Oct 28 18:16:19.004842 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:19.007158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Returning 404 to user: Instance 87446121-3f48-49ed-b9a4-9d0507d245e8 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:19.008307 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0502105b-7c5e-4087-8bf5-c1cf7b16da8f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8" status: 404 len: 111 microversion: 2.1 time: 0.058784 Oct 28 18:16:19.010814 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1606/3337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:18 2022] GET /compute/v2.1/servers/87446121-3f48-49ed-b9a4-9d0507d245e8 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:16:19.019891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:19.020598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:19.030044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:19.030880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:19.031503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:19.032410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:19.033041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:19.033631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:19.101510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:19.296901 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3601964-6ffe-4c74-81d3-f452ad2d010e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 204 len: 0 microversion: 2.1 time: 0.278362 Oct 28 18:16:19.302571 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1732/3338] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:19 2022] DELETE /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:19.307909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:19.308734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:19.315626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:19.316789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:19.317325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:19.318127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:19.318791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:19.319312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:19.996994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:20.005849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:20.007484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:20.016380 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e0e0ccc-61b3-467d-8a62-b5afac394b82 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1472 microversion: 2.1 time: 0.712316 Oct 28 18:16:20.017556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:20.018755 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1607/3339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:19 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1472 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:20.034218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:20.034218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:20.034218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:20.034538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:20.035721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:20.036281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:20.332208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:20.352276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:20.354348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:20.358901 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91b1c675-4cd4-46c1-96dd-8e48894c7b7d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1357 microversion: 2.54 time: 0.370782 Oct 28 18:16:20.362888 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1733/3340] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:19 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1357 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:20.398237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c9e02c7-2cb3-4632-9a5b-ed933842ce47 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Action: 'create', calling method: .version_select at 0x7f78de7f6670>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1844198504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5vu2zKiffDYAuGczf37oq9wC4t5yjJAhEg+ZP6QgzYUU/kvLhrQc2+DkFt5dnwONHxsgUl27dl9oyh28K5ZpxkrR++HbVC18T3FbNjtmyKkkKJEuMebU6mniVNAtbtYg=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:20.437425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-4c9e02c7-2cb3-4632-9a5b-ed933842ce47 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Getting quotas for project d4b201c0812844e6b295e2377d5d424e. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:20.458294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-4c9e02c7-2cb3-4632-9a5b-ed933842ce47 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Getting quotas for user 2e3632d4ee1b44d99a326322d7859a4e and project d4b201c0812844e6b295e2377d5d424e. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:20.525136 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c9e02c7-2cb3-4632-9a5b-ed933842ce47 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.132052 Oct 28 18:16:20.525759 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1608/3341] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:16:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 18:16:20.543423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1844198504", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:20.548826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:20.558260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:20.560130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:20.562195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:20.564234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:20.565785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:20.566701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:20.779078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:16:20.779626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:16:20.781161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:16:20.782034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:16:20.784671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:16:20.981383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:20.998387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:21.002490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:21.003912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:21.007797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:21.017518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:21.021933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:21.043722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:21.044648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:21.078297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:21.078804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:21.079255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:21.080025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:21.080494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:21.080931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:21.143116 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ec2b049-4f6c-488f-80ff-2e9e337c5d7b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "POST /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01/action" status: 202 len: 1140 microversion: 2.54 time: 0.607895 Oct 28 18:16:21.175066 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1734/3342] 10.222.0.16 () {62 vars in 1320 bytes} [Fri Oct 28 18:16:20 2022] POST /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01/action => generated 1140 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 28 18:16:21.181002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:21.183282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:21.184109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:21.191866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:21.192711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:21.193453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:21.194485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:21.195262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:21.196223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:21.337348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:21.356706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:21.364158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:21.365486 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-49467852-6b04-4f09-813c-7d97a4aa8b21 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.188319 Oct 28 18:16:21.379846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1735/3343] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:21 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:21.719144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:21.729472 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ec14ab8-dde6-4737-b4d6-9ce1874e4427 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1472 microversion: 2.1 time: 0.691507 Oct 28 18:16:21.741991 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1609/3344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:21 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1472 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:21.904820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:21.972458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:22.005667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8867064f-e6c1-4240-8805-ce27844bd1d1 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] Calling method '.version_select at 0x7f78e252ae50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:22.096798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8867064f-e6c1-4240-8805-ce27844bd1d1 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.289979 Oct 28 18:16:22.098457 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1736/3345] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:16:21 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:16:22.114793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffe6e3a6-1585-4f34-8480-ed43ebac0952 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] Action: 'create', calling method: .version_select at 0x7f78de6ff1f0>, body: {"pool": "non_exist_pool"} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:22.183285 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ffe6e3a6-1585-4f34-8480-ed43ebac0952 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] HTTP exception thrown: Floating IP pool not found. Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffe6e3a6-1585-4f34-8480-ed43ebac0952 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] Request method failure captured: Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 26 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBx17KewWb3dHI6P_DpbIn1ePI2DoclOrhj_CF31RrTPc5YOkSG5tTJfF1LrSjU5fSrvGyFtAoVuBajSTCTLgTm5mUnf6DwRnqfWLU0L6ZBf7aUmj4WDo58C1ydydfdptC9NTxqZaFqHHVQ_hDcr8HMhxCWCuJ58LMaYo2fIzJloRqg Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 8d06eb8d26c045f08b6cc02a1001aa77 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-370902708 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d06eb8d26c045f08b6cc02a1001aa77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d06eb8d26c045f08b6cc02a1001aa77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8d06eb8d26c045f08b6cc02a1001aa77", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8d06eb8d26c045f08b6cc02a1001aa77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-370902708 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 8d06eb8d26c045f08b6cc02a1001aa77 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-370902708 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-FloatingIPsNegativeTestJSON-370902708-project Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 05abbf023e40433bb48914b583b53cd6 Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-370902708-project Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: {"pool": "non_exist_pool"} Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: exception: Floating IP pool not found. Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:22.184875 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:22.189805 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 28 18:16:22.189805 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.191247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffe6e3a6-1585-4f34-8480-ed43ebac0952 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] Returning 404 to user: Floating IP pool not found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:22.192451 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffe6e3a6-1585-4f34-8480-ed43ebac0952 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.082906 Oct 28 18:16:22.198764 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1610/3346] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:16:22 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:16:22.210651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4f27f8b-3949-4d36-beee-93a98f957380 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] Calling method '.version_select at 0x7f78de4e5f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:22.309029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG neutronclient.v2_0.client [None req-c4f27f8b-3949-4d36-beee-93a98f957380 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 could not be found", "detail": ""}} {{(pid=120680) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:16:22.310092 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c4f27f8b-3949-4d36-beee-93a98f957380 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] HTTP exception thrown: Floating IP not found for ID e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4f27f8b-3949-4d36-beee-93a98f957380 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] Request method failure captured: Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-floating-ips/e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 HTTP/1.1 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBx17KewWb3dHI6P_DpbIn1ePI2DoclOrhj_CF31RrTPc5YOkSG5tTJfF1LrSjU5fSrvGyFtAoVuBajSTCTLgTm5mUnf6DwRnqfWLU0L6ZBf7aUmj4WDo58C1ydydfdptC9NTxqZaFqHHVQ_hDcr8HMhxCWCuJ58LMaYo2fIzJloRqg Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 8d06eb8d26c045f08b6cc02a1001aa77 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-370902708 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d06eb8d26c045f08b6cc02a1001aa77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8d06eb8d26c045f08b6cc02a1001aa77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8d06eb8d26c045f08b6cc02a1001aa77", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8d06eb8d26c045f08b6cc02a1001aa77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-370902708 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 8d06eb8d26c045f08b6cc02a1001aa77 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-370902708 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-FloatingIPsNegativeTestJSON-370902708-project Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 05abbf023e40433bb48914b583b53cd6 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-370902708-project Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: exception: Floating IP not found for ID e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'e3f30ca7-7814-47d9-8acc-fb8fd8fc4633'} Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 could not be found Oct 28 18:16:22.312463 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15a8d6da-95bc-4926-84af-66e892ede1e2'] Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e3f30ca7-7814-47d9-8acc-fb8fd8fc4633. Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 Oct 28 18:16:22.316305 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:22.320798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4f27f8b-3949-4d36-beee-93a98f957380 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] Returning 404 to user: Floating IP not found for ID e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:22.321928 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c4f27f8b-3949-4d36-beee-93a98f957380 tempest-FloatingIPsNegativeTestJSON-370902708 tempest-FloatingIPsNegativeTestJSON-370902708-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/e3f30ca7-7814-47d9-8acc-fb8fd8fc4633" status: 404 len: 111 microversion: 2.1 time: 0.115789 Oct 28 18:16:22.323064 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1737/3347] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:16:22 2022] DELETE /compute/v2.1/os-floating-ips/e3f30ca7-7814-47d9-8acc-fb8fd8fc4633 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:22.394468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:22.395454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:22.421331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:22.421833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:22.422281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:22.427636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:22.428347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:22.428800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:22.482535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-574f4b85-b592-48f7-8e55-97c9951d65c0 req-d2f13287-06b3-484e-9dd0-93cc24752b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9568c5fb-24a4-40bd-a549-d41a503cc432", "name": "network-vif-deleted", "tag": "5897f17d-f134-4969-8c92-54220ef306d4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:22.512352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-574f4b85-b592-48f7-8e55-97c9951d65c0 req-d2f13287-06b3-484e-9dd0-93cc24752b4b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:22.513861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-574f4b85-b592-48f7-8e55-97c9951d65c0 req-d2f13287-06b3-484e-9dd0-93cc24752b4b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:22.514500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-574f4b85-b592-48f7-8e55-97c9951d65c0 req-d2f13287-06b3-484e-9dd0-93cc24752b4b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:22.535435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-574f4b85-b592-48f7-8e55-97c9951d65c0 req-d2f13287-06b3-484e-9dd0-93cc24752b4b service nova] Creating event network-vif-deleted:5897f17d-f134-4969-8c92-54220ef306d4 for instance 9568c5fb-24a4-40bd-a549-d41a503cc432 on n-h1-862404-2 Oct 28 18:16:22.547351 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-574f4b85-b592-48f7-8e55-97c9951d65c0 req-d2f13287-06b3-484e-9dd0-93cc24752b4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067369 Oct 28 18:16:22.556046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1738/3348] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:22.746522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:22.766566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:22.766808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:22.767272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:22.781588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:22.782562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:22.788475 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-69bb7a97-078e-420d-ac9e-ccdacfeb742f tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.399999 Oct 28 18:16:22.791848 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1611/3349] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:22 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:22.804849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:22.804849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:22.804849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:22.804849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:22.804849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:22.942303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:22.951108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:22.951686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:22.953330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lazy-loading 'fault' on Instance uuid 9568c5fb-24a4-40bd-a549-d41a503cc432 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:23.091800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:23.105342 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aed33199-bf21-4dbc-ade8-e7ec356075c1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 200 len: 1307 microversion: 2.1 time: 0.338822 Oct 28 18:16:23.119853 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1739/3350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:22 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 1307 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:23.824259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:23.825167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:23.842190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:23.842758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:23.857766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:23.862608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:23.864438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:23.865062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:24.134523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:24.135304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 9568c5fb-24a4-40bd-a549-d41a503cc432] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:24.149255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:24.151982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:24.153405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:24.160550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:24.161052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:24.161512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:24.168821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:24.184592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:24.189611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:24.198553 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-05484eac-6da1-444c-877f-0ffc71ee3467 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.379369 Oct 28 18:16:24.199168 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1612/3351] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:23 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:24.230346 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] HTTP exception thrown: Instance 9568c5fb-24a4-40bd-a549-d41a503cc432 could not be found. Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Request method failure captured: Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 HTTP/1.1 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBurlOSG2IkxF_LFDThlwSF8-psoTn5bLcQiKk9MOMxAiWlXeohGSygCPKbDCEff41uIJcPcyTPOlyxgB4loykYiHuQaNN31z5a5ufRihUue4O7472OMbwLQ8O0Xb9K9UC1doM_rwL5_2_Zslcqv3cDFEXSglhCqgMTHtCGHiquBslo Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc800102cc1463eab50923ae3bcd9e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b69293ed019d421aa34dd62c232eb131 Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 9568c5fb-24a4-40bd-a549-d41a503cc432 could not be found. Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '9568c5fb-24a4-40bd-a549-d41a503cc432'} Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9568c5fb-24a4-40bd-a549-d41a503cc432 could not be found. Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9568c5fb-24a4-40bd-a549-d41a503cc432 could not be found. Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:24.236120 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:24.240914 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:24.240914 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:24.240914 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:24.240914 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:24.240914 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:24.240914 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9568c5fb-24a4-40bd-a549-d41a503cc432 could not be found. Oct 28 18:16:24.240914 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:24.244147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Returning 404 to user: Instance 9568c5fb-24a4-40bd-a549-d41a503cc432 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:24.245259 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f291e564-a902-4142-998f-31e8425946c9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432" status: 404 len: 111 microversion: 2.1 time: 0.114812 Oct 28 18:16:24.251745 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1740/3352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:24 2022] GET /compute/v2.1/servers/9568c5fb-24a4-40bd-a549-d41a503cc432 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:16:24.255786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:24.256339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:24.263220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:24.263722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:24.268606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:24.269474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:24.269879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:24.270316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:24.319366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:24.457144 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5ed786c7-bf4e-4572-aa93-b10a9baacd1c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 204 len: 0 microversion: 2.1 time: 0.205150 Oct 28 18:16:24.468634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:24.469687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:24.471722 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1613/3353] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:24 2022] DELETE /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:24.477533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:24.478652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:24.479324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:24.480426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:24.481146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:24.481804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:25.099538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:25.114160 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3deafd4b-52c6-43c4-8396-18e15ffd8271 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1471 microversion: 2.1 time: 0.651368 Oct 28 18:16:25.122052 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1741/3354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:24 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1471 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:25.230948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:25.231776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:25.238582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:25.239459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:25.240192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:25.241257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:25.241956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:25.242601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:25.314177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:25.325919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:25.329819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:25.331303 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-120f43aa-04a3-409e-878c-0f200a96d822 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.105835 Oct 28 18:16:25.331898 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1614/3355] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:25 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:25.561233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-436291525", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "e2c4a9e5-a767-484d-b248-791615b27a48"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:25.649418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] validate_networks() for [('e2c4a9e5-a767-484d-b248-791615b27a48', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:16:26.139319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:26.140618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:26.157348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:26.157964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:26.158426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:26.159173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:26.163720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:26.173025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:26.542007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:26.551950 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de946585-36ce-4cca-bb89-6c3b1299a3ab tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1471 microversion: 2.1 time: 0.417552 Oct 28 18:16:26.552553 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1615/3356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:26 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:26.566507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:26.568548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:26.587803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:26.588607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:26.591210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:26.592356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:26.593618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:26.597149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:26.808237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:26.841668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:26.844222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:26.845657 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43d4a0cf-a5b6-4120-ae4f-8b42f2e9cff8 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.288581 Oct 28 18:16:26.848524 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1616/3357] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:26 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:26.940991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:26.941962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:26.948736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:16:26.951491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:16:26.952138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:16:26.952565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:16:26.952987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:16:26.954173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:26.955149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:26.956873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:26.963917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:26.965280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:26.965890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:26.972442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:26.972936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:26.977963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:26.979042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:26.979547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:26.984203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:27.035295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:27.035733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Getting quotas for project 3582e5d532e644408f7680cbfb641c2a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:27.049887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Getting quotas for user 8435105202cf4562842047923c91993f and project 3582e5d532e644408f7680cbfb641c2a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:27.083161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:16:27.085839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:16:27.242184 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d9d17f5c-c272-4afd-ad3d-ca366fb89756 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750265 Oct 28 18:16:27.256024 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1742/3358] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:16:27.266473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2eec2733-6e90-4d16-8964-cab055c3179f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:27.268470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2eec2733-6e90-4d16-8964-cab055c3179f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:27.269384 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c6667b73-4293-41d5-acc5-8c0e17ea36ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 204 len: 0 microversion: 2.1 time: 0.332080 Oct 28 18:16:27.270823 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1617/3359] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:26 2022] DELETE /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:16:27.282532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:27.283670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:27.302921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:27.306443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:27.307992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:27.310278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:27.312866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:27.314224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:27.360798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2eec2733-6e90-4d16-8964-cab055c3179f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:27.372024 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2eec2733-6e90-4d16-8964-cab055c3179f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1224 microversion: 2.1 time: 0.114417 Oct 28 18:16:27.372929 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1743/3360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:27 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:27.577819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:27.578715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:27.595057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:27.603616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:27.604288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:27.605003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:27.605479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:27.609794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:28.103329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:28.133770 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3f378dc-c717-4da3-9ac2-0bb678a75544 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1471 microversion: 2.1 time: 0.561237 Oct 28 18:16:28.136663 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1744/3361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:27 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1471 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:28.142744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:28.157024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:28.157950 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-90a22973-6d3c-49c8-a220-6f608d5dcc6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1552 microversion: 2.1 time: 0.882783 Oct 28 18:16:28.160780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:28.161795 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1618/3362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:27 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1552 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:28.194197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:28.194525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:28.194954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:28.195685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:28.196183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:28.197012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:28.222920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:28.364305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:28.379558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:28.383352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:28.387342 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c75964a-f4d9-4e4e-a0b1-d2cf34e86fcc tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.247560 Oct 28 18:16:28.390733 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1745/3363] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:28 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:28.399577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:28.400575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:28.408558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:28.409341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:28.410064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:28.411162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:28.412161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:28.412821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:28.626455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:28.643778 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-911c14be-b534-44f6-b68a-68849bb80e09 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1228 microversion: 2.1 time: 0.251586 Oct 28 18:16:28.653492 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1619/3364] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:28 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1228 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:28.810324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-219fe80d-2de8-4366-a744-7dd541b75af1 req-cfe83b7d-9023-46b4-8645-ec125a54acb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f358d61-64bf-4efb-908b-5ba233a11fb2", "name": "network-vif-deleted", "tag": "9934cfed-52db-450e-a30f-a1166d12ec61"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:28.831435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-219fe80d-2de8-4366-a744-7dd541b75af1 req-cfe83b7d-9023-46b4-8645-ec125a54acb2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:28.856311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-219fe80d-2de8-4366-a744-7dd541b75af1 req-cfe83b7d-9023-46b4-8645-ec125a54acb2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:28.856832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-219fe80d-2de8-4366-a744-7dd541b75af1 req-cfe83b7d-9023-46b4-8645-ec125a54acb2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:28.923236 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-219fe80d-2de8-4366-a744-7dd541b75af1 req-cfe83b7d-9023-46b4-8645-ec125a54acb2 service nova] Creating event network-vif-deleted:9934cfed-52db-450e-a30f-a1166d12ec61 for instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 on n-h1-862404-2 Oct 28 18:16:28.935438 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-219fe80d-2de8-4366-a744-7dd541b75af1 req-cfe83b7d-9023-46b4-8645-ec125a54acb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129741 Oct 28 18:16:28.939495 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1746/3365] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:29.165014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:29.165629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:29.188993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:29.190395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:29.191583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.192127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.197070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.199131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.199629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.200120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.231781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.232959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.239052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.241115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.242922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.245966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.300530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.303625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.304394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.305026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lazy-loading 'fault' on Instance uuid 8f358d61-64bf-4efb-908b-5ba233a11fb2 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:29.432095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:29.448262 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ce9c566a-c12b-4e22-b2da-29f9b5a72e1b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 200 len: 1306 microversion: 2.1 time: 0.284024 Oct 28 18:16:29.450010 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1620/3366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:29 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 1306 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:29.469228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:29.472337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:29.493250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.495329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.498530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.500039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.500674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.501654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.731556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:29.750745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:29.764356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:29.766714 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-27493706-ef42-4e90-bee8-1cfb79434614 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.312183 Oct 28 18:16:29.767656 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1621/3367] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:29 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:29.780154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:29.788527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:29.805388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.806107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.807555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.810551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:29.814408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:29.816125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:29.981025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:29.997873 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56c5dfb4-bdc7-4caa-a346-d03a828b87e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1552 microversion: 2.1 time: 0.812739 Oct 28 18:16:30.001780 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1747/3368] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:29 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1552 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:30.060162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:30.071181 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed6c7ed9-4a80-4a23-b997-d4f45983540e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1276 microversion: 2.1 time: 0.302394 Oct 28 18:16:30.072830 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1622/3369] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:29 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:30.478533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:30.479135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 8f358d61-64bf-4efb-908b-5ba233a11fb2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:30.486419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:30.487147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:30.487746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:30.488650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:30.489268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:30.489874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:30.505030 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] HTTP exception thrown: Instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 could not be found. Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Request method failure captured: Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 HTTP/1.1 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBurlOSG2IkxF_LFDThlwSF8-psoTn5bLcQiKk9MOMxAiWlXeohGSygCPKbDCEff41uIJcPcyTPOlyxgB4loykYiHuQaNN31z5a5ufRihUue4O7472OMbwLQ8O0Xb9K9UC1doM_rwL5_2_Zslcqv3cDFEXSglhCqgMTHtCGHiquBslo Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc800102cc1463eab50923ae3bcd9e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b69293ed019d421aa34dd62c232eb131 Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 could not be found. Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8f358d61-64bf-4efb-908b-5ba233a11fb2'} Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 could not be found. Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 could not be found. Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:30.506977 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:30.511788 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:30.511788 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:30.511788 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:30.511788 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:30.511788 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:30.511788 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 could not be found. Oct 28 18:16:30.511788 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:30.513193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Returning 404 to user: Instance 8f358d61-64bf-4efb-908b-5ba233a11fb2 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:30.514271 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a07fe569-c674-4a5e-9209-a18dbb3bf2ec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2" status: 404 len: 111 microversion: 2.1 time: 0.039633 Oct 28 18:16:30.516369 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1748/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:30 2022] GET /compute/v2.1/servers/8f358d61-64bf-4efb-908b-5ba233a11fb2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:16:30.524930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:30.526579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:30.531424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:30.536683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:30.537455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:30.538167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:30.539120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:30.539731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:30.540556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:30.568070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:30.596712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:30.803381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:30.804519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:30.821080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:30.822055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:30.823777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:30.831752 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a7f6277a-a66a-487a-9de3-e661a1d8cc95 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 204 len: 0 microversion: 2.1 time: 0.310031 Oct 28 18:16:30.838229 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1623/3371] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:30 2022] DELETE /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:30.841360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:30.843573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:30.844361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:30.867630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:30.868269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:30.895939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:30.897642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:30.899433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:30.900962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:30.902975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:30.904002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:30.966852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:31.089768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:31.121304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:31.123123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:31.125677 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1e2b204e-0d53-43b5-8d45-844b3ec58a63 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.332617 Oct 28 18:16:31.126670 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1749/3372] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:30 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:31.131785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:31.132674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:31.140799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:31.141607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:31.142205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:31.143117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:31.143731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:31.144595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:31.196006 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-33b75c7b-d679-429e-8249-c4a7f371b91e tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 204 len: 0 microversion: 2.1 time: 0.354484 Oct 28 18:16:31.200341 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1624/3373] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:30 2022] DELETE /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:31.206862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ebf5aee4-e716-4ff8-b74f-1f9915c1face req-6db179fb-d126-48af-8e35-8c7d7277c86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f49b0af-abe0-4242-9f3d-1d789b7965dc", "name": "network-vif-deleted", "tag": "bbfe69b9-90a5-4025-9383-d47f8e337e61"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:31.240954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ebf5aee4-e716-4ff8-b74f-1f9915c1face req-6db179fb-d126-48af-8e35-8c7d7277c86c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:31.241736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ebf5aee4-e716-4ff8-b74f-1f9915c1face req-6db179fb-d126-48af-8e35-8c7d7277c86c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:31.242336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ebf5aee4-e716-4ff8-b74f-1f9915c1face req-6db179fb-d126-48af-8e35-8c7d7277c86c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:31.276555 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ebf5aee4-e716-4ff8-b74f-1f9915c1face req-6db179fb-d126-48af-8e35-8c7d7277c86c service nova] Creating event network-vif-deleted:bbfe69b9-90a5-4025-9383-d47f8e337e61 for instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc on n-h2-862404-2 Oct 28 18:16:31.288880 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ebf5aee4-e716-4ff8-b74f-1f9915c1face req-6db179fb-d126-48af-8e35-8c7d7277c86c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086692 Oct 28 18:16:31.290702 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1625/3374] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:31.301983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:31.304328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:31.320269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:31.321112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:31.322252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:31.323139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:31.323751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:31.324350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:31.354002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:31.363643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-abf4bb11-c072-4305-bb71-9b04ce1f3d6b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1510 microversion: 2.1 time: 0.235769 Oct 28 18:16:31.364255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1750/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:31 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:31.381916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:31.382556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:31.392766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:31.393293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:31.394208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:31.395065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:31.395065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:31.395332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:31.422013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:31.429465 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a4a89d6-7829-4439-b8d0-9687a93f6a86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1282 microversion: 2.1 time: 0.135466 Oct 28 18:16:31.438736 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1626/3376] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:31 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:31.902077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1955634133", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "1f9c539f-abcf-42ea-86d6-df33321996ac"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:31.925056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:31.944388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7fd54a6b-1d44-4527-8cd1-47b196ed52d9 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 200 len: 1473 microversion: 2.1 time: 0.570090 Oct 28 18:16:31.945214 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1751/3377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:31 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 1473 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:32.005228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] validate_networks() for [('1f9c539f-abcf-42ea-86d6-df33321996ac', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:16:32.157793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:32.158587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:32.174813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:32.179662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:32.180448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:32.181929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:32.184308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:32.188858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:32.539123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:32.560459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:32.565726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:32.567458 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be408a52-c5a5-41aa-8af0-6cdf25be9751 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.414592 Oct 28 18:16:32.577132 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1752/3378] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:32 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:32.588101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:32.589584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:32.609215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:32.611541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:32.612299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:32.614231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:32.614977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:32.615655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:32.913780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:32.953984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d69252be-9865-42fb-b549-35f12505395e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1345 microversion: 2.1 time: 0.375168 Oct 28 18:16:32.993747 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1753/3379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:32 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1345 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:33.009353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:33.013373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:33.068297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:33.071717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:33.072377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:33.075834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:33.076912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:33.083949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:33.312423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:16:33.312877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:16:33.313313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:16:33.313721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:16:33.316695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:16:33.322456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:33.333156 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c088824-2596-48e4-bc41-cc92edccadb7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1282 microversion: 2.1 time: 0.337909 Oct 28 18:16:33.338926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:33.339701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:33.348109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:33.349017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:33.349149 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1754/3380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:32 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1282 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:33.349514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:33.349960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:33.365969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:33.368012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:33.383432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:33.393532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:33.394911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:33.395898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:33.396639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:33.397271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:33.425533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Getting quotas for project cba701c5ce114dd1b4136e2c154e2233. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:33.452209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Getting quotas for user 1601c82108f9480d9ee46004e51a5bce and project cba701c5ce114dd1b4136e2c154e2233. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:33.485692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:16:33.488561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:16:33.607962 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-57311c44-e40e-4dc8-afbb-5ce82b7503b3 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.828670 Oct 28 18:16:33.614664 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1627/3381] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:16:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:16:33.629098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:33.632512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:33.654319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:33.658599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:33.661743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:33.663789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:33.664809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:33.670276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:34.350830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:34.362544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ed33957-669a-4407-854c-c7e2b616c5dc tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 200 len: 1473 microversion: 2.1 time: 1.008981 Oct 28 18:16:34.365046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1755/3382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:33 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 1473 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:34.398653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9ccab8e-00b0-4261-a05e-821443f27101 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:34.404807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9ccab8e-00b0-4261-a05e-821443f27101 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:34.524123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:34.533652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:34.542265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:34.543769 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-afb5f8b3-7ffd-4f67-b53f-3e403cbb532b tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.927861 Oct 28 18:16:34.546444 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1628/3383] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:33 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:34.551186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9ccab8e-00b0-4261-a05e-821443f27101 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:34.554544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:34.556161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:34.567520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9ccab8e-00b0-4261-a05e-821443f27101 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:34.569203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9ccab8e-00b0-4261-a05e-821443f27101 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:34.570437 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9ccab8e-00b0-4261-a05e-821443f27101 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1259 microversion: 2.21 time: 0.192592 Oct 28 18:16:34.572221 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1756/3384] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:34 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:34.574558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:34.576343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:34.578663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:34.579636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:34.582881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:34.583407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:34.604496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:34.606996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:34.621682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:34.625532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:34.626298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:34.627301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:34.629148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:34.630348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:34.740222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:34.751547 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cd887dba-0809-4699-8b54-f2c8508f9c26 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1345 microversion: 2.1 time: 0.203422 Oct 28 18:16:34.755697 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1629/3385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:34 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:35.214793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:35.223444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c38782b-94d1-4536-8058-6b3f321b008e tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.636533 Oct 28 18:16:35.232373 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1757/3386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:34 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:35.392179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:35.393135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:35.401362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:35.401864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:35.402310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:35.403080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:35.415063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:35.415421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:35.461421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f2599fd4-78c6-4391-8a86-f88c13369a58 req-9d27d60d-0553-483c-b005-05ebdc6eccb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a6ffc8-fd33-4acf-b318-897c0bbfcb56", "name": "network-vif-deleted", "tag": "b8b4269d-c2f8-4a2e-9f91-2f32717778f0"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:35.500424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2599fd4-78c6-4391-8a86-f88c13369a58 req-9d27d60d-0553-483c-b005-05ebdc6eccb2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:35.500921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2599fd4-78c6-4391-8a86-f88c13369a58 req-9d27d60d-0553-483c-b005-05ebdc6eccb2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:35.501364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2599fd4-78c6-4391-8a86-f88c13369a58 req-9d27d60d-0553-483c-b005-05ebdc6eccb2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:35.551218 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f2599fd4-78c6-4391-8a86-f88c13369a58 req-9d27d60d-0553-483c-b005-05ebdc6eccb2 service nova] Creating event network-vif-deleted:b8b4269d-c2f8-4a2e-9f91-2f32717778f0 for instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 on n-h2-862404-2 Oct 28 18:16:35.573642 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f2599fd4-78c6-4391-8a86-f88c13369a58 req-9d27d60d-0553-483c-b005-05ebdc6eccb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115792 Oct 28 18:16:35.577004 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1758/3387] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:35.590940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:35.592785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:35.607373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:35.609444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:35.609940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:35.610680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:35.611152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:35.611621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:35.631366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:35.640800 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a964a709-0ac6-45d0-85ab-74e04caab292 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 200 len: 1431 microversion: 2.1 time: 0.252659 Oct 28 18:16:35.652232 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1630/3388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:35 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 1431 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:35.659422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:35.662942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:35.692999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:35.695026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:35.707379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:35.708151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:35.709086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:35.717503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:35.718653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:35.875250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:35.915679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:35.917642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:35.925624 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d013de6-e727-4808-8d43-bd85960d8fa1 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.346837 Oct 28 18:16:35.926237 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1759/3389] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:35 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:35.962566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:35.964099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:35.998345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:35.999409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:35.999892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:36.000624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:36.001092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:36.001528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:36.043519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:36.052208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:36.070038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:36.078477 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f6586fdf-b10d-4a14-8f11-d6e301e12daa tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1311 microversion: 2.21 time: 0.424245 Oct 28 18:16:36.079130 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1631/3390] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:35 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1311 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:36.258713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:36.259581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:36.267605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:36.272544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:36.273259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:36.274201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:36.274877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:36.275528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:36.279002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:36.291323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-83153f10-5a8f-4178-a260-868c27d52583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1345 microversion: 2.1 time: 0.357091 Oct 28 18:16:36.303985 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1760/3391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:35 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1345 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:36.573794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:36.592552 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8736f300-0961-43a0-ba65-299891efb31b tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.333005 Oct 28 18:16:36.594995 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1632/3392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:36 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:36.666758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:36.667386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:36.677696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:36.678451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:36.679547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:36.681495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:36.684161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:36.684768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:36.824335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:36.824483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:36.824896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:36.825333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lazy-loading 'fault' on Instance uuid 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:36.957618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:36.958161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:36.969138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:36.969650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:36.970103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:36.970828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:36.971292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:36.986415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:37.003688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:37.077467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:37.088377 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5aae7441-0c24-4482-8bca-17ef996e8b4f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 200 len: 1308 microversion: 2.1 time: 0.425547 Oct 28 18:16:37.093911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1761/3393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:36 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:37.132758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:37.145821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:37.147310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:37.148699 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d68c604b-0f53-4c7a-932f-c50ce7e99a79 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.195338 Oct 28 18:16:37.156748 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1633/3394] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:36 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:37.174046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:37.174704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:37.186285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:37.186952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:37.187648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:37.188404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:37.188867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:37.193088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:37.333883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:37.361496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:37.369748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:37.374016 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-99159c92-d627-4606-8658-fc744c6eb3e7 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1317 microversion: 2.21 time: 0.215464 Oct 28 18:16:37.376277 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1634/3395] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:37 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:37.412518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:37.413602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:37.444235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:37.444751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:37.445206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:37.445939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:37.449852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:37.450839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:37.467372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5b725962-b3e2-4b66-8fc8-f49ec7de5844 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Action: 'create', calling method: .version_select at 0x7f78de4e0940>, body: {"keypair": {"name": "tempest-keypair-220558092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6Wc4gg5YPJcaEqs7oHCmZpJMw2kcuhAxYIZDSTLWDxGVvI+CGcGDgkT/kjcu345OyBfsT8EtBwEN75xX3pX3dwrJ5RvPS92q9no2InqI499PoqJRj3lyURlU1S8+hBrw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:37.503606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5b725962-b3e2-4b66-8fc8-f49ec7de5844 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:37.534127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5b725962-b3e2-4b66-8fc8-f49ec7de5844 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for user ce6764014c81465a96518bd220b3eed8 and project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:37.597419 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5b725962-b3e2-4b66-8fc8-f49ec7de5844 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.490292 Oct 28 18:16:37.598703 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1762/3396] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:16:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:37.609927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe654de4-120a-45c3-ada3-ff118e782e50 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Calling method '.version_select at 0x7f78dd705ca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:37.629796 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe654de4-120a-45c3-ada3-ff118e782e50 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-220558092" status: 200 len: 497 microversion: 2.1 time: 0.024560 Oct 28 18:16:37.635389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1763/3397] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Oct 28 18:16:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-220558092 => generated 497 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:37.641128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:37.652098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:37.652753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:37.656504 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a88afc76-3cf1-4a4b-827e-2e7a07f67a1b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1345 microversion: 2.1 time: 0.267900 Oct 28 18:16:37.659414 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1635/3398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:37 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:37.665461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:37.665975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:37.666428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:37.671529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93c9a9fe-6d37-4427-a725-1fed87b59f0a tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Calling method '.version_select at 0x7f78de4eb8b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:37.676654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:37.677162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:37.677630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:37.710875 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-93c9a9fe-6d37-4427-a725-1fed87b59f0a tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220558092" status: 202 len: 0 microversion: 2.1 time: 0.049008 Oct 28 18:16:37.712391 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1636/3399] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:16:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220558092 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:16:37.723613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2c59a5e9-0c05-4afb-9552-0284b5fe91cf req-52035bcb-cfd5-43ca-8cc3-ba9d982e1861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4", "name": "network-vif-deleted", "tag": "688d9718-ad07-478f-bce3-450b34064388"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:37.744242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c59a5e9-0c05-4afb-9552-0284b5fe91cf req-52035bcb-cfd5-43ca-8cc3-ba9d982e1861 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:37.744996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c59a5e9-0c05-4afb-9552-0284b5fe91cf req-52035bcb-cfd5-43ca-8cc3-ba9d982e1861 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:37.745630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c59a5e9-0c05-4afb-9552-0284b5fe91cf req-52035bcb-cfd5-43ca-8cc3-ba9d982e1861 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:37.783014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2c59a5e9-0c05-4afb-9552-0284b5fe91cf req-52035bcb-cfd5-43ca-8cc3-ba9d982e1861 service nova] Creating event network-vif-deleted:688d9718-ad07-478f-bce3-450b34064388 for instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 on n-h1-862404-2 Oct 28 18:16:37.790427 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2c59a5e9-0c05-4afb-9552-0284b5fe91cf req-52035bcb-cfd5-43ca-8cc3-ba9d982e1861 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076031 Oct 28 18:16:37.791758 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1637/3400] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:37.799724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6844f7da-d8d6-4c52-a703-1c562f984783 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Action: 'create', calling method: .version_select at 0x7f78dea92040>, body: {"keypair": {"name": "tempest-keypair-920705417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBD0iqOg4IZFbV2WRNZBpnP74WbaRMf7PoA/FFwY8yuVNwuuOxv7ck4gBc4bzM8WHte5vDFuDCd2hr1JvlNCc/6B8wepABQFpiz7r6eFWThOvX51fdvtuor66Esq5DC5A=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:37.834385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6844f7da-d8d6-4c52-a703-1c562f984783 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:37.844444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-6844f7da-d8d6-4c52-a703-1c562f984783 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for user ce6764014c81465a96518bd220b3eed8 and project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:37.878147 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6844f7da-d8d6-4c52-a703-1c562f984783 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084396 Oct 28 18:16:37.879626 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1638/3401] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:16:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:37.898958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4da6b11f-fb67-49f7-b5ed-b63a94698c52 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Calling method '.version_select at 0x7f78e237ea60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:37.939535 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4da6b11f-fb67-49f7-b5ed-b63a94698c52 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920705417" status: 202 len: 0 microversion: 2.1 time: 0.051992 Oct 28 18:16:37.940940 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1639/3402] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:16:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920705417 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:16:37.953106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-db54c438-82df-4eee-bff1-d38630145009 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Action: 'create', calling method: .version_select at 0x7f78de316b80>, body: {"keypair": {"name": "tempest-keypair-523625710", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:37.975839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-db54c438-82df-4eee-bff1-d38630145009 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:37.983804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-db54c438-82df-4eee-bff1-d38630145009 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for user ce6764014c81465a96518bd220b3eed8 and project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:38.042324 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-db54c438-82df-4eee-bff1-d38630145009 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.094465 Oct 28 18:16:38.043422 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1640/3403] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:16:37 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:38.047912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:38.059515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74c3841a-d90d-4728-8cf1-451cbb5b26f1 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Calling method '.version_select at 0x7f78de279f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.068869 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61d8a39f-4c4b-4ecc-a5d5-4b8cc363bd31 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.432027 Oct 28 18:16:38.071647 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1764/3404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:37 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:38.090929 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74c3841a-d90d-4728-8cf1-451cbb5b26f1 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523625710" status: 202 len: 0 microversion: 2.1 time: 0.037135 Oct 28 18:16:38.104997 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1641/3405] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523625710 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:16:38.107425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6ff1ebd-6a72-498f-8dc2-6143c8f4ca26 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Action: 'create', calling method: .version_select at 0x7f78e23cd550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-823586207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgLghajrME9bO1GR0Xf88B8vy8OKnTttwqfvZZ5D2WE9sogysqUABLdEGLSVnzSUXDw+LKiVYkKn2TcOJKVSZrIRb84k+7WcunS3ueQHT4liYYxUcMCRYnv3ezJdsHLyA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:38.119652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.120778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 88a6ffc8-fd33-4acf-b318-897c0bbfcb56] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:38.128057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.128768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.129317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.130140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.130714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.131253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.143786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:38.149239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a6ff1ebd-6a72-498f-8dc2-6143c8f4ca26 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:38.150193 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] HTTP exception thrown: Instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 could not be found. Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Request method failure captured: Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 HTTP/1.1 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBurlOSG2IkxF_LFDThlwSF8-psoTn5bLcQiKk9MOMxAiWlXeohGSygCPKbDCEff41uIJcPcyTPOlyxgB4loykYiHuQaNN31z5a5ufRihUue4O7472OMbwLQ8O0Xb9K9UC1doM_rwL5_2_Zslcqv3cDFEXSglhCqgMTHtCGHiquBslo Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc800102cc1463eab50923ae3bcd9e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: b69293ed019d421aa34dd62c232eb131 Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 could not be found. Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '88a6ffc8-fd33-4acf-b318-897c0bbfcb56'} Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 could not be found. Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 could not be found. Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:38.152931 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.157735 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:38.157735 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:38.157735 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:38.157735 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:38.157735 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:38.157735 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 could not be found. Oct 28 18:16:38.157735 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.158960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Returning 404 to user: Instance 88a6ffc8-fd33-4acf-b318-897c0bbfcb56 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:38.159985 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-51f29607-55b6-44cd-8105-32dbe1122bcd tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56" status: 404 len: 111 microversion: 2.1 time: 0.045540 Oct 28 18:16:38.161013 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1642/3406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:38 2022] GET /compute/v2.1/servers/88a6ffc8-fd33-4acf-b318-897c0bbfcb56 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:38.163774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a6ff1ebd-6a72-498f-8dc2-6143c8f4ca26 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for user ce6764014c81465a96518bd220b3eed8 and project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:38.172460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.174256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:38.183085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.183785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.184540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.187095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.187724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.188424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.208939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] HTTP exception thrown: Instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 could not be found. Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Request method failure captured: Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 HTTP/1.1 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBurlOSG2IkxF_LFDThlwSF8-psoTn5bLcQiKk9MOMxAiWlXeohGSygCPKbDCEff41uIJcPcyTPOlyxgB4loykYiHuQaNN31z5a5ufRihUue4O7472OMbwLQ8O0Xb9K9UC1doM_rwL5_2_Zslcqv3cDFEXSglhCqgMTHtCGHiquBslo Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc800102cc1463eab50923ae3bcd9e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: b69293ed019d421aa34dd62c232eb131 Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 could not be found. Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4'} Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 could not be found. Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 could not be found. Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:38.211403 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.218225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:38.218225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:38.218225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:38.218225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:38.218225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:38.218225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 could not be found. Oct 28 18:16:38.218225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:38.218225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Returning 404 to user: Instance c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:38.219196 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a1cf493-b646-44f5-bee4-aa297f4d8efe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4" status: 404 len: 111 microversion: 2.1 time: 0.048199 Oct 28 18:16:38.220392 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1643/3407] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:38 2022] GET /compute/v2.1/servers/c7f31643-4ccc-4fbb-91c6-d4a9074bd0e4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:38.222666 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6ff1ebd-6a72-498f-8dc2-6143c8f4ca26 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.120297 Oct 28 18:16:38.231289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1765/3408] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:16:38 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:38.231289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-23b6e576-81a2-45e9-a48d-25c0e184a87a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.236138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.237065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:38.248176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.249407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.250153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.251140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.251976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.253040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.337057 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-23b6e576-81a2-45e9-a48d-25c0e184a87a tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e05c82c7-d4ec-4017-ad58-68fb7e5552cd" status: 204 len: 0 microversion: 2.1 time: 0.112519 Oct 28 18:16:38.337846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1766/3409] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:16:38 2022] DELETE /compute/v2.1/os-server-groups/e05c82c7-d4ec-4017-ad58-68fb7e5552cd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:38.343502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff5a5e04-626b-4dce-8a8a-5095b26e1a2f tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Action: 'create', calling method: .version_select at 0x7f78dd705550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-254658425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMibsxo0m5UMMAo4C1jFSum6762iCUH7HczjguETfa+mQOQvg26K1vTxYjezRdDyy3FeQf03Fgq3bYrLKPnH0TQ4tddY66D5j9p8ylKciAWS8woJlruizCJyE5mEb5wYRw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:38.365876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:38.379274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:38.379589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ff5a5e04-626b-4dce-8a8a-5095b26e1a2f tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:38.381341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:38.383612 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c4c4fdc3-66eb-4eec-9809-a9df96d5a8a5 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.161866 Oct 28 18:16:38.384630 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1644/3410] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:38 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:38.392326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.393034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:38.400814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.401404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ff5a5e04-626b-4dce-8a8a-5095b26e1a2f tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for user ce6764014c81465a96518bd220b3eed8 and project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:38.401529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.401970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.402836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.403655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.404110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.411290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:38.443765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:38.472797 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff5a5e04-626b-4dce-8a8a-5095b26e1a2f tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.133902 Oct 28 18:16:38.473454 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1767/3411] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:16:38 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:38.478577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.479211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:38.497083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.497507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.497959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.499212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.499733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.500197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.630788 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7525d22c-71ec-49b8-acd8-31234c704dec tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 204 len: 0 microversion: 2.1 time: 0.244368 Oct 28 18:16:38.632139 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1645/3412] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:38 2022] DELETE /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:38.640159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-07a1841c-72bb-4c17-8026-f05c95cff30a tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Action: 'create', calling method: .version_select at 0x7f78de7f6ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-98831345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBhEGXNHskABqAUOS+o1MUFefs/nvAEQZUeu8k9M9PPR2jrbuhldAqZpcmjCWtAjrus476up0tQ09QYieCi9CXldbdxhrld5gJxPaovU9hvBIL3vM6uD/VBZQ2ejUfRAw=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:38.667738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-07a1841c-72bb-4c17-8026-f05c95cff30a tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:38.676525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-07a1841c-72bb-4c17-8026-f05c95cff30a tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Getting quotas for user ce6764014c81465a96518bd220b3eed8 and project 9efb519bfee64d7da7e68dc446209cfc. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:38.718449 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-07a1841c-72bb-4c17-8026-f05c95cff30a tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.084212 Oct 28 18:16:38.719596 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1646/3413] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:16:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:38.727643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.728354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:38.735962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.736511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.737287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.738485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.738976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.740203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.782320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:38.885717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:38.895113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:38.899109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:38.900347 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba9546f4-3510-4f44-bc6a-40b9123e619a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1317 microversion: 2.21 time: 0.425779 Oct 28 18:16:38.901793 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e71ccd68-ac3e-4280-9776-97cc6ed2fd11 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 204 len: 0 microversion: 2.1 time: 0.180563 Oct 28 18:16:38.902932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1647/3414] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:38 2022] DELETE /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:38.909892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.911072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:38.913373 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1768/3415] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:38 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:38.918731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.919550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.920362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.921777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c7ff622-4390-425b-b5ee-0659098df70f tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Calling method '.version_select at 0x7f78e25455e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:38.921923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.922464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:38.923076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:38.925858 n-d-862404-2 devstack@n-api.service[120680]: WARNING oslo_db.sqlalchemy.utils [None req-5c7ff622-4390-425b-b5ee-0659098df70f tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 18:16:38.958248 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c7ff622-4390-425b-b5ee-0659098df70f tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1090 microversion: 2.1 time: 0.030241 Oct 28 18:16:38.959182 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1769/3416] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:38 2022] GET /compute/v2.1/os-keypairs => generated 1090 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:38.970806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-85b255a7-a01c-41c9-b7b1-b56026afee4f req-1ed669e7-0f8c-4043-85c4-63b22cd40134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25478cd-2f9f-4583-951f-41d008c3c3a5", "tag": "d5a3b6a7-7122-448d-8c80-a8cd327cc9f3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:38.995280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85b255a7-a01c-41c9-b7b1-b56026afee4f req-1ed669e7-0f8c-4043-85c4-63b22cd40134 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:38.996120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85b255a7-a01c-41c9-b7b1-b56026afee4f req-1ed669e7-0f8c-4043-85c4-63b22cd40134 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.001934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85b255a7-a01c-41c9-b7b1-b56026afee4f req-1ed669e7-0f8c-4043-85c4-63b22cd40134 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:39.024444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-85b255a7-a01c-41c9-b7b1-b56026afee4f req-1ed669e7-0f8c-4043-85c4-63b22cd40134 service nova] Creating event network-changed:d5a3b6a7-7122-448d-8c80-a8cd327cc9f3 for instance c25478cd-2f9f-4583-951f-41d008c3c3a5 on n-h2-862404-2 Oct 28 18:16:39.037816 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-85b255a7-a01c-41c9-b7b1-b56026afee4f req-1ed669e7-0f8c-4043-85c4-63b22cd40134 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071485 Oct 28 18:16:39.042374 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1770/3417] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:39.057576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:39.066916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:39.071140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:39.079069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:39.079909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.080588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:39.081697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:39.082440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.083139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:39.085601 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-12e3d34c-729e-4486-9481-fe83368a122d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1345 microversion: 2.1 time: 0.179698 Oct 28 18:16:39.087927 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1648/3418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:38 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:39.100727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a27a4f67-94ab-441c-8bbe-5b74ab01d235 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Calling method '.version_select at 0x7f78dee26310>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:39.109852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:39.147359 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a27a4f67-94ab-441c-8bbe-5b74ab01d235 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-98831345" status: 202 len: 0 microversion: 2.1 time: 0.058098 Oct 28 18:16:39.151235 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1649/3419] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-98831345 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:16:39.154493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:39.156006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:39.164161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:39.164816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.165375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:39.166207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:39.167489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.168161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:39.500723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:39.533865 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20d08c39-6234-4b66-9962-5ee8e3361087 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.383651 Oct 28 18:16:39.547848 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1650/3420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:39 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:39.553476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-120e6969-a713-4456-85c7-9da2a476c7f9 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Calling method '.version_select at 0x7f78de4ebb80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:39.567132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:39.581629 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b241f6ce-0d59-43c4-9f82-e9b570401507 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 200 len: 1475 microversion: 2.1 time: 0.537696 Oct 28 18:16:39.583344 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-120e6969-a713-4456-85c7-9da2a476c7f9 tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-254658425" status: 202 len: 0 microversion: 2.1 time: 0.045349 Oct 28 18:16:39.587018 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1771/3422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:39 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 1475 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:39.588033 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1651/3422] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-254658425 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:16:39.595086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4779da1-0fc8-4f25-ad4e-93dc7385348a tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] Calling method '.version_select at 0x7f78de96fca0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:39.604364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:39.604996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:39.611634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:39.612163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.612614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:39.613336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:39.613794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.614251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:39.621940 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4779da1-0fc8-4f25-ad4e-93dc7385348a tempest-KeyPairsV2TestJSON-69786121 tempest-KeyPairsV2TestJSON-69786121-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-823586207" status: 202 len: 0 microversion: 2.1 time: 0.032290 Oct 28 18:16:39.629160 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1652/3423] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-823586207 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:16:39.842357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:39.868922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:39.874772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:39.880900 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22bca509-a8ec-46d3-9b68-7e3a36ec0737 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.279081 Oct 28 18:16:39.896662 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1772/3424] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:39 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:39.928391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:39.929879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:39.944876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:39.945447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.946636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:39.947716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:39.947894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:39.948333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.113391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:40.114029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:40.128172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.129641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.130547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.131834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.132468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.133457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.169217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:40.183103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:40.185126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:40.186523 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-54b813ac-fd54-4dc2-a0a2-39b08ba36ef8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.262423 Oct 28 18:16:40.202866 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1653/3425] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:39 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:40.243406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:40.255318 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b452adc-bcda-40e8-a834-0e8e74aae68e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1345 microversion: 2.1 time: 0.148194 Oct 28 18:16:40.259108 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1773/3426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:40 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:40.561869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:40.562511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:40.565460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:40.579517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.581431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.584130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.585374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.585669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.586153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.610957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:40.611573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:40.617665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.618271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.618708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.619411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.619891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.620320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.926218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:40.934911 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2284f6d4-9387-46fb-859b-5c55f5241164 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.378350 Oct 28 18:16:40.935520 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1654/3427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:40 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:40.946117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:40.947229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:40.987307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:40.988507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.989536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.990772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.992382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.995564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.996317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7d6d489e-eebf-4d5f-a93f-e3682705e915 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 200 len: 1475 microversion: 2.1 time: 0.389414 Oct 28 18:16:40.996587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.998216 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1774/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:40 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 1475 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:41.131892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.142126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.153555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.155089 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0ae8280-2d0b-4e15-8f78-97350ffc9688 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.214208 Oct 28 18:16:41.155863 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1655/3429] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:40 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:41.214925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:41.216060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:41.228368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.232455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.234840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:41.237899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.238405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.238851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:41.260173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a300cd52-3ae3-4186-afd7-817722fb8ad6 req-c23835a5-b8ee-4074-a9b8-582d4dfd4022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508b5d48-392a-42bb-8ec6-377aabd672cb", "tag": "86aa975b-71cf-4190-bb57-93cdc011d0c8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:41.281732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a300cd52-3ae3-4186-afd7-817722fb8ad6 req-c23835a5-b8ee-4074-a9b8-582d4dfd4022 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.282235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a300cd52-3ae3-4186-afd7-817722fb8ad6 req-c23835a5-b8ee-4074-a9b8-582d4dfd4022 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.282669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a300cd52-3ae3-4186-afd7-817722fb8ad6 req-c23835a5-b8ee-4074-a9b8-582d4dfd4022 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:41.313491 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a300cd52-3ae3-4186-afd7-817722fb8ad6 req-c23835a5-b8ee-4074-a9b8-582d4dfd4022 service nova] Creating event network-changed:86aa975b-71cf-4190-bb57-93cdc011d0c8 for instance 508b5d48-392a-42bb-8ec6-377aabd672cb on n-h1-862404-2 Oct 28 18:16:41.321854 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a300cd52-3ae3-4186-afd7-817722fb8ad6 req-c23835a5-b8ee-4074-a9b8-582d4dfd4022 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067067 Oct 28 18:16:41.326658 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1656/3430] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:41.334793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:41.354470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:41.374366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.374882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.375334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:41.376108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.376580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.377008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:41.579390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.597329 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3ae1069e-d070-4936-97aa-d4d4905177f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 200 len: 1345 microversion: 2.1 time: 0.266813 Oct 28 18:16:41.607844 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1657/3431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:41 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 1345 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:41.762039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:41.769742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.770598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Searching by: {'deleted': False, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:16:41.783951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.784903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.785371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:41.788028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.789940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.790430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:41.838124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:16:41.908869 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b52f219b-5ac7-45d9-8369-20c8da6e9ec4 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.150647 Oct 28 18:16:41.917707 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1658/3432] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:16:41 2022] GET /compute/v2.1/servers => generated 334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:41.931319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:41.936988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.940871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Searching by: {'deleted': False, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:16:41.947405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.959658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.964830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:41.966018 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b238dad5-70ca-40d5-a5ae-346bcba43d18 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.755215 Oct 28 18:16:41.969296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.971964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.975315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:41.979094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:41.988468 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1775/3433] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:41 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:41.992689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:41.993872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.002281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:42.007334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:42.021957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.025806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.027730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.029803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.031223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.031908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.051268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:16:42.120868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:42.130834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.131529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.132294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.331883 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b75381ca-30d1-4a18-88b5-bca97206fac6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.404704 Oct 28 18:16:42.342703 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1659/3434] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:16:41 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:42.351333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:42.354400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:42.362801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.363382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.364362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.365282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.366153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.366815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.525837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:42.541446 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c285e259-bb82-4633-b66f-85bfc2e68b42 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 200 len: 1433 microversion: 2.1 time: 0.196063 Oct 28 18:16:42.543429 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1660/3435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:42 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 1433 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:42.558921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:42.559776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:42.576047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.576685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.577769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.578583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.579280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.591225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:42.602994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.616597 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5daa0139-a636-499d-a926-44b24acffc86 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.626278 Oct 28 18:16:42.617217 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1776/3436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:41 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:42.630809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c8b6adb2-d7e9-498d-bce0-7e634688cd62 req-4c024f04-c46d-4f05-85e7-c636de9820f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6", "name": "network-vif-deleted", "tag": "f5fcb9bc-34ba-42a9-8fe8-cebeedcb5338"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:42.672340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c8b6adb2-d7e9-498d-bce0-7e634688cd62 req-4c024f04-c46d-4f05-85e7-c636de9820f2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.673283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c8b6adb2-d7e9-498d-bce0-7e634688cd62 req-4c024f04-c46d-4f05-85e7-c636de9820f2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.674060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c8b6adb2-d7e9-498d-bce0-7e634688cd62 req-4c024f04-c46d-4f05-85e7-c636de9820f2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.693209 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c8b6adb2-d7e9-498d-bce0-7e634688cd62 req-4c024f04-c46d-4f05-85e7-c636de9820f2 service nova] Creating event network-vif-deleted:f5fcb9bc-34ba-42a9-8fe8-cebeedcb5338 for instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 on n-h1-862404-2 Oct 28 18:16:42.698527 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c8b6adb2-d7e9-498d-bce0-7e634688cd62 req-4c024f04-c46d-4f05-85e7-c636de9820f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076515 Oct 28 18:16:42.699138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1777/3437] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:42.705525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1129bc3b-afb6-44f3-9757-3fca31354dd3 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:42.713858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1129bc3b-afb6-44f3-9757-3fca31354dd3 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013223 Oct 28 18:16:42.726169 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1778/3438] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:42.728381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:42.732135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:42.733184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:42.740200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.741556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.742152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.743543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:42.744159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.744859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.745440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.746822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:42.748431 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a79ca18-fbaa-4bc2-a85b-eecd1e5cfb65 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.201175 Oct 28 18:16:42.757101 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1661/3439] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:42 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:42.764124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc HTTP/1.1 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '1f49b0af-abe0-4242-9f3d-1d789b7965dc'} Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:42.766206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:42.770143 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8794f10b-b1b0-468e-9a25-5c6810215a60 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 404 len: 111 microversion: 2.1 time: 0.042253 Oct 28 18:16:42.771606 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1779/3440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:42 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:42.932393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:42.934766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:42.959556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.960751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.963163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.966069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:42.966779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:42.967914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:42.972737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:42.990347 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc/os-volume_attachments HTTP/1.1 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'server_id': '1f49b0af-abe0-4242-9f3d-1d789b7965dc'} Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:42.999491 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-64f605bf-dbcf-4f1e-8036-c7ce700a40ed tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074064 Oct 28 18:16:43.007912 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1662/3441] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:16:42 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc/os-volume_attachments => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:43.011617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:43.012958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:43.029761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.038149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:43.039045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.039839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.040805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.041460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.041989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:43.042261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.064651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.065320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.065870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.066694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.067296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.067987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.145855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:43.280517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:43.286645 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62e73463-d814-4cde-ad08-c6e8eb802de0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "DELETE /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 204 len: 0 microversion: 2.1 time: 0.256050 Oct 28 18:16:43.287359 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1663/3442] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:43 2022] DELETE /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:16:43.297552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:43.299455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:43.299719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:43.302185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:43.303942 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da98c009-07b5-4090-854f-0d46bdefa45b tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.308339 Oct 28 18:16:43.316653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.317878 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1780/3443] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:42 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:43.322312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.322927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.324382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.325979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.331367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.336320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2082590205", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "70c5abb7-d4bd-4b29-a58f-099ce9f71832"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:43.456507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] validate_networks() for [('70c5abb7-d4bd-4b29-a58f-099ce9f71832', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:16:43.622748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:43.636728 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6c20aca7-7632-4ed7-bfb7-b7f622d36885 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1702 microversion: 2.1 time: 0.344368 Oct 28 18:16:43.637331 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1664/3444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:43 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1702 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:43.649336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-002514ca-f251-41a5-8bb7-f3398024ca9c req-5fd94db9-9d3e-489d-a00c-6eae834a038e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0074c72c-bbb0-4ab2-8aee-079cb1aef133", "name": "network-vif-deleted", "tag": "0b0d747a-b6c8-4925-b3ce-f5f4c717489c"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:43.659683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-002514ca-f251-41a5-8bb7-f3398024ca9c req-5fd94db9-9d3e-489d-a00c-6eae834a038e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.660298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-002514ca-f251-41a5-8bb7-f3398024ca9c req-5fd94db9-9d3e-489d-a00c-6eae834a038e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.660731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-002514ca-f251-41a5-8bb7-f3398024ca9c req-5fd94db9-9d3e-489d-a00c-6eae834a038e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.672359 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-002514ca-f251-41a5-8bb7-f3398024ca9c req-5fd94db9-9d3e-489d-a00c-6eae834a038e service nova] Creating event network-vif-deleted:0b0d747a-b6c8-4925-b3ce-f5f4c717489c for instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 on n-h1-862404-2 Oct 28 18:16:43.677394 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-002514ca-f251-41a5-8bb7-f3398024ca9c req-5fd94db9-9d3e-489d-a00c-6eae834a038e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038908 Oct 28 18:16:43.678181 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1665/3445] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:43.683179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:43.683901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:43.691954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.692500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.693091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.693840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.694500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.695077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.765676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:43.773981 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45fbbe1c-0cd9-4eff-b1a0-bd646bab0126 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 200 len: 1433 microversion: 2.1 time: 0.094628 Oct 28 18:16:43.788314 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1666/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:43 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 1433 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:43.788314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:43.788314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:43.788314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.788314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.788314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.788314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.788314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.789032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.960608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:43.974424 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-971706f9-233b-41b1-ae3a-487e1cb0cd0c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.198775 Oct 28 18:16:43.978083 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1667/3447] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:43 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:43.982004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:43.982812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:43.991200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.992008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.992715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:43.993655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:43.994124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:43.994754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.072250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:44.083787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:44.085498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:44.087094 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ab8354de-bd97-46b0-bfa8-2939a7309b74 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.109420 Oct 28 18:16:44.088842 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1668/3448] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:43 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:44.338741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:44.339808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:44.353200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.353930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.354393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.355430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.355918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.356348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.505218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:44.537810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:44.542119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:44.543249 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-21a41fdb-d4f6-4276-b54e-248aa79cd501 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.208740 Oct 28 18:16:44.544064 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1669/3449] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:44 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:44.560629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:16:44.563070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:16:44.563906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:16:44.564407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:16:44.564918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:16:44.591713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.592518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.593080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.600650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.606456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.607590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.651544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:44.661154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:44.663048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:44.669701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for user 84bb8a18e9264efbaef518e6a5ae0e32 and project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:44.675586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.676139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.676762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.677633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.685439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.686881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.711871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:16:44.721996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: fb82eee7-37ae-402d-b372-2cb97204b5b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:16:44.824285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a374b7dd-ea61-4045-8e84-fa4beb1cc9a6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.500536 Oct 28 18:16:44.825442 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1781/3450] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:16:44.831084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:44.832270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:44.848432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.849109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.852273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.853049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.853523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.854125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.899504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:44.900037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:44.900481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:44.900934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lazy-loading 'fault' on Instance uuid 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:45.006391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:45.021400 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04d5ece4-2cd8-4462-b9fc-d2305518d603 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 200 len: 1309 microversion: 2.1 time: 0.194728 Oct 28 18:16:45.038060 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1782/3451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:44 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:45.038779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:45.044525 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14e51172-6116-4a6e-8ea3-11e11c081da6 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1702 microversion: 2.1 time: 0.387250 Oct 28 18:16:45.045127 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1670/3452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:44 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1702 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:45.057872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90b78eff-59a7-4b91-bfdd-c51d3cec92e4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:45.062425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:45.062846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90b78eff-59a7-4b91-bfdd-c51d3cec92e4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: fb82eee7-37ae-402d-b372-2cb97204b5b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:45.063068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:45.079544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:45.080068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:45.080562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:45.081328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:45.081656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:45.082081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:45.183503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-90b78eff-59a7-4b91-bfdd-c51d3cec92e4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:45.199427 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90b78eff-59a7-4b91-bfdd-c51d3cec92e4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6" status: 200 len: 1215 microversion: 2.1 time: 0.152057 Oct 28 18:16:45.200415 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1783/3453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:45 2022] GET /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:45.210078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:45.210708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:45.224320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:45.224745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:45.225294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:45.226203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:45.226715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:45.227153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:45.260658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:45.270426 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-67658291-4db5-4550-ac15-06dc1c10190c tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.222896 Oct 28 18:16:45.271227 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1671/3454] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:45 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:45.278182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25d90d39-838f-463d-a997-848b58a190ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:45.278753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25d90d39-838f-463d-a997-848b58a190ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: fb82eee7-37ae-402d-b372-2cb97204b5b6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:45.297791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25d90d39-838f-463d-a997-848b58a190ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: fb82eee7-37ae-402d-b372-2cb97204b5b6] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:45.472899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:45.482135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:45.490450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:45.491871 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-beef1965-ae08-4d0e-af25-1ece4a5ca12e tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.290352 Oct 28 18:16:45.510148 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1784/3455] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:45 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:45.573832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:45.574497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:45.586643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:45.587142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:45.587582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:45.593003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:45.596216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:45.596697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:45.619240 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.scheduler.client.report [None req-25d90d39-838f-463d-a997-848b58a190ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Deleted allocations for instance fb82eee7-37ae-402d-b372-2cb97204b5b6 Oct 28 18:16:45.647171 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25d90d39-838f-463d-a997-848b58a190ba tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6" status: 204 len: 0 microversion: 2.1 time: 0.374596 Oct 28 18:16:45.647844 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1672/3456] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:45 2022] DELETE /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:45.659153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:45.660462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: fb82eee7-37ae-402d-b372-2cb97204b5b6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:45.668768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:45.670208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:45.671255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:45.672686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:45.673379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:45.674038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:45.691238 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6 HTTP/1.1 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'fb82eee7-37ae-402d-b372-2cb97204b5b6'} Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:45.693225 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f38abe81-7ee0-4346-84f9-c7f12350d21b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6" status: 404 len: 111 microversion: 2.1 time: 0.042665 Oct 28 18:16:45.697182 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1673/3457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:45 2022] GET /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:16:45.752240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-268069784", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "70c5abb7-d4bd-4b29-a58f-099ce9f71832"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:45.820876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] validate_networks() for [('70c5abb7-d4bd-4b29-a58f-099ce9f71832', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:16:46.200000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:46.218876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:46.220489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:46.223308 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c59b3c1-7148-427e-9064-9fe8e04e595e tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.656233 Oct 28 18:16:46.225374 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1785/3458] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:45 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:46.234893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:46.236571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:46.247719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.249380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.250286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.251841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.252506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.253259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.309181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.310136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.310925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.312619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lazy-loading 'fault' on Instance uuid 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:46.383676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:16:46.384321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:16:46.384797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:16:46.385221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:16:46.385610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:16:46.396766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.397179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.397612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.398335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.398789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.399209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.408676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:46.417859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:46.424432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for user 84bb8a18e9264efbaef518e6a5ae0e32 and project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:46.425544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38285c34-e764-4847-ba39-848a9182fe7c tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 200 len: 1309 microversion: 2.1 time: 0.198865 Oct 28 18:16:46.427334 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1786/3459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:46 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:46.437883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:46.438774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:46.452513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.453026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.453471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.454189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.454851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.455439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.456174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:16:46.458569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:16:46.549497 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fdf70851-8ba3-408f-8470-1745f3870ac7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802351 Oct 28 18:16:46.550508 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1674/3460] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:16:46.555616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9a8b2a68-9568-447d-b3cb-7bb2ba34af43 req-15ab076e-76da-4a60-b949-194b33f0d74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25478cd-2f9f-4583-951f-41d008c3c3a5", "name": "network-vif-plugged", "status": "completed", "tag": "d5a3b6a7-7122-448d-8c80-a8cd327cc9f3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:46.574690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9a8b2a68-9568-447d-b3cb-7bb2ba34af43 req-15ab076e-76da-4a60-b949-194b33f0d74b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.575682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9a8b2a68-9568-447d-b3cb-7bb2ba34af43 req-15ab076e-76da-4a60-b949-194b33f0d74b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.576404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9a8b2a68-9568-447d-b3cb-7bb2ba34af43 req-15ab076e-76da-4a60-b949-194b33f0d74b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.590271 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9a8b2a68-9568-447d-b3cb-7bb2ba34af43 req-15ab076e-76da-4a60-b949-194b33f0d74b service nova] Creating event network-vif-plugged:d5a3b6a7-7122-448d-8c80-a8cd327cc9f3 for instance c25478cd-2f9f-4583-951f-41d008c3c3a5 on n-h2-862404-2 Oct 28 18:16:46.597845 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9a8b2a68-9568-447d-b3cb-7bb2ba34af43 req-15ab076e-76da-4a60-b949-194b33f0d74b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045901 Oct 28 18:16:46.603344 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1675/3461] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:46.609919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:46.611462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:46.625889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.626869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.627540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.633080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.633979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.636957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.941875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:46.950870 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f26f4cb-0dc8-44b4-8a78-77b529a8ae6a tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1702 microversion: 2.1 time: 0.521806 Oct 28 18:16:46.959111 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1787/3462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:46 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1702 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:46.964104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:46.968878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:46.979445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.984340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.984953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:46.985867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:46.986343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:46.986766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.156748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:47.171296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:47.179605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:47.182793 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe4ebfdd-7a5b-4a59-b5c6-5c29ede549d3 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.222402 Oct 28 18:16:47.184494 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1788/3463] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:46 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:47.206033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:47.216514 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9f388a39-6afb-4c17-a991-da4c20e9947f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.611299 Oct 28 18:16:47.220164 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1676/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:46 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:47.234484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a9e2aee8-6679-4e0d-bec1-941fb38081df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:47.236374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a9e2aee8-6679-4e0d-bec1-941fb38081df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:47.255625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:47.257833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:47.274689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.275212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.277900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.280829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.281927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.283191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.370097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a9e2aee8-6679-4e0d-bec1-941fb38081df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:47.384354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a9e2aee8-6679-4e0d-bec1-941fb38081df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1214 microversion: 2.1 time: 0.197975 Oct 28 18:16:47.386940 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1789/3465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:47 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:47.454386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:47.455360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:47.469929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.477313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.479467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.483923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.486398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.488212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.538687 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] HTTP exception thrown: Instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 could not be found. Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Request method failure captured: Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 HTTP/1.1 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBurlOSG2IkxF_LFDThlwSF8-psoTn5bLcQiKk9MOMxAiWlXeohGSygCPKbDCEff41uIJcPcyTPOlyxgB4loykYiHuQaNN31z5a5ufRihUue4O7472OMbwLQ8O0Xb9K9UC1doM_rwL5_2_Zslcqv3cDFEXSglhCqgMTHtCGHiquBslo Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc800102cc1463eab50923ae3bcd9e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b69293ed019d421aa34dd62c232eb131 Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 could not be found. Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6'} Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 could not be found. Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 could not be found. Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:47.542949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.548621 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:47.548621 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:47.548621 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:47.548621 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:47.548621 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:47.548621 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 could not be found. Oct 28 18:16:47.548621 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.551650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Returning 404 to user: Instance 83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:47.555504 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab7af5a0-9805-452d-9145-9e9c5eed1afe tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6" status: 404 len: 111 microversion: 2.1 time: 0.104120 Oct 28 18:16:47.556172 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1790/3466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:47 2022] GET /compute/v2.1/servers/83f0bbb6-6a74-4d2b-91be-e0d7023d4ca6 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:47.566829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:47.570768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 0074c72c-bbb0-4ab2-8aee-079cb1aef133] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:47.590005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.594348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.594701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.599329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.600261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.600881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.634032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] HTTP exception thrown: Instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 could not be found. Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Request method failure captured: Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 HTTP/1.1 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBurlOSG2IkxF_LFDThlwSF8-psoTn5bLcQiKk9MOMxAiWlXeohGSygCPKbDCEff41uIJcPcyTPOlyxgB4loykYiHuQaNN31z5a5ufRihUue4O7472OMbwLQ8O0Xb9K9UC1doM_rwL5_2_Zslcqv3cDFEXSglhCqgMTHtCGHiquBslo Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc800102cc1463eab50923ae3bcd9e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b69293ed019d421aa34dd62c232eb131 Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 could not be found. Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0074c72c-bbb0-4ab2-8aee-079cb1aef133'} Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 could not be found. Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 could not be found. Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:47.639086 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.647191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:47.647191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:47.647191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:47.647191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:47.647191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:47.647191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 could not be found. Oct 28 18:16:47.647191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:16:47.650453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Returning 404 to user: Instance 0074c72c-bbb0-4ab2-8aee-079cb1aef133 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:47.651710 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b541f97-621c-48d1-818f-42c5b765dc1d tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133" status: 404 len: 111 microversion: 2.1 time: 0.088980 Oct 28 18:16:47.652874 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1791/3467] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:47 2022] GET /compute/v2.1/servers/0074c72c-bbb0-4ab2-8aee-079cb1aef133 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:47.664584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33eb0f85-39c6-4416-a919-51c5503cf154 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:47.672951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:47.704345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33eb0f85-39c6-4416-a919-51c5503cf154 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/73160af1-6986-4ffe-a141-fa77e5515ff6" status: 204 len: 0 microversion: 2.1 time: 0.046046 Oct 28 18:16:47.705863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1792/3468] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:16:47 2022] DELETE /compute/v2.1/os-server-groups/73160af1-6986-4ffe-a141-fa77e5515ff6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:47.714843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:47.715440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:47.722832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.723633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.724326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.725277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.725943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.726613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.765712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:47.805865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:47.876086 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc96ec42-ea0a-4fde-8a45-3d7229ab31d1 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "DELETE /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 204 len: 0 microversion: 2.1 time: 0.165232 Oct 28 18:16:47.880739 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1793/3469] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:47 2022] DELETE /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:47.887744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:47.889050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:47.896822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:47.900769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.901756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.902424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.903406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.904583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.905674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.927365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:47.930973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:47.938727 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c1047488-959f-4ac1-94d2-428ef4b1a82a tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.688668 Oct 28 18:16:47.941005 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1677/3470] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:47 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:47.983164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:47.985040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:47.991708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.992613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.993447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:47.994291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:47.995123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:47.995976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.120379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:48.130999 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-61f741d3-48ef-4b76-ae95-d77ece71c1a0 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1634 microversion: 2.1 time: 0.152052 Oct 28 18:16:48.148231 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1678/3471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:47 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1634 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:48.218269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:48.219741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:48.228013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.229421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.230055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.231336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.232057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.232657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.590754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:48.603228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:48.604276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:48.608148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:48.611032 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8fe52cea-ec7e-4ea6-a4d6-ebbd0d35e903 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.398354 Oct 28 18:16:48.615041 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1679/3472] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:48 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:48.619688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76982687-93ca-48d8-a8c3-51c153bd20b0 tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1473 microversion: 2.1 time: 0.736804 Oct 28 18:16:48.620742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:48.621562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:48.632863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1794/3473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:47 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1473 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:48.643408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:48.644323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:48.652489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.653561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.654257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.655766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.656519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.656964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.659737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.664830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.665321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.666069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.670832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.671325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.731030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:48.742956 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44400772-64b0-4640-8302-238aa5b843ff tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1210 microversion: 2.1 time: 0.105841 Oct 28 18:16:48.755880 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1795/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:48 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:48.787578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c9cc66b8-099b-42a4-8912-da4e2507779c req-f337b031-682a-44e1-8a5b-bd702e4575a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440b2b69-5998-49f9-aa5d-6b2cc75a7954", "name": "network-vif-deleted", "tag": "7f9cab0b-7a3f-4709-b7bf-17d55642d800"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:48.805572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9cc66b8-099b-42a4-8912-da4e2507779c req-f337b031-682a-44e1-8a5b-bd702e4575a9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.808476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9cc66b8-099b-42a4-8912-da4e2507779c req-f337b031-682a-44e1-8a5b-bd702e4575a9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.808985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9cc66b8-099b-42a4-8912-da4e2507779c req-f337b031-682a-44e1-8a5b-bd702e4575a9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.866939 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c9cc66b8-099b-42a4-8912-da4e2507779c req-f337b031-682a-44e1-8a5b-bd702e4575a9 service nova] Creating event network-vif-deleted:7f9cab0b-7a3f-4709-b7bf-17d55642d800 for instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 on n-h1-862404-2 Oct 28 18:16:48.893821 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c9cc66b8-099b-42a4-8912-da4e2507779c req-f337b031-682a-44e1-8a5b-bd702e4575a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109913 Oct 28 18:16:48.894478 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1796/3475] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:48.930673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:48.940567 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0b899a3-a427-47db-a896-c7cb12a2794f tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1324 microversion: 2.1 time: 0.323587 Oct 28 18:16:48.958725 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1680/3476] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:48 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:48.968902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:48.969624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:48.985721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.986229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.986672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:48.987403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:48.988290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:48.988526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.154722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:49.155417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:49.162226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.162606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.163050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.166727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.167251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.167702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.197674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:49.213980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.214433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.215142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.215602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lazy-loading 'fault' on Instance uuid 440b2b69-5998-49f9-aa5d-6b2cc75a7954 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:49.290490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcbbffbb8d29409ca6f7265593c9f384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cbc033276dd4b91a0e6bdfd5608b228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:49.310793 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ecda4c89-de9d-4c0e-bd36-ea69f849a6d9 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 200 len: 1360 microversion: 2.1 time: 0.159845 Oct 28 18:16:49.311512 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1681/3477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:49 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:49.595868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d589a1d2-3413-4fbd-a557-822497563fbf req-0e410451-71ea-4113-801b-b8d6dcd62d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508b5d48-392a-42bb-8ec6-377aabd672cb", "name": "network-vif-plugged", "status": "completed", "tag": "86aa975b-71cf-4190-bb57-93cdc011d0c8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:49.615482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d589a1d2-3413-4fbd-a557-822497563fbf req-0e410451-71ea-4113-801b-b8d6dcd62d9c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.616013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d589a1d2-3413-4fbd-a557-822497563fbf req-0e410451-71ea-4113-801b-b8d6dcd62d9c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.616450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d589a1d2-3413-4fbd-a557-822497563fbf req-0e410451-71ea-4113-801b-b8d6dcd62d9c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.660033 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d589a1d2-3413-4fbd-a557-822497563fbf req-0e410451-71ea-4113-801b-b8d6dcd62d9c service nova] Creating event network-vif-plugged:86aa975b-71cf-4190-bb57-93cdc011d0c8 for instance 508b5d48-392a-42bb-8ec6-377aabd672cb on n-h1-862404-2 Oct 28 18:16:49.692180 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d589a1d2-3413-4fbd-a557-822497563fbf req-0e410451-71ea-4113-801b-b8d6dcd62d9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095874 Oct 28 18:16:49.693352 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1682/3478] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:49.699011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:49.700210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:49.707127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.708047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.708892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.709851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.712465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.713181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.810356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:49.822242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:49.829682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:49.831158 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b1ce736e-d102-461e-8552-a3afa9757950 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.867694 Oct 28 18:16:49.852496 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1797/3479] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:48 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:49.863638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:49.864650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:49.871564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:49.875924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.877319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.877958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.878845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.880154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.880758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.889149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:49.891390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:49.893847 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fdad23eb-aed1-44cb-8265-caf35af976ab tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1409 microversion: 2.54 time: 0.198184 Oct 28 18:16:49.896583 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1683/3480] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:49 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:49.908940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:49.910377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:49.929580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.931929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.932840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:49.935459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:49.937369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:49.938076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.106513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:50.127977 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b006a240-498d-4590-b730-f8df5c957c55 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1266 microversion: 2.1 time: 0.230025 Oct 28 18:16:50.128934 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1684/3481] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:49 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:50.144042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:50.144735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:50.151121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:50.153459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:50.153956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:50.154698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.156874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:50.157700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:50.158303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.430422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:50.442960 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fcb33a53-023c-4ea4-801a-6e5efa0f22c7 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1522 microversion: 2.1 time: 0.312710 Oct 28 18:16:50.443492 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1685/3482] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:50 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:50.468056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:50.469232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] [instance: 440b2b69-5998-49f9-aa5d-6b2cc75a7954] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:50.476188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:50.477184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:50.477815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.478809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:50.479374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:50.479792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.503789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] HTTP exception thrown: Instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 could not be found. Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Request method failure captured: Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 HTTP/1.1 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwR_BsjZz7_4JfiHjAA_mByt6apyQqOAgQ-AUBZE7wrWTKaHhWv2ocbEqgU6ZGx_0pcrh4pjSDf9sWZGDgh4OeBepgimfh8u4mnh7QtW-DjZjdVQGIoAtZkibFITrbLdl72jzKfe5IXsHitipwAP95_rDAgwKovH6A_91vZ9o834PQ Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 0cbc033276dd4b91a0e6bdfd5608b228 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersTestJSON-1161197899 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cbc033276dd4b91a0e6bdfd5608b228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0cbc033276dd4b91a0e6bdfd5608b228"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0cbc033276dd4b91a0e6bdfd5608b228", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0cbc033276dd4b91a0e6bdfd5608b228"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersTestJSON-1161197899 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 0cbc033276dd4b91a0e6bdfd5608b228 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersTestJSON-1161197899 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersTestJSON-1161197899-project Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: fcbbffbb8d29409ca6f7265593c9f384 Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersTestJSON-1161197899-project Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 could not be found. Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '440b2b69-5998-49f9-aa5d-6b2cc75a7954'} Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 could not be found. Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 could not be found. Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:50.506354 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.511273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:50.511273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:50.511273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:50.511273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:50.511273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:50.511273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 could not be found. Oct 28 18:16:50.511273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.513005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Returning 404 to user: Instance 440b2b69-5998-49f9-aa5d-6b2cc75a7954 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:50.514056 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3cfcedf3-f8a0-4068-a2f1-a7ffadc40239 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954" status: 404 len: 111 microversion: 2.1 time: 0.056804 Oct 28 18:16:50.514955 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1686/3483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:50 2022] GET /compute/v2.1/servers/440b2b69-5998-49f9-aa5d-6b2cc75a7954 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:50.526662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:50.527805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:50.536370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:50.537171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:50.537828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.538757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:50.539553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:50.540206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.590681 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] HTTP exception thrown: Action 999 not found Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Request method failure captured: Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5/os-instance-actions/999 HTTP/1.1 Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBx5a5SrOTRTohNyfEGunWcEQ0wGMtyGubIW3y-woK9GBPrONt3sMe7YFlocyzs_ADyW7ialaLvCo9bqsAGepw5gPx9y7ATP2y270UL8k8FqzsnU6Wy5DU41Y6x9tSqy8gK3e0JXItW3vduyaU-O9JmRBp-tU5GL9FvBZZqGBcH5HSI Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 3582e5d532e644408f7680cbfb641c2a Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3582e5d532e644408f7680cbfb641c2a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 3582e5d532e644408f7680cbfb641c2a Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceActionsNegativeTestJSON-1068064645-project Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8435105202cf4562842047923c91993f Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1068064645-project Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: exception: Action 999 not found Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'server_id': 'c25478cd-2f9f-4583-951f-41d008c3c3a5', 'id': '999'} Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 28 18:16:50.606144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.610939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Returning 404 to user: Action 999 not found {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:50.610939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e381f2ef-250a-4756-9220-65c9bf57ab11 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.088269 Oct 28 18:16:50.616190 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1687/3484] 10.222.0.16 () {58 vars in 1308 bytes} [Fri Oct 28 18:16:50 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5/os-instance-actions/999 => generated 66 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:16:50.637095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4521fc55-d182-4abf-b726-6c78c7adddf3 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] Calling method '.version_select at 0x7f78dee26790>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:50.692570 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4521fc55-d182-4abf-b726-6c78c7adddf3 tempest-ServersTestJSON-1161197899 tempest-ServersTestJSON-1161197899-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193604293" status: 202 len: 0 microversion: 2.1 time: 0.078314 Oct 28 18:16:50.693186 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1688/3485] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:16:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193604293 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:16:50.698178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c7a5f716-fbc2-4dcf-9133-c976ed054366 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '.version_select at 0x7f78de259b80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:50.698748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c7a5f716-fbc2-4dcf-9133-c976ed054366 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: cac92d33-935f-445b-9720-27fd066311b3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:50.713966 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-c7a5f716-fbc2-4dcf-9133-c976ed054366 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] HTTP exception thrown: Instance cac92d33-935f-445b-9720-27fd066311b3 could not be found. Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c7a5f716-fbc2-4dcf-9133-c976ed054366 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Request method failure captured: Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/cac92d33-935f-445b-9720-27fd066311b3/os-instance-actions HTTP/1.1 Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBx5a5SrOTRTohNyfEGunWcEQ0wGMtyGubIW3y-woK9GBPrONt3sMe7YFlocyzs_ADyW7ialaLvCo9bqsAGepw5gPx9y7ATP2y270UL8k8FqzsnU6Wy5DU41Y6x9tSqy8gK3e0JXItW3vduyaU-O9JmRBp-tU5GL9FvBZZqGBcH5HSI Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 3582e5d532e644408f7680cbfb641c2a Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3582e5d532e644408f7680cbfb641c2a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 3582e5d532e644408f7680cbfb641c2a Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceActionsNegativeTestJSON-1068064645-project Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8435105202cf4562842047923c91993f Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1068064645-project Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance cac92d33-935f-445b-9720-27fd066311b3 could not be found. Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'server_id': 'cac92d33-935f-445b-9720-27fd066311b3'} Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cac92d33-935f-445b-9720-27fd066311b3 could not be found. Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:50.718830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cac92d33-935f-445b-9720-27fd066311b3 could not be found. Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cac92d33-935f-445b-9720-27fd066311b3 could not be found. Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c7a5f716-fbc2-4dcf-9133-c976ed054366 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Returning 404 to user: Instance cac92d33-935f-445b-9720-27fd066311b3 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:50.723574 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c7a5f716-fbc2-4dcf-9133-c976ed054366 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/cac92d33-935f-445b-9720-27fd066311b3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.026174 Oct 28 18:16:50.728302 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1689/3486] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 18:16:50 2022] GET /compute/v2.1/servers/cac92d33-935f-445b-9720-27fd066311b3/os-instance-actions => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:50.739528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:50.740075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:50.755055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:50.755999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:50.757151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.761429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:50.762189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:50.766042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:50.821090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:51.041394 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4b7d8c84-7849-4985-b026-3821dc1d5ecb tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 204 len: 0 microversion: 2.1 time: 0.311440 Oct 28 18:16:51.042759 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1690/3487] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:50 2022] DELETE /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:51.049904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:51.054967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:51.070505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.072270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.075444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.077984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.079197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.081881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.084039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.094640 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4788a401-37f4-4f2c-9d6f-1d507b04655f tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1473 microversion: 2.1 time: 1.241344 Oct 28 18:16:51.100027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1798/3488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:49 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1473 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:51.105150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0e1f604c-c4af-485f-aea6-45462924b810 req-04e64e86-2ef5-48f0-9dbc-128aac42ce4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482db24a-f4e1-401d-8ace-4a3c5b673e66", "name": "network-vif-deleted", "tag": "652cd558-3e8c-4c0f-9be9-e79d47a568ea"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:51.150466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0e1f604c-c4af-485f-aea6-45462924b810 req-04e64e86-2ef5-48f0-9dbc-128aac42ce4c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.159088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0e1f604c-c4af-485f-aea6-45462924b810 req-04e64e86-2ef5-48f0-9dbc-128aac42ce4c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.159715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0e1f604c-c4af-485f-aea6-45462924b810 req-04e64e86-2ef5-48f0-9dbc-128aac42ce4c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.178928 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0e1f604c-c4af-485f-aea6-45462924b810 req-04e64e86-2ef5-48f0-9dbc-128aac42ce4c service nova] Creating event network-vif-deleted:652cd558-3e8c-4c0f-9be9-e79d47a568ea for instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 on n-h2-862404-2 Oct 28 18:16:51.205956 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0e1f604c-c4af-485f-aea6-45462924b810 req-04e64e86-2ef5-48f0-9dbc-128aac42ce4c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104317 Oct 28 18:16:51.208232 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1799/3489] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:51.213826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:51.214823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:51.248422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.249759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.253333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.254312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.254816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.255267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.397182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.406753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.408443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.409675 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0dfb5ef-e3b8-428f-b355-687cabd65919 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1415 microversion: 2.54 time: 0.200244 Oct 28 18:16:51.413008 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1800/3490] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:51 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1415 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:51.418986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:51.419973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:51.429095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.430039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.430733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.431773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.432675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.433600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.547119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.561214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.563145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.565011 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-356cb8a7-2b23-4a45-bfef-f338b5d2e19d tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.520875 Oct 28 18:16:51.565768 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1691/3491] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:51 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:51.571029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:51.574011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:51.589034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.590050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.591597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.595510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:51.597220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:51.597864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:51.683447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.695379 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffc8c846-8ede-4ce9-aef1-90f5f20b7659 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1528 microversion: 2.1 time: 0.280560 Oct 28 18:16:51.696014 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1801/3492] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:51 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1528 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:51.713904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:51.733077 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-442064da-5bf2-4e1d-9a6f-062ec25cb6ad tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1272 microversion: 2.1 time: 0.165775 Oct 28 18:16:51.738048 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1692/3493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:51 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:52.132654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:52.133504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:52.141732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.142227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.142661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:52.143394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.143875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.144876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:52.180989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.181849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.182510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:52.183193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lazy-loading 'fault' on Instance uuid 482db24a-f4e1-401d-8ace-4a3c5b673e66 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:52.285686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69293ed019d421aa34dd62c232eb131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc800102cc1463eab50923ae3bcd9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:52.293942 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4833a649-0fe2-486f-ade3-f45528758abf tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 200 len: 1307 microversion: 2.1 time: 0.165088 Oct 28 18:16:52.294528 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1802/3494] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:52 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:52.295045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3fd49004-2c11-42e9-9cca-ec661bebee91 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Action: 'create', calling method: .version_select at 0x7f78de561ca0>, body: {"keypair": {"name": "tempest-keypair-1006732752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6T+g4F+q/GU4TtD7NlKO7TQ2tCTzw9NklPBclSsCgSPwt3LQwwK/2QR9wwJ1zV2Ackod+vqE/+7xhYnYnDcA3eUjcpb2dM0XjLYfvwUpJ+GMUto7cUUhtnxOT4ncxxbg=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:52.324845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-3fd49004-2c11-42e9-9cca-ec661bebee91 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Getting quotas for project 35dcc5899d5e4c2abe6d99ac9f2c8eee. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:16:52.337338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-3fd49004-2c11-42e9-9cca-ec661bebee91 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Getting quotas for user ef5590f1c6b74e01aeaae57f896d46c2 and project 35dcc5899d5e4c2abe6d99ac9f2c8eee. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:16:52.366826 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3fd49004-2c11-42e9-9cca-ec661bebee91 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.220691 Oct 28 18:16:52.367750 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1693/3495] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:16:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:52.449298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:52.450296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:52.458978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.459944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.460673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:52.461814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.462539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.463060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:52.596131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:52.597475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:52.605152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.605724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.606367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:52.607095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.607667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.608900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:52.752823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:52.770331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:52.773462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:52.776425 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5a49ca0-79d7-4592-8945-aa1c847c1921 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1415 microversion: 2.54 time: 0.334010 Oct 28 18:16:52.777932 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1803/3496] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:52 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1415 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:52.785610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:52.786663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:52.796772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.798341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.799080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:52.800058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:52.800740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:52.802243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:53.003336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:53.019429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:53.020924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:53.022238 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-db6377e9-e252-4391-8950-b1f417c2b145 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1359 microversion: 2.21 time: 0.431084 Oct 28 18:16:53.022844 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1694/3497] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:52 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:53.032736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:53.037332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:53.052860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:53.055305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:53.059341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:53.060331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:53.060989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:53.061638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:53.194225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:53.206337 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b75b011-6b8f-48cf-ba0f-4bf3ca23498c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1272 microversion: 2.1 time: 0.177613 Oct 28 18:16:53.208188 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1695/3498] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:53 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:53.318482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:53.319398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] [instance: 482db24a-f4e1-401d-8ace-4a3c5b673e66] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:53.329732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:53.330243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:53.330680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:53.331387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:53.331897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:53.332360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:53.369834 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] HTTP exception thrown: Instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 could not be found. Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Request method failure captured: Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 HTTP/1.1 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBurlOSG2IkxF_LFDThlwSF8-psoTn5bLcQiKk9MOMxAiWlXeohGSygCPKbDCEff41uIJcPcyTPOlyxgB4loykYiHuQaNN31z5a5ufRihUue4O7472OMbwLQ8O0Xb9K9UC1doM_rwL5_2_Zslcqv3cDFEXSglhCqgMTHtCGHiquBslo Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc800102cc1463eab50923ae3bcd9e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc800102cc1463eab50923ae3bcd9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: cdc800102cc1463eab50923ae3bcd9e6 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-210774807 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: b69293ed019d421aa34dd62c232eb131 Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersOnMultiNodesTest-210774807-project Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 could not be found. Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '482db24a-f4e1-401d-8ace-4a3c5b673e66'} Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 could not be found. Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 could not be found. Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:53.371554 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 could not be found. Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] Returning 404 to user: Instance 482db24a-f4e1-401d-8ace-4a3c5b673e66 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:53.378682 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbf5e343-8c7f-492d-809e-80ffcbd3778b tempest-ServersOnMultiNodesTest-210774807 tempest-ServersOnMultiNodesTest-210774807-project] 10.222.0.16 "GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66" status: 404 len: 111 microversion: 2.1 time: 0.058376 Oct 28 18:16:53.384121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1696/3499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:53 2022] GET /compute/v2.1/servers/482db24a-f4e1-401d-8ace-4a3c5b673e66 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:16:53.476433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:53.489159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07cfa3b7-ae63-49b5-9529-3d0a332a19f0 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1528 microversion: 2.1 time: 0.708533 Oct 28 18:16:53.492009 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1804/3500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:52 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1528 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:53.526102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ed201b77-fa68-495e-a5c9-bf0826df3da5 req-f6d0dd43-67b4-4451-b6d5-3702ee0d3dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25478cd-2f9f-4583-951f-41d008c3c3a5", "name": "network-vif-deleted", "tag": "d5a3b6a7-7122-448d-8c80-a8cd327cc9f3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:53.546293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ed201b77-fa68-495e-a5c9-bf0826df3da5 req-f6d0dd43-67b4-4451-b6d5-3702ee0d3dc3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:53.546869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ed201b77-fa68-495e-a5c9-bf0826df3da5 req-f6d0dd43-67b4-4451-b6d5-3702ee0d3dc3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:53.547195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ed201b77-fa68-495e-a5c9-bf0826df3da5 req-f6d0dd43-67b4-4451-b6d5-3702ee0d3dc3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:53.583152 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ed201b77-fa68-495e-a5c9-bf0826df3da5 req-f6d0dd43-67b4-4451-b6d5-3702ee0d3dc3 service nova] Creating event network-vif-deleted:d5a3b6a7-7122-448d-8c80-a8cd327cc9f3 for instance c25478cd-2f9f-4583-951f-41d008c3c3a5 on n-h2-862404-2 Oct 28 18:16:53.601938 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ed201b77-fa68-495e-a5c9-bf0826df3da5 req-f6d0dd43-67b4-4451-b6d5-3702ee0d3dc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080164 Oct 28 18:16:53.602599 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1697/3501] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:53.808643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:53.809435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:53.829993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:53.830207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:53.834996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:53.837186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:53.847452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:53.849130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.023976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:54.038334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:54.041789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:54.043615 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c880e15-3ee8-48e4-802c-044a650bebb6 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1415 microversion: 2.54 time: 0.240357 Oct 28 18:16:54.044884 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1805/3502] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:53 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1415 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:54.064219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:54.069183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:54.085847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.086490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.087101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.088022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.088488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.088916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.233097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:54.234024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:54.241556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.242412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.243029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.243960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.244586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.245180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.375941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:54.409845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6a88665-608d-4648-8c86-e553b1e39160 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1272 microversion: 2.1 time: 0.176484 Oct 28 18:16:54.412349 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1806/3503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:54 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:54.506317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:54.530790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:54.534990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:54.552130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:54.553761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.554534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.555217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.557073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:54.557847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.559340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.560264 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-770606bf-f3ab-4942-b12b-af3fb75ea417 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1551 microversion: 2.21 time: 0.511626 Oct 28 18:16:54.560823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.562510 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1698/3504] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:54 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1551 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:54.598151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:54.600400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:54.618488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.619805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.620280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.620991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.625361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.628412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.651583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:54.672105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.672889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.673583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.674227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lazy-loading 'fault' on Instance uuid c25478cd-2f9f-4583-951f-41d008c3c3a5 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:16:54.679361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:54.855437 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0fb58530-c679-4c99-afc1-001d59901c76 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "DELETE /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 204 len: 0 microversion: 2.21 time: 0.261966 Oct 28 18:16:54.856451 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1699/3505] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:16:54 2022] DELETE /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 18:16:54.872490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:54.873963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:54.884550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.885152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.885847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.886582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:54.887543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:54.888063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:54.901074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:55.029546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8435105202cf4562842047923c91993f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3582e5d532e644408f7680cbfb641c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:55.037712 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00ddb9f7-0cb4-498b-af1e-c4f97e0b1a6d tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 200 len: 1314 microversion: 2.1 time: 0.525655 Oct 28 18:16:55.054102 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1807/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:54 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:55.072110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:55.072742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:55.097907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:55.099977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:55.100533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:55.102422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:55.103587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:55.105460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:55.312320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:55.326924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:55.331143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:55.332851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d804de43-cc17-448d-aefd-c9cf863dc1be tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1415 microversion: 2.54 time: 0.265993 Oct 28 18:16:55.334514 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1808/3507] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:55 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1415 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:55.356568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:55.375307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:55.378349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:55.379592 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cf032ff0-1f1a-4bae-9446-04d53992deab tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1557 microversion: 2.21 time: 0.516167 Oct 28 18:16:55.381815 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1700/3508] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:54 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1557 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:55.436470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:55.437069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:55.443255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:55.443745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:55.444209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:55.444920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:55.445376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:55.445802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:56.062554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:56.063294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] [instance: c25478cd-2f9f-4583-951f-41d008c3c3a5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:56.077505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:56.078849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:56.080375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:56.084741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:56.085444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:56.086092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:56.111171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:56.120199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] HTTP exception thrown: Instance c25478cd-2f9f-4583-951f-41d008c3c3a5 could not be found. Oct 28 18:16:56.129131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-287b0d52-d4e6-4b96-8054-184e9bf5f006 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 0.696883 Oct 28 18:16:56.130554 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1809/3509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:55 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Request method failure captured: Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 HTTP/1.1 Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBx5a5SrOTRTohNyfEGunWcEQ0wGMtyGubIW3y-woK9GBPrONt3sMe7YFlocyzs_ADyW7ialaLvCo9bqsAGepw5gPx9y7ATP2y270UL8k8FqzsnU6Wy5DU41Y6x9tSqy8gK3e0JXItW3vduyaU-O9JmRBp-tU5GL9FvBZZqGBcH5HSI Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 3582e5d532e644408f7680cbfb641c2a Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3582e5d532e644408f7680cbfb641c2a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3582e5d532e644408f7680cbfb641c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 3582e5d532e644408f7680cbfb641c2a Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1068064645 Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceActionsNegativeTestJSON-1068064645-project Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 8435105202cf4562842047923c91993f Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1068064645-project Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance c25478cd-2f9f-4583-951f-41d008c3c3a5 could not be found. Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'c25478cd-2f9f-4583-951f-41d008c3c3a5'} Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25478cd-2f9f-4583-951f-41d008c3c3a5 could not be found. Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25478cd-2f9f-4583-951f-41d008c3c3a5 could not be found. Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:56.142394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25478cd-2f9f-4583-951f-41d008c3c3a5 could not be found. Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:16:56.148011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] Returning 404 to user: Instance c25478cd-2f9f-4583-951f-41d008c3c3a5 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:16:56.151955 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8bd62de-6837-4584-af0d-cda176412f47 tempest-InstanceActionsNegativeTestJSON-1068064645 tempest-InstanceActionsNegativeTestJSON-1068064645-project] 10.222.0.16 "GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5" status: 404 len: 111 microversion: 2.1 time: 0.086479 Oct 28 18:16:56.154024 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1701/3510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:56 2022] GET /compute/v2.1/servers/c25478cd-2f9f-4583-951f-41d008c3c3a5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:16:56.360417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:56.361207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:56.382639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:56.387753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:56.388510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:56.399963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:56.402067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:56.405513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:56.411471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:56.412121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:56.414349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:56.428683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:56.429742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:56.430842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:56.432174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:56.432964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:56.433447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:56.433882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:56.847035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:56.870521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:56.872490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:56.874553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9047838d-3739-406f-a143-871fc1069a4a tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1400 microversion: 2.54 time: 0.518485 Oct 28 18:16:56.875978 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1810/3511] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:56 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1400 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:56.891250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:56.903299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a76e3522-9005-4f68-935c-4af1ac4c8781 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '.version_select at 0x7f78dd64a8b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:56.915295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:56.916879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:56.918099 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea34d5d9-0f3e-4a15-87d0-0ff434bd5c43 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1557 microversion: 2.21 time: 0.511070 Oct 28 18:16:56.918663 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1702/3512] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:56 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1557 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:56.962963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a76e3522-9005-4f68-935c-4af1ac4c8781 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1844198504" status: 204 len: 0 microversion: 2.54 time: 0.065192 Oct 28 18:16:56.966857 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1811/3513] 10.222.0.16 () {60 vars in 1319 bytes} [Fri Oct 28 18:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1844198504 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 18:16:56.995874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:56.996793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:57.012903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.017085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.017842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.018965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.020911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.024038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.133443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:16:57.164557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.165668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:57.178158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.178675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.179126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.179873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.180344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.180780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.335802 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4f9474fb-a673-4118-a72a-f5880211b66c tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 204 len: 0 microversion: 2.54 time: 0.346290 Oct 28 18:16:57.336574 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1703/3514] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:16:56 2022] DELETE /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:16:57.381056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=32 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:57.576211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:57.590664 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7fc9ea71-dff7-482e-b145-c932e7e62add tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 0.438166 Oct 28 18:16:57.593181 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1812/3515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:57.612221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d70e45c4-e81f-49ed-9d38-cd4410e391a1 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.617720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.619627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:57.630125 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d70e45c4-e81f-49ed-9d38-cd4410e391a1 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.291478 Oct 28 18:16:57.632055 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1704/3516] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:57.632794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.633822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.634487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.635424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.636462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.637274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.646474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6a689779-4a3e-4b79-a85e-d110c3b3305c tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.705138 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6a689779-4a3e-4b79-a85e-d110c3b3305c tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.063187 Oct 28 18:16:57.711474 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1705/3517] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:57.729903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e051d904-d9f9-4dde-b7ea-f1e718949d51 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.742543 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e051d904-d9f9-4dde-b7ea-f1e718949d51 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018705 Oct 28 18:16:57.744058 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1706/3518] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:57.758050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5514bfa3-6e48-4358-b28f-62a6480a01b8 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.786329 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5514bfa3-6e48-4358-b28f-62a6480a01b8 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032153 Oct 28 18:16:57.788110 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1707/3519] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:57.803186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc02b981-3c99-4a7e-bbb0-ffde7b368a35 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.829829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:57.847087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:57.849106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:57.850594 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5e73658-c0f9-4bf2-9727-17d014c4a280 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1406 microversion: 2.54 time: 0.256208 Oct 28 18:16:57.851455 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1813/3520] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:16:57.870612 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc02b981-3c99-4a7e-bbb0-ffde7b368a35 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.073533 Oct 28 18:16:57.879670 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1708/3521] 10.222.0.16 () {58 vars in 1165 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:57.895135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2129d343-7f34-4a8f-94b1-3f1fdae4fb74 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.904268 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2129d343-7f34-4a8f-94b1-3f1fdae4fb74 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012962 Oct 28 18:16:57.906343 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1814/3522] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:57.921535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-16a82af5-95dd-4c72-9064-1a992d8b7f6f tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.946691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.947741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:57.953781 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-16a82af5-95dd-4c72-9064-1a992d8b7f6f tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.037661 Oct 28 18:16:57.954904 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1709/3523] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:57.958921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.959724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.968195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.969067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.969547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.969981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.979180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3b205087-61d4-431b-922d-d64ca7b9700d tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.998019 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3b205087-61d4-431b-922d-d64ca7b9700d tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.030713 Oct 28 18:16:57.999493 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1710/3524] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:58.018353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad2bc6d5-ae0d-4070-99be-b0e419d914cb tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.038756 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad2bc6d5-ae0d-4070-99be-b0e419d914cb tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027588 Oct 28 18:16:58.040257 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1711/3525] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:58.059530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4c9b3b1-c6f9-44cf-8eaf-d579cdca1586 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.123429 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4c9b3b1-c6f9-44cf-8eaf-d579cdca1586 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.070586 Oct 28 18:16:58.125781 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1712/3526] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:58.148467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-35dd8639-b3ac-40fb-8e6f-52ba7d804d2b tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.166269 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-35dd8639-b3ac-40fb-8e6f-52ba7d804d2b tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022978 Oct 28 18:16:58.169654 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1713/3527] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:58.182235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ffadf8f-af10-4087-976b-0eba8b66bbbb tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.208900 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ffadf8f-af10-4087-976b-0eba8b66bbbb tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.030214 Oct 28 18:16:58.209885 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1714/3528] 10.222.0.16 () {58 vars in 1144 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:58.226389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0bdb133f-7bf2-4217-933a-5be70ebc4d8c tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.251786 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0bdb133f-7bf2-4217-933a-5be70ebc4d8c tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029212 Oct 28 18:16:58.253086 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1715/3529] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:58.266695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2c62e571-b576-4fb6-b12c-343d5adbda7a tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.287696 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2c62e571-b576-4fb6-b12c-343d5adbda7a tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.026014 Oct 28 18:16:58.289121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1716/3530] 10.222.0.16 () {58 vars in 1148 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:58.305975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aea38307-c85b-4e0f-af25-c6e2cf39c382 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.329329 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aea38307-c85b-4e0f-af25-c6e2cf39c382 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.028105 Oct 28 18:16:58.335562 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1717/3531] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:58.352462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-83ab1043-7657-451a-948d-0627f51c0412 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.383839 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-83ab1043-7657-451a-948d-0627f51c0412 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040768 Oct 28 18:16:58.392262 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1718/3532] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:58.397454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a0503dd-7525-49f4-b9cc-5ab60b6ddec8 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.405358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:58.424598 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a0503dd-7525-49f4-b9cc-5ab60b6ddec8 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.030615 Oct 28 18:16:58.425420 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1719/3533] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:58.444784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2297860-cdad-4730-aa31-29cb7b298a04 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.476730 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2297860-cdad-4730-aa31-29cb7b298a04 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040614 Oct 28 18:16:58.492429 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1720/3534] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:58.497857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28acf7e8-d33a-4f76-98e9-6a6e5e3ff3f6 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.514543 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28acf7e8-d33a-4f76-98e9-6a6e5e3ff3f6 tempest-FlavorsV2TestJSON-1409354049 tempest-FlavorsV2TestJSON-1409354049-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020260 Oct 28 18:16:58.523323 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1721/3535] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:58.615113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.615448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:58.630018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:58.630906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:58.636059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:58.637548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:58.638220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:58.641592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:58.971693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:58.987697 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94a5dc4b-ad1f-4528-892c-dc52cd2399fb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 0.376930 Oct 28 18:16:58.988544 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1722/3536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:58.995746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-28ef8deb-2763-4806-a122-97a4c494eb72 req-1f11e476-d47a-4c95-9852-159a561f6df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508b5d48-392a-42bb-8ec6-377aabd672cb", "name": "network-vif-deleted", "tag": "86aa975b-71cf-4190-bb57-93cdc011d0c8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:59.018853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28ef8deb-2763-4806-a122-97a4c494eb72 req-1f11e476-d47a-4c95-9852-159a561f6df2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:59.019216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28ef8deb-2763-4806-a122-97a4c494eb72 req-1f11e476-d47a-4c95-9852-159a561f6df2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:59.019645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28ef8deb-2763-4806-a122-97a4c494eb72 req-1f11e476-d47a-4c95-9852-159a561f6df2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:59.032189 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-28ef8deb-2763-4806-a122-97a4c494eb72 req-1f11e476-d47a-4c95-9852-159a561f6df2 service nova] Creating event network-vif-deleted:86aa975b-71cf-4190-bb57-93cdc011d0c8 for instance 508b5d48-392a-42bb-8ec6-377aabd672cb on n-h1-862404-2 Oct 28 18:16:59.037427 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-28ef8deb-2763-4806-a122-97a4c494eb72 req-1f11e476-d47a-4c95-9852-159a561f6df2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047851 Oct 28 18:16:59.040440 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1723/3537] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:59.049073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:59.049277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:59.049858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:16:59.057898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:59.058397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:59.058841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:59.059554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:59.060092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:59.060505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:59.064554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:59.066724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:59.068062 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7682e5fe-f925-4b9e-8342-c52f99481449 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1557 microversion: 2.21 time: 1.125400 Oct 28 18:16:59.068624 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1815/3538] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1557 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:16:59.264854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:59.281556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:59.283666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:59.285472 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04c789b5-9463-476d-9767-34c30f7071f0 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1406 microversion: 2.54 time: 0.243882 Oct 28 18:16:59.287363 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1724/3539] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:16:59 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:00.023667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:00.031216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:00.067845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.069075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.069698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.070628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.072386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.072812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.193652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:00.194284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:00.220519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.221024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.221470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.222189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.222648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.223078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.351807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.355501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.356176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.358500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lazy-loading 'fault' on Instance uuid 508b5d48-392a-42bb-8ec6-377aabd672cb {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:17:00.503616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:00.517530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:00.522819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1601c82108f9480d9ee46004e51a5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba701c5ce114dd1b4136e2c154e2233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:00.526632 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28471a82-b6a0-4fec-a2d8-a5dc9d1c9ba9 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 200 len: 1349 microversion: 2.21 time: 0.337031 Oct 28 18:17:00.533280 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1725/3540] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:00 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 1349 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:00.539213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:00.540230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:00.572179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.578877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.580112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.581131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.583103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.585647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.690367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.691174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.692022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.692824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lazy-loading 'fault' on Instance uuid d37ca446-1e96-4bac-b5ec-b09d46719c01 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:17:00.782976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:00.800019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:00.804066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e3632d4ee1b44d99a326322d7859a4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b201c0812844e6b295e2377d5d424e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:00.806728 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-378dad6e-2801-4b3a-a93e-b65d79ab9213 tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 200 len: 1411 microversion: 2.54 time: 0.272095 Oct 28 18:17:00.823838 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1726/3541] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:00 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 1411 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:01.062363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a8b6f5ac-e89e-4db5-b78f-da288b6573ac req-fc6cd545-aa8d-49d3-8fc0-6c789ffd4139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7be3a9b-2eea-47b7-bd7b-2d84527eda5b", "tag": "22dd5ea0-7c9a-4ee2-84fe-c450cd61ee14"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:01.106185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a8b6f5ac-e89e-4db5-b78f-da288b6573ac req-fc6cd545-aa8d-49d3-8fc0-6c789ffd4139 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.110559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a8b6f5ac-e89e-4db5-b78f-da288b6573ac req-fc6cd545-aa8d-49d3-8fc0-6c789ffd4139 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.111376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a8b6f5ac-e89e-4db5-b78f-da288b6573ac req-fc6cd545-aa8d-49d3-8fc0-6c789ffd4139 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.175986 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a8b6f5ac-e89e-4db5-b78f-da288b6573ac req-fc6cd545-aa8d-49d3-8fc0-6c789ffd4139 service nova] Creating event network-changed:22dd5ea0-7c9a-4ee2-84fe-c450cd61ee14 for instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b on n-h2-862404-2 Oct 28 18:17:01.202405 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a8b6f5ac-e89e-4db5-b78f-da288b6573ac req-fc6cd545-aa8d-49d3-8fc0-6c789ffd4139 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181312 Oct 28 18:17:01.205817 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1727/3542] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:01.567675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:01.569357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:01.600532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.625705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.626184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.626952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.627431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.627885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.688445 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] HTTP exception thrown: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Request method failure captured: Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb HTTP/1.1 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBx_NkClEqa__7o71AiJXo8OBGW_PoRExQsclZYaSj4BdC24a0h8Sk0BAgDECE4J_u5w5OWyvCbfDvfG16uI_E0bKyVEdL-ghxmHLwM1V5J4OJJTrwyfjUrGV5Is9k33_-84TcIZPexpesFCROAcyZmaVW1egvnyUbmSP0oSi_C0eHo Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: cba701c5ce114dd1b4136e2c154e2233 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cba701c5ce114dd1b4136e2c154e2233", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: cba701c5ce114dd1b4136e2c154e2233 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceActionsV221TestJSON-114635548-project Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 1601c82108f9480d9ee46004e51a5bce Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceActionsV221TestJSON-114635548-project Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '508b5d48-392a-42bb-8ec6-377aabd672cb'} Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.690560 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:01.694859 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.694859 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.694859 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:01.694859 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:01.694859 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:01.694859 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:01.694859 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.694859 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.698022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Returning 404 to user: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:01.700821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6224d82f-b2a8-41c2-9b90-1c7f8882d1f8 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 404 len: 111 microversion: 2.21 time: 0.142624 Oct 28 18:17:01.705655 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1728/3543] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:01 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:17:01.712980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '.version_select at 0x7f78e24245e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:01.713978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:01.723478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.724500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.725161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.726349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.727082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.727748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.738631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:01.746491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7312df39-0204-4913-8018-aaa3dddf207b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 1.732377 Oct 28 18:17:01.747085 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1816/3544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:00 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:01.844107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:01.844734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] [instance: d37ca446-1e96-4bac-b5ec-b09d46719c01] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:01.858505 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ec10f41-c6f7-4602-a01d-8d915312c2d6 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.148004 Oct 28 18:17:01.860198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.868601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.869534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.870172 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1729/3545] 10.222.0.16 () {60 vars in 1337 bytes} [Fri Oct 28 18:17:01 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb/os-instance-actions => generated 611 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:17:01.870717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.871372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.872033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.887608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:01.890932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:01.902341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.902853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.903296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.906308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.906835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.908151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.914157 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] HTTP exception thrown: Instance d37ca446-1e96-4bac-b5ec-b09d46719c01 could not be found. Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Request method failure captured: Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 HTTP/1.1 Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBxrZ5G_djG-jmEQxce42CEsI-7mEbtL5K2mRdugNE5io9AzVkR-YzKmxeEWWqtF4uYfUYVSl4se8gJw_gE_jIvGy5ox5UEYVapxL4Nja_-vSXHiTR0SmTU1hQI7xJwkyWa7p5W59FrSkr5xVFLB8D489_H2oTRXlwpb2zPHa19GUEE Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.54 Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: d4b201c0812844e6b295e2377d5d424e Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerShowV254Test-432424743 Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4b201c0812844e6b295e2377d5d424e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d4b201c0812844e6b295e2377d5d424e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d4b201c0812844e6b295e2377d5d424e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d4b201c0812844e6b295e2377d5d424e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerShowV254Test-432424743 Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: d4b201c0812844e6b295e2377d5d424e Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerShowV254Test-432424743 Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerShowV254Test-432424743-project Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2e3632d4ee1b44d99a326322d7859a4e Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerShowV254Test-432424743-project Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance d37ca446-1e96-4bac-b5ec-b09d46719c01 could not be found. Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'd37ca446-1e96-4bac-b5ec-b09d46719c01'} Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37ca446-1e96-4bac-b5ec-b09d46719c01 could not be found. Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37ca446-1e96-4bac-b5ec-b09d46719c01 could not be found. Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:01.924966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.930960 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.930960 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:01.930960 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:01.930960 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:01.930960 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:01.930960 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37ca446-1e96-4bac-b5ec-b09d46719c01 could not be found. Oct 28 18:17:01.930960 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.954177 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] HTTP exception thrown: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Request method failure captured: Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb HTTP/1.1 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBx_NkClEqa__7o71AiJXo8OBGW_PoRExQsclZYaSj4BdC24a0h8Sk0BAgDECE4J_u5w5OWyvCbfDvfG16uI_E0bKyVEdL-ghxmHLwM1V5J4OJJTrwyfjUrGV5Is9k33_-84TcIZPexpesFCROAcyZmaVW1egvnyUbmSP0oSi_C0eHo Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: cba701c5ce114dd1b4136e2c154e2233 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cba701c5ce114dd1b4136e2c154e2233", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: cba701c5ce114dd1b4136e2c154e2233 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceActionsV221TestJSON-114635548-project Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 1601c82108f9480d9ee46004e51a5bce Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceActionsV221TestJSON-114635548-project Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '508b5d48-392a-42bb-8ec6-377aabd672cb'} Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:17:01.955771 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Returning 404 to user: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:01.961215 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d10a78fc-86ae-42f7-941b-067ae3e5faeb tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "DELETE /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 404 len: 111 microversion: 2.21 time: 0.085985 Oct 28 18:17:01.963044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] Returning 404 to user: Instance d37ca446-1e96-4bac-b5ec-b09d46719c01 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:01.965238 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-706235ba-aab4-4ed2-b18e-203375a0b95d tempest-ServerShowV254Test-432424743 tempest-ServerShowV254Test-432424743-project] 10.222.0.16 "GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01" status: 404 len: 111 microversion: 2.54 time: 0.127859 Oct 28 18:17:01.965375 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1730/3546] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:01 2022] DELETE /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:17:01.972975 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1817/3547] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:01 2022] GET /compute/v2.1/servers/d37ca446-1e96-4bac-b5ec-b09d46719c01 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:17:01.976607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:01.977311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] [instance: 508b5d48-392a-42bb-8ec6-377aabd672cb] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:01.993789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.996538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.997040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:02.000718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:02.001202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:02.002960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:02.036562 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] HTTP exception thrown: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Request method failure captured: Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb HTTP/1.1 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBx_NkClEqa__7o71AiJXo8OBGW_PoRExQsclZYaSj4BdC24a0h8Sk0BAgDECE4J_u5w5OWyvCbfDvfG16uI_E0bKyVEdL-ghxmHLwM1V5J4OJJTrwyfjUrGV5Is9k33_-84TcIZPexpesFCROAcyZmaVW1egvnyUbmSP0oSi_C0eHo Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: cba701c5ce114dd1b4136e2c154e2233 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cba701c5ce114dd1b4136e2c154e2233", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cba701c5ce114dd1b4136e2c154e2233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: cba701c5ce114dd1b4136e2c154e2233 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-114635548 Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-InstanceActionsV221TestJSON-114635548-project Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 1601c82108f9480d9ee46004e51a5bce Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-InstanceActionsV221TestJSON-114635548-project Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '508b5d48-392a-42bb-8ec6-377aabd672cb'} Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.038394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:02.043358 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.043358 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:02.043358 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:02.043358 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:02.043358 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:02.043358 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:02.043358 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. Oct 28 18:17:02.043358 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.056588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] Returning 404 to user: Instance 508b5d48-392a-42bb-8ec6-377aabd672cb could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:02.057772 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-07560acf-a796-4643-b50d-885852876a48 tempest-InstanceActionsV221TestJSON-114635548 tempest-InstanceActionsV221TestJSON-114635548-project] 10.222.0.16 "GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb" status: 404 len: 111 microversion: 2.21 time: 0.091446 Oct 28 18:17:02.070386 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1731/3548] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:01 2022] GET /compute/v2.1/servers/508b5d48-392a-42bb-8ec6-377aabd672cb => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:17:02.791335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:02.793540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:02.819457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:02.820144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:02.822009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:02.827687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:02.832636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:02.849434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:03.727090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6e7cfbf0-a5c2-4a98-a4f9-011f506ca505 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Calling method '.version_select at 0x7f78de259b80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:03.777281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=32 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:03.801363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:03.811966 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3ff7f85-318c-4e55-b860-e1afb8c6f580 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 1.026498 Oct 28 18:17:03.817458 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1818/3549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:02 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:03.853700 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6e7cfbf0-a5c2-4a98-a4f9-011f506ca505 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443" status: 200 len: 636 microversion: 2.1 time: 0.133421 Oct 28 18:17:03.857042 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1732/3550] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 18:17:03 2022] GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443 => generated 636 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:03.871372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68d15464-4f54-499c-a734-5dfa3c58a5dd tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'update_all', calling method: .version_select at 0x7f78e2500940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:03.994595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-68d15464-4f54-499c-a734-5dfa3c58a5dd tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:04.002669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-68d15464-4f54-499c-a734-5dfa3c58a5dd tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:04.677469 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68d15464-4f54-499c-a734-5dfa3c58a5dd tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 61 microversion: 2.1 time: 0.809715 Oct 28 18:17:04.681805 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1819/3551] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:03 2022] PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 61 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:04.693324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a30af73c-2478-447a-a351-cc6e4369913a tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Calling method '.version_select at 0x7f78e239f550>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:04.849446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:04.856612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:04.888136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:04.891267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:04.896353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:04.898267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:04.898771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:04.910502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:05.258305 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a30af73c-2478-447a-a351-cc6e4369913a tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "DELETE /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.569890 Oct 28 18:17:05.258878 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1733/3552] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 18:17:04 2022] DELETE /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata/os_version => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:17:05.269335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-89d1105c-e601-4a83-acda-54bdfbd357f2 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Calling method '.version_select at 0x7f78e23e8820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:05.381133 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-89d1105c-e601-4a83-acda-54bdfbd357f2 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 37 microversion: 2.1 time: 0.117975 Oct 28 18:17:05.386732 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1734/3553] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:17:05 2022] GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 37 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:17:05.392859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-163022a8-fc95-4549-8142-d127c1e40a96 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'update_all', calling method: .version_select at 0x7f78ddbd6550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:05.506527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-163022a8-fc95-4549-8142-d127c1e40a96 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:05.516128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-163022a8-fc95-4549-8142-d127c1e40a96 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:05.981603 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-163022a8-fc95-4549-8142-d127c1e40a96 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 61 microversion: 2.1 time: 0.593503 Oct 28 18:17:05.984357 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1735/3554] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:05 2022] PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 61 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:05.995681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b561b872-35aa-4758-8a9c-38b8696a14c6 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Calling method '.version_select at 0x7f78dd76a670>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:06.069781 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b561b872-35aa-4758-8a9c-38b8696a14c6 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.080165 Oct 28 18:17:06.071143 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1736/3555] 10.222.0.16 () {58 vars in 1290 bytes} [Fri Oct 28 18:17:05 2022] GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata/os_distro => generated 33 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:17:06.083860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-160a485a-bd39-40d1-aba9-eccba23ffc95 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'update_all', calling method: .version_select at 0x7f78dd76a820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:06.218127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-160a485a-bd39-40d1-aba9-eccba23ffc95 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:06.227660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-160a485a-bd39-40d1-aba9-eccba23ffc95 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:06.332524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:06.348021 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6780bdce-0b74-4a7a-9f8d-098d5c985a70 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 1.509399 Oct 28 18:17:06.349200 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1820/3556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:04 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:06.522375 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-160a485a-bd39-40d1-aba9-eccba23ffc95 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 61 microversion: 2.1 time: 0.444336 Oct 28 18:17:06.523383 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1737/3557] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:06 2022] PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 61 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:06.534926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-311f87c7-610e-43bd-909f-18072585da59 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Calling method '.version_select at 0x7f78e23e8b80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:06.614500 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-311f87c7-610e-43bd-909f-18072585da59 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 61 microversion: 2.1 time: 0.085145 Oct 28 18:17:06.615665 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1738/3558] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:17:06 2022] GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 61 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:17:06.627061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a4c9154-ecc8-4e37-a3db-a318bb0ae678 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'update_all', calling method: .version_select at 0x7f78ddbc4040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:06.671771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-919888331", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": "none"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:06.739595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-8a4c9154-ecc8-4e37-a3db-a318bb0ae678 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:06.757460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-8a4c9154-ecc8-4e37-a3db-a318bb0ae678 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:06.806924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:06.807354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:06.807918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:06.808336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:06.808751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:06.850419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:06.851708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:06.854869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:06.856596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:06.860251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:06.862729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:06.918114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Getting quotas for project 7376eb80dbac4879b4e9434e7924c91a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:06.939106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Getting quotas for user b4bb9d2e51f74c178c77788fd05b990a and project 7376eb80dbac4879b4e9434e7924c91a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:06.976324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:17:06.982886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:07.076955 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a4c9154-ecc8-4e37-a3db-a318bb0ae678 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 61 microversion: 2.1 time: 0.454338 Oct 28 18:17:07.077756 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1739/3559] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:06 2022] PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 61 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:07.089581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d3217b8c-e2bf-4364-b50b-1333246459d3 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'update_all', calling method: .version_select at 0x7f78e23e81f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:07.109681 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dcd3a054-482e-4d39-84d0-f8b9849f53d4 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.723572 Oct 28 18:17:07.113597 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1821/3560] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 18:17:07.127520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5fa5602-55d5-4685-82d9-2fcf6c617d77 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:07.129625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5fa5602-55d5-4685-82d9-2fcf6c617d77 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:07.160862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:07.235206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-d3217b8c-e2bf-4364-b50b-1333246459d3 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:07.242545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-d3217b8c-e2bf-4364-b50b-1333246459d3 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:07.473734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5fa5602-55d5-4685-82d9-2fcf6c617d77 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:07.481338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5fa5602-55d5-4685-82d9-2fcf6c617d77 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:07.485088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5fa5602-55d5-4685-82d9-2fcf6c617d77 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:07.486404 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5fa5602-55d5-4685-82d9-2fcf6c617d77 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1277 microversion: 2.57 time: 0.368279 Oct 28 18:17:07.498809 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1822/3561] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:07 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1277 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:07.504892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:07.505532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:07.527450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:07.533071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:07.535307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:07.540783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:07.542487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:07.543362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:08.100371 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d3217b8c-e2bf-4364-b50b-1333246459d3 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 64 microversion: 2.1 time: 1.014712 Oct 28 18:17:08.101397 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1740/3562] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:07 2022] PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 64 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:08.114169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-54f5207d-7a1e-4ef3-ab7e-93d65f450b05 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Calling method '.version_select at 0x7f78e2410af0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:08.216816 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-54f5207d-7a1e-4ef3-ab7e-93d65f450b05 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 64 microversion: 2.1 time: 0.107321 Oct 28 18:17:08.218302 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1741/3563] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:17:08 2022] GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 64 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:17:08.229561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2bdf9d9-ba76-4edd-ac7d-fe52a220b4d4 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'update_all', calling method: .version_select at 0x7f78ddc135e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:08.332005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c2bdf9d9-ba76-4edd-ac7d-fe52a220b4d4 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:08.340713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c2bdf9d9-ba76-4edd-ac7d-fe52a220b4d4 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:08.667681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:08.684313 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af9fea36-ce12-4fcb-87dc-46055eb38703 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 1.183826 Oct 28 18:17:08.710061 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1823/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:07 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:08.738998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:08.744742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:08.761336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:08.762621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:08.765035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:08.765982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:08.767849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:08.772878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:09.063179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:09.085319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:09.090647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:09.102651 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e4000d8-b810-4d95-b0c8-7d26af903c5a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1329 microversion: 2.57 time: 0.378642 Oct 28 18:17:09.126902 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1824/3565] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:08 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1329 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:09.153700 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2bdf9d9-ba76-4edd-ac7d-fe52a220b4d4 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 61 microversion: 2.1 time: 0.928946 Oct 28 18:17:09.157465 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1742/3566] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:08 2022] PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 61 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:17:09.166636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3835fec1-512d-4728-af7c-1363bc60ec68 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'update', calling method: .version_select at 0x7f78dd665d30>, body: {"meta": {"os_version": "alt"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:09.260739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3835fec1-512d-4728-af7c-1363bc60ec68 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:09.266908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3835fec1-512d-4728-af7c-1363bc60ec68 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:09.733435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:09.734596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:09.773382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:09.778681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:09.780680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:09.784091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:09.786747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:09.788267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:09.888399 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3835fec1-512d-4728-af7c-1363bc60ec68 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.726101 Oct 28 18:17:09.889334 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1825/3567] 10.222.0.16 () {60 vars in 1313 bytes} [Fri Oct 28 18:17:09 2022] PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata/os_version => generated 31 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:09.900311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-93f7dd03-0525-4479-a8c8-360e3f19bc2a tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Calling method '.version_select at 0x7f78dd665e50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:09.981818 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-93f7dd03-0525-4479-a8c8-360e3f19bc2a tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 58 microversion: 2.1 time: 0.085231 Oct 28 18:17:09.983316 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1826/3568] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:17:09 2022] GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 58 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:17:10.013338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c52c8cf7-8b5a-46f4-ad4f-c3d893bc78de tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'update_all', calling method: .version_select at 0x7f78e23cdb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:10.110588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c52c8cf7-8b5a-46f4-ad4f-c3d893bc78de tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:10.134490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c52c8cf7-8b5a-46f4-ad4f-c3d893bc78de tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:10.271646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:10.284706 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-025cbf04-2df5-4d32-9232-a7ec1f4df5ae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 0.556504 Oct 28 18:17:10.285511 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1743/3569] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:09 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:10.299463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:10.300132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:10.340464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:10.340959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:10.341394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:10.343698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:10.346462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:10.350422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:10.602800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:10.630068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:10.641065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:10.644271 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72e44457-564d-44a0-b948-62c4406f1b74 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1335 microversion: 2.57 time: 0.355067 Oct 28 18:17:10.649103 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1744/3570] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:10 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1335 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:10.665326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6338db72-6b31-4bbb-a99b-186c5b036318 req-efb21184-c46c-40eb-bb71-74780ac5a169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7be3a9b-2eea-47b7-bd7b-2d84527eda5b", "name": "network-vif-plugged", "status": "completed", "tag": "22dd5ea0-7c9a-4ee2-84fe-c450cd61ee14"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:10.686550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6338db72-6b31-4bbb-a99b-186c5b036318 req-efb21184-c46c-40eb-bb71-74780ac5a169 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:10.687512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6338db72-6b31-4bbb-a99b-186c5b036318 req-efb21184-c46c-40eb-bb71-74780ac5a169 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:10.689175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6338db72-6b31-4bbb-a99b-186c5b036318 req-efb21184-c46c-40eb-bb71-74780ac5a169 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:10.715520 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6338db72-6b31-4bbb-a99b-186c5b036318 req-efb21184-c46c-40eb-bb71-74780ac5a169 service nova] Creating event network-vif-plugged:22dd5ea0-7c9a-4ee2-84fe-c450cd61ee14 for instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b on n-h2-862404-2 Oct 28 18:17:10.727300 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6338db72-6b31-4bbb-a99b-186c5b036318 req-efb21184-c46c-40eb-bb71-74780ac5a169 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075410 Oct 28 18:17:10.731509 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1745/3571] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:10.773331 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c52c8cf7-8b5a-46f4-ad4f-c3d893bc78de tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 61 microversion: 2.1 time: 0.773154 Oct 28 18:17:10.784068 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1827/3572] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:09 2022] PUT /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 61 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:10.794771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59b7cb56-32ef-4aee-8eaa-8afa481deda1 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Action: 'create', calling method: .version_select at 0x7f78de1f8a60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:10.863902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-59b7cb56-32ef-4aee-8eaa-8afa481deda1 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:10.870550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-59b7cb56-32ef-4aee-8eaa-8afa481deda1 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Getting quotas for user 49f1d527332b42508cac6568cc1ba2af and project c3c86377c14c49d0b6cd4e1722a83b3e. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:11.309182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:11.310438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:11.329610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:11.330204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:11.330667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:11.331420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:11.332689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:11.333140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:11.466755 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59b7cb56-32ef-4aee-8eaa-8afa481deda1 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "POST /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 85 microversion: 2.1 time: 0.678618 Oct 28 18:17:11.467962 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1746/3573] 10.222.0.16 () {60 vars in 1281 bytes} [Fri Oct 28 18:17:10 2022] POST /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 85 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:11.478513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a3881607-860e-47a0-9047-56180e70dae8 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] Calling method '.version_select at 0x7f78dd7c0ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:11.557613 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a3881607-860e-47a0-9047-56180e70dae8 tempest-ImagesMetadataTestJSON-1755454614 tempest-ImagesMetadataTestJSON-1755454614-project] 10.222.0.16 "GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata" status: 200 len: 85 microversion: 2.1 time: 0.082896 Oct 28 18:17:11.558212 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1747/3574] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:17:11 2022] GET /compute/v2.1/images/91e81edd-5be1-4e2a-b4b1-18949f1dc443/metadata => generated 85 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:17:11.664221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:11.682987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:11.683722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:11.689765 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cda69eb1-0e64-4fc2-bd72-1d0a1eecd324 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1314 microversion: 2.1 time: 0.385187 Oct 28 18:17:11.690387 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1828/3575] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:11 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:11.696028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:11.697103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:11.698552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:11.699465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:11.700151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:11.700987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:11.807970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:11.821630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:11.824029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:11.827910 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59649191-8498-4dc0-8d21-405bdca145b2 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1335 microversion: 2.57 time: 0.150347 Oct 28 18:17:11.845385 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1748/3576] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:11 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1335 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:17:12.719000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:12.719663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:12.734100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:12.734606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:12.740639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:12.741411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:12.741896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:12.744965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:12.864027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:12.864757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:12.881662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:12.884158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:12.884935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:12.887454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:12.889787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:12.892249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:13.200377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:13.219388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-760294b7-d190-4e23-b3a2-5cebe833f14d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1500 microversion: 2.1 time: 0.504276 Oct 28 18:17:13.220108 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1829/3577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:12 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1500 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:13.250455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:13.251105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:13.261318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:13.266335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:13.266907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:13.270612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:13.272397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:13.272927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:13.470459 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c6c796d-3715-48e6-9768-53ac9010348c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b/action" status: 202 len: 0 microversion: 2.1 time: 0.222128 Oct 28 18:17:13.473596 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1830/3578] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:17:13 2022] POST /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:17:13.500243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:13.501107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:13.514664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:13.517077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:13.518970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:13.521073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:13.521949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:13.524001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:13.526018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:13.543621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:13.549066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:13.550781 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-19846063-596d-49e5-8d43-7afb42111f97 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1335 microversion: 2.57 time: 0.694685 Oct 28 18:17:13.554407 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1749/3579] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:12 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1335 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:17:13.869043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:13.880704 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4955ee70-0d22-4dfe-8e04-627a8f10462e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1505 microversion: 2.1 time: 0.402035 Oct 28 18:17:13.881726 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1831/3580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:13 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:14.587760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:14.589095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:14.610171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.611021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.611590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:14.612549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.613117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.613655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:14.698724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:14.782940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:14.794917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:14.797778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:14.800670 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e03d3763-5b76-4bcb-9546-768bc8c54268 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1356 microversion: 2.57 time: 0.222550 Oct 28 18:17:14.801838 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1750/3581] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:14 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1356 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:14.832469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:14.836768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:14.847544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.848392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.849090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:14.851373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.852782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.853500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:14.907955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:14.909001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:14.925009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.925532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.928100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:14.928938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.931534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.932320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.120010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:15.124069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:15.124949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:15.125942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:15.126611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:15.233778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:15.243101 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a6ce62e-7765-49c1-aa84-91f1f09631f1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1485 microversion: 2.1 time: 0.341006 Oct 28 18:17:15.249472 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1751/3582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:14 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1485 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:15.250265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:15.269378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:15.277353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:15.277850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:15.285105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.286345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.286969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.287945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.288739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.289395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.289523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.290818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.292261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.300680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.301631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.303649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.360673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:17:15.371276 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32e9d8f5-cfc0-4489-9bb8-fbfec9cb4f57 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "POST /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1/action" status: 202 len: 1137 microversion: 2.57 time: 0.544167 Oct 28 18:17:15.375907 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1832/3583] 10.222.0.16 () {62 vars in 1320 bytes} [Fri Oct 28 18:17:14 2022] POST /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1/action => generated 1137 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 18:17:15.396929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:15.397563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:15.411258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.411760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.414203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.414870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.415344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.415783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.575343 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08572edc-a16d-4dfb-9807-4a256a88d7ef tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 204 len: 0 microversion: 2.1 time: 0.302379 Oct 28 18:17:15.580544 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1752/3584] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:17:15 2022] DELETE /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:17:15.591327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:15.592099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:15.597824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:15.599435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.599923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.604845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.605869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.608904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.610479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.821716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:15.837222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:15.837813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:15.838923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:15.840426 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d078f57-7e1a-4f7f-b61c-bf7819497b25 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.447756 Oct 28 18:17:15.850418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ce257ad7-08c0-4779-9a15-03c25f4e884d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1491 microversion: 2.1 time: 0.265057 Oct 28 18:17:15.852107 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1753/3585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:15 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1491 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:15.864030 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1833/3586] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:15 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:17:16.407983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df16f50e-7a33-4d7c-9855-9683a9617d7c tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Action: 'create', calling method: .version_select at 0x7f78ddbba4c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMUtL6vK8IhoC9ZaVcD4VxU2gbhhHjKSe1nj/RLoL11SkHy7sdQuc90aReHye0aMGCyrg5aXlEUogOzclXGaMydEJBweT75rWz07YKXlyWTOUlVa5Eeog0LzHylRS1Wfg=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df16f50e-7a33-4d7c-9855-9683a9617d7c tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Request method failure captured: Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 257 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBysOY5k9LRIw-Va9odHxgsPlrNCdSuTh7YGWyi8ak9X7TL8eXiPdVS3gc4rudElFwexkRY1jA7oceJ62MuBYnNFALhteRuXJYQwt8xqettdD4wg2z0aZiQlKhg5JDLkr_XS0WYN0GGYOIoG5lQx2oTcRuWn13z1_wQ4zNTCWQuQ70Y Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57b9af18154346a0894612e860455b00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57b9af18154346a0894612e860455b00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMUtL6vK8IhoC9ZaVcD4VxU2gbhhHjKSe1nj/RLoL11SkHy7sdQuc90aReHye0aMGCyrg5aXlEUogOzclXGaMydEJBweT75rWz07YKXlyWTOUlVa5Eeog0LzHylRS1Wfg=="}} Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: method: Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMUtL6vK8IhoC9ZaVcD4VxU2gbhhHjKSe1nj/RLoL11SkHy7sdQuc90aReHye0aMGCyrg5aXlEUogOzclXGaMydEJBweT75rWz07YKXlyWTOUlVa5Eeog0LzHylRS1Wfg=='}}} Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 28 18:17:16.416216 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 18:17:16.422483 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.427018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df16f50e-7a33-4d7c-9855-9683a9617d7c tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:16.430103 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df16f50e-7a33-4d7c-9855-9683a9617d7c tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.269490 Oct 28 18:17:16.432076 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1754/3587] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:17:16 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:17:16.442055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd268763-2f97-46f0-b062-7288dd837801 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Action: 'create', calling method: .version_select at 0x7f78dd665d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1964502442", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:16.493852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-dd268763-2f97-46f0-b062-7288dd837801 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:16.534066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-dd268763-2f97-46f0-b062-7288dd837801 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for user e657667996d54285aba74ed4c4bd5769 and project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:16.588006 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-dd268763-2f97-46f0-b062-7288dd837801 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd268763-2f97-46f0-b062-7288dd837801 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Request method failure captured: Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 2167 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysOY5k9LRIw-Va9odHxgsPlrNCdSuTh7YGWyi8ak9X7TL8eXiPdVS3gc4rudElFwexkRY1jA7oceJ62MuBYnNFALhteRuXJYQwt8xqettdD4wg2z0aZiQlKhg5JDLkr_XS0WYN0GGYOIoG5lQx2oTcRuWn13z1_wQ4zNTCWQuQ70Y Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57b9af18154346a0894612e860455b00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57b9af18154346a0894612e860455b00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1964502442", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:17:16.611788 n-d-862404-2 devstack@n-api.service[120680]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1964502442', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:16.614560 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:16.617672 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.620537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd268763-2f97-46f0-b062-7288dd837801 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:16.621843 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dd268763-2f97-46f0-b062-7288dd837801 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.183914 Oct 28 18:17:16.623634 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1834/3588] 10.222.0.16 () {60 vars in 1160 bytes} [Fri Oct 28 18:17:16 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:17:16.636537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ebf0f3e-21eb-49ac-9d81-e5976c21275c tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Action: 'create', calling method: .version_select at 0x7f78dd665790>, body: {"keypair": {"name": "tempest-keypair-1410846231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFMqlbQG/vCaokV49nqWwfclhRsLAfe/tHpm/i3KAFZouyI0mt35aO/RabHARu9nJ5nmSUkKXXoNBcmCm03xdQSdAOF6WgT3hUTlDzeBxSdfUWFbV4x55bDu9/lQ9ErwA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:16.641404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-303212241", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "8005560b-57c5-4636-b8cf-3b405873d9c2"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:16.656920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2ebf0f3e-21eb-49ac-9d81-e5976c21275c tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:16.665299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2ebf0f3e-21eb-49ac-9d81-e5976c21275c tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for user e657667996d54285aba74ed4c4bd5769 and project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:16.707839 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ebf0f3e-21eb-49ac-9d81-e5976c21275c tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076140 Oct 28 18:17:16.710418 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1835/3589] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:17:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:16.729689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0d51b83-a8ab-418c-ace0-b0fa08582c58 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Action: 'create', calling method: .version_select at 0x7f78e2568820>, body: {"keypair": {"name": "tempest-keypair-1410846231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNATNrUdSTd6aIWdjK/3V4vb3f8HBrK975QJM7V730SeJoU7voL+9lEINM2p6U78+xxpq0ZjFzAC9m/Zu9N8vGnIuuUkpJvY9Nob3aZd7Xx2swn6+SmhFllWTcB6lWNnAQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:16.774622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d0d51b83-a8ab-418c-ace0-b0fa08582c58 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:16.796501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d0d51b83-a8ab-418c-ace0-b0fa08582c58 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for user e657667996d54285aba74ed4c4bd5769 and project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:16.802003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] validate_networks() for [('8005560b-57c5-4636-b8cf-3b405873d9c2', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:17:16.872363 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d0d51b83-a8ab-418c-ace0-b0fa08582c58 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] HTTP exception thrown: Key pair 'tempest-keypair-1410846231' already exists. Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0d51b83-a8ab-418c-ace0-b0fa08582c58 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Request method failure captured: Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 273 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysOY5k9LRIw-Va9odHxgsPlrNCdSuTh7YGWyi8ak9X7TL8eXiPdVS3gc4rudElFwexkRY1jA7oceJ62MuBYnNFALhteRuXJYQwt8xqettdD4wg2z0aZiQlKhg5JDLkr_XS0WYN0GGYOIoG5lQx2oTcRuWn13z1_wQ4zNTCWQuQ70Y Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57b9af18154346a0894612e860455b00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57b9af18154346a0894612e860455b00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: {"keypair": {"name": "tempest-keypair-1410846231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNATNrUdSTd6aIWdjK/3V4vb3f8HBrK975QJM7V730SeJoU7voL+9lEINM2p6U78+xxpq0ZjFzAC9m/Zu9N8vGnIuuUkpJvY9Nob3aZd7Xx2swn6+SmhFllWTcB6lWNnAQ=="}} Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: exception: Key pair 'tempest-keypair-1410846231' already exists. Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1410846231', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNATNrUdSTd6aIWdjK/3V4vb3f8HBrK975QJM7V730SeJoU7voL+9lEINM2p6U78+xxpq0ZjFzAC9m/Zu9N8vGnIuuUkpJvY9Nob3aZd7Xx2swn6+SmhFllWTcB6lWNnAQ=='}}} Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result.read() Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'e657667996d54285aba74ed4c4bd5769-tempest-keypair-1410846231' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 18:17:16.890470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result.read() Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 18:17:16.894969 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'e657667996d54285aba74ed4c4bd5769-tempest-keypair-1410846231' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 18, 17, 16, 840125), 'updated_at': None, 'name': 'tempest-keypair-1410846231', 'user_id': 'e657667996d54285aba74ed4c4bd5769', 'fingerprint': 'de:6f:17:9e:af:d6:07:69:f3:ba:6a:87:07:69:53:c0', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNATNrUdSTd6aIWdjK/3V4vb3f8HBrK975QJM7V730SeJoU7voL+9lEINM2p6U78+xxpq0ZjFzAC9m/Zu9N8vGnIuuUkpJvY9Nob3aZd7Xx2swn6+SmhFllWTcB6lWNnAQ==', 'type': 'ssh'}] Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6779, in import_key_pair Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi keypair.create() Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._create() Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1410846231' already exists. Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 28 18:17:16.901267 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1410846231' already exists. Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1410846231' already exists. Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0d51b83-a8ab-418c-ace0-b0fa08582c58 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Returning 409 to user: Key pair 'tempest-keypair-1410846231' already exists. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d0d51b83-a8ab-418c-ace0-b0fa08582c58 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.176302 Oct 28 18:17:16.913494 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1836/3590] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:17:16 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:17:16.915373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:16.919751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:16.935611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:16.945603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:16.946224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:16.946685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:16.949254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:16.950081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:16.952380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:17.642524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:17.656353 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e77695f7-f9fd-46f5-83ca-0ef3ebfcfad5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1491 microversion: 2.1 time: 0.755345 Oct 28 18:17:17.660143 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1837/3591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:16 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1491 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:17.673320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:17.674242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:17.683206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:17.683702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:17.684170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:17.684892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:17.685342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:17.685860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:17.936447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:17.938682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:17.939361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:17.940031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:17.941440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:17.963749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:17.965263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:17.965434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:17.970277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:17.974018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:17.974785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:17.976783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:17.979246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:17.981028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:17.983753 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9aaf746c-ec9c-47e3-9b35-2c6ba07d0dff tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.322298 Oct 28 18:17:17.996906 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1838/3592] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:17 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:18.002236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0aab7f99-e1b9-4edb-8b45-487c9e97fda2 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Calling method '.version_select at 0x7f78dd5f3ca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:18.039761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0aab7f99-e1b9-4edb-8b45-487c9e97fda2 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410846231" status: 202 len: 0 microversion: 2.1 time: 0.041464 Oct 28 18:17:18.047177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Getting quotas for project 17172ae3971e4810ac1f8afca2b8f8f6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:18.048123 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1839/3593] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:17:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410846231 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:17:18.053330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f80c0f2-f755-477f-a6bf-0b96bf3e426e tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Action: 'create', calling method: .version_select at 0x7f78dd5ea0d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqQcZu+8vIsHl2zIfnK/qK6lfQoAtAjvXNok+sf0Ww5hSENN3ZyRPLzmsWDkzxNbydkGiaEAr0kLnnU2QUQZCq0bMp0hLE+ANGytNMblJylW4SKxUlC2MpuySq4j0jUzQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f80c0f2-f755-477f-a6bf-0b96bf3e426e tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Request method failure captured: Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 247 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysOY5k9LRIw-Va9odHxgsPlrNCdSuTh7YGWyi8ak9X7TL8eXiPdVS3gc4rudElFwexkRY1jA7oceJ62MuBYnNFALhteRuXJYQwt8xqettdD4wg2z0aZiQlKhg5JDLkr_XS0WYN0GGYOIoG5lQx2oTcRuWn13z1_wQ4zNTCWQuQ70Y Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57b9af18154346a0894612e860455b00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57b9af18154346a0894612e860455b00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqQcZu+8vIsHl2zIfnK/qK6lfQoAtAjvXNok+sf0Ww5hSENN3ZyRPLzmsWDkzxNbydkGiaEAr0kLnnU2QUQZCq0bMp0hLE+ANGytNMblJylW4SKxUlC2MpuySq4j0jUzQ=="}} Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqQcZu+8vIsHl2zIfnK/qK6lfQoAtAjvXNok+sf0Ww5hSENN3ZyRPLzmsWDkzxNbydkGiaEAr0kLnnU2QUQZCq0bMp0hLE+ANGytNMblJylW4SKxUlC2MpuySq4j0jUzQ=='}}} Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '' Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:17:18.057533 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:17:18.061884 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.062827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Getting quotas for user 203b0141d9574732971db25586457f8c and project 17172ae3971e4810ac1f8afca2b8f8f6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:18.073956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f80c0f2-f755-477f-a6bf-0b96bf3e426e tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:18.075313 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f80c0f2-f755-477f-a6bf-0b96bf3e426e tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.025959 Oct 28 18:17:18.080586 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1840/3594] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:17:18 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:17:18.087431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f884691a-fae5-4288-aae5-e7a9fbbdb909 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Action: 'create', calling method: .version_select at 0x7f78e2568e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-914645315", "public_key": " "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:18.095766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:17:18.102603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:18.137845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-f884691a-fae5-4288-aae5-e7a9fbbdb909 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:18.155569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-f884691a-fae5-4288-aae5-e7a9fbbdb909 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for user e657667996d54285aba74ed4c4bd5769 and project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:18.182514 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f884691a-fae5-4288-aae5-e7a9fbbdb909 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f884691a-fae5-4288-aae5-e7a9fbbdb909 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Request method failure captured: Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 94 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysOY5k9LRIw-Va9odHxgsPlrNCdSuTh7YGWyi8ak9X7TL8eXiPdVS3gc4rudElFwexkRY1jA7oceJ62MuBYnNFALhteRuXJYQwt8xqettdD4wg2z0aZiQlKhg5JDLkr_XS0WYN0GGYOIoG5lQx2oTcRuWn13z1_wQ4zNTCWQuQ70Y Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57b9af18154346a0894612e860455b00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57b9af18154346a0894612e860455b00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-914645315", "public_key": " "}} Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-914645315', 'public_key': ' '}}} Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.188383 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.193659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f884691a-fae5-4288-aae5-e7a9fbbdb909 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:18.196917 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f884691a-fae5-4288-aae5-e7a9fbbdb909 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.112648 Oct 28 18:17:18.196917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1841/3595] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Oct 28 18:17:18 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:17:18.216309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c50c0144-fbac-4dd7-932e-baa301badf16 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Action: 'create', calling method: .version_select at 0x7f78de31f310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrxbtdmry70M1hwnJbhnkrEgYCW2BeGeyLXZasOPL7QJUNjDBMk4kgAoME/VpmdvDsOA3TiKYRHB0JXu8qzLY4OXrFNmPfXyxbCqvZnLSPu3iR1LT2FaGzj06vnk19DzA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:18.226033 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff11a4b8-c2d3-4c97-8dfc-2133970641e8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738381 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c50c0144-fbac-4dd7-932e-baa301badf16 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Request method failure captured: Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 507 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysOY5k9LRIw-Va9odHxgsPlrNCdSuTh7YGWyi8ak9X7TL8eXiPdVS3gc4rudElFwexkRY1jA7oceJ62MuBYnNFALhteRuXJYQwt8xqettdD4wg2z0aZiQlKhg5JDLkr_XS0WYN0GGYOIoG5lQx2oTcRuWn13z1_wQ4zNTCWQuQ70Y Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57b9af18154346a0894612e860455b00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57b9af18154346a0894612e860455b00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrxbtdmry70M1hwnJbhnkrEgYCW2BeGeyLXZasOPL7QJUNjDBMk4kgAoME/VpmdvDsOA3TiKYRHB0JXu8qzLY4OXrFNmPfXyxbCqvZnLSPu3iR1LT2FaGzj06vnk19DzA=="}} Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrxbtdmry70M1hwnJbhnkrEgYCW2BeGeyLXZasOPL7QJUNjDBMk4kgAoME/VpmdvDsOA3TiKYRHB0JXu8qzLY4OXrFNmPfXyxbCqvZnLSPu3iR1LT2FaGzj06vnk19DzA=='}}} Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 18:17:18.226928 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.230622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c50c0144-fbac-4dd7-932e-baa301badf16 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:18.233836 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c50c0144-fbac-4dd7-932e-baa301badf16 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.026128 Oct 28 18:17:18.233836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1842/3596] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:17:18 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:17:18.243319 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1755/3597] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:17:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:17:18.254035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64f595c4-d199-409a-b8ef-2abfcd2a882d tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Action: 'create', calling method: .version_select at 0x7f78dd5f38b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1554435266", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:18.295888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-64f595c4-d199-409a-b8ef-2abfcd2a882d tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:18.307039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-64f595c4-d199-409a-b8ef-2abfcd2a882d tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Getting quotas for user e657667996d54285aba74ed4c4bd5769 and project 57b9af18154346a0894612e860455b00. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:18.323526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-511136551", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "8005560b-57c5-4636-b8cf-3b405873d9c2"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:18.379335 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-64f595c4-d199-409a-b8ef-2abfcd2a882d tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64f595c4-d199-409a-b8ef-2abfcd2a882d tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Request method failure captured: Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 118 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysOY5k9LRIw-Va9odHxgsPlrNCdSuTh7YGWyi8ak9X7TL8eXiPdVS3gc4rudElFwexkRY1jA7oceJ62MuBYnNFALhteRuXJYQwt8xqettdD4wg2z0aZiQlKhg5JDLkr_XS0WYN0GGYOIoG5lQx2oTcRuWn13z1_wQ4zNTCWQuQ70Y Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57b9af18154346a0894612e860455b00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57b9af18154346a0894612e860455b00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1554435266", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1554435266', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 28 18:17:18.381478 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 18:17:18.386310 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.391734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64f595c4-d199-409a-b8ef-2abfcd2a882d tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:18.391734 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64f595c4-d199-409a-b8ef-2abfcd2a882d tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.146436 Oct 28 18:17:18.391734 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1843/3598] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:17:18 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:17:18.409015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a1e3675-4abb-4929-a130-8e0f201b9877 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Calling method '.version_select at 0x7f78dd64a5e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:18.431065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:18.442311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4a1e3675-4abb-4929-a130-8e0f201b9877 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1398213071 not found for user e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.447374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] validate_networks() for [('8005560b-57c5-4636-b8cf-3b405873d9c2', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a1e3675-4abb-4929-a130-8e0f201b9877 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Request method failure captured: Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1398213071 HTTP/1.1 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysOY5k9LRIw-Va9odHxgsPlrNCdSuTh7YGWyi8ak9X7TL8eXiPdVS3gc4rudElFwexkRY1jA7oceJ62MuBYnNFALhteRuXJYQwt8xqettdD4wg2z0aZiQlKhg5JDLkr_XS0WYN0GGYOIoG5lQx2oTcRuWn13z1_wQ4zNTCWQuQ70Y Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57b9af18154346a0894612e860455b00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57b9af18154346a0894612e860455b00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57b9af18154346a0894612e860455b00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 57b9af18154346a0894612e860455b00 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782440842 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782440842-project Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: exception: Keypair tempest-keypair-non-existent-1398213071 not found for user e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'tempest-keypair-non-existent-1398213071'} Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6863, in delete_key_pair Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6884, in get_key_pair Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1398213071 not found for user e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.448259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1398213071 not found for user e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1398213071 not found for user e657667996d54285aba74ed4c4bd5769 Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a1e3675-4abb-4929-a130-8e0f201b9877 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1398213071 not found for user e657667996d54285aba74ed4c4bd5769 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:18.453022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a1e3675-4abb-4929-a130-8e0f201b9877 tempest-KeyPairsNegativeTestJSON-782440842 tempest-KeyPairsNegativeTestJSON-782440842-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1398213071" status: 404 len: 145 microversion: 2.1 time: 0.046192 Oct 28 18:17:18.454951 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1844/3599] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 18:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1398213071 => generated 145 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:17:18.684488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:18.685232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:18.710881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:18.711424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:18.717496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:18.722129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:18.722722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:18.724514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:19.604560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:19.614489 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76a2981e-6365-48d4-ba43-f756aa464843 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1491 microversion: 2.1 time: 0.937503 Oct 28 18:17:19.621361 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1845/3600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:18 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1491 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:19.635039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:19.645499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:19.658795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:19.660393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:19.661514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:19.665798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:19.666606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:19.667241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:19.743768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:19.744854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:19.745588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:19.746174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:19.746776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:19.769203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:19.769702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:19.773745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:19.774945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:19.775654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:19.786396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:19.883338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Getting quotas for project 17172ae3971e4810ac1f8afca2b8f8f6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:19.905625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Getting quotas for user 203b0141d9574732971db25586457f8c and project 17172ae3971e4810ac1f8afca2b8f8f6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:19.927012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:19.941210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:19.943157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:19.944301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e244c5e-3dbf-40d0-924d-bbf105d9ae7a tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.321652 Oct 28 18:17:19.955504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:17:19.964372 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1846/3601] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:19 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:19.967941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:19.986272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0141a968-3d5a-41cc-a670-dff1dc139bb5 req-5dfe433b-97c6-4b19-bdfc-678b481daa31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7be3a9b-2eea-47b7-bd7b-2d84527eda5b", "name": "network-vif-deleted", "tag": "22dd5ea0-7c9a-4ee2-84fe-c450cd61ee14"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:20.046377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0141a968-3d5a-41cc-a670-dff1dc139bb5 req-5dfe433b-97c6-4b19-bdfc-678b481daa31 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:20.052068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0141a968-3d5a-41cc-a670-dff1dc139bb5 req-5dfe433b-97c6-4b19-bdfc-678b481daa31 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:20.052918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0141a968-3d5a-41cc-a670-dff1dc139bb5 req-5dfe433b-97c6-4b19-bdfc-678b481daa31 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:20.083360 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0141a968-3d5a-41cc-a670-dff1dc139bb5 req-5dfe433b-97c6-4b19-bdfc-678b481daa31 service nova] Creating event network-vif-deleted:22dd5ea0-7c9a-4ee2-84fe-c450cd61ee14 for instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b on n-h2-862404-2 Oct 28 18:17:20.094134 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0141a968-3d5a-41cc-a670-dff1dc139bb5 req-5dfe433b-97c6-4b19-bdfc-678b481daa31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128021 Oct 28 18:17:20.095221 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1847/3602] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:20.150952 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-039d0a13-2cab-4e05-84e6-8091da83c676 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831319 Oct 28 18:17:20.151744 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1756/3603] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:17:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:17:20.504024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2074019896", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "451", "networks": [{"uuid": "8005560b-57c5-4636-b8cf-3b405873d9c2"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:20.651225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:20.651862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:20.683335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] validate_networks() for [('8005560b-57c5-4636-b8cf-3b405873d9c2', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:17:20.695728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:20.696770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:20.703103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:20.704817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:20.707971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:20.712864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:20.842816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:20.843505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:20.844125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:20.847153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lazy-loading 'fault' on Instance uuid f7be3a9b-2eea-47b7-bd7b-2d84527eda5b {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:17:21.046377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:21.054791 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b68c85c5-9eff-4065-9a2a-24b32dfbd7ab tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 200 len: 1304 microversion: 2.1 time: 0.408243 Oct 28 18:17:21.105715 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1757/3604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:20 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 1304 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:21.126832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:21.129526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:21.137545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:21.139190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:21.139850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:21.141125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:21.142124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:21.142763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:21.508076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:21.528966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:21.530919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:21.532168 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea659d7d-e668-4e33-ae78-3f3d52021b23 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.425278 Oct 28 18:17:21.548054 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1758/3605] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:21 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:22.086653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:22.087324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:22.099860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:22.103569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:22.104397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:22.105144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:22.105833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:22.110847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:22.154509 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b HTTP/1.1 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f7be3a9b-2eea-47b7-bd7b-2d84527eda5b'} Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:22.157600 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:22.162396 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:22.162396 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:22.162396 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:22.162396 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:22.162396 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:22.162396 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:17:22.162396 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:17:22.166793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:22.170494 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cedad0d4-9def-44bd-9267-28b17989e6df tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 404 len: 111 microversion: 2.1 time: 0.089178 Oct 28 18:17:22.177742 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1759/3606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:22 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:17:22.493379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-867397576", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "70c5abb7-d4bd-4b29-a58f-099ce9f71832"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:22.635170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] validate_networks() for [('70c5abb7-d4bd-4b29-a58f-099ce9f71832', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:17:23.224214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:23.224768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:23.225115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:23.225533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:23.225954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:23.256275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:23.259154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:23.259397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:23.265097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:23.265921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:23.269052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:23.345650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Getting quotas for project 17172ae3971e4810ac1f8afca2b8f8f6. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:23.376624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Getting quotas for user 203b0141d9574732971db25586457f8c and project 17172ae3971e4810ac1f8afca2b8f8f6. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:23.426449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:17:23.434392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:23.568889 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae0ea715-a426-4374-9ef6-da609853bf72 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.068028 Oct 28 18:17:23.580981 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1848/3607] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:17:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:17:23.605236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:23.606764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:23.640912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:23.654124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:23.655296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:23.656514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:23.661405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:23.662466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:24.081243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:24.090850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:24.093234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:24.119807 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2f98eb7-9cda-432c-99f8-31e116fa4e83 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.512405 Oct 28 18:17:24.120517 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1849/3608] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:23 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:24.134022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfe4b862-f153-4750-8ab6-aeccc5752dd9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:24.134720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dfe4b862-f153-4750-8ab6-aeccc5752dd9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:24.364624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dfe4b862-f153-4750-8ab6-aeccc5752dd9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:24.378398 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dfe4b862-f153-4750-8ab6-aeccc5752dd9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1221 microversion: 2.1 time: 0.244779 Oct 28 18:17:24.379371 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1850/3609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:24 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1221 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:25.146857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:25.147689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:25.166034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.166542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.166992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.167715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.174370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.174865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.192739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:25.193265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:25.193644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:25.194062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:25.194479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:25.231284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.234016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.236273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.239419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.241477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.242898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.351807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:25.375229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for user 84bb8a18e9264efbaef518e6a5ae0e32 and project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:25.413875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:17:25.418642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:25.528591 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a72a243d-843e-4a05-ae05-de289a10f13d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.039549 Oct 28 18:17:25.532518 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1760/3610] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:17:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:17:25.543103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:25.543753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:25.561662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.562367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.562980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.565938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.567579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.568789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.595997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:25.615469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:25.621678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:25.630116 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f15b037-4209-4282-93d1-7e2fa85aeeb3 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.486925 Oct 28 18:17:25.652732 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1851/3611] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:25 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:17:25.677363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f43792ce-50a4-4e4d-9bec-34025e84e009 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:25.680708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f43792ce-50a4-4e4d-9bec-34025e84e009 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:25.844942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f43792ce-50a4-4e4d-9bec-34025e84e009 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:25.859527 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f43792ce-50a4-4e4d-9bec-34025e84e009 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1214 microversion: 2.1 time: 0.197333 Oct 28 18:17:25.861238 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1852/3612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:25 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:26.649683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:26.659757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:26.660554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:26.660960 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc0f4e7e-2822-4662-9e1c-e6ed97b8e3ea tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1273 microversion: 2.1 time: 1.127113 Oct 28 18:17:26.667160 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1761/3613] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:25 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1273 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:26.689685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:26.690195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:26.690644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:26.691371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:26.699041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:26.699575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:26.885728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:26.886565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:26.899000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:26.901061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:26.902810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:26.903896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:26.905459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:26.906742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:26.921732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:26.938553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:26.944767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:26.951238 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5878b15-6220-4d44-8e7e-f04d85815c1c tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.294710 Oct 28 18:17:26.953581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1853/3614] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:26 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:27.414943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:27.427947 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b284a48d-56a8-4872-bdf0-b0ece7754ff4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1210 microversion: 2.1 time: 0.545412 Oct 28 18:17:27.428895 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1762/3615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:26 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1210 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:27.688206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:27.689003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:27.702014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:27.708620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:27.709694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:27.710619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:27.719900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:27.720643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:27.970906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1905327043", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "27d21cf1-d70e-406b-adca-eb2981c884b5"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:28.089152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] validate_networks() for [('27d21cf1-d70e-406b-adca-eb2981c884b5', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:17:28.255683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:28.266515 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a1edb0b8-6506-401a-baef-00cfbc477bd0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1279 microversion: 2.1 time: 0.583813 Oct 28 18:17:28.277768 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1854/3616] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:27 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1279 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:28.295916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:28.296817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:28.309415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:28.309924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:28.310370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:28.311149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:28.311597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:28.312060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:28.593431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:28.603175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:28.613980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:28.615420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-801ba5a0-a382-4d49-a472-be354e397739 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.336385 Oct 28 18:17:28.616266 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1855/3617] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:28 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:28.626213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:28.627134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:28.649540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:28.650043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:28.650629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:28.652371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:28.653809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:28.654319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:28.820505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:28.833672 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e3a439f8-2ab9-4268-beb1-166cb9563ef8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1272 microversion: 2.1 time: 0.214343 Oct 28 18:17:28.837711 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1856/3618] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:28 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:29.303548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:29.304200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:29.317869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:29.318396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:29.318982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:29.319792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:29.320283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:29.331064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:29.483717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:29.484512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:29.485044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:29.485458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:29.485870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:29.517944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:29.518537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:29.518985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:29.525709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:29.526212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:29.526658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:29.604290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Getting quotas for project 1db0d39c8f6b4bbe8a667b9b6f4b171a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:29.614580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Getting quotas for user 5342b8afb30d4c4fb079f3e70015f447 and project 1db0d39c8f6b4bbe8a667b9b6f4b171a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:29.633540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Going to run 3 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:17:29.637814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:29.685104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: 4b71a015-10f8-47dd-a5e0-78c850774ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=f593eaf1-07cf-4d02-b32a-ae554636f092,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:29.703759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:29.720879 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0897cde8-aa5a-470f-bce6-6e08bdcc6a8b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1279 microversion: 2.1 time: 0.420256 Oct 28 18:17:29.722247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1857/3619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:29 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1279 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:29.736818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:29.739120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:29.795440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:29.796274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:29.796738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:29.797545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:29.798343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:29.798942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:29.830512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=4b71a015-10f8-47dd-a5e0-78c850774ebd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:30.033343 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0893b4dc-62c0-4b5d-b8c9-2d85530e88a7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.349511 Oct 28 18:17:30.039381 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1763/3620] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:17:30.058984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:30.062443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:30.128145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:30.128810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:30.129489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:30.132130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:30.134512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:30.135187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:30.218282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:30.243242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:30.268059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:30.272982 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a8cc00e-862d-4a35-b8df-68e0751c4ee5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.548959 Oct 28 18:17:30.277267 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1858/3621] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:29 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:30.286444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:30.292728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:30.293603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'deleted': False, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:17:30.327316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:30.328150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:30.328898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:30.330039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:30.330911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:30.331500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:30.462722 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2672a0b1-2faf-42f9-a0f6-c2b6f276c69a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.183339 Oct 28 18:17:30.473983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1859/3622] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:17:30 2022] GET /compute/v2.1/servers => generated 1018 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:30.480405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1c9cf09b-a1b1-4bc8-a06e-87d5b2ea3971 req-3ce977af-b965-40ae-bc22-9a9998ebcb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d7e9fed-6ab0-496b-b537-02fa9be99935", "tag": "c32a0d9d-8272-4689-8881-9411b9e4d880"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:30.493160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1c9cf09b-a1b1-4bc8-a06e-87d5b2ea3971 req-3ce977af-b965-40ae-bc22-9a9998ebcb29 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:30.494348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1c9cf09b-a1b1-4bc8-a06e-87d5b2ea3971 req-3ce977af-b965-40ae-bc22-9a9998ebcb29 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:30.494970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1c9cf09b-a1b1-4bc8-a06e-87d5b2ea3971 req-3ce977af-b965-40ae-bc22-9a9998ebcb29 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:30.519007 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1c9cf09b-a1b1-4bc8-a06e-87d5b2ea3971 req-3ce977af-b965-40ae-bc22-9a9998ebcb29 service nova] Creating event network-changed:c32a0d9d-8272-4689-8881-9411b9e4d880 for instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 on n-h1-862404-2 Oct 28 18:17:30.533268 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1c9cf09b-a1b1-4bc8-a06e-87d5b2ea3971 req-3ce977af-b965-40ae-bc22-9a9998ebcb29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057101 Oct 28 18:17:30.535360 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1860/3623] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:30.553633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91326074-dbb1-4c3e-b225-71c5801a8052 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:30.554757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91326074-dbb1-4c3e-b225-71c5801a8052 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:31.149561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91326074-dbb1-4c3e-b225-71c5801a8052 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:31.152156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=51 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:31.163657 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91326074-dbb1-4c3e-b225-71c5801a8052 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1223 microversion: 2.1 time: 0.624603 Oct 28 18:17:31.165836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1861/3624] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:30 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1223 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:31.193819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:31.194746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:31.210432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:31.211247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:31.211903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:31.215003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:31.215762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:31.217362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:31.373326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:31.391070 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bac3aa45-41cf-4aaa-8303-68802aedec3e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 1.339254 Oct 28 18:17:31.393296 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1764/3625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:30 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:31.417433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:31.425821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:31.449941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:31.450720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:31.453743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:31.456585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:31.457098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:31.460317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:31.502399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:31.511466 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7d78d35d-4daf-4343-b3a6-a83743692fd3 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1279 microversion: 2.1 time: 0.328095 Oct 28 18:17:31.517029 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1862/3626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:31 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:31.878935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:31.888291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:31.896316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:31.897976 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c68433a-f99c-43d8-b320-9392b8f089cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.500836 Oct 28 18:17:31.922568 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1765/3627] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:31 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:32.196934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e2629c9-f4cb-4caa-be15-11279f765dbb tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:32.197785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2e2629c9-f4cb-4caa-be15-11279f765dbb tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:32.416894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:32.417631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:32.436309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:32.436978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:32.438654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:32.439613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:32.443903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:32.445316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:33.047190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e2629c9-f4cb-4caa-be15-11279f765dbb tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:33.058602 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e2629c9-f4cb-4caa-be15-11279f765dbb tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1223 microversion: 2.1 time: 0.868380 Oct 28 18:17:33.062314 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1863/3628] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:32 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1223 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:33.072768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:33.075266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:33.094883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:33.095431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:33.099459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:33.100304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:33.100784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:33.102634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:33.166320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:33.225338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:33.238953 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-958f1049-df0a-4671-84d1-ca2c5db2e690 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.823383 Oct 28 18:17:33.241198 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1766/3629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:32 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:33.346150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-757184951", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "0f71ee16-b5ba-49d3-a6be-7310d68be45d"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:33.409766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] validate_networks() for [('0f71ee16-b5ba-49d3-a6be-7310d68be45d', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:17:34.538786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:34.558095 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5c6ebe9-3b82-417a-932c-4a8c456c965c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1321 microversion: 2.1 time: 1.491357 Oct 28 18:17:34.573922 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1864/3630] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:33 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1321 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:34.592982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:34.593636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:34.611305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:34.611832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:34.612317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:34.613019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:34.613467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:34.613894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:34.760466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:34.761770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:34.762602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:34.763225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:34.764683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:34.791680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=49 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:34.797789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:34.800029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:34.801087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:34.802788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:34.804385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:34.804385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:34.877104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Getting quotas for project 539907337e514bf189d5cc0e95c6d2c6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:34.887412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Getting quotas for user c2e620d949eb41ef81c5fa12921213e6 and project 539907337e514bf189d5cc0e95c6d2c6. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:34.889748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=18 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:34.915797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:17:34.918094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:35.039051 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0748803a-c666-416a-acee-f5e7b186b130 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796429 Oct 28 18:17:35.049354 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1767/3631] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:17:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:17:35.055208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a52762c-de9d-4ab6-9ed3-8e072bc1b377 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-805686764", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7b0dd299-fc61-4dd4-841a-b632d4924a1e"}], "security_groups": [{"name": "tempest-securitygroup--1928229265"}], "key_name": "tempest-keypair-1006732752", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9e05b5b3-80c3-4646-9111-5d3de668b498", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:35.724622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:35.735291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:35.736868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:35.754595 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa48294f-d189-4501-93d4-6ef0aee7eba5 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 1.163556 Oct 28 18:17:35.759836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1865/3632] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:34 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:35.775850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:35.776886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:35.799708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:35.800388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:35.802909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:35.803926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:35.805751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:35.807500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:36.881830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:36.895626 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b413cc4d-a091-4e0e-bc38-24e1dcafd13b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1281 microversion: 2.1 time: 1.134326 Oct 28 18:17:36.897865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1866/3633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:35 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1281 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:36.922713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:36.928656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:36.937156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:36.937667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:36.938109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:36.939167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:36.941028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:36.941658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:37.693360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:37.706659 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-395dcf0e-f4ef-417b-be7a-cff79bf8d5dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.807292 Oct 28 18:17:37.707362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1867/3634] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:36 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:37.712503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:37.713339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:37.720305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:37.720923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:37.721461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:37.722296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:37.723039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:37.723662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:37.929020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:37.953378 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6a55ea2-cd38-4b54-99a4-889508b1e6a7 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1282 microversion: 2.1 time: 0.241653 Oct 28 18:17:37.954019 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1868/3635] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:37 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1282 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:37.962406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:37.963506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:37.986977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:37.987489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:37.988722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:37.993581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:37.994576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:37.995183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:38.777661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:38.787161 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ff335ff-932e-476b-b2cd-152eb21319dc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1321 microversion: 2.1 time: 0.829190 Oct 28 18:17:38.787775 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1869/3636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:37 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1321 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:38.807987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:38.808863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:38.815692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:38.816467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:38.817308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:38.818199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:38.818675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:38.819103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:39.273340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:39.291075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:39.292730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:39.294168 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0861a99-9b15-414d-a5a9-1bc3b6986233 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.490119 Oct 28 18:17:39.308827 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1870/3637] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:38 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:39.308827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1b56cd7f-33ee-4499-9fec-d8ebb62f048e req-3b9ff285-ed76-4a34-bcef-8d01fe051a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb", "tag": "d2e52b98-0a61-4dc7-a814-41da8d8d57ce"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:39.313638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1b56cd7f-33ee-4499-9fec-d8ebb62f048e req-3b9ff285-ed76-4a34-bcef-8d01fe051a33 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:39.314509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1b56cd7f-33ee-4499-9fec-d8ebb62f048e req-3b9ff285-ed76-4a34-bcef-8d01fe051a33 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:39.315684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1b56cd7f-33ee-4499-9fec-d8ebb62f048e req-3b9ff285-ed76-4a34-bcef-8d01fe051a33 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:39.335874 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1b56cd7f-33ee-4499-9fec-d8ebb62f048e req-3b9ff285-ed76-4a34-bcef-8d01fe051a33 service nova] Creating event network-changed:d2e52b98-0a61-4dc7-a814-41da8d8d57ce for instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb on n-h2-862404-2 Oct 28 18:17:39.344796 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1b56cd7f-33ee-4499-9fec-d8ebb62f048e req-3b9ff285-ed76-4a34-bcef-8d01fe051a33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047713 Oct 28 18:17:39.348085 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1871/3638] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:39.359447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:39.360810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:39.367581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:39.368383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:39.369453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:39.370662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:39.371299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:39.371751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:39.958425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:39.971277 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f006a173-8fb1-4512-b413-90ed1cbdf22e tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.620910 Oct 28 18:17:39.973150 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1872/3639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:39 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:39.979283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:39.980163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:39.987679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:39.988500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:39.989173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:39.990122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:39.990811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:39.991447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:40.380075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:40.390552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:40.393985 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-735ee7d2-eb9b-4038-98e5-3972c93e146b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.419546 Oct 28 18:17:40.394765 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1873/3640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:39 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:40.417169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-bdd1af1d-e96f-4f12-8aa1-f13b6d5e522b req-260b518b-95d5-4039-9c98-8b6178961da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f843aa59-eec2-4bd9-ab00-f7ebe5338248", "tag": "c8ff9b2f-0627-4424-99b3-05590613555d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:40.429096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bdd1af1d-e96f-4f12-8aa1-f13b6d5e522b req-260b518b-95d5-4039-9c98-8b6178961da4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:40.429870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bdd1af1d-e96f-4f12-8aa1-f13b6d5e522b req-260b518b-95d5-4039-9c98-8b6178961da4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:40.430521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bdd1af1d-e96f-4f12-8aa1-f13b6d5e522b req-260b518b-95d5-4039-9c98-8b6178961da4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:40.445527 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-bdd1af1d-e96f-4f12-8aa1-f13b6d5e522b req-260b518b-95d5-4039-9c98-8b6178961da4 service nova] Creating event network-changed:c8ff9b2f-0627-4424-99b3-05590613555d for instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 on n-h1-862404-2 Oct 28 18:17:40.450716 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-bdd1af1d-e96f-4f12-8aa1-f13b6d5e522b req-260b518b-95d5-4039-9c98-8b6178961da4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040970 Oct 28 18:17:40.452635 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1874/3641] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:40.457910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:40.458814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:40.467233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:40.467971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:40.468577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:40.469670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:40.470499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:40.476683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:40.788326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:40.796603 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35f88129-962f-4603-b9b1-7ef815e259bf tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1324 microversion: 2.1 time: 0.342596 Oct 28 18:17:40.808284 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1875/3642] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:40 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:40.818463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-927a5609-51cf-41e9-8143-2f2e629ca72c req-d1b3fec4-713b-4ae6-b19c-9d34e539ce2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7e9fed-6ab0-496b-b537-02fa9be99935", "name": "network-vif-plugged", "status": "completed", "tag": "c32a0d9d-8272-4689-8881-9411b9e4d880"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:40.829878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-927a5609-51cf-41e9-8143-2f2e629ca72c req-d1b3fec4-713b-4ae6-b19c-9d34e539ce2a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:40.830553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-927a5609-51cf-41e9-8143-2f2e629ca72c req-d1b3fec4-713b-4ae6-b19c-9d34e539ce2a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:40.832049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-927a5609-51cf-41e9-8143-2f2e629ca72c req-d1b3fec4-713b-4ae6-b19c-9d34e539ce2a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:40.849948 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-927a5609-51cf-41e9-8143-2f2e629ca72c req-d1b3fec4-713b-4ae6-b19c-9d34e539ce2a service nova] Creating event network-vif-plugged:c32a0d9d-8272-4689-8881-9411b9e4d880 for instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 on n-h1-862404-2 Oct 28 18:17:40.855184 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-927a5609-51cf-41e9-8143-2f2e629ca72c req-d1b3fec4-713b-4ae6-b19c-9d34e539ce2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045352 Oct 28 18:17:40.856069 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1876/3643] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:40.863695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:40.864642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:40.871520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:40.872535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:40.873934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:40.874833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:40.875479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:40.875997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:41.231996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:41.254544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c80d886-7173-4a4a-8472-21314c7fed7b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1321 microversion: 2.1 time: 0.394170 Oct 28 18:17:41.257518 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1877/3644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:40 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:41.270026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:41.271099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:41.286792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:41.288277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:41.289013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:41.290145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:41.291989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:41.294076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:41.439397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:41.456883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:41.460851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:41.463211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-94ad992b-5497-4e47-9159-d83f3dc970cf tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.202809 Oct 28 18:17:41.463982 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1878/3645] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:41 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:41.475239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:41.476684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:41.485584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:41.486663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:41.487304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:41.488213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:41.489271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:41.490793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:41.961770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:41.999002 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-747759ad-d590-495c-bdf3-a9c052133bee tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.532406 Oct 28 18:17:42.016917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1879/3646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:41 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:42.024429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3c9e9f6c-1d6a-4591-9931-18e327851e64 req-f323d718-89c6-44e1-b4a6-3bde811a4875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2164efc4-61e1-437d-870f-98fbae5d329e", "tag": "e677cb09-2070-4c19-a8c5-c0c6ad01a11d"}, {"name": "network-changed", "server_uuid": "6a003065-8214-4c1a-bfe2-1d36f8b6401b", "tag": "b4a4a1a1-99f0-43dc-8d16-4fee1e508e51"}, {"name": "network-changed", "server_uuid": "ace49418-f4f4-4658-81fa-5329327349b6", "tag": "e6102505-e6f7-4e59-a2de-83f037e98582"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:42.040568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3c9e9f6c-1d6a-4591-9931-18e327851e64 req-f323d718-89c6-44e1-b4a6-3bde811a4875 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:42.041292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3c9e9f6c-1d6a-4591-9931-18e327851e64 req-f323d718-89c6-44e1-b4a6-3bde811a4875 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:42.041796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3c9e9f6c-1d6a-4591-9931-18e327851e64 req-f323d718-89c6-44e1-b4a6-3bde811a4875 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:42.060879 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3c9e9f6c-1d6a-4591-9931-18e327851e64 req-f323d718-89c6-44e1-b4a6-3bde811a4875 service nova] Creating event network-changed:e677cb09-2070-4c19-a8c5-c0c6ad01a11d for instance 2164efc4-61e1-437d-870f-98fbae5d329e on n-h1-862404-2 Oct 28 18:17:42.061772 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3c9e9f6c-1d6a-4591-9931-18e327851e64 req-f323d718-89c6-44e1-b4a6-3bde811a4875 service nova] Creating event network-changed:b4a4a1a1-99f0-43dc-8d16-4fee1e508e51 for instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b on n-h2-862404-2 Oct 28 18:17:42.062575 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3c9e9f6c-1d6a-4591-9931-18e327851e64 req-f323d718-89c6-44e1-b4a6-3bde811a4875 service nova] Creating event network-changed:e6102505-e6f7-4e59-a2de-83f037e98582 for instance ace49418-f4f4-4658-81fa-5329327349b6 on n-h2-862404-2 Oct 28 18:17:42.076983 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3c9e9f6c-1d6a-4591-9931-18e327851e64 req-f323d718-89c6-44e1-b4a6-3bde811a4875 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.058429 Oct 28 18:17:42.077935 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1880/3647] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:42.083863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:42.084951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:42.093326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:42.094448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:42.095356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:42.096435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:42.097429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:42.098137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:42.725252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:42.734145 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-965ebb6e-09d0-41ba-ac8b-52ae3a71b8de tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.654544 Oct 28 18:17:42.752021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1881/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:42 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:42.762861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:42.764952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:42.788724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:42.789228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:42.789706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:42.790574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:42.791221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:42.791827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:42.987592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:42.997281 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0f9c992-3b4d-4b90-baa5-d4b17ede4c42 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1324 microversion: 2.1 time: 0.244027 Oct 28 18:17:42.999180 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1882/3649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:42 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1324 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:43.004582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:43.005408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:43.011486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:43.013147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.013851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.014679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:43.015624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.016566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.017156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:43.052931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:43.192091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:43.195867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:43.203016 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9e69193f-8b31-4e3c-b4b1-2142b9dca651 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1321 microversion: 2.1 time: 0.202334 Oct 28 18:17:43.219681 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1883/3650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:42 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:43.219681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-055ca9db-e4e8-4717-aea7-055a2601b656 req-bf56ce4a-32f6-4dbc-8537-898e68bb3db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f593eaf1-07cf-4d02-b32a-ae554636f092", "tag": "79c499b7-d9ff-484d-80a2-1b1fd9d371b4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:43.219681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-055ca9db-e4e8-4717-aea7-055a2601b656 req-bf56ce4a-32f6-4dbc-8537-898e68bb3db1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.220229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-055ca9db-e4e8-4717-aea7-055a2601b656 req-bf56ce4a-32f6-4dbc-8537-898e68bb3db1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.220621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-055ca9db-e4e8-4717-aea7-055a2601b656 req-bf56ce4a-32f6-4dbc-8537-898e68bb3db1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:43.233924 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-055ca9db-e4e8-4717-aea7-055a2601b656 req-bf56ce4a-32f6-4dbc-8537-898e68bb3db1 service nova] Creating event network-changed:79c499b7-d9ff-484d-80a2-1b1fd9d371b4 for instance f593eaf1-07cf-4d02-b32a-ae554636f092 on n-h2-862404-2 Oct 28 18:17:43.238814 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-055ca9db-e4e8-4717-aea7-055a2601b656 req-bf56ce4a-32f6-4dbc-8537-898e68bb3db1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033523 Oct 28 18:17:43.239429 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1884/3651] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:43.244604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:43.245314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:43.253465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.254076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.254613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:43.255415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.255985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.256508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:43.331586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:43.340874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:43.344126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:43.345447 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ad3aa2d-2cab-454f-b553-84402d233e84 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.104880 Oct 28 18:17:43.359838 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1885/3652] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:43 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:43.359838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:43.359838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:43.359838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.359838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.359838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:43.360437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.363609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.363609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:43.523864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:43.532397 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1c4139a2-6fe6-4e99-8930-48afe1b6ab16 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.184906 Oct 28 18:17:43.533447 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1886/3653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:43 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:43.761354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:43.764258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:43.774736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.777560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.778178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:43.779874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:43.780494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:43.781074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.084685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:44.093525 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d8aa885-f72f-42ef-a569-b665967c7bc6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.336754 Oct 28 18:17:44.094118 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1887/3654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:43 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:44.099426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:44.100059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:44.106405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:44.106866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:44.108095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.108950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:44.109410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:44.109832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.281149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:44.289242 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b7157814-19d6-4577-bff5-ac42299c6f95 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1324 microversion: 2.1 time: 0.193895 Oct 28 18:17:44.290809 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1888/3655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:44 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:44.297873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:44.299219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:44.314992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:44.316367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:44.317299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.318399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:44.319515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:44.320216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.565383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:44.578598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0b2e80f-5b53-4ac2-927c-ea5716d91418 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1321 microversion: 2.1 time: 0.286458 Oct 28 18:17:44.582275 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1889/3656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:44 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:44.587465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:44.588211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:44.595957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:44.596531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:44.597039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.597978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:44.598511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:44.599007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.704774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:44.724050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:44.726060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:44.727426 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c200cb0a-c27d-4e28-bb4d-4c1e9026b57f tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1365 microversion: 2.57 time: 0.143943 Oct 28 18:17:44.728829 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1890/3657] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:44 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:44.744924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:44.746143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:44.756675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:44.758010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:44.758776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.764376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:44.765496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:44.766835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:44.826620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=10 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:44.831943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:44.908426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=5 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:45.069814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:45.214794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:45.226018 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8ed7d6a-f437-4e8b-a980-39eea3aca777 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.495476 Oct 28 18:17:45.243258 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1891/3658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:44 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:45.249797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:45.250748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:45.259212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:45.259713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:45.260270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:45.261089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:45.261652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:45.262652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:45.734474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:45.752146 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2ee2919-fd20-4409-8187-176b139dc069 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.507049 Oct 28 18:17:45.753205 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1892/3659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:45 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:45.770422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:45.771867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:45.784091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:45.787049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:45.788550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:45.790494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:45.792415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:45.793135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:46.460347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:46.472592 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7fec5dec-39d6-4904-99f3-a1eb5d36d913 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1324 microversion: 2.1 time: 0.716951 Oct 28 18:17:46.473199 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1893/3660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:45 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1324 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:46.495357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f96003fe-182e-4530-ae96-b73c64555cda req-0ab44235-f44f-4dfa-b6c5-21d634ab9091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b71a015-10f8-47dd-a5e0-78c850774ebd", "tag": "07234485-dc23-49b4-9cb5-97d7fa4aa6e5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:46.514712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f96003fe-182e-4530-ae96-b73c64555cda req-0ab44235-f44f-4dfa-b6c5-21d634ab9091 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:46.515431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f96003fe-182e-4530-ae96-b73c64555cda req-0ab44235-f44f-4dfa-b6c5-21d634ab9091 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:46.515919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f96003fe-182e-4530-ae96-b73c64555cda req-0ab44235-f44f-4dfa-b6c5-21d634ab9091 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:46.530320 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f96003fe-182e-4530-ae96-b73c64555cda req-0ab44235-f44f-4dfa-b6c5-21d634ab9091 service nova] Creating event network-changed:07234485-dc23-49b4-9cb5-97d7fa4aa6e5 for instance 4b71a015-10f8-47dd-a5e0-78c850774ebd on n-h1-862404-2 Oct 28 18:17:46.536130 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f96003fe-182e-4530-ae96-b73c64555cda req-0ab44235-f44f-4dfa-b6c5-21d634ab9091 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045328 Oct 28 18:17:46.537292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1894/3661] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:46.545252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:46.550267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:46.564306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:46.564907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:46.565786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:46.566772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:46.572491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:46.573082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:47.609871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:47.619233 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e5f4044-b197-4e30-a823-db7a29519a74 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1321 microversion: 2.1 time: 1.080533 Oct 28 18:17:47.636161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1895/3662] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:46 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1321 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:47.645150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:47.645873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:47.654893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:47.655786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:47.656529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:47.657789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:47.658491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:47.659194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:47.809672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:47.821400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:47.824655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:47.830234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1632aede-4b54-4fc6-88c0-898e117ee489 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1371 microversion: 2.57 time: 0.192525 Oct 28 18:17:47.830825 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1896/3663] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:47 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:47.850717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:47.851566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:47.859219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:47.859968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:47.860608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:47.861569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:47.862702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:47.863710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:48.273627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:48.284992 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d887223-8894-4b2c-b620-f72e16ba91fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.452764 Oct 28 18:17:48.286713 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1897/3664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:47 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:48.307398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:48.309148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:48.316343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:48.317220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:48.317836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:48.318886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:48.319530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:48.320144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:48.681369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:48.695930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8ddd67f-0a69-4047-acaf-1168303c1b13 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.406725 Oct 28 18:17:48.697363 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1898/3665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:48 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:48.703764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3cf23128-242b-4e4f-8eb2-115c1122dd86 req-c8528d1a-ff19-4095-9b4d-ebb1f92c54dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb", "name": "network-vif-plugged", "status": "completed", "tag": "d2e52b98-0a61-4dc7-a814-41da8d8d57ce"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:48.723470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3cf23128-242b-4e4f-8eb2-115c1122dd86 req-c8528d1a-ff19-4095-9b4d-ebb1f92c54dd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:48.724387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3cf23128-242b-4e4f-8eb2-115c1122dd86 req-c8528d1a-ff19-4095-9b4d-ebb1f92c54dd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:48.725870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3cf23128-242b-4e4f-8eb2-115c1122dd86 req-c8528d1a-ff19-4095-9b4d-ebb1f92c54dd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:48.743739 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3cf23128-242b-4e4f-8eb2-115c1122dd86 req-c8528d1a-ff19-4095-9b4d-ebb1f92c54dd service nova] Creating event network-vif-plugged:d2e52b98-0a61-4dc7-a814-41da8d8d57ce for instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb on n-h2-862404-2 Oct 28 18:17:48.752647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3cf23128-242b-4e4f-8eb2-115c1122dd86 req-c8528d1a-ff19-4095-9b4d-ebb1f92c54dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053832 Oct 28 18:17:48.753871 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1899/3666] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:48.759567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:48.763112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:48.771151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:48.772697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:48.773345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:48.774276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:48.774924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:48.775543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:49.327024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:49.337206 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5856541-fa2a-413d-9349-00e41bbc0884 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1324 microversion: 2.1 time: 0.581776 Oct 28 18:17:49.352122 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1900/3667] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:48 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1324 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:49.352122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:49.352122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:49.355912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:49.356405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:49.357104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:49.357862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:49.358306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:49.358733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:49.967513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:49.976284 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e64598e-4de0-4c9c-a8cc-737055108fcc tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1321 microversion: 2.1 time: 0.636574 Oct 28 18:17:49.976883 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1901/3668] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:49 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1321 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:49.983234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:49.983867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:49.989782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:49.990250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:49.990690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:49.991380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:49.991890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:49.992392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:50.014911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:50.147053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:50.156662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:50.158413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:50.159771 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff122d93-4ad4-484d-961c-787ecf70c488 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1371 microversion: 2.57 time: 0.181719 Oct 28 18:17:50.161547 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1902/3669] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:49 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:50.166440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:50.168594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:50.175150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:50.175720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:50.176273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:50.177047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:50.177577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:50.178080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:50.396483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:50.405133 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6d3d0c8-de39-4e7b-95f5-0fa907d714fc tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.242156 Oct 28 18:17:50.405637 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1903/3670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:50 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:50.410486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:50.411100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:50.417001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:50.417494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:50.417930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:50.418759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:50.419222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:50.420398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:50.694438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:50.702984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-751e9ef5-ab4c-4ee4-bcad-056e44bb8583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.296321 Oct 28 18:17:50.713776 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1904/3671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:50 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:50.720701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:50.721699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:50.728605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:50.729105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:50.729539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:50.730264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:50.731038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:50.731589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:50.962107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:50.971058 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e428f523-9def-4aa2-a1af-3c09dde149f1 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1324 microversion: 2.1 time: 0.255667 Oct 28 18:17:50.971739 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1905/3672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:50 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:50.976672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d10143ee-464f-4d4d-a35a-7f927f971a15 req-87ab2e7b-bf27-4a75-97d7-c80b6638fde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a003065-8214-4c1a-bfe2-1d36f8b6401b", "name": "network-vif-plugged", "status": "completed", "tag": "b4a4a1a1-99f0-43dc-8d16-4fee1e508e51"}, {"server_uuid": "2164efc4-61e1-437d-870f-98fbae5d329e", "name": "network-vif-plugged", "status": "completed", "tag": "e677cb09-2070-4c19-a8c5-c0c6ad01a11d"}, {"server_uuid": "f843aa59-eec2-4bd9-ab00-f7ebe5338248", "name": "network-vif-plugged", "status": "completed", "tag": "c8ff9b2f-0627-4424-99b3-05590613555d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:50.991014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d10143ee-464f-4d4d-a35a-7f927f971a15 req-87ab2e7b-bf27-4a75-97d7-c80b6638fde6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:50.991744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d10143ee-464f-4d4d-a35a-7f927f971a15 req-87ab2e7b-bf27-4a75-97d7-c80b6638fde6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:50.991996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d10143ee-464f-4d4d-a35a-7f927f971a15 req-87ab2e7b-bf27-4a75-97d7-c80b6638fde6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:51.008271 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d10143ee-464f-4d4d-a35a-7f927f971a15 req-87ab2e7b-bf27-4a75-97d7-c80b6638fde6 service nova] Creating event network-vif-plugged:b4a4a1a1-99f0-43dc-8d16-4fee1e508e51 for instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b on n-h2-862404-2 Oct 28 18:17:51.009444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d10143ee-464f-4d4d-a35a-7f927f971a15 req-87ab2e7b-bf27-4a75-97d7-c80b6638fde6 service nova] Creating event network-vif-plugged:e677cb09-2070-4c19-a8c5-c0c6ad01a11d for instance 2164efc4-61e1-437d-870f-98fbae5d329e on n-h1-862404-2 Oct 28 18:17:51.009958 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d10143ee-464f-4d4d-a35a-7f927f971a15 req-87ab2e7b-bf27-4a75-97d7-c80b6638fde6 service nova] Creating event network-vif-plugged:c8ff9b2f-0627-4424-99b3-05590613555d for instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 on n-h1-862404-2 Oct 28 18:17:51.021172 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d10143ee-464f-4d4d-a35a-7f927f971a15 req-87ab2e7b-bf27-4a75-97d7-c80b6638fde6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048294 Oct 28 18:17:51.022074 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1906/3673] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:51.027079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:51.027782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:51.034021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:51.034517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:51.034943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:51.035650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:51.036123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:51.036555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:51.338949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:51.350199 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6ae5159-e2d9-4960-a722-d516c6885c43 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1321 microversion: 2.1 time: 0.326739 Oct 28 18:17:51.363842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1907/3674] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:51 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:51.363842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:51.364505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:51.371142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:51.371898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:51.372578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:51.374001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:51.374468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:51.374900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:51.487367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:51.497559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:51.500259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:51.501792 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-12010c28-169e-4580-a587-a674dfcb9cfe tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1371 microversion: 2.57 time: 0.142486 Oct 28 18:17:51.504485 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1908/3675] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:51 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:51.507704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:51.508473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:51.515866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:51.516263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:51.516815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:51.517636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:51.518201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:51.518734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:51.765516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:51.779880 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dcbc0024-a7c2-47c3-a146-14db5d34255a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.274743 Oct 28 18:17:51.793185 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1909/3676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:51 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:51.807681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:51.808338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:51.816711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:51.817254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:51.817698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:51.818409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:51.818862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:51.819351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:52.062110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:52.074987 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50428763-5d7d-44d9-8ea9-ce88c4cc8acb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.273488 Oct 28 18:17:52.079520 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1910/3677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:51 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:52.090272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:52.092002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:52.100375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:52.101278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:52.101931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:52.102821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:52.103515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:52.116791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:52.506720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:52.524554 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb86a025-2621-4f01-8169-0836c17683fe tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1324 microversion: 2.1 time: 0.441085 Oct 28 18:17:52.535841 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1911/3678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:52 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:52.535841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:52.535841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:52.544645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:52.546665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:52.547597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:52.548404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:52.548888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:52.549327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:52.899208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:52.908030 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d1a95ea6-ef85-4f1f-8730-3b5b833f0c29 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1513 microversion: 2.1 time: 0.381790 Oct 28 18:17:52.927911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1912/3679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:52 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:52.935961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:52.936925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:52.945728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:52.948145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:52.948756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:52.950162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:52.950909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:52.952022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:53.087755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:53.103127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:53.104876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:53.106219 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d69bd422-590f-40da-b836-d3235ed507f8 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1356 microversion: 2.57 time: 0.175833 Oct 28 18:17:53.107734 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1913/3680] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:52 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:53.119776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:53.121657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:53.137285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:53.138817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:53.139334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:53.140100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:53.140560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:53.141982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:53.660394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:53.671186 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e52e5d7-90c7-4e8c-8d40-c789a56d4477 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.561070 Oct 28 18:17:53.672161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1914/3681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:53 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:53.677318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:53.678007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:53.684123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:53.684709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:53.685985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:53.687014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:53.687590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:53.688096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:53.844007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:53.853052 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-637e19c3-3477-451d-9eb6-a9093d1eecd5 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1511 microversion: 2.1 time: 0.180031 Oct 28 18:17:53.868060 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1915/3682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:53 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:53.868060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-eaa8f42e-b988-43dc-9d41-562572d9d1f7 req-0d0a77ac-d182-4035-91f1-042049701fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace49418-f4f4-4658-81fa-5329327349b6", "name": "network-vif-plugged", "status": "completed", "tag": "e6102505-e6f7-4e59-a2de-83f037e98582"}, {"server_uuid": "f593eaf1-07cf-4d02-b32a-ae554636f092", "name": "network-vif-plugged", "status": "completed", "tag": "79c499b7-d9ff-484d-80a2-1b1fd9d371b4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:53.870564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eaa8f42e-b988-43dc-9d41-562572d9d1f7 req-0d0a77ac-d182-4035-91f1-042049701fe0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:53.871053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eaa8f42e-b988-43dc-9d41-562572d9d1f7 req-0d0a77ac-d182-4035-91f1-042049701fe0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:53.871493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eaa8f42e-b988-43dc-9d41-562572d9d1f7 req-0d0a77ac-d182-4035-91f1-042049701fe0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:53.889408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-eaa8f42e-b988-43dc-9d41-562572d9d1f7 req-0d0a77ac-d182-4035-91f1-042049701fe0 service nova] Creating event network-vif-plugged:e6102505-e6f7-4e59-a2de-83f037e98582 for instance ace49418-f4f4-4658-81fa-5329327349b6 on n-h2-862404-2 Oct 28 18:17:53.889948 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-eaa8f42e-b988-43dc-9d41-562572d9d1f7 req-0d0a77ac-d182-4035-91f1-042049701fe0 service nova] Creating event network-vif-plugged:79c499b7-d9ff-484d-80a2-1b1fd9d371b4 for instance f593eaf1-07cf-4d02-b32a-ae554636f092 on n-h2-862404-2 Oct 28 18:17:53.896618 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-eaa8f42e-b988-43dc-9d41-562572d9d1f7 req-0d0a77ac-d182-4035-91f1-042049701fe0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041837 Oct 28 18:17:53.897424 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1916/3683] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:53.902506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:53.903228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:53.910580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:53.911865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:53.912324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:53.913049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:53.913514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:53.913946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:54.239114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:54.249408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2baeaef2-041e-4b83-82d4-39dbb353bdfb tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1314 microversion: 2.1 time: 0.350806 Oct 28 18:17:54.258958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1917/3684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:53 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:54.266239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:54.266966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:54.273397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:54.273887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:54.274319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:54.275007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:54.275459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:54.275904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:54.318395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:17:54.425425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:54.465302 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d140f0e-e90b-4f46-bd1e-8a93abc012bb tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 204 len: 0 microversion: 2.57 time: 0.203563 Oct 28 18:17:54.467162 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1918/3685] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:54 2022] DELETE /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:17:54.474954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:54.476443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:54.495738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:54.496388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:54.497091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:54.498681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:54.499489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:54.500157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.046567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:55.072669 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-de281ffe-619d-4381-83b0-c83ff42cfa9d tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1520 microversion: 2.1 time: 0.598803 Oct 28 18:17:55.076290 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1919/3686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:54 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1520 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:55.082477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:55.083206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:55.094508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.094508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.094508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.095484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.096215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.096740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.269144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:55.278183 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95391675-b190-41ed-8047-3d5e20a5773c tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb" status: 200 len: 1512 microversion: 2.1 time: 0.202375 Oct 28 18:17:55.278856 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1920/3687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:55 2022] GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:55.284205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:55.284814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:55.290679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.291196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.291632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.292413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.293042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.293642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.368658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:55.379682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:55.381329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b4bb9d2e51f74c178c77788fd05b990a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7376eb80dbac4879b4e9434e7924c91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:55.382601 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56e077f9-c6f6-415a-b245-eb6086953654 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 200 len: 1362 microversion: 2.57 time: 0.102268 Oct 28 18:17:55.383283 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1921/3688] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:55 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 1362 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:55.389527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:55.390128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:55.396478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.397236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.397677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.398515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.399143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.400084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.581460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:55.590959 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99eebfd7-523f-490d-b1f5-3805c40d11e6 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1323 microversion: 2.1 time: 0.204953 Oct 28 18:17:55.603847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1922/3689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:55 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:55.603847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:55.603847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:55.608309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.608918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.609514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.610287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.610849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.611485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.640789 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] HTTP exception thrown: Instance is not a member of specified network Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Request method failure captured: Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248/ips/invalid HTTP/1.1 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy82Xgamt24ZHQhYD7syNBaJhRfw8VtT6R0ynsvQ6jMkdjBUGs6S9_QAELibD-JmjTIxHF5-B8wl7JxRkvgpLDcIwZgEXisO26HgnxVQna_JQmMv3th-AbkIW7B2hlThorunjyEZSp49q3HFgJ00Vehm7qkvn39MtPcHPzzpaLHd2w Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 539907337e514bf189d5cc0e95c6d2c6 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_539907337e514bf189d5cc0e95c6d2c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 539907337e514bf189d5cc0e95c6d2c6 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerAddressesNegativeTestJSON-611370545-project Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c2e620d949eb41ef81c5fa12921213e6 Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-611370545-project Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance is not a member of specified network Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': 'f843aa59-eec2-4bd9-ab00-f7ebe5338248', 'id': 'invalid'} Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 28 18:17:55.644386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:55.648634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:55.648634 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2afae877-81d9-48f4-87c8-d8c9476b81cb tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.052222 Oct 28 18:17:55.651311 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1923/3690] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:17:55 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248/ips/invalid => generated 91 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:17:55.656663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:55.657447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:55.665648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.666245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.666744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.667514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.668098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.668723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.821751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:55.832821 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33f87813-eedc-4f35-b930-586e1ea01077 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1500 microversion: 2.1 time: 0.180238 Oct 28 18:17:55.833416 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1924/3691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:55 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1500 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:55.839204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:55.845162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:55.846023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:17:55.859222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.859703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.860168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.860889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:55.863130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:55.863130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:55.984861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:17:56.075426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:56.082509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:56.083249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:56.083715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:56.257404 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-20a771ec-2013-4b39-8668-6f479d2e6010 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.422871 Oct 28 18:17:56.258202 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1925/3692] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 18:17:55 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:56.437465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:56.438232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:56.447525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:56.448157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:56.448618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:56.449328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:56.456840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:56.457389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:56.492646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:17:56.640921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:56.660935 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2be7766-5c1c-43b9-950f-13dfd7a40c8b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 204 len: 0 microversion: 2.32 time: 0.401652 Oct 28 18:17:56.665234 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1926/3693] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:17:56 2022] DELETE /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:17:56.667169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bf82ef8-3843-41b5-88cf-df826e0260f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:56.667740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2bf82ef8-3843-41b5-88cf-df826e0260f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Failed to fetch instance by id 999 {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2983}} Oct 28 18:17:56.668339 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2bf82ef8-3843-41b5-88cf-df826e0260f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] HTTP exception thrown: Instance 999 could not be found. Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bf82ef8-3843-41b5-88cf-df826e0260f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Request method failure captured: Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy82Xgamt24ZHQhYD7syNBaJhRfw8VtT6R0ynsvQ6jMkdjBUGs6S9_QAELibD-JmjTIxHF5-B8wl7JxRkvgpLDcIwZgEXisO26HgnxVQna_JQmMv3th-AbkIW7B2hlThorunjyEZSp49q3HFgJ00Vehm7qkvn39MtPcHPzzpaLHd2w Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 539907337e514bf189d5cc0e95c6d2c6 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_539907337e514bf189d5cc0e95c6d2c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 539907337e514bf189d5cc0e95c6d2c6 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerAddressesNegativeTestJSON-611370545-project Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c2e620d949eb41ef81c5fa12921213e6 Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-611370545-project Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 999 could not be found. Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '999'} Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2984, in get Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 18:17:56.672078 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:56.676600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bf82ef8-3843-41b5-88cf-df826e0260f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:56.681563 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2bf82ef8-3843-41b5-88cf-df826e0260f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.014336 Oct 28 18:17:56.681563 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1927/3694] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:17:56 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:17:56.692609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:56.696811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:56.722355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:56.727956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:56.728430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:56.729173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:56.733317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:56.733795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:56.791471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lazy-loading 'flavor' on Instance uuid 2164efc4-61e1-437d-870f-98fbae5d329e {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:17:57.057068 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86ae9d75-779f-4acd-8637-14b31d6c05dc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e/action" status: 202 len: 0 microversion: 2.1 time: 0.378047 Oct 28 18:17:57.057701 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1928/3695] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:17:56 2022] POST /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:17:57.068565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7d7343f5-751a-4983-a7af-a835e22a662b req-6f65717e-2b6c-42a5-9ea7-114b964ea766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b71a015-10f8-47dd-a5e0-78c850774ebd", "name": "network-vif-plugged", "status": "completed", "tag": "07234485-dc23-49b4-9cb5-97d7fa4aa6e5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:57.084152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d7343f5-751a-4983-a7af-a835e22a662b req-6f65717e-2b6c-42a5-9ea7-114b964ea766 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.084863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d7343f5-751a-4983-a7af-a835e22a662b req-6f65717e-2b6c-42a5-9ea7-114b964ea766 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.085560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d7343f5-751a-4983-a7af-a835e22a662b req-6f65717e-2b6c-42a5-9ea7-114b964ea766 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.097524 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7d7343f5-751a-4983-a7af-a835e22a662b req-6f65717e-2b6c-42a5-9ea7-114b964ea766 service nova] Creating event network-vif-plugged:07234485-dc23-49b4-9cb5-97d7fa4aa6e5 for instance 4b71a015-10f8-47dd-a5e0-78c850774ebd on n-h1-862404-2 Oct 28 18:17:57.103701 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7d7343f5-751a-4983-a7af-a835e22a662b req-6f65717e-2b6c-42a5-9ea7-114b964ea766 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044524 Oct 28 18:17:57.104851 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1929/3696] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:57.110944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:57.116364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:57.117560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-303212241', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:17:57.125682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.126276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.126840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.128640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.129348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.130007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.242788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:17:57.317933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:57.325068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.326288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.326897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.476723 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8b88757-6555-4161-bfc8-6074055bc5c9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-303212241" status: 200 len: 1514 microversion: 2.1 time: 0.370289 Oct 28 18:17:57.478002 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1930/3697] 10.222.0.16 () {58 vars in 1261 bytes} [Fri Oct 28 18:17:57 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-303212241 => generated 1514 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:57.483882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:57.484911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] [instance: 4ef9970d-7670-4160-9774-168940f48fa1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:57.491276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.492038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.492667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.493563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.494252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.495022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.512626 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] HTTP exception thrown: Instance 4ef9970d-7670-4160-9774-168940f48fa1 could not be found. Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Request method failure captured: Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 HTTP/1.1 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXByiwS34Rz7X-RCE54mN7gV_WWUjW6a_D-rq5De1trBQEoVly-7dvynOJnBhmikSHpHlfkznv5UozwhdAzAM8Yr2Cdeej8zitiE5e2X56J7sVx_B_kkqzXRx8i_mcWkZqtOlPEs_6vmUWfMFAsMX2jg1a9_N0XWrvVHF5WbiNztjaJ8 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.57 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 7376eb80dbac4879b4e9434e7924c91a Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerShowV257Test-1123805174 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7376eb80dbac4879b4e9434e7924c91a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7376eb80dbac4879b4e9434e7924c91a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7376eb80dbac4879b4e9434e7924c91a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7376eb80dbac4879b4e9434e7924c91a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerShowV257Test-1123805174 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 7376eb80dbac4879b4e9434e7924c91a Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerShowV257Test-1123805174 Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerShowV257Test-1123805174-project Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b4bb9d2e51f74c178c77788fd05b990a Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerShowV257Test-1123805174-project Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4ef9970d-7670-4160-9774-168940f48fa1 could not be found. Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4ef9970d-7670-4160-9774-168940f48fa1'} Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef9970d-7670-4160-9774-168940f48fa1 could not be found. Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef9970d-7670-4160-9774-168940f48fa1 could not be found. Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:57.514425 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef9970d-7670-4160-9774-168940f48fa1 could not be found. Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] Returning 404 to user: Instance 4ef9970d-7670-4160-9774-168940f48fa1 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d09530f4-2365-4328-b417-f7f15fdab9d6 tempest-ServerShowV257Test-1123805174 tempest-ServerShowV257Test-1123805174-project] 10.222.0.16 "GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1" status: 404 len: 111 microversion: 2.57 time: 0.036790 Oct 28 18:17:57.519590 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1931/3698] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:57 2022] GET /compute/v2.1/servers/4ef9970d-7670-4160-9774-168940f48fa1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:17:57.521458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:57.521587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:57.530184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.530710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.531181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.532016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.532471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.533176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.696333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:57.711401 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7d5615ef-9af5-45fd-82e2-a04deb66d68a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1516 microversion: 2.1 time: 0.193743 Oct 28 18:17:57.713016 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1932/3699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:57 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:57.720612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:57.721662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:57.729614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.730182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.730864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.731579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:57.732918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:57.733508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:57.738246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:57.975901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:57.987508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:57.989397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:57.991345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38cc48c2-888c-424c-90cc-e309f63a83cc tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 2949 microversion: 2.32 time: 0.276288 Oct 28 18:17:57.992391 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1933/3700] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:57 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 2949 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:57.997881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:57.998462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:58.005002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:58.005892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:58.006604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:58.007420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:58.008040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:58.008572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:58.040844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:17:58.398227 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5a35a2a0-ec7f-48fc-9d7c-254ad357e020 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 204 len: 0 microversion: 2.1 time: 0.404506 Oct 28 18:17:58.398911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1934/3701] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:17:57 2022] DELETE /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:17:58.405268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:58.406411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:58.413193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:58.413882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:58.414340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:58.415356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:58.415849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:58.416673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:58.578525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:58.587948 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5863999-ce02-45b6-8122-458f9c1f9d4b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.187430 Oct 28 18:17:58.596273 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1935/3702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:58 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:58.601671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:58.607058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:58.608497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:17:58.614227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:58.614938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:58.615442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:58.616292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:58.617096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:58.617660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:58.740188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:17:58.824753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:58.833029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:58.833522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:58.833960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:58.986792 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86dcb5f7-e1b6-41fc-bcf0-311695fefb25 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.389255 Oct 28 18:17:58.989158 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1936/3703] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 18:17:58 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:58.995866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:58.995866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: 4b71a015-10f8-47dd-a5e0-78c850774ebd] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:59.000634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.001129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.001627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.002334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.002793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.003348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.163531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:59.173209 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3f6ef0a-59ab-40d2-94d7-bee1945fe7c7 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd" status: 200 len: 1323 microversion: 2.1 time: 0.183992 Oct 28 18:17:59.173802 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1937/3704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:58 2022] GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd => generated 1323 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:59.180419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:59.181517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:59.192702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.194138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.194721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.195525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.196091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.196626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.338540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:59.351063 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2743b75-a98c-448c-962b-8fa6a020b4f3 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1526 microversion: 2.1 time: 0.175968 Oct 28 18:17:59.351735 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1938/3705] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:59 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:59.358336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:59.363462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:59.363951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.servers [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Removing options 'limit' from query {{(pid=120680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 18:17:59.365170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:17:59.371915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.372456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.372906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.373659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.374120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.374551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.407633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:59.413688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.414174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.414604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.537289 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a17d420-a76e-4ddb-bffa-5c50b7563e4e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.184138 Oct 28 18:17:59.537917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1939/3706] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:17:59 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:59.545457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:59.546342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:17:59.552395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.552878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.553309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.554000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.554450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.554870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.773212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:59.782753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:59.784330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:59.785624 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7b78e54-cbef-4f50-af89-86431c16b655 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 2949 microversion: 2.32 time: 0.244833 Oct 28 18:17:59.786194 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1940/3707] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:17:59 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 2949 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:17:59.933363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d4a9df6-6fc4-4ace-bccf-837fa9959f8f tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] Calling method '.version_select at 0x7f78dd4f4430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:00.004232 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d4a9df6-6fc4-4ace-bccf-837fa9959f8f tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.216904 Oct 28 18:18:00.004829 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1941/3708] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:17:59 2022] GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f/defaults => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:00.009834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:00.019406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:00.020194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:00.028166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.029229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.029911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.030665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.031135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.031567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.068583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:00.107487 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a4851588-7b81-4973-aadf-2cb8de791783 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.100896 Oct 28 18:18:00.115987 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1942/3709] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:18:00 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:00.115987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:00.115987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:00.123925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.124746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.125400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.126230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.126836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.127328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.359448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:00.367359 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61a78305-e04a-4b86-a311-9fa647e0c8d8 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.257706 Oct 28 18:18:00.368216 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1943/3710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:00 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:00.377791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb8af9d0-b511-4952-b7fb-885ec66e3fd8 tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] Calling method '.version_select at 0x7f78dd59c5e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:00.462604 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb8af9d0-b511-4952-b7fb-885ec66e3fd8 tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f" status: 200 len: 371 microversion: 2.1 time: 0.092616 Oct 28 18:18:00.463622 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1944/3711] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:18:00 2022] GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:00.469949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:00.475668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:00.476155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.servers [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Removing options 'limit' from query {{(pid=120680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 18:18:00.476833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:00.482506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.483086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.483543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.484500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.485161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.485599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.518030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:00.584156 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22a8bddc-56cb-47de-9249-20f37a46abb6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.118907 Oct 28 18:18:00.584984 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1945/3712] 10.222.0.16 () {58 vars in 1150 bytes} [Fri Oct 28 18:18:00 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:00.595301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:00.596734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: 4b71a015-10f8-47dd-a5e0-78c850774ebd] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:00.606106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.606779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.607850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.608708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.609436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.610113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.914713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:00.926198 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59ff0c5d-746b-47ce-a519-d27e16b3ebad tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd" status: 200 len: 1517 microversion: 2.1 time: 0.338634 Oct 28 18:18:00.940305 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1946/3713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:00 2022] GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd => generated 1517 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:00.949895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:00.951313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:00.958330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.958847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.959287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.960025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.960623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.961053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.995062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:00.995645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:00.996172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:00.996696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lazy-loading 'fault' on Instance uuid f843aa59-eec2-4bd9-ab00-f7ebe5338248 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:18:01.062503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e620d949eb41ef81c5fa12921213e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539907337e514bf189d5cc0e95c6d2c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:01.072971 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1aab7f29-9fc6-4517-8eaf-2b0a90ac2e84 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 200 len: 1314 microversion: 2.1 time: 0.131211 Oct 28 18:18:01.084339 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1947/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:00 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:01.095036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8641abc8-3c00-4259-89ef-8cd2b0e672c3 tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] Calling method '.version_select at 0x7f78dd52ae50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:01.167074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8641abc8-3c00-4259-89ef-8cd2b0e672c3 tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.081722 Oct 28 18:18:01.168504 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1948/3715] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:18:01 2022] GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f/defaults => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:01.173401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:01.179004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:01.180306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:01.186708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:01.187463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:01.188166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:01.189261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:01.189956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:01.190614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:01.225494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:01.229797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:01.261188 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68da4bd4-9419-4b81-ad59-db1450040b3b tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.091370 Oct 28 18:18:01.262137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1949/3716] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:18:01 2022] GET /compute/v2.1/servers => generated 1010 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:01.275648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-73342b03-7d3f-4ee1-b97f-c929e8606697 req-83da3862-6036-40be-adfb-b461d326d72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f843aa59-eec2-4bd9-ab00-f7ebe5338248", "name": "network-vif-deleted", "tag": "c8ff9b2f-0627-4424-99b3-05590613555d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:01.288571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-73342b03-7d3f-4ee1-b97f-c929e8606697 req-83da3862-6036-40be-adfb-b461d326d72d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:01.289316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-73342b03-7d3f-4ee1-b97f-c929e8606697 req-83da3862-6036-40be-adfb-b461d326d72d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:01.289909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-73342b03-7d3f-4ee1-b97f-c929e8606697 req-83da3862-6036-40be-adfb-b461d326d72d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:01.303323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-73342b03-7d3f-4ee1-b97f-c929e8606697 req-83da3862-6036-40be-adfb-b461d326d72d service nova] Creating event network-vif-deleted:c8ff9b2f-0627-4424-99b3-05590613555d for instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 on n-h1-862404-2 Oct 28 18:18:01.309238 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-73342b03-7d3f-4ee1-b97f-c929e8606697 req-83da3862-6036-40be-adfb-b461d326d72d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045660 Oct 28 18:18:01.310988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1950/3717] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:01.318337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:01.319296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:01.327243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:01.327771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:01.328585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:01.329116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:01.329572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:01.329997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:01.627012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:01.636706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:01.638192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:01.639694 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-abc767db-2f99-4e20-8969-b89bb24cf6c0 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 2928 microversion: 2.32 time: 0.327354 Oct 28 18:18:01.640352 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1951/3718] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:01 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 2928 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:01.645704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:01.649284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:01.656589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:01.657518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:01.658163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:01.658871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:01.659324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:01.659745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:01.951474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:01.960980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67788f97-365a-4c90-9ee0-e1b4b8eb8176 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092" status: 200 len: 1516 microversion: 2.1 time: 0.319188 Oct 28 18:18:01.972860 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1952/3719] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:01 2022] GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:01.984056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0019e555-e056-48c4-987c-5bcbf3ac1329 tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] Calling method '.version_select at 0x7f78dd5af820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:02.076944 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0019e555-e056-48c4-987c-5bcbf3ac1329 tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f" status: 200 len: 371 microversion: 2.1 time: 0.101063 Oct 28 18:18:02.077558 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1953/3720] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:18:01 2022] GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:02.088336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:02.108455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:02.109242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:02.143908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:02.144390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:02.144849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:02.145614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:02.146076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:02.146617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:02.248592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:02.312983 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf92ada5-4b93-4695-b419-75d8da829518 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.227996 Oct 28 18:18:02.321300 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1954/3721] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:18:02 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:02.321300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:02.321300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:02.326927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:02.327535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:02.328101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:02.328909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:02.329503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:02.332106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:02.629795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:02.645256 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c1882f2-d245-4fdc-b95e-8a747c55e3c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.325341 Oct 28 18:18:02.653751 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1955/3722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:02 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:02.658855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:02.660090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:02.666474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:02.667098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:02.667626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:02.668474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:02.669010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:02.670051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:02.697986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:18:02.818434 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f91b632-02c7-471a-8144-a5a380a01d3b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092" status: 204 len: 0 microversion: 2.1 time: 0.162570 Oct 28 18:18:02.819886 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1956/3723] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:18:02 2022] DELETE /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:18:02.830143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e37e54a-bb13-4a2f-bb49-6ddcf710a080 tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] Calling method '.version_select at 0x7f78dd5bc430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:02.994651 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e37e54a-bb13-4a2f-bb49-6ddcf710a080 tempest-QuotasTestJSON-1357232718 tempest-QuotasTestJSON-1357232718-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f?user_id=c92761cb2d2c43ca96706bc3694a5259" status: 200 len: 371 microversion: 2.1 time: 0.172915 Oct 28 18:18:03.004373 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1957/3724] 10.222.0.16 () {58 vars in 1323 bytes} [Fri Oct 28 18:18:02 2022] GET /compute/v2.1/os-quota-sets/5eecc92c87cf4b548b75801e0d9f333f?user_id=c92761cb2d2c43ca96706bc3694a5259 => generated 371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:03.050297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:03.053784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] [instance: f843aa59-eec2-4bd9-ab00-f7ebe5338248] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:03.079121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.079748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.080211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:03.083283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.083770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.088669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:03.128248 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] HTTP exception thrown: Instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 could not be found. Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Request method failure captured: Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 HTTP/1.1 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy82Xgamt24ZHQhYD7syNBaJhRfw8VtT6R0ynsvQ6jMkdjBUGs6S9_QAELibD-JmjTIxHF5-B8wl7JxRkvgpLDcIwZgEXisO26HgnxVQna_JQmMv3th-AbkIW7B2hlThorunjyEZSp49q3HFgJ00Vehm7qkvn39MtPcHPzzpaLHd2w Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 539907337e514bf189d5cc0e95c6d2c6 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_539907337e514bf189d5cc0e95c6d2c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/539907337e514bf189d5cc0e95c6d2c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 539907337e514bf189d5cc0e95c6d2c6 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-611370545 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerAddressesNegativeTestJSON-611370545-project Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c2e620d949eb41ef81c5fa12921213e6 Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-611370545-project Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 could not be found. Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f843aa59-eec2-4bd9-ab00-f7ebe5338248'} Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 could not be found. Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 could not be found. Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:03.133732 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 could not be found. Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] Returning 404 to user: Instance f843aa59-eec2-4bd9-ab00-f7ebe5338248 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:03.137973 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f474fd6-7dd4-466c-8484-05b7780bd288 tempest-ServerAddressesNegativeTestJSON-611370545 tempest-ServerAddressesNegativeTestJSON-611370545-project] 10.222.0.16 "GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248" status: 404 len: 111 microversion: 2.1 time: 0.134319 Oct 28 18:18:03.141680 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1958/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:03 2022] GET /compute/v2.1/servers/f843aa59-eec2-4bd9-ab00-f7ebe5338248 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:03.155888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:03.166313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:03.168085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.servers [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Removing options 'limit' from query {{(pid=120680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 18:18:03.169881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:03.180712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.181154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.181589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:03.184879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.185928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.188565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:03.252691 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0195abe-1c9a-4e82-8b10-8627a4f250d7 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.095662 Oct 28 18:18:03.266329 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1959/3726] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 18:18:03 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:03.283952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5c91b8e1-4b64-4892-8ec4-70c36936cb02 req-b3798431-ebe6-452a-b070-69b59bbb64b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-deleted", "tag": "7f0322f3-5f52-4071-9bb2-531a91aebf45"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:03.299945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c91b8e1-4b64-4892-8ec4-70c36936cb02 req-b3798431-ebe6-452a-b070-69b59bbb64b4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.300443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c91b8e1-4b64-4892-8ec4-70c36936cb02 req-b3798431-ebe6-452a-b070-69b59bbb64b4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.300882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c91b8e1-4b64-4892-8ec4-70c36936cb02 req-b3798431-ebe6-452a-b070-69b59bbb64b4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:03.330424 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5c91b8e1-4b64-4892-8ec4-70c36936cb02 req-b3798431-ebe6-452a-b070-69b59bbb64b4 service nova] Creating event network-vif-deleted:7f0322f3-5f52-4071-9bb2-531a91aebf45 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:18:03.348407 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5c91b8e1-4b64-4892-8ec4-70c36936cb02 req-b3798431-ebe6-452a-b070-69b59bbb64b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079798 Oct 28 18:18:03.349399 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1960/3727] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:03.374248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:03.375082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:03.399359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=97 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:03.401045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.401542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.402116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:03.402828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.403311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.416503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:03.796083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:03.815476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:03.829317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:03.836237 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db929f7b-e918-4212-b343-f294ed19b74e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 2861 microversion: 2.32 time: 0.485461 Oct 28 18:18:03.837175 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1961/3728] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:03 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 2861 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:03.850167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:03.850511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:03.873519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.874080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.874535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:03.875287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:03.875757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:03.876221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:04.643024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:04.652807 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ad9f4cc-4c97-4461-8662-22ee1e8f96d2 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092" status: 200 len: 1522 microversion: 2.1 time: 0.814455 Oct 28 18:18:04.695997 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1962/3729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:03 2022] GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 => generated 1522 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:04.701692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:04.716422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:04.717220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-303212241', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:04.728398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:04.729037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:04.729476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:04.731035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:04.731916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:04.732364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:04.852269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:04.940735 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5111c42-53c6-48ec-8763-9c7d307936e9 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-303212241" status: 200 len: 345 microversion: 2.1 time: 0.237962 Oct 28 18:18:04.951226 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1963/3730] 10.222.0.16 () {58 vars in 1240 bytes} [Fri Oct 28 18:18:04 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-303212241 => generated 345 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:04.951226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-30586ffd-ee40-4db7-a30c-6a44346cc2a7 req-ebf4919b-834f-4398-8d2d-8e21f5375449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-unplugged", "status": "completed", "tag": "7d7ae5e3-3f70-4637-8a50-c637d361ee01"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:04.960051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30586ffd-ee40-4db7-a30c-6a44346cc2a7 req-ebf4919b-834f-4398-8d2d-8e21f5375449 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:04.960462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30586ffd-ee40-4db7-a30c-6a44346cc2a7 req-ebf4919b-834f-4398-8d2d-8e21f5375449 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:04.960901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30586ffd-ee40-4db7-a30c-6a44346cc2a7 req-ebf4919b-834f-4398-8d2d-8e21f5375449 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:04.974665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-30586ffd-ee40-4db7-a30c-6a44346cc2a7 req-ebf4919b-834f-4398-8d2d-8e21f5375449 service nova] Creating event network-vif-unplugged:7d7ae5e3-3f70-4637-8a50-c637d361ee01 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:18:04.985185 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-30586ffd-ee40-4db7-a30c-6a44346cc2a7 req-ebf4919b-834f-4398-8d2d-8e21f5375449 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042422 Oct 28 18:18:04.985973 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1964/3731] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:04.993890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:04.994560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:05.002408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:05.002906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:05.003349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:05.004098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:05.004558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:05.004986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:05.530593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:05.543013 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-140494bc-cf8e-4ffe-87fc-57cce3a34c92 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.555975 Oct 28 18:18:05.545164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1965/3732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:04 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:05.556233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:05.562316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:05.571694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:05.572220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:05.572661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:05.573369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:05.573826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:05.574253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:06.073089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:06.088036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:06.089545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:06.091608 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c574505-16b5-4662-b10f-46c0865fcf5e tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 2702 microversion: 2.32 time: 0.542035 Oct 28 18:18:06.097961 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1966/3733] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:05 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 2702 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:06.115164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-529c1011-de77-4511-aba1-e5e8fea6f059 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:06.157954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-529c1011-de77-4511-aba1-e5e8fea6f059 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:06.159197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-529c1011-de77-4511-aba1-e5e8fea6f059 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:06.160631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-529c1011-de77-4511-aba1-e5e8fea6f059 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:06.222211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-529c1011-de77-4511-aba1-e5e8fea6f059 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:18:06.332090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:06.357165 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-529c1011-de77-4511-aba1-e5e8fea6f059 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "POST /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935/action" status: 202 len: 0 microversion: 2.1 time: 0.256939 Oct 28 18:18:06.357844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1967/3734] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:18:06 2022] POST /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:18:06.410201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-bb38a548-aa6e-430a-9a32-4d8e3a126116 req-7cd45b12-fe22-432d-bdb8-6290cc7321b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-deleted", "tag": "24d57195-2b05-4d20-a213-c277be41e78e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:06.469360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bb38a548-aa6e-430a-9a32-4d8e3a126116 req-7cd45b12-fe22-432d-bdb8-6290cc7321b2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:06.472414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bb38a548-aa6e-430a-9a32-4d8e3a126116 req-7cd45b12-fe22-432d-bdb8-6290cc7321b2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:06.473148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bb38a548-aa6e-430a-9a32-4d8e3a126116 req-7cd45b12-fe22-432d-bdb8-6290cc7321b2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:06.524838 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-bb38a548-aa6e-430a-9a32-4d8e3a126116 req-7cd45b12-fe22-432d-bdb8-6290cc7321b2 service nova] Creating event network-vif-deleted:24d57195-2b05-4d20-a213-c277be41e78e for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:18:06.537603 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-bb38a548-aa6e-430a-9a32-4d8e3a126116 req-7cd45b12-fe22-432d-bdb8-6290cc7321b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167529 Oct 28 18:18:06.543552 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1968/3735] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:06.553418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:06.555978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:06.565374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:06.566178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:06.567088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:06.568561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:06.569313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:06.569973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:06.614616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:06.615642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:06.616460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:06.617669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lazy-loading 'fault' on Instance uuid f593eaf1-07cf-4d02-b32a-ae554636f092 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:18:07.035800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:07.050658 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87be451b-20dc-4595-9662-3516d43dec5b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092" status: 200 len: 1313 microversion: 2.1 time: 0.497868 Oct 28 18:18:07.056856 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1969/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:06 2022] GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:07.097512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:07.099744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:07.131571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:07.133471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:07.139330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:07.140728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:07.141396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:07.141662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:07.835726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:07.844838 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-647a1789-a377-4fb2-8853-599919d8a58d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1521 microversion: 2.1 time: 0.786500 Oct 28 18:18:07.848073 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1970/3737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:07 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1521 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:07.863583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:07.864274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:07.877841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:07.878347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:07.878785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:07.879499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:07.879983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:07.880408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:08.405357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:08.420022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42f4b741-2278-4852-aa2c-c688f36e4cf0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.566272 Oct 28 18:18:08.421404 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1971/3738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:07 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:08.435296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:08.440102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:08.454215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:08.456198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:08.457612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:08.459053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:08.460314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:08.460816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:08.940020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:08.958144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:08.960343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:08.963388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-679e5152-db08-4036-b998-dbe2a7785f0d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 2323 microversion: 2.32 time: 0.540792 Oct 28 18:18:08.968500 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1972/3739] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:08 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 2323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:08.976383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5cdd59a8-8b42-4331-8c51-6e5d790c3975 req-38dbf2ac-3e8a-4a9e-9a4f-6ec598f9358b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-unplugged", "status": "completed", "tag": "273d1c49-3383-47fd-aa8d-f805a87da16e"}, {"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-unplugged", "status": "completed", "tag": "ad067f57-087c-42da-93dc-9dfd4efd49b3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:09.023163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cdd59a8-8b42-4331-8c51-6e5d790c3975 req-38dbf2ac-3e8a-4a9e-9a4f-6ec598f9358b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:09.023757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cdd59a8-8b42-4331-8c51-6e5d790c3975 req-38dbf2ac-3e8a-4a9e-9a4f-6ec598f9358b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:09.024879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cdd59a8-8b42-4331-8c51-6e5d790c3975 req-38dbf2ac-3e8a-4a9e-9a4f-6ec598f9358b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:09.056039 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5cdd59a8-8b42-4331-8c51-6e5d790c3975 req-38dbf2ac-3e8a-4a9e-9a4f-6ec598f9358b service nova] Creating event network-vif-unplugged:273d1c49-3383-47fd-aa8d-f805a87da16e for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:18:09.056631 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5cdd59a8-8b42-4331-8c51-6e5d790c3975 req-38dbf2ac-3e8a-4a9e-9a4f-6ec598f9358b service nova] Creating event network-vif-unplugged:ad067f57-087c-42da-93dc-9dfd4efd49b3 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:18:09.077307 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5cdd59a8-8b42-4331-8c51-6e5d790c3975 req-38dbf2ac-3e8a-4a9e-9a4f-6ec598f9358b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.107179 Oct 28 18:18:09.078236 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1973/3740] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:09.348168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fae104e2-50f1-40f6-89da-09e3b0b375c7 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Action: 'create', calling method: .version_select at 0x7f78dd651670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2096950004", "metadata": {"Type": "work"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:09.808619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fae104e2-50f1-40f6-89da-09e3b0b375c7 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.728819 Oct 28 18:18:09.820594 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1974/3741] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 18:18:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 741 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 18:18:09.826315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:09.836468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:09.857414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:09.860162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:09.861940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:09.863509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:09.865519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:09.869493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:09.909841 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] HTTP exception thrown: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Request method failure captured: Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 HTTP/1.1 Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy3hRWsf5CMKLYOj3c3jyvUe5WSMNuZR-vF4eRKmzUbrGSnlcRYDHFGME3SvYP_JCMIHGo8XezfVur9J4Z8U-855BRyODA5JnDm-Hx6Ew0wWfBNaGFfLrJmGiPt4mr0lhJwPur6Oen_a8RWMsTGj7_QztNe6w1-jo7ijaXkBMCxLVw Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db0d39c8f6b4bbe8a667b9b6f4b171a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5342b8afb30d4c4fb079f3e70015f447 Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f593eaf1-07cf-4d02-b32a-ae554636f092'} Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:09.916761 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Returning 404 to user: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:09.922968 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0160448f-bd06-4809-8569-c6cc3d7b6044 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092" status: 404 len: 111 microversion: 2.1 time: 0.100917 Oct 28 18:18:09.929242 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1975/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:09 2022] GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:09.934791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-91606592-a298-4815-af60-f8afc19dc2d1 req-368a6696-7a3d-4c08-ba3f-cdfecd452ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f593eaf1-07cf-4d02-b32a-ae554636f092", "name": "network-vif-deleted", "tag": "79c499b7-d9ff-484d-80a2-1b1fd9d371b4"}, {"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-deleted", "tag": "ad067f57-087c-42da-93dc-9dfd4efd49b3"}, {"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-deleted", "tag": "273d1c49-3383-47fd-aa8d-f805a87da16e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:09.947896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-91606592-a298-4815-af60-f8afc19dc2d1 req-368a6696-7a3d-4c08-ba3f-cdfecd452ee4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:09.948693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-91606592-a298-4815-af60-f8afc19dc2d1 req-368a6696-7a3d-4c08-ba3f-cdfecd452ee4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:09.949622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-91606592-a298-4815-af60-f8afc19dc2d1 req-368a6696-7a3d-4c08-ba3f-cdfecd452ee4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:09.967848 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-91606592-a298-4815-af60-f8afc19dc2d1 req-368a6696-7a3d-4c08-ba3f-cdfecd452ee4 service nova] Creating event network-vif-deleted:79c499b7-d9ff-484d-80a2-1b1fd9d371b4 for instance f593eaf1-07cf-4d02-b32a-ae554636f092 on n-h2-862404-2 Oct 28 18:18:09.968396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-91606592-a298-4815-af60-f8afc19dc2d1 req-368a6696-7a3d-4c08-ba3f-cdfecd452ee4 service nova] Creating event network-vif-deleted:ad067f57-087c-42da-93dc-9dfd4efd49b3 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:18:09.968890 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-91606592-a298-4815-af60-f8afc19dc2d1 req-368a6696-7a3d-4c08-ba3f-cdfecd452ee4 service nova] Creating event network-vif-deleted:273d1c49-3383-47fd-aa8d-f805a87da16e for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:18:09.976284 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-91606592-a298-4815-af60-f8afc19dc2d1 req-368a6696-7a3d-4c08-ba3f-cdfecd452ee4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048258 Oct 28 18:18:09.983784 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1976/3743] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:09.989595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:09.990463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:09.998339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:09.998832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:09.999472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.000418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.001046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.001666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.177765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:10.194178 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c4f7cc5-e2a7-488b-b957-b921ee47c0ae tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1521 microversion: 2.1 time: 0.208678 Oct 28 18:18:10.203577 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1977/3744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:09 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:10.209103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:10.209893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:10.221875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.222661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.223270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.224524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.225154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.225586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.442910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:10.451961 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e92fc628-80fe-4362-9d32-2316746e7947 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.254798 Oct 28 18:18:10.452556 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1978/3745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:10 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:10.477699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0cf3ec0-e314-42ea-9533-377ed8cad28d tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Calling method '.version_select at 0x7f78dd5ea670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:10.567526 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0cf3ec0-e314-42ea-9533-377ed8cad28d tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424" status: 200 len: 353 microversion: 2.1 time: 0.101370 Oct 28 18:18:10.568314 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1979/3746] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:18:10 2022] GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:10.572785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:10.595158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:10.596196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:10.601848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.602336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.602776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.603511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.604000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.604426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.788595 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ccc99f39-94df-4472-9ec0-682f26d75a62 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.219203 Oct 28 18:18:10.797529 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1980/3747] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 18:18:10 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:18:10.797529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:10.797529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:10.803078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.803742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.804238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.805114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.805671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.806178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.887726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:10.901960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:10.905645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:10.907231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ee88492-5711-43ca-880c-13a58ccf0df2 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.116534 Oct 28 18:18:10.908134 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1981/3748] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:10 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:10.916747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07884c2b-3760-4252-9bc1-280d85b646ce tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07884c2b-3760-4252-9bc1-280d85b646ce tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Request method failure captured: Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy3hRWsf5CMKLYOj3c3jyvUe5WSMNuZR-vF4eRKmzUbrGSnlcRYDHFGME3SvYP_JCMIHGo8XezfVur9J4Z8U-855BRyODA5JnDm-Hx6Ew0wWfBNaGFfLrJmGiPt4mr0lhJwPur6Oen_a8RWMsTGj7_QztNe6w1-jo7ijaXkBMCxLVw Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db0d39c8f6b4bbe8a667b9b6f4b171a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5342b8afb30d4c4fb079f3e70015f447 Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: action_args: {} Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 18:18:10.926538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 18:18:10.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:10.933846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07884c2b-3760-4252-9bc1-280d85b646ce tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:10.935646 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07884c2b-3760-4252-9bc1-280d85b646ce tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025740 Oct 28 18:18:10.936697 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1982/3749] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 18:18:10 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:18:10.946632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:10.952712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:10.953932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'deleted': False, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:10.962047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.962747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.963885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:10.964831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:10.967874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:10.968647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:11.031479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:11.083803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-16b944e6-e4ae-4ddb-931e-78564f577430 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.141733 Oct 28 18:18:11.085509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1983/3750] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:18:10 2022] GET /compute/v2.1/servers => generated 683 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:11.098252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.103519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:11.104101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.servers [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Removing options 'limit' from query {{(pid=120680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 18:18:11.105002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'deleted': False, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:11.112153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:11.112725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:11.122979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:11.124311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:11.124674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:11.125358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:11.158318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:11.202872 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bdce2e0f-9f80-4cce-b5ec-c0ca94ccacc1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.108564 Oct 28 18:18:11.204300 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1984/3751] 10.222.0.16 () {58 vars in 1144 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:11.223390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.223968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:11.235988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:11.237174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:11.237639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:11.238379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:11.240238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:11.240624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:11.433193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:11.449573 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6ba61fd-0d3e-4038-a88a-4c9237df14fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1521 microversion: 2.1 time: 0.233888 Oct 28 18:18:11.451548 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1985/3752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:11.459042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f475a89a-5ed3-4499-9a70-f0b67f3d5d1d tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f475a89a-5ed3-4499-9a70-f0b67f3d5d1d tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Request method failure captured: Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy3hRWsf5CMKLYOj3c3jyvUe5WSMNuZR-vF4eRKmzUbrGSnlcRYDHFGME3SvYP_JCMIHGo8XezfVur9J4Z8U-855BRyODA5JnDm-Hx6Ew0wWfBNaGFfLrJmGiPt4mr0lhJwPur6Oen_a8RWMsTGj7_QztNe6w1-jo7ijaXkBMCxLVw Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db0d39c8f6b4bbe8a667b9b6f4b171a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5342b8afb30d4c4fb079f3e70015f447 Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: action_args: {} Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '-1' Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 18:18:11.464406 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 18:18:11.470433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.472128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f475a89a-5ed3-4499-9a70-f0b67f3d5d1d tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:11.473104 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f475a89a-5ed3-4499-9a70-f0b67f3d5d1d tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.020273 Oct 28 18:18:11.487916 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1986/3753] 10.222.0.16 () {58 vars in 1142 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:18:11.495127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.496059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:11.504837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:11.505711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:11.506538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:11.507427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:11.508421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:11.509192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:11.695899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:11.709074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8fa18ec-dd87-4d70-a528-59edceffce40 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.219658 Oct 28 18:18:11.725695 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1987/3754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:11.734355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cc0b68c-e5d8-406a-9cc3-93ba6fa932db tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cc0b68c-e5d8-406a-9cc3-93ba6fa932db tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Request method failure captured: Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy3hRWsf5CMKLYOj3c3jyvUe5WSMNuZR-vF4eRKmzUbrGSnlcRYDHFGME3SvYP_JCMIHGo8XezfVur9J4Z8U-855BRyODA5JnDm-Hx6Ew0wWfBNaGFfLrJmGiPt4mr0lhJwPur6Oen_a8RWMsTGj7_QztNe6w1-jo7ijaXkBMCxLVw Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db0d39c8f6b4bbe8a667b9b6f4b171a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5342b8afb30d4c4fb079f3e70015f447 Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: action_args: {} Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'testing' Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 18:18:11.738772 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cc0b68c-e5d8-406a-9cc3-93ba6fa932db tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:11.744528 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cc0b68c-e5d8-406a-9cc3-93ba6fa932db tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.013310 Oct 28 18:18:11.745793 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1988/3755] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:18:11.751082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b091a84f-a747-47c7-94f6-cab66571ac96 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Calling method '.version_select at 0x7f78dd5ea820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.871531 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b091a84f-a747-47c7-94f6-cab66571ac96 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424" status: 200 len: 354 microversion: 2.1 time: 0.125198 Oct 28 18:18:11.873584 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1989/3756] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:11.879496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e95e15d-b8b9-4bd8-a8fa-17386224f5d1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.886620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e95e15d-b8b9-4bd8-a8fa-17386224f5d1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:11.887720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e95e15d-b8b9-4bd8-a8fa-17386224f5d1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:11.898790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.servers [None req-0e95e15d-b8b9-4bd8-a8fa-17386224f5d1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Flavor 'non_existing_flavor' could not be found {{(pid=120680) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 28 18:18:11.900741 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e95e15d-b8b9-4bd8-a8fa-17386224f5d1 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.025536 Oct 28 18:18:11.910607 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1990/3757] 10.222.0.16 () {58 vars in 1178 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:18:11.912165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a31764d-f8d0-4cb2-8627-9ea09b0f912b tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Calling method '.version_select at 0x7f78e2451700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.979396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a31764d-f8d0-4cb2-8627-9ea09b0f912b tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424" status: 200 len: 354 microversion: 2.1 time: 0.074018 Oct 28 18:18:11.980363 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1991/3758] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:11.986306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:11.995090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:11.996149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:12.006971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.007736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.009073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.011552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.012354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.013527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.152320 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4da5571e-24e2-4c36-8bbe-4352152b4a9b tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.171200 Oct 28 18:18:12.161073 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1992/3759] 10.222.0.16 () {58 vars in 1174 bytes} [Fri Oct 28 18:18:11 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:18:12.161073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:12.161073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:12.165733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.166236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.166898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.167619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.168181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.168619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.245656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:12.256391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:12.258362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:12.259869 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36265502-a1a6-48ea-8d7b-4e571232979d tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.105867 Oct 28 18:18:12.260983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1993/3760] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:12 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:12.266523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-019acbd9-2410-4f09-a284-6a306d900799 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Calling method '.version_select at 0x7f78dd5ead30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:12.344777 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-019acbd9-2410-4f09-a284-6a306d900799 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424" status: 202 len: 0 microversion: 2.1 time: 0.082358 Oct 28 18:18:12.349028 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1994/3761] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:18:12 2022] DELETE /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:18:12.355395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5f4b1da5-ecc0-4cb0-8253-da53c0064da6 req-d833b137-722f-4801-834a-a1399da4f7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d", "name": "network-vif-deleted", "tag": "7d7ae5e3-3f70-4637-8a50-c637d361ee01"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:12.367611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f4b1da5-ecc0-4cb0-8253-da53c0064da6 req-d833b137-722f-4801-834a-a1399da4f7cd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.368356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f4b1da5-ecc0-4cb0-8253-da53c0064da6 req-d833b137-722f-4801-834a-a1399da4f7cd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.368966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f4b1da5-ecc0-4cb0-8253-da53c0064da6 req-d833b137-722f-4801-834a-a1399da4f7cd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.381935 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5f4b1da5-ecc0-4cb0-8253-da53c0064da6 req-d833b137-722f-4801-834a-a1399da4f7cd service nova] Creating event network-vif-deleted:7d7ae5e3-3f70-4637-8a50-c637d361ee01 for instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d on n-h2-862404-2 Oct 28 18:18:12.387146 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5f4b1da5-ecc0-4cb0-8253-da53c0064da6 req-d833b137-722f-4801-834a-a1399da4f7cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036661 Oct 28 18:18:12.388591 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1995/3762] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:12.398090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:12.404289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:12.405653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:12.426151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.426636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.427070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.427854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.428308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.439063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.654223 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c91d6a9-7baf-464f-a968-7eb5af9602c3 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.260162 Oct 28 18:18:12.658086 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1996/3763] 10.222.0.16 () {58 vars in 1184 bytes} [Fri Oct 28 18:18:12 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:18:12.667963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffdadc06-12fe-400c-823f-cdd302cff2aa tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Calling method '.version_select at 0x7f78dd5ea700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:12.741914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffdadc06-12fe-400c-823f-cdd302cff2aa tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424" status: 200 len: 353 microversion: 2.1 time: 0.082659 Oct 28 18:18:12.742848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1997/3764] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:18:12 2022] GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:12.748413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:12.749386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:12.758698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.759509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.760158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.761060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:12.761679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:12.762266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:12.977763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:12.985717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=16 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:12.986427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:12.994803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e51b21c2-facf-44b9-a868-d05de22bdc1a tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1498 microversion: 2.1 time: 0.250717 Oct 28 18:18:12.996864 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1998/3765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:12 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:13.007004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:13.014658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:13.015610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'deleted': False, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:13.022844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.023337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.023770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:13.024582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.025022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.025445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:13.061823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:13.158088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:13.173251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.175529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.176029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:13.436046 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-559e2e90-e2bd-454a-aa90-2bf469be9f54 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.434870 Oct 28 18:18:13.436858 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1999/3766] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:18:12 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:13.441431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:13.442992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:13.458505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.462160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.462635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:13.463389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.464031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.471330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:13.710811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:13.720880 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-086c06a4-eff9-4fd6-9886-acd3737d21e0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.282852 Oct 28 18:18:13.728580 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2000/3767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:13 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:13.737634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:13.746741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:13.747603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:13.760238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.761642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.762095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:13.763280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.763762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.771795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:13.820240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:13.884128 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8332898-1c75-4e47-aebd-db5622dce005 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.160464 Oct 28 18:18:13.891990 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2001/3768] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Oct 28 18:18:13 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:13.914342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:13.918762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:13.946193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.946693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.947151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:13.948149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:13.948512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:13.948948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:14.046395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:14.059221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:14.061835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:14.069868 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f94fa5b-9258-4f38-8d3b-de2439e0730f tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.176730 Oct 28 18:18:14.070666 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2002/3769] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:13 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:14.081329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0278f200-925d-4ff9-b976-a8874998b399 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:14.089045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0278f200-925d-4ff9-b976-a8874998b399 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:14.090532 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0278f200-925d-4ff9-b976-a8874998b399 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.018712 Oct 28 18:18:14.092265 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2003/3770] 10.222.0.16 () {58 vars in 1178 bytes} [Fri Oct 28 18:18:14 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:18:14.097412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ffd39dc-28e9-409d-bc54-e803ad29d462 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Calling method '.version_select at 0x7f78e25450d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:14.208595 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ffd39dc-28e9-409d-bc54-e803ad29d462 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424" status: 200 len: 353 microversion: 2.1 time: 0.114995 Oct 28 18:18:14.209340 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2004/3771] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:18:14 2022] GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:14.219872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c79a882-8c2e-44f9-b4f9-625095bc0f99 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:14.228288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c79a882-8c2e-44f9-b4f9-625095bc0f99 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:14.229735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c79a882-8c2e-44f9-b4f9-625095bc0f99 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:14.232000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c79a882-8c2e-44f9-b4f9-625095bc0f99 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:14.293137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c79a882-8c2e-44f9-b4f9-625095bc0f99 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Going to try to start instance {{(pid=120680) start /opt/stack/nova/nova/compute/api.py:2787}} Oct 28 18:18:14.359998 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c79a882-8c2e-44f9-b4f9-625095bc0f99 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "POST /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935/action" status: 202 len: 0 microversion: 2.1 time: 0.147525 Oct 28 18:18:14.363725 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2005/3772] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:18:14 2022] POST /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:18:14.384026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:14.396457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:14.397626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Searching by: {'deleted': False, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:14.406920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:14.407429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:14.407902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:14.408757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:14.409574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:14.410326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:14.503118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:14.567634 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1892ade6-44dc-401b-a399-c13273a5f75a tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.205010 Oct 28 18:18:14.587975 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2006/3773] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:18:14 2022] GET /compute/v2.1/servers => generated 683 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:14.598884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:14.602932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:14.621571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:14.623360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:14.625639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:14.626619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:14.630037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:14.630504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:14.913596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:14.924464 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5f377fd-049a-4b93-8f55-0b1e36d9f742 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1507 microversion: 2.1 time: 0.335003 Oct 28 18:18:14.925937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2007/3774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:14 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:14.931153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:14.934374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:14.947048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:14.948358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:14.949065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:14.950491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:14.951139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:14.951759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:14.976542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] HTTP exception thrown: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Request method failure captured: Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 HTTP/1.1 Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy3hRWsf5CMKLYOj3c3jyvUe5WSMNuZR-vF4eRKmzUbrGSnlcRYDHFGME3SvYP_JCMIHGo8XezfVur9J4Z8U-855BRyODA5JnDm-Hx6Ew0wWfBNaGFfLrJmGiPt4mr0lhJwPur6Oen_a8RWMsTGj7_QztNe6w1-jo7ijaXkBMCxLVw Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db0d39c8f6b4bbe8a667b9b6f4b171a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5342b8afb30d4c4fb079f3e70015f447 Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f593eaf1-07cf-4d02-b32a-ae554636f092'} Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:14.978697 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:14.984432 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:14.986312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Returning 404 to user: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:14.987344 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e62256fb-cbf4-4faf-817c-1c46cb45a537 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092" status: 404 len: 111 microversion: 2.1 time: 0.060214 Oct 28 18:18:14.991379 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2008/3775] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:18:14 2022] DELETE /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:15.003578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:15.004547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:15.016935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:15.017713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:15.018337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:15.020451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:15.021121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:15.021725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:15.338838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:15.355530 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41faddac-a528-4561-894a-acd41c44e0e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.362502 Oct 28 18:18:15.356571 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2009/3776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:14 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:15.361475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:15.361977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: 4b71a015-10f8-47dd-a5e0-78c850774ebd] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:15.377583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:15.384813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:15.385134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:15.386048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:15.386524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:15.386960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:15.450079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: 4b71a015-10f8-47dd-a5e0-78c850774ebd] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:18:15.595470 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b55d0ee-1130-49c1-8a4b-c94de5406056 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd" status: 204 len: 0 microversion: 2.1 time: 0.237456 Oct 28 18:18:15.596103 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2010/3777] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:18:15 2022] DELETE /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:18:15.610638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:15.611431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:15.638672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:15.639282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:15.639735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:15.640511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:15.640974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:15.641409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:15.760141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:15.771015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:15.772596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:15.774628 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-caae2c94-516d-4acd-8889-d727198b104b tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.177070 Oct 28 18:18:15.775645 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2011/3778] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:15 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:15.781213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4eb5c9c1-ae49-4c4e-8b0d-51744660f2cc tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Calling method '.version_select at 0x7f78dd4a9820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:15.891062 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4eb5c9c1-ae49-4c4e-8b0d-51744660f2cc tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424" status: 200 len: 353 microversion: 2.1 time: 0.114133 Oct 28 18:18:15.898290 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2012/3779] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:18:15 2022] GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:15.903294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:15.904971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:15.914004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:15.914641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:15.915283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:15.916836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:15.917711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:15.918237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:15.962523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:18:16.040367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:16.139629 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8b9bc2a9-21a6-4ba2-98e2-48d9c7e57582 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 204 len: 0 microversion: 2.1 time: 0.244041 Oct 28 18:18:16.140571 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2013/3780] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:18:15 2022] DELETE /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:18:16.160384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:16.161214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:16.167313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:16.167834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:16.168280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:16.169093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:16.169557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:16.170006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:17.067342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:17.077317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8e0b5be-c32d-4a93-94e0-984c6c136047 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1507 microversion: 2.1 time: 0.932764 Oct 28 18:18:17.081466 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2014/3781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:16 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1507 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:17.088353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:17.094789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: f593eaf1-07cf-4d02-b32a-ae554636f092] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:17.107676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:17.109884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:17.111068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:17.111740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:17.112803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:17.113509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:17.114188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:17.138830 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] HTTP exception thrown: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Request method failure captured: Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 HTTP/1.1 Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy3hRWsf5CMKLYOj3c3jyvUe5WSMNuZR-vF4eRKmzUbrGSnlcRYDHFGME3SvYP_JCMIHGo8XezfVur9J4Z8U-855BRyODA5JnDm-Hx6Ew0wWfBNaGFfLrJmGiPt4mr0lhJwPur6Oen_a8RWMsTGj7_QztNe6w1-jo7ijaXkBMCxLVw Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db0d39c8f6b4bbe8a667b9b6f4b171a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5342b8afb30d4c4fb079f3e70015f447 Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f593eaf1-07cf-4d02-b32a-ae554636f092'} Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:17.145141 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:17.149254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:17.149254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:17.149254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:17.149254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:17.149254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:17.149254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:17.149254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. Oct 28 18:18:17.149254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:17.155279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Returning 404 to user: Instance f593eaf1-07cf-4d02-b32a-ae554636f092 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:17.158922 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9100688b-7b68-46f4-9822-7f90bcb80f34 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092" status: 404 len: 111 microversion: 2.1 time: 0.076078 Oct 28 18:18:17.159950 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2015/3782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:17 2022] GET /compute/v2.1/servers/f593eaf1-07cf-4d02-b32a-ae554636f092 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:17.171259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:17.171259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:17.188102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:17.191051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:17.191610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:17.192846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:17.196603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:17.197173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:17.489178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:17.498910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07f1e26e-08e8-4562-82f5-9c1d68345350 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.337483 Oct 28 18:18:17.504236 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2016/3783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:17 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:17.540592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:17.549236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:17.573112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:17.574245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:17.576507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:17.580241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:17.580945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:17.581586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:18.111533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:18.129766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:18.138558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:18.149400 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56b34e1d-5208-4f12-b610-2cce3180697c tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.628233 Oct 28 18:18:18.150112 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2017/3784] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:17 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:18.174751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae7ec8e1-ad1a-4ed8-aac5-ffaa7be2ddc1 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Calling method '.version_select at 0x7f78e23c4790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:18.280539 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ae7ec8e1-ad1a-4ed8-aac5-ffaa7be2ddc1 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] HTTP exception thrown: Volume da84c8a7-7bf7-4258-8873-1df9b08b4424 could not be found. Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae7ec8e1-ad1a-4ed8-aac5-ffaa7be2ddc1 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Request method failure captured: Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 HTTP/1.1 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzfbYDEhINQ6CwJH0sFfWaAuUEFvWU6o3SynsRI8FiWiOTSNsgYrf1XJ4d5Iq3QlSOuw9BDMFsby_jXIOd3lQaLgBo1ON-taS5I_-wlqyBmHjc0NgQHUa6NEASYXsDzBeo6c_iolPnExDooBS8MWnvQZz1nI1QULYHfSplePePKo9I Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 96d1887a4ba943f3830348eb21a24f62 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesGetTestJSON-802939314 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96d1887a4ba943f3830348eb21a24f62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96d1887a4ba943f3830348eb21a24f62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96d1887a4ba943f3830348eb21a24f62", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96d1887a4ba943f3830348eb21a24f62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesGetTestJSON-802939314 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 96d1887a4ba943f3830348eb21a24f62 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesGetTestJSON-802939314 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesGetTestJSON-802939314-project Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: f671972976084ce899d9f7c86cf894a3 Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesGetTestJSON-802939314-project Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: exception: Volume da84c8a7-7bf7-4258-8873-1df9b08b4424 could not be found. Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'da84c8a7-7bf7-4258-8873-1df9b08b4424'} Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da84c8a7-7bf7-4258-8873-1df9b08b4424 could not be found. (HTTP 404) (Request-ID: req-0987b920-3cae-4b25-8b71-9b15208a154a) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:18:18.282614 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da84c8a7-7bf7-4258-8873-1df9b08b4424 could not be found. Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da84c8a7-7bf7-4258-8873-1df9b08b4424 could not be found. Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da84c8a7-7bf7-4258-8873-1df9b08b4424 could not be found. Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:18.287440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae7ec8e1-ad1a-4ed8-aac5-ffaa7be2ddc1 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] Returning 404 to user: Volume da84c8a7-7bf7-4258-8873-1df9b08b4424 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:18.292304 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae7ec8e1-ad1a-4ed8-aac5-ffaa7be2ddc1 tempest-VolumesGetTestJSON-802939314 tempest-VolumesGetTestJSON-802939314-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424" status: 404 len: 109 microversion: 2.1 time: 0.130767 Oct 28 18:18:18.292304 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2018/3785] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:18:18 2022] GET /compute/v2.1/os-volumes/da84c8a7-7bf7-4258-8873-1df9b08b4424 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:18.298836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:18.299473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: 4b71a015-10f8-47dd-a5e0-78c850774ebd] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:18.329708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:18.330223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:18.330676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:18.331403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:18.347166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:18.348407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:18.902865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:18.918498 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7d7af5a-5e6e-4403-b2b2-fdd23a6bea82 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd" status: 200 len: 1481 microversion: 2.1 time: 0.625246 Oct 28 18:18:18.924323 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2019/3786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:18 2022] GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd => generated 1481 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:18.929342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:18.940888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:18.948849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:18.967547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:18.968318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:18.969296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:18.969949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:18.970557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:19.604552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:19.618686 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1fddb264-2c95-445c-8d11-6004e5cadd06 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1511 microversion: 2.1 time: 0.692978 Oct 28 18:18:19.619311 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2020/3787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:18 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1511 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:19.632749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d9e36f9d-6ddc-4519-a956-5e3ae07e0189 req-6c283384-402b-4e45-8ad3-8c75c04337ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b71a015-10f8-47dd-a5e0-78c850774ebd", "name": "network-vif-deleted", "tag": "07234485-dc23-49b4-9cb5-97d7fa4aa6e5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:19.671779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d9e36f9d-6ddc-4519-a956-5e3ae07e0189 req-6c283384-402b-4e45-8ad3-8c75c04337ec service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:19.672338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d9e36f9d-6ddc-4519-a956-5e3ae07e0189 req-6c283384-402b-4e45-8ad3-8c75c04337ec service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:19.673000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d9e36f9d-6ddc-4519-a956-5e3ae07e0189 req-6c283384-402b-4e45-8ad3-8c75c04337ec service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:19.700889 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d9e36f9d-6ddc-4519-a956-5e3ae07e0189 req-6c283384-402b-4e45-8ad3-8c75c04337ec service nova] Creating event network-vif-deleted:07234485-dc23-49b4-9cb5-97d7fa4aa6e5 for instance 4b71a015-10f8-47dd-a5e0-78c850774ebd on n-h1-862404-2 Oct 28 18:18:19.712519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d9e36f9d-6ddc-4519-a956-5e3ae07e0189 req-6c283384-402b-4e45-8ad3-8c75c04337ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089838 Oct 28 18:18:19.714941 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2021/3788] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:19.734120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:19.735182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:19.742425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:19.743255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:19.743948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:19.744888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:19.745528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:19.746149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.101059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:20.114903 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eab9fba2-3352-4227-8068-25b3b142a07c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.382948 Oct 28 18:18:20.114903 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2022/3789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:19 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:20.125668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:20.136690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:20.143601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.144128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.144571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.145280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.145737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.146168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.272270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:20.289082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:20.293461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:20.303538 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4eef48f-fb17-48e5-9f28-6b6622219872 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.189500 Oct 28 18:18:20.305032 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2023/3790] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:20 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:20.325787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:20.335953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:20.336858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.servers [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Removing options 'limit' from query {{(pid=120680) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 18:18:20.338305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:20.340456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.342285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.343081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.345707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.346566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.347166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.350957 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e7726f9-ddd4-45a6-8d72-2b34ba5d3f22 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.043840 Oct 28 18:18:20.352233 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2024/3791] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 18:18:20 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:18:20.383006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:20.383640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: 4b71a015-10f8-47dd-a5e0-78c850774ebd] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:20.397539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.398041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.398510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.405064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.405570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.406923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.426559 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] HTTP exception thrown: Instance 4b71a015-10f8-47dd-a5e0-78c850774ebd could not be found. Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Request method failure captured: Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd HTTP/1.1 Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy3hRWsf5CMKLYOj3c3jyvUe5WSMNuZR-vF4eRKmzUbrGSnlcRYDHFGME3SvYP_JCMIHGo8XezfVur9J4Z8U-855BRyODA5JnDm-Hx6Ew0wWfBNaGFfLrJmGiPt4mr0lhJwPur6Oen_a8RWMsTGj7_QztNe6w1-jo7ijaXkBMCxLVw Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db0d39c8f6b4bbe8a667b9b6f4b171a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5342b8afb30d4c4fb079f3e70015f447 Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4b71a015-10f8-47dd-a5e0-78c850774ebd could not be found. Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4b71a015-10f8-47dd-a5e0-78c850774ebd'} Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b71a015-10f8-47dd-a5e0-78c850774ebd could not be found. Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b71a015-10f8-47dd-a5e0-78c850774ebd could not be found. Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:20.428893 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b71a015-10f8-47dd-a5e0-78c850774ebd could not be found. Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Returning 404 to user: Instance 4b71a015-10f8-47dd-a5e0-78c850774ebd could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a44e3007-faa5-458a-84e4-5c8483ff3b12 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd" status: 404 len: 111 microversion: 2.1 time: 0.077355 Oct 28 18:18:20.433236 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2025/3792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:20 2022] GET /compute/v2.1/servers/4b71a015-10f8-47dd-a5e0-78c850774ebd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:20.445024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:20.446961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:20.457102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.457755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.458297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.459092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.459645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.460273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.841876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:20.853705 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-17cf1b3a-d00e-46a5-8304-2e22a8f4b348 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1511 microversion: 2.1 time: 0.419562 Oct 28 18:18:20.854571 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2026/3793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:20 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:20.863691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:20.884272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:20.898339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.898841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.899280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:20.907175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:20.907770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:20.908657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:21.001248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:21.001749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:21.003367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:21.007883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lazy-loading 'fault' on Instance uuid ace49418-f4f4-4658-81fa-5329327349b6 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:18:21.088270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5342b8afb30d4c4fb079f3e70015f447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db0d39c8f6b4bbe8a667b9b6f4b171a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:21.101716 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02cce60e-e5cc-42b0-bcf1-1a384eba7127 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 200 len: 1313 microversion: 2.1 time: 0.241852 Oct 28 18:18:21.105488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2027/3794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:20 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:21.116592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4778d7fb-2a70-4160-a1d4-c98e6746b7ff req-968dc667-c784-41ad-9c5d-6a6947dba22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace49418-f4f4-4658-81fa-5329327349b6", "name": "network-vif-deleted", "tag": "e6102505-e6f7-4e59-a2de-83f037e98582"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:21.146534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4778d7fb-2a70-4160-a1d4-c98e6746b7ff req-968dc667-c784-41ad-9c5d-6a6947dba22b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:21.147022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4778d7fb-2a70-4160-a1d4-c98e6746b7ff req-968dc667-c784-41ad-9c5d-6a6947dba22b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:21.147450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4778d7fb-2a70-4160-a1d4-c98e6746b7ff req-968dc667-c784-41ad-9c5d-6a6947dba22b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:21.175566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4778d7fb-2a70-4160-a1d4-c98e6746b7ff req-968dc667-c784-41ad-9c5d-6a6947dba22b service nova] Creating event network-vif-deleted:e6102505-e6f7-4e59-a2de-83f037e98582 for instance ace49418-f4f4-4658-81fa-5329327349b6 on n-h2-862404-2 Oct 28 18:18:21.183211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4778d7fb-2a70-4160-a1d4-c98e6746b7ff req-968dc667-c784-41ad-9c5d-6a6947dba22b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076231 Oct 28 18:18:21.184445 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2028/3795] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:21.190688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:21.191411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:21.207200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:21.207701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:21.208189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:21.208889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:21.209967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:21.209967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:21.538021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:21.555605 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3fa380ef-3b19-4df3-9ee5-66ef3c1735ed tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb" status: 200 len: 1512 microversion: 2.1 time: 0.367889 Oct 28 18:18:21.559367 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2029/3796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:21 2022] GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:21.584193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:21.585400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:21.594324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:21.595002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:21.595757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:21.596714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:21.597370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:21.599764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:21.819947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:21.834157 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f62af58f-a741-4da6-a155-8b38083f8e2d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1506 microversion: 2.1 time: 0.271394 Oct 28 18:18:21.834904 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2030/3797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:21 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:21.998202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-167060e6-118b-4485-87da-1eb0ad1f526b tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Action: 'create', calling method: .version_select at 0x7f78dd651820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-438371444", "metadata": {"Type": "work"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-167060e6-118b-4485-87da-1eb0ad1f526b tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Request method failure captured: Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 121 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzttEVQlsyZn0tM1C8TJ1sQNykmHlWRy0COI5D5IbtaDeg7XJKLGsaMwnk0J7CQYhZJ6RXZFhOHR1cpeQwwPnsC9U7nerpllJ3X3xbWuyzOjOdq6Kj_lTbXgqxAAuiibPlwMexT20UcvrYhiAity0fsnHXfZ_r3iF95xalh1QDj_Vw Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbb243ae15b4952aef5579d972a31e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4a1d83b56eca4396a007d88acf76b6f3 Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-438371444", "metadata": {"Type": "work"}}} Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-438371444', 'metadata': {'Type': 'work'}}}} Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '#$%' Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:18:22.002379 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-167060e6-118b-4485-87da-1eb0ad1f526b tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:22.008088 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-167060e6-118b-4485-87da-1eb0ad1f526b tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.169507 Oct 28 18:18:22.013352 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2031/3798] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 18:18:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:18:22.020327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:22.020958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:22.029714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:22.030395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:22.030854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:22.032139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:22.032616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:22.033196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:22.120199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:22.133092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:22.135317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:22.136871 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2662f26-7b6a-450f-925c-5010c38f28bd tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.122306 Oct 28 18:18:22.139098 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2032/3799] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:22 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:22.144480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:22.145601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:22.152106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:22.152603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:22.153036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:22.154340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:22.154873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:22.155592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:22.309105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:22.319157 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d089f3f-90e4-48e7-a2f6-8152ae3140f0 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1513 microversion: 2.1 time: 0.178589 Oct 28 18:18:22.321079 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2033/3800] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:22 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:22.390712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-509257721", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:22.453474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] validate_networks() for [('1ef5dac1-d901-4add-a069-15c2a8da687c', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:18:22.939000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:18:22.939585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:18:22.940206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:18:22.940875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:18:22.941566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:18:22.954210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:22.954860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:22.955567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:22.956449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:22.957116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:22.957928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:22.965675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=37 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:22.980461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Getting quotas for project ce634b9e301b4619a1f0ce89cfc1ed68. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:18:22.987205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Getting quotas for user b7740749fbc24944ac581deab9701f53 and project ce634b9e301b4619a1f0ce89cfc1ed68. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:18:23.003355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:18:23.005864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:18:23.075283 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8cf9c70-fae6-40a7-9dd2-50d3d950fe87 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.752666 Oct 28 18:18:23.082361 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2034/3801] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:18:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:18:23.082361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ef18040-a4a4-4937-9978-7187ae996cf6 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Action: 'create', calling method: .version_select at 0x7f78e2535310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1381704402", "metadata": {"Type": "work"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ef18040-a4a4-4937-9978-7187ae996cf6 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Request method failure captured: Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 120 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzttEVQlsyZn0tM1C8TJ1sQNykmHlWRy0COI5D5IbtaDeg7XJKLGsaMwnk0J7CQYhZJ6RXZFhOHR1cpeQwwPnsC9U7nerpllJ3X3xbWuyzOjOdq6Kj_lTbXgqxAAuiibPlwMexT20UcvrYhiAity0fsnHXfZ_r3iF95xalh1QDj_Vw Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbb243ae15b4952aef5579d972a31e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4a1d83b56eca4396a007d88acf76b6f3 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1381704402", "metadata": {"Type": "work"}}} Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1381704402', 'metadata': {'Type': 'work'}}}} Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '0' Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:18:23.085901 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.091716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2ef18040-a4a4-4937-9978-7187ae996cf6 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:23.093242 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2ef18040-a4a4-4937-9978-7187ae996cf6 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015218 Oct 28 18:18:23.093921 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2035/3802] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 18:18:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:18:23.105009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:23.105778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] [instance: ace49418-f4f4-4658-81fa-5329327349b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:23.114352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:23.114974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:23.115529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:23.116612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:23.117029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:23.117557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:23.133576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] HTTP exception thrown: Instance ace49418-f4f4-4658-81fa-5329327349b6 could not be found. Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Request method failure captured: Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 HTTP/1.1 Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBy3hRWsf5CMKLYOj3c3jyvUe5WSMNuZR-vF4eRKmzUbrGSnlcRYDHFGME3SvYP_JCMIHGo8XezfVur9J4Z8U-855BRyODA5JnDm-Hx6Ew0wWfBNaGFfLrJmGiPt4mr0lhJwPur6Oen_a8RWMsTGj7_QztNe6w1-jo7ijaXkBMCxLVw Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db0d39c8f6b4bbe8a667b9b6f4b171a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db0d39c8f6b4bbe8a667b9b6f4b171a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 1db0d39c8f6b4bbe8a667b9b6f4b171a Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-233061082 Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 5342b8afb30d4c4fb079f3e70015f447 Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServersNegativeTestJSON-233061082-project Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance ace49418-f4f4-4658-81fa-5329327349b6 could not be found. Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'ace49418-f4f4-4658-81fa-5329327349b6'} Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace49418-f4f4-4658-81fa-5329327349b6 could not be found. Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace49418-f4f4-4658-81fa-5329327349b6 could not be found. Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.135298 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace49418-f4f4-4658-81fa-5329327349b6 could not be found. Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:23.141206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] Returning 404 to user: Instance ace49418-f4f4-4658-81fa-5329327349b6 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:23.142461 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c293478-353e-4e66-8fa4-2fa0f2226ec8 tempest-ListServersNegativeTestJSON-233061082 tempest-ListServersNegativeTestJSON-233061082-project] 10.222.0.16 "GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6" status: 404 len: 111 microversion: 2.1 time: 0.042454 Oct 28 18:18:23.144206 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2036/3803] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:23 2022] GET /compute/v2.1/servers/ace49418-f4f4-4658-81fa-5329327349b6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:23.150484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:23.159262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:23.159262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:23.429904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:23.429904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:23.429904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:23.432900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:23.433651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:23.434162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:23.599466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:23.622043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:23.704238 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2fde98f8-0def-4b64-bc72-be4407ea00fa tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.558675 Oct 28 18:18:23.705334 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2037/3804] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Oct 28 18:18:23 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:23.720075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:23.721075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:23.731000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:23.732627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:23.733346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:23.734324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:23.735902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:23.736618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:23.956955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:23.968448 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36f9d514-c932-4612-8ae3-ecd707a6741e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1527 microversion: 2.1 time: 0.252472 Oct 28 18:18:23.969427 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2038/3805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:23 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1527 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:23.979246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6e8a2b0-c89b-4789-a1bc-363a0d492a4a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:23.980030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6e8a2b0-c89b-4789-a1bc-363a0d492a4a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:24.077114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6e8a2b0-c89b-4789-a1bc-363a0d492a4a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:24.085368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6e8a2b0-c89b-4789-a1bc-363a0d492a4a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1221 microversion: 2.1 time: 0.114150 Oct 28 18:18:24.086160 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2039/3806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:23 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:24.119093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4809b842-2a69-4f32-9c3b-455bfd0c1b43 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Action: 'create', calling method: .version_select at 0x7f78e25685e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1573297061", "metadata": {"Type": "work"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4809b842-2a69-4f32-9c3b-455bfd0c1b43 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Request method failure captured: Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 119 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzttEVQlsyZn0tM1C8TJ1sQNykmHlWRy0COI5D5IbtaDeg7XJKLGsaMwnk0J7CQYhZJ6RXZFhOHR1cpeQwwPnsC9U7nerpllJ3X3xbWuyzOjOdq6Kj_lTbXgqxAAuiibPlwMexT20UcvrYhiAity0fsnHXfZ_r3iF95xalh1QDj_Vw Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbb243ae15b4952aef5579d972a31e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4a1d83b56eca4396a007d88acf76b6f3 Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1573297061", "metadata": {"Type": "work"}}} Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1573297061', 'metadata': {'Type': 'work'}}}} Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '' Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:18:24.142957 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4809b842-2a69-4f32-9c3b-455bfd0c1b43 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:24.147615 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4809b842-2a69-4f32-9c3b-455bfd0c1b43 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.043371 Oct 28 18:18:24.154541 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2040/3807] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 18:18:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:18:24.164614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:24.168190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:24.184993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:24.185511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:24.187946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:24.188825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:24.189313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:24.189829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:24.326347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:24.350889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:24.352410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:24.354029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0097f45-c8f4-498c-8851-4a2a2e599e61 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.197980 Oct 28 18:18:24.355305 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2041/3808] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:24 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:24.377317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:24.378110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:24.390123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:24.390642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:24.391098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:24.391939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:24.395404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:24.396119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:25.080156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:25.092173 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb0fa5e3-7338-4bdc-a53d-7ba2fcee2bca tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1511 microversion: 2.1 time: 0.734895 Oct 28 18:18:25.108334 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2042/3809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:24 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1511 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:25.117456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b19f3d5d-cb71-48be-981b-5703f4355b83 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Calling method '.version_select at 0x7f78de4e0d30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:25.337239 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b19f3d5d-cb71-48be-981b-5703f4355b83 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] HTTP exception thrown: Volume tempest-invalid-955313690 could not be found. Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b19f3d5d-cb71-48be-981b-5703f4355b83 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Request method failure captured: Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-955313690 HTTP/1.1 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzttEVQlsyZn0tM1C8TJ1sQNykmHlWRy0COI5D5IbtaDeg7XJKLGsaMwnk0J7CQYhZJ6RXZFhOHR1cpeQwwPnsC9U7nerpllJ3X3xbWuyzOjOdq6Kj_lTbXgqxAAuiibPlwMexT20UcvrYhiAity0fsnHXfZ_r3iF95xalh1QDj_Vw Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbb243ae15b4952aef5579d972a31e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4a1d83b56eca4396a007d88acf76b6f3 Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: exception: Volume tempest-invalid-955313690 could not be found. Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'tempest-invalid-955313690'} Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-955313690 could not be found. (HTTP 404) (Request-ID: req-182d9457-e864-4d83-8004-64ebae76af62) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:18:25.342152 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-955313690 could not be found. Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-955313690 could not be found. Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-955313690 could not be found. Oct 28 18:18:25.346655 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:25.359116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b19f3d5d-cb71-48be-981b-5703f4355b83 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Returning 404 to user: Volume tempest-invalid-955313690 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:25.360438 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b19f3d5d-cb71-48be-981b-5703f4355b83 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-955313690" status: 404 len: 98 microversion: 2.1 time: 0.250720 Oct 28 18:18:25.361670 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2043/3810] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Oct 28 18:18:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-955313690 => generated 98 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:18:25.370862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1286815795", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:25.458574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] validate_networks() for [('1ef5dac1-d901-4add-a069-15c2a8da687c', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:18:26.774086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:18:26.774739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:18:26.775200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:18:26.775631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:18:26.776076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:18:26.793490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:26.801221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:26.801811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:26.803166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:26.803661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:26.804136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:26.881139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Getting quotas for project ce634b9e301b4619a1f0ce89cfc1ed68. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:18:26.896659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Getting quotas for user b7740749fbc24944ac581deab9701f53 and project ce634b9e301b4619a1f0ce89cfc1ed68. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:18:26.928749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:18:26.933756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:18:27.109560 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30ac3bd5-73dd-4569-81fc-f32f0e44113b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.746251 Oct 28 18:18:27.110908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2044/3811] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:18:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:18:27.117164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:27.118063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:27.127408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:27.128284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:27.129596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:27.130518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:27.131204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:27.131956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:27.560377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:27.570439 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f76cdf4d-43f5-4d28-a719-de414242f0a5 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1527 microversion: 2.1 time: 0.458174 Oct 28 18:18:27.574566 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2045/3812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:27 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1527 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:27.601899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:27.602696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:27.615573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:27.616102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:27.616542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:27.619221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:27.619702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:27.620176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:28.146928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:28.162669 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3e8caa48-72d7-4f24-838c-dbecb99bb515 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb" status: 200 len: 1512 microversion: 2.1 time: 0.573528 Oct 28 18:18:28.164515 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2046/3813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:27 2022] GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb => generated 1512 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:28.186389 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c095491d-e8af-4c7b-b754-d8bb54648775 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016811 Oct 28 18:18:28.187354 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2047/3814] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 18:18:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 18:18:28.201557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:28.204095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:28.226788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:28.231967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:28.232874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:28.235392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:28.239238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:28.239846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:28.563158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:28.579934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:28.582220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:28.584813 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a66e39d-e0af-4262-9cac-c467e736e986 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.391788 Oct 28 18:18:28.585945 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2048/3815] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:28 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:28.593542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:28.594641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:28.604411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:28.605324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:28.606005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:28.612136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:28.612882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:28.613559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:28.748722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:28.760222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a111a6e4-aab1-493b-b69c-5fdbbfc1072b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1274 microversion: 2.1 time: 0.170498 Oct 28 18:18:28.761424 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2049/3816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:28 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:28.772307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:28.775730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:28.806641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:28.807147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:28.807597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:28.808437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:28.808896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:28.809319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:29.934198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:29.971083 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e47d17c-d265-48ff-9e59-7d96fd348ad6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1513 microversion: 2.1 time: 1.207043 Oct 28 18:18:29.979933 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2050/3817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:28 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1513 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:29.987428 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a373710-c906-4285-9cb1-8c21e40abe88 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014154 Oct 28 18:18:29.988658 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2051/3818] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:18:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 18:18:30.005503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-85df79af-61f6-4bfc-a830-6618b338552a req-1d12066a-ba67-4cfd-8699-4c2831e9c45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2164efc4-61e1-437d-870f-98fbae5d329e", "name": "network-vif-plugged", "status": "completed", "tag": "e677cb09-2070-4c19-a8c5-c0c6ad01a11d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:30.030487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85df79af-61f6-4bfc-a830-6618b338552a req-1d12066a-ba67-4cfd-8699-4c2831e9c45f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.036778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85df79af-61f6-4bfc-a830-6618b338552a req-1d12066a-ba67-4cfd-8699-4c2831e9c45f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.037589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85df79af-61f6-4bfc-a830-6618b338552a req-1d12066a-ba67-4cfd-8699-4c2831e9c45f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.065494 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-85df79af-61f6-4bfc-a830-6618b338552a req-1d12066a-ba67-4cfd-8699-4c2831e9c45f service nova] Creating event network-vif-plugged:e677cb09-2070-4c19-a8c5-c0c6ad01a11d for instance 2164efc4-61e1-437d-870f-98fbae5d329e on n-h1-862404-2 Oct 28 18:18:30.085274 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-85df79af-61f6-4bfc-a830-6618b338552a req-1d12066a-ba67-4cfd-8699-4c2831e9c45f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089579 Oct 28 18:18:30.089668 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2052/3819] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:30.104610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:30.105581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:30.128135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.128648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.129098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.129826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.130297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.130737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:31.328780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:31.336709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3b07564-bc46-4d0d-9826-985717ec6e3d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1522 microversion: 2.1 time: 1.239724 Oct 28 18:18:31.337815 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2053/3820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:30 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1522 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:31.343521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:31.344376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:31.352783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:31.353525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:31.354144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:31.355092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:31.355733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:31.356411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:31.661270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:31.678909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:31.680778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:31.682196 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68439c28-aeda-49b7-8722-1f05dedf66f4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.343255 Oct 28 18:18:31.684883 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2054/3821] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:31 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:31.697257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:31.698186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:31.726097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:31.726862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:31.729332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:31.730256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:31.730888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:31.736810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:31.917589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:31.933777 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-910f7694-80d2-4ca9-91d3-441862770dee tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1280 microversion: 2.1 time: 0.247597 Oct 28 18:18:31.936937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2055/3822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:31 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1280 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:31.946968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f06219ee-994a-4d5f-8b05-f54fb276df6e tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Calling method '.version_select at 0x7f78e25603a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:32.009149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f06219ee-994a-4d5f-8b05-f54fb276df6e tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] HTTP exception thrown: Volume bbf91778-db55-4989-90cd-f077c5283717 could not be found. Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f06219ee-994a-4d5f-8b05-f54fb276df6e tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Request method failure captured: Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-volumes/bbf91778-db55-4989-90cd-f077c5283717 HTTP/1.1 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzttEVQlsyZn0tM1C8TJ1sQNykmHlWRy0COI5D5IbtaDeg7XJKLGsaMwnk0J7CQYhZJ6RXZFhOHR1cpeQwwPnsC9U7nerpllJ3X3xbWuyzOjOdq6Kj_lTbXgqxAAuiibPlwMexT20UcvrYhiAity0fsnHXfZ_r3iF95xalh1QDj_Vw Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbb243ae15b4952aef5579d972a31e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4a1d83b56eca4396a007d88acf76b6f3 Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: exception: Volume bbf91778-db55-4989-90cd-f077c5283717 could not be found. Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'bbf91778-db55-4989-90cd-f077c5283717'} Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbf91778-db55-4989-90cd-f077c5283717 could not be found. (HTTP 404) (Request-ID: req-e0f2e602-df9c-45ca-971c-24466b748137) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:18:32.013774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbf91778-db55-4989-90cd-f077c5283717 could not be found. Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbf91778-db55-4989-90cd-f077c5283717 could not be found. Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbf91778-db55-4989-90cd-f077c5283717 could not be found. Oct 28 18:18:32.019703 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:32.026782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f06219ee-994a-4d5f-8b05-f54fb276df6e tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Returning 404 to user: Volume bbf91778-db55-4989-90cd-f077c5283717 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:32.026782 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f06219ee-994a-4d5f-8b05-f54fb276df6e tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/bbf91778-db55-4989-90cd-f077c5283717" status: 404 len: 109 microversion: 2.1 time: 0.087274 Oct 28 18:18:32.027027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2056/3823] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:18:31 2022] DELETE /compute/v2.1/os-volumes/bbf91778-db55-4989-90cd-f077c5283717 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:32.035497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:32.055180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:32.056420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:32.069062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:32.076917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:32.077553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:32.078527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:32.088145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:32.089142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:32.149384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:32.235757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:32.246594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:32.247565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:32.248360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:33.021678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-770a9270-f334-4166-ad15-b3bd3a32c4e1 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.993385 Oct 28 18:18:33.036820 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2057/3824] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:18:32 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:33.050568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ca0a452-12d0-434e-b714-eed0fea0c8b9 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Calling method '.version_select at 0x7f78de2bdee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:33.098034 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3ca0a452-12d0-434e-b714-eed0fea0c8b9 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] HTTP exception thrown: Volume a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e could not be found. Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ca0a452-12d0-434e-b714-eed0fea0c8b9 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Request method failure captured: Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-volumes/a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e HTTP/1.1 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzttEVQlsyZn0tM1C8TJ1sQNykmHlWRy0COI5D5IbtaDeg7XJKLGsaMwnk0J7CQYhZJ6RXZFhOHR1cpeQwwPnsC9U7nerpllJ3X3xbWuyzOjOdq6Kj_lTbXgqxAAuiibPlwMexT20UcvrYhiAity0fsnHXfZ_r3iF95xalh1QDj_Vw Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdbb243ae15b4952aef5579d972a31e8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdbb243ae15b4952aef5579d972a31e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: fdbb243ae15b4952aef5579d972a31e8 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesNegativeTest-210897973 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4a1d83b56eca4396a007d88acf76b6f3 Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesNegativeTest-210897973-project Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: exception: Volume a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e could not be found. Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e'} Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e could not be found. (HTTP 404) (Request-ID: req-d2862058-c616-46f4-aa20-b70a2186e31c) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:18:33.101654 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e could not be found. Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e could not be found. Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e could not be found. Oct 28 18:18:33.106669 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:33.111308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ca0a452-12d0-434e-b714-eed0fea0c8b9 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] Returning 404 to user: Volume a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:33.112552 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ca0a452-12d0-434e-b714-eed0fea0c8b9 tempest-VolumesNegativeTest-210897973 tempest-VolumesNegativeTest-210897973-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e" status: 404 len: 109 microversion: 2.1 time: 0.074630 Oct 28 18:18:33.113692 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2058/3825] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:18:33 2022] GET /compute/v2.1/os-volumes/a8344fd0-2d4f-49ba-9d64-c79fd0d0f07e => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:33.123849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-142605b2-a977-4e59-98e7-a8b9ddb46cf0 req-d40269c5-76c6-4e93-bf4b-72f3cc94f43c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f57a499d-80c7-4ac5-88fb-07b9192dc6a0", "tag": "735b0cb3-4ed0-491d-8cfa-60779929f25a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:33.134804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:33.137014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-142605b2-a977-4e59-98e7-a8b9ddb46cf0 req-d40269c5-76c6-4e93-bf4b-72f3cc94f43c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:33.138318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-142605b2-a977-4e59-98e7-a8b9ddb46cf0 req-d40269c5-76c6-4e93-bf4b-72f3cc94f43c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:33.138960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-142605b2-a977-4e59-98e7-a8b9ddb46cf0 req-d40269c5-76c6-4e93-bf4b-72f3cc94f43c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:33.153404 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-142605b2-a977-4e59-98e7-a8b9ddb46cf0 req-d40269c5-76c6-4e93-bf4b-72f3cc94f43c service nova] Creating event network-changed:735b0cb3-4ed0-491d-8cfa-60779929f25a for instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 on n-h2-862404-2 Oct 28 18:18:33.170284 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-142605b2-a977-4e59-98e7-a8b9ddb46cf0 req-d40269c5-76c6-4e93-bf4b-72f3cc94f43c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054692 Oct 28 18:18:33.171149 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2059/3826] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:33.193544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:33.195533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:33.219593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:33.223914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:33.224523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:33.225296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:33.226867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:33.227304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:33.820440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:33.832556 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c2c11c5d-2e35-4ffe-a385-12f61d751c64 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1522 microversion: 2.1 time: 0.652500 Oct 28 18:18:33.836066 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2060/3827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:33 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:33.873405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:33.874107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:33.892554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:33.893490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:33.898073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:33.899677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:33.900528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:33.902135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:34.022321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:34.051942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:34.065899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7af32e785674747a0c07d471e7f3aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb01cab48b5437cbbe52dea0a0b97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:34.067561 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-480e9ada-eaa0-4cbd-8e64-c8b08a1268ea tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 200 len: 1604 microversion: 2.32 time: 0.230294 Oct 28 18:18:34.069219 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2061/3828] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:33 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:18:34.075763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:34.077097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:34.084535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:34.085387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:34.086106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:34.087062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:34.087761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:34.089043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:34.136752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:34.463692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:34.479591 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a4f5b31-ebc4-4eee-a129-a7e80b1175ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1322 microversion: 2.1 time: 0.408926 Oct 28 18:18:34.496211 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2062/3829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:34 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:34.496211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:34.523491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:34.524369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:35.053070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:35.053820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:35.054108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:35.055012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:35.055479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:35.055932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:35.166939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:35.344591 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5c69edd-e816-452c-ada9-c25863f8742d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.855024 Oct 28 18:18:35.347405 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2063/3830] 10.222.0.16 () {58 vars in 1150 bytes} [Fri Oct 28 18:18:34 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:35.384172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-17437a22-3748-4cc5-85eb-9b695a975235 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Calling method '.version_select at 0x7f78de4e5c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:35.482365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-17437a22-3748-4cc5-85eb-9b695a975235 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006732752" status: 202 len: 0 microversion: 2.1 time: 0.129439 Oct 28 18:18:35.482994 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2064/3831] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:18:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006732752 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:18:35.498875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:35.509235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:35.525984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:35.529128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:35.538341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:35.539126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:35.539610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:35.540081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:36.588646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:36.600093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8062b8ab-bb5b-4cc7-b63a-019e4b082125 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1522 microversion: 2.1 time: 1.115975 Oct 28 18:18:36.611492 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2065/3832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:35 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1522 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:36.626695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd01d684-8df9-490a-a3be-4e82849b87f1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Action: 'create', calling method: .version_select at 0x7f78de30c940>, body: {"keypair": {"name": "tempest-keypair-1018615621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKwEDNLiYzIU0wHnQivoLGaJsQKlwrmnyDcP0Sd7pKq6AzzXCBMXZzhSvsfMGA+6xYK9QQ5HrPRCqdghJHMQHd0v+N97u8pMtAoOBXm0tqvq/VQQ5KlqG/BPd5zC1tDeg=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:36.709196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-fd01d684-8df9-490a-a3be-4e82849b87f1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Getting quotas for project f9feb5dd23bd49ad8f9552e045838aa4. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:18:36.754472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-fd01d684-8df9-490a-a3be-4e82849b87f1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Getting quotas for user 611e91c42dbe4519874fb2330e1ce75f and project f9feb5dd23bd49ad8f9552e045838aa4. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:18:36.845918 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd01d684-8df9-490a-a3be-4e82849b87f1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.232959 Oct 28 18:18:36.848097 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2066/3833] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:18:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 18:18:36.863710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:36.865294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:36.887884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:36.889349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:36.891396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:36.899464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:36.900407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:36.901178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:36.924672 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] HTTP exception thrown: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Request method failure captured: Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d HTTP/1.1 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBtWflJ2aRt-Kh_okzWshbHIkRBWTMyrEjruGuwYK76rbox44S8Vvgq6oYtcD7vld3gPjR77C462qKkljQvvbcukSCEqEw6TBg1svVLZOImiqUDlohJ0KFmr_3x2uuPWplVIznPRlIwTlKvMoLXVrSTWIAXlDjY34btHgvhXx7cjMnE Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: eeb01cab48b5437cbbe52dea0a0b97e6 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb01cab48b5437cbbe52dea0a0b97e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: eeb01cab48b5437cbbe52dea0a0b97e6 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TaggedBootDevicesTest-348295680-project Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7af32e785674747a0c07d471e7f3aa1 Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TaggedBootDevicesTest-348295680-project Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d'} Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:36.926834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:36.931380 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:36.931380 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:36.931380 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:36.931380 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:36.931380 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:36.931380 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:36.931380 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:36.938408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Returning 404 to user: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:36.940028 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4278c3ac-7081-4f4a-864d-cad292aece01 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 404 len: 111 microversion: 2.32 time: 0.090386 Oct 28 18:18:36.941171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2067/3834] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:36 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:18:36.946977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:36.956919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:36.958039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:36.964190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:36.965104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:36.966576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:36.968727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:36.969473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:36.970201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:37.141763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:37.257318 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-edfc13a6-7c7d-4e5c-b03d-87bfc24d54bd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.314740 Oct 28 18:18:37.258429 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2068/3835] 10.222.0.16 () {58 vars in 1212 bytes} [Fri Oct 28 18:18:36 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:37.276380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:37.277235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:37.307535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:37.309484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:37.310950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:37.312081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:37.315328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:37.316115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:38.113313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:38.125760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35eb5e9c-94ae-4582-89a6-46134262380a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1322 microversion: 2.1 time: 0.866027 Oct 28 18:18:38.128912 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2069/3836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:37 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1322 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:38.141046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1d6ca42f-0e05-4524-ae96-ceeb44422ef4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '.version_select at 0x7f78e23d99d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:38.193444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1d6ca42f-0e05-4524-ae96-ceeb44422ef4 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427085366" status: 204 len: 0 microversion: 2.32 time: 0.062274 Oct 28 18:18:38.194351 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2070/3837] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Oct 28 18:18:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427085366 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:18:38.209615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:38.229568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:38.236927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:38.255707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:38.257543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:38.257981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:38.265330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:38.266066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:38.266775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:38.536948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:38.702347 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-89ca8c52-a7d7-4e4a-b402-45ae68f3219e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.502963 Oct 28 18:18:38.704407 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2071/3838] 10.222.0.16 () {58 vars in 1196 bytes} [Fri Oct 28 18:18:38 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:38.745322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:38.746567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:38.765508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:38.769807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:38.772019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:38.781120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:38.781864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:38.785060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.120997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:40.138854 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51c123a5-4055-4b6b-a4f7-cdcd9a71ab76 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1522 microversion: 2.1 time: 1.423493 Oct 28 18:18:40.139894 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2072/3839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:38 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1522 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:40.144865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:40.162128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:40.170496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'name': '-303212241', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:40.179767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.180654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.181445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.182355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.182990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.183584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.356020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:40.475486 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f91fd408-e218-4d69-8a65-49544c765e1e tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-303212241" status: 200 len: 345 microversion: 2.1 time: 0.334180 Oct 28 18:18:40.477430 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2073/3840] 10.222.0.16 () {58 vars in 1156 bytes} [Fri Oct 28 18:18:40 2022] GET /compute/v2.1/servers?name=-303212241 => generated 345 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:40.483275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:40.484166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:40.491736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.492537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.493179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.494582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.495274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.495903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.795246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:40.812081 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ef9b037-af69-4f86-a410-1b0870540c6a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1322 microversion: 2.1 time: 0.330818 Oct 28 18:18:40.813216 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2074/3841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:40 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:40.821797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ee4f843f-dffa-42ff-8652-5013851005b7 req-3626c96d-e99d-46a9-9ef7-3aa68c529bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f416cc1a-709e-4417-84dc-7f62b7e1bf93", "tag": "8c1b112f-5a38-4e3e-8929-423c0e421423"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:40.849070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ee4f843f-dffa-42ff-8652-5013851005b7 req-3626c96d-e99d-46a9-9ef7-3aa68c529bb6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.850033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ee4f843f-dffa-42ff-8652-5013851005b7 req-3626c96d-e99d-46a9-9ef7-3aa68c529bb6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.850691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ee4f843f-dffa-42ff-8652-5013851005b7 req-3626c96d-e99d-46a9-9ef7-3aa68c529bb6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.868417 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ee4f843f-dffa-42ff-8652-5013851005b7 req-3626c96d-e99d-46a9-9ef7-3aa68c529bb6 service nova] Creating event network-changed:8c1b112f-5a38-4e3e-8929-423c0e421423 for instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 on n-h2-862404-2 Oct 28 18:18:40.874004 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ee4f843f-dffa-42ff-8652-5013851005b7 req-3626c96d-e99d-46a9-9ef7-3aa68c529bb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059402 Oct 28 18:18:40.874903 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2075/3842] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:40.885086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:40.891255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:40.896582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:40.917512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.919882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.920551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.921541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.923908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.930472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:41.193680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:41.385678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d71d1ae-18f4-4a97-82af-5ceab5952231 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.509275 Oct 28 18:18:41.396613 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2076/3843] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Oct 28 18:18:40 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:41.415657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:41.416474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:41.426372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:41.426882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:41.427397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:41.428124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:41.428810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:41.429251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:41.786354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:41.802932 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d9d3755-799d-4b6b-a4a3-98cb2180fcae tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1522 microversion: 2.1 time: 0.401752 Oct 28 18:18:41.803945 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2077/3844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:41 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:41.835024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:41.852385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:41.853104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-30321224', 'deleted': False, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:18:41.875389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:41.876285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:41.878540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:41.881719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:41.882411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:41.883263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:42.126680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:18:42.237032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5f8754e-159a-469b-82e5-ed67bed298fd tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-30321224" status: 200 len: 345 microversion: 2.1 time: 0.431487 Oct 28 18:18:42.238644 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2078/3845] 10.222.0.16 () {58 vars in 1226 bytes} [Fri Oct 28 18:18:41 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-30321224 => generated 345 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:42.255727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b8bf3aed-4698-4e70-86ac-b1b43b45a1a5 req-85260b4a-4156-43d7-8643-d8d174bc095d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57a499d-80c7-4ac5-88fb-07b9192dc6a0", "name": "network-vif-plugged", "status": "completed", "tag": "735b0cb3-4ed0-491d-8cfa-60779929f25a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:42.330539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b8bf3aed-4698-4e70-86ac-b1b43b45a1a5 req-85260b4a-4156-43d7-8643-d8d174bc095d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:42.335095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b8bf3aed-4698-4e70-86ac-b1b43b45a1a5 req-85260b4a-4156-43d7-8643-d8d174bc095d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:42.335288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b8bf3aed-4698-4e70-86ac-b1b43b45a1a5 req-85260b4a-4156-43d7-8643-d8d174bc095d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:42.363779 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b8bf3aed-4698-4e70-86ac-b1b43b45a1a5 req-85260b4a-4156-43d7-8643-d8d174bc095d service nova] Creating event network-vif-plugged:735b0cb3-4ed0-491d-8cfa-60779929f25a for instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 on n-h2-862404-2 Oct 28 18:18:42.382240 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b8bf3aed-4698-4e70-86ac-b1b43b45a1a5 req-85260b4a-4156-43d7-8643-d8d174bc095d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142155 Oct 28 18:18:42.383842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2079/3846] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:42.405010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:42.409094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:42.418904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:42.419412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:42.419976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:42.438038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:42.438769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:42.439222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:42.962455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:42.973150 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2149729-c4aa-46f3-b08a-3edca6845f8a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1322 microversion: 2.1 time: 0.588628 Oct 28 18:18:42.976169 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2080/3847] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:42 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1322 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:42.986734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:42.991719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:43.009303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:43.009819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:43.010273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:43.010997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:43.011456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:43.011915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:43.084982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:18:43.183567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:43.281526 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-83294260-8b9e-41a7-afd5-d10848d8f3c8 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 204 len: 0 microversion: 2.1 time: 0.303517 Oct 28 18:18:43.283112 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2081/3848] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:18:42 2022] DELETE /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:18:43.293299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:43.296839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:43.331090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:43.331901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:43.332647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:43.334603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:43.340314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:43.342040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:43.898942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:43.907963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6ed52fe-faf3-4f10-816b-9e1ee0d2b7f7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1522 microversion: 2.1 time: 0.623311 Oct 28 18:18:43.908567 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2082/3849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:43 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:43.933791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:43.934517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:43.959518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:43.960021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:43.961623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:43.962482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:43.963995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:43.964690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:45.659084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:45.676131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61e69d54-2a7e-4f88-814a-c7e2c8ed2545 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 200 len: 1519 microversion: 2.1 time: 1.760992 Oct 28 18:18:45.677107 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2083/3850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:43 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 1519 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:45.691762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:45.692857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:45.708851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:45.709815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:45.710723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:45.711650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:45.712309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:45.712944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:46.188790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:46.220740 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5561f180-43b6-45f0-bcb0-19280398055b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1322 microversion: 2.1 time: 0.532792 Oct 28 18:18:46.222882 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2084/3851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:45 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:46.246532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-714320910", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ba642a7e-5846-4b3c-9ce5-e9eca5785636"}, {"port": "f6faaf47-a79d-4a83-8673-436e23fd58c2", "tag": "port-1"}, {"port": "9d47d85a-5cef-4716-bd46-75acc348c1ba", "tag": "port-2"}, {"uuid": "ee803d21-84e4-4314-87fa-fb1fb0324c54", "tag": "net-1"}, {"uuid": "ee803d21-84e4-4314-87fa-fb1fb0324c54"}, {"uuid": "8b2590c0-620c-4ddc-9f28-723ccf4b3fa2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8b2590c0-620c-4ddc-9f28-723ccf4b3fa2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f9cd0dfa-5a23-4f54-8d53-9564d543fa1d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3efd89a0-e866-4eb9-b112-fb6092e25f42", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "cd7e97f3-e1bf-4586-923b-e886d9b01f97", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--412802061"}], "key_name": "tempest-keypair-1018615621", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:46.643885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] validate_networks() for [('ba642a7e-5846-4b3c-9ce5-e9eca5785636', None, None, None, None, None), (None, None, 'f6faaf47-a79d-4a83-8673-436e23fd58c2', None, None, None), (None, None, '9d47d85a-5cef-4716-bd46-75acc348c1ba', None, None, None), ('ee803d21-84e4-4314-87fa-fb1fb0324c54', None, None, None, None, None), ('ee803d21-84e4-4314-87fa-fb1fb0324c54', None, None, None, None, None), ('8b2590c0-620c-4ddc-9f28-723ccf4b3fa2', '10.2.2.100', None, None, None, None), ('8b2590c0-620c-4ddc-9f28-723ccf4b3fa2', '10.2.2.200', None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:18:46.786722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=22 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:52.019956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=19 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:55.469965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:18:55.470591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:18:55.478255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:18:55.479319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:18:55.479876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:18:55.502094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:55.508641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:55.509344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:55.511641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:55.533748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:55.534684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:55.558910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Getting quotas for project f9feb5dd23bd49ad8f9552e045838aa4. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:18:55.568410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Getting quotas for user 611e91c42dbe4519874fb2330e1ce75f and project f9feb5dd23bd49ad8f9552e045838aa4. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:18:55.844434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:18:55.848775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f9cd0dfa-5a23-4f54-8d53-9564d543fa1d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3efd89a0-e866-4eb9-b112-fb6092e25f42',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd7e97f3-e1bf-4586-923b-e886d9b01f97',volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:18:56.391997 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df305474-eb64-4e96-9c2b-a3c0387ca9ad tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.148081 Oct 28 18:18:56.394689 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2085/3852] 10.222.0.16 () {62 vars in 1189 bytes} [Fri Oct 28 18:18:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 10171 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:18:56.404826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:56.409066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:56.422272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:56.423540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:56.424528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:56.425523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:56.426244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:56.426686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:56.733457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:56.743123 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9dae9f94-c5c5-4d79-a070-7fb3d65adb1e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1504 microversion: 2.1 time: 0.346392 Oct 28 18:18:56.745389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2086/3853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:56 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:56.842126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-eebe88ff-0990-4774-b239-f3e0c49c5943 req-d8860509-9987-4e5c-a12f-d6ec84e064af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f416cc1a-709e-4417-84dc-7f62b7e1bf93", "name": "network-vif-plugged", "status": "completed", "tag": "8c1b112f-5a38-4e3e-8929-423c0e421423"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:56.869547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eebe88ff-0990-4774-b239-f3e0c49c5943 req-d8860509-9987-4e5c-a12f-d6ec84e064af service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:56.870090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eebe88ff-0990-4774-b239-f3e0c49c5943 req-d8860509-9987-4e5c-a12f-d6ec84e064af service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:56.876264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eebe88ff-0990-4774-b239-f3e0c49c5943 req-d8860509-9987-4e5c-a12f-d6ec84e064af service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:56.899974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-eebe88ff-0990-4774-b239-f3e0c49c5943 req-d8860509-9987-4e5c-a12f-d6ec84e064af service nova] Creating event network-vif-plugged:8c1b112f-5a38-4e3e-8929-423c0e421423 for instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 on n-h2-862404-2 Oct 28 18:18:56.914342 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-eebe88ff-0990-4774-b239-f3e0c49c5943 req-d8860509-9987-4e5c-a12f-d6ec84e064af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166403 Oct 28 18:18:56.915294 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2087/3854] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:56.925021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:56.926038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 6a003065-8214-4c1a-bfe2-1d36f8b6401b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:56.943566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:56.947244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:56.947244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:56.948217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:56.948942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:56.949612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:56.970273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] HTTP exception thrown: Instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b could not be found. Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Request method failure captured: Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b HTTP/1.1 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysKIOju90GpHXckvVPH4lRGftBAlJOcr_JbPypfYnHfrJbbd_YSYfahVYOTw6Lymp3-5L-7MtsFYKHSHEriwZ-Y1gU18p9MnDhBYyv-rPMhlAl6UJ-FR7mGZodF-D7DSzppPem2FZyqhrlVzD_7NezrDSPiPfSkPrvi41y0CNBHlI Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 17172ae3971e4810ac1f8afca2b8f8f6 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_17172ae3971e4810ac1f8afca2b8f8f6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 17172ae3971e4810ac1f8afca2b8f8f6 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServerFiltersTestJSON-365964503-project Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 203b0141d9574732971db25586457f8c Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServerFiltersTestJSON-365964503-project Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b could not be found. Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '6a003065-8214-4c1a-bfe2-1d36f8b6401b'} Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b could not be found. Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b could not be found. Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:56.972682 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b could not be found. Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Returning 404 to user: Instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:56.978412 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f3e7c52-4053-45b2-b178-6e8dbea99c76 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b" status: 404 len: 111 microversion: 2.1 time: 0.058661 Oct 28 18:18:56.979711 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2088/3855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:56 2022] GET /compute/v2.1/servers/6a003065-8214-4c1a-bfe2-1d36f8b6401b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:18:56.985861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:56.987734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:56.998119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:56.998872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:56.999508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:57.002312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:57.003012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:57.003628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:57.420719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:57.432396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-685783ce-9409-4ac4-a1e4-eebf0a237da1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1322 microversion: 2.1 time: 0.451189 Oct 28 18:18:57.433279 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2089/3856] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:56 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:57.575375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d090f1a9-a301-4ada-9f5b-8ea776e7b4d7 req-122917e2-9d66-4410-8823-b68c9eb5ee60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a003065-8214-4c1a-bfe2-1d36f8b6401b", "name": "network-vif-deleted", "tag": "b4a4a1a1-99f0-43dc-8d16-4fee1e508e51"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:57.600904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d090f1a9-a301-4ada-9f5b-8ea776e7b4d7 req-122917e2-9d66-4410-8823-b68c9eb5ee60 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:57.602477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d090f1a9-a301-4ada-9f5b-8ea776e7b4d7 req-122917e2-9d66-4410-8823-b68c9eb5ee60 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:57.604130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d090f1a9-a301-4ada-9f5b-8ea776e7b4d7 req-122917e2-9d66-4410-8823-b68c9eb5ee60 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:57.624356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d090f1a9-a301-4ada-9f5b-8ea776e7b4d7 req-122917e2-9d66-4410-8823-b68c9eb5ee60 service nova] Creating event network-vif-deleted:b4a4a1a1-99f0-43dc-8d16-4fee1e508e51 for instance 6a003065-8214-4c1a-bfe2-1d36f8b6401b on n-h2-862404-2 Oct 28 18:18:57.629738 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d090f1a9-a301-4ada-9f5b-8ea776e7b4d7 req-122917e2-9d66-4410-8823-b68c9eb5ee60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195284 Oct 28 18:18:57.630915 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2090/3857] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:57.649344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:57.650202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:57.658468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:57.659052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:57.659569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:57.660386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:57.661103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:57.661764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:57.678866 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] HTTP exception thrown: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Request method failure captured: Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d HTTP/1.1 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBtWflJ2aRt-Kh_okzWshbHIkRBWTMyrEjruGuwYK76rbox44S8Vvgq6oYtcD7vld3gPjR77C462qKkljQvvbcukSCEqEw6TBg1svVLZOImiqUDlohJ0KFmr_3x2uuPWplVIznPRlIwTlKvMoLXVrSTWIAXlDjY34btHgvhXx7cjMnE Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: eeb01cab48b5437cbbe52dea0a0b97e6 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb01cab48b5437cbbe52dea0a0b97e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: eeb01cab48b5437cbbe52dea0a0b97e6 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TaggedBootDevicesTest-348295680-project Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7af32e785674747a0c07d471e7f3aa1 Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TaggedBootDevicesTest-348295680-project Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d'} Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:57.681306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:18:57.686242 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:18:57.688558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Returning 404 to user: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:57.689681 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1bb05d02-1068-43b8-8bbd-64d3dd6005d7 tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "DELETE /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 404 len: 111 microversion: 2.32 time: 0.057519 Oct 28 18:18:57.690485 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2091/3858] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:18:57 2022] DELETE /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:18:57.925671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-217112283", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:57.953979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:58.095245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] validate_networks() for [('cf67e321-0643-4611-86f4-f2705daf5cd0', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:18:59.612125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:18:59.612723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:18:59.613010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:18:59.613415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:18:59.614019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:18:59.647332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:59.653023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:59.653610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:59.654571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:59.655207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:59.655845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:59.713801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Getting quotas for project 73143b013601482688c81ecf99ea17b2. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:18:59.728793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Getting quotas for user 6df00f0289484016a60bf76bf36e5b16 and project 73143b013601482688c81ecf99ea17b2. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:18:59.769715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:18:59.772485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:18:59.927170 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbc89e8c-a547-4568-89b0-5784746a8d40 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.229980 Oct 28 18:18:59.928732 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2092/3859] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:18:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:18:59.962848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:59.963915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:18:59.985171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:59.985965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:59.986760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:59.989829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.001041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.006111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.208655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:00.221777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:00.223400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:00.233550 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dbb7a17b-afac-402c-be7f-857a00114403 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1583 microversion: 2.42 time: 0.289241 Oct 28 18:19:00.234508 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2093/3860] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:18:59 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1583 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:00.252527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:00.253266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:00.268139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.269929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.270745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.271503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.272033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.279662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.368989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:19:00.559852 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38644b4a-9488-4186-9cc9-8e0b65085206 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb" status: 204 len: 0 microversion: 2.1 time: 0.323465 Oct 28 18:19:00.564636 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2094/3861] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:19:00 2022] DELETE /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:19:00.571228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:00.580553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] [instance: 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:00.588903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.589415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.589859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.591607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.592355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.601201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.638381 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] HTTP exception thrown: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Request method failure captured: Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d HTTP/1.1 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBtWflJ2aRt-Kh_okzWshbHIkRBWTMyrEjruGuwYK76rbox44S8Vvgq6oYtcD7vld3gPjR77C462qKkljQvvbcukSCEqEw6TBg1svVLZOImiqUDlohJ0KFmr_3x2uuPWplVIznPRlIwTlKvMoLXVrSTWIAXlDjY34btHgvhXx7cjMnE Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: eeb01cab48b5437cbbe52dea0a0b97e6 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eeb01cab48b5437cbbe52dea0a0b97e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eeb01cab48b5437cbbe52dea0a0b97e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: eeb01cab48b5437cbbe52dea0a0b97e6 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TaggedBootDevicesTest-348295680 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TaggedBootDevicesTest-348295680-project Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7af32e785674747a0c07d471e7f3aa1 Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TaggedBootDevicesTest-348295680-project Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d'} Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:00.640036 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:00.646780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:00.646780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:00.646780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:00.646780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:19:00.646780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:19:00.646780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. Oct 28 18:19:00.646780 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:00.646780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] Returning 404 to user: Instance 88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:19:00.658148 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f045dffc-93ea-4cf7-a4bf-3492fa4320ef tempest-TaggedBootDevicesTest-348295680 tempest-TaggedBootDevicesTest-348295680-project] 10.222.0.16 "GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d" status: 404 len: 111 microversion: 2.32 time: 0.075459 Oct 28 18:19:00.663140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2095/3862] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:00 2022] GET /compute/v2.1/servers/88e34bbf-fadb-4faf-8b3e-8ccc5baf4d7d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:19:00.670017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:00.670645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:00.678940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.679452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.679919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.680649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.681110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.681616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.050585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:01.094790 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5b4bad3f-4c89-4e3f-98c4-5c6d90e21034 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 200 len: 1447 microversion: 2.1 time: 0.430491 Oct 28 18:19:01.103097 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2096/3863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:00 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 1447 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:01.119921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:01.123255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:01.139689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.146209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.148162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.153734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.154748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.156069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.400596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:01.419515 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-413fe7c3-fb8f-44a1-820f-ca43d8687049 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1516 microversion: 2.1 time: 0.313968 Oct 28 18:19:01.421256 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2097/3864] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:01 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:01.440884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0ceee6f2-75ae-48ce-839b-286be8f9987e req-de562aa9-362a-4c6e-9771-1a9e21da6782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2164efc4-61e1-437d-870f-98fbae5d329e", "name": "network-vif-unplugged", "status": "completed", "tag": "e677cb09-2070-4c19-a8c5-c0c6ad01a11d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:01.458139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0ceee6f2-75ae-48ce-839b-286be8f9987e req-de562aa9-362a-4c6e-9771-1a9e21da6782 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.458955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0ceee6f2-75ae-48ce-839b-286be8f9987e req-de562aa9-362a-4c6e-9771-1a9e21da6782 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.460079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0ceee6f2-75ae-48ce-839b-286be8f9987e req-de562aa9-362a-4c6e-9771-1a9e21da6782 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.479469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.server_external_events [req-0ceee6f2-75ae-48ce-839b-286be8f9987e req-de562aa9-362a-4c6e-9771-1a9e21da6782 service nova] Unable to find a host for instance 2164efc4-61e1-437d-870f-98fbae5d329e. Dropping event network-vif-unplugged {{(pid=120680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 18:19:01.484761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0ceee6f2-75ae-48ce-839b-286be8f9987e req-de562aa9-362a-4c6e-9771-1a9e21da6782 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061880 Oct 28 18:19:01.486056 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2098/3865] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 18:19:01.492987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:01.494049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:01.506213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.507280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.508380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.509786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.510486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.511568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.608220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:01.624309 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3db67d0-7c99-4b20-825e-7087318dd592 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1274 microversion: 2.1 time: 0.136136 Oct 28 18:19:01.625884 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2099/3866] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:01 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:01.641141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:01.646858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:01.676054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.676555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.676989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.677697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.683342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.688808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.983363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:01.987693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:01.995477 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d824e379-836a-4bf0-a858-47a20a13dc49 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb" status: 200 len: 1518 microversion: 2.1 time: 0.368088 Oct 28 18:19:01.999141 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2100/3867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:01 2022] GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb => generated 1518 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:02.018471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:02.020462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:02.049661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:02.050712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:02.053221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:02.055335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:02.058375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:02.060048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:02.173572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:19:02.190516 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.compute.api [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Working on deleting snapshot 6e2234aa-1b1b-45b1-90d6-56eb05785a6e from shelved instance... Oct 28 18:19:03.631254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Doing local delete in cell 43f74929-bc21-41df-9120-e6be09c18015(cell1) {{(pid=120680) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 18:19:03.640228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:03.641371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:03.642022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:03.642657 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.compute.api [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 18:19:03.647242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] deallocate_for_instance() {{(pid=120680) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 18:19:05.196760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Updating instance_info_cache with network_info: [] {{(pid=120680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:19:05.886280 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-547b7f71-6d0b-4aac-93ba-2e434d654168 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 204 len: 0 microversion: 2.1 time: 3.884914 Oct 28 18:19:05.887937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2101/3868] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:19:01 2022] DELETE /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 0 bytes in 3888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:19:05.893361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:05.894220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:05.909250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:05.912309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:05.913015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:05.914663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:05.916949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:05.917618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:06.321781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:06.335803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:06.338142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:06.339347 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a00df21-7b2a-4c5f-92be-863ae0695559 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1660 microversion: 2.42 time: 0.450239 Oct 28 18:19:06.351780 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2102/3869] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:05 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1660 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:06.363533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:06.372304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:06.383428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:06.385006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:06.386729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:06.388074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:06.388554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:06.389030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:06.450547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lazy-loading 'flavor' on Instance uuid f416cc1a-709e-4417-84dc-7f62b7e1bf93 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:19:06.647244 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff39cab0-cd77-40dc-af04-6d7c7d8fbbfc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93/action" status: 200 len: 32 microversion: 2.1 time: 0.292619 Oct 28 18:19:06.653298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2103/3870] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:06 2022] POST /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93/action => generated 32 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:19:06.673742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:06.674605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:06.707639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:06.708871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:06.709340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:06.720519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:06.721218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:06.721722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.702846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:07.725160 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6550e51-8403-4102-a994-a564b16c1490 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1322 microversion: 2.1 time: 1.075290 Oct 28 18:19:07.732208 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2104/3871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:06 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1322 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:07.746094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:07.747644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:07.769524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.770038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.770484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.771204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.771669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.772232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.801480 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] HTTP exception thrown: Instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb could not be found. Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Request method failure captured: Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb HTTP/1.1 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysKIOju90GpHXckvVPH4lRGftBAlJOcr_JbPypfYnHfrJbbd_YSYfahVYOTw6Lymp3-5L-7MtsFYKHSHEriwZ-Y1gU18p9MnDhBYyv-rPMhlAl6UJ-FR7mGZodF-D7DSzppPem2FZyqhrlVzD_7NezrDSPiPfSkPrvi41y0CNBHlI Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 17172ae3971e4810ac1f8afca2b8f8f6 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_17172ae3971e4810ac1f8afca2b8f8f6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 17172ae3971e4810ac1f8afca2b8f8f6 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServerFiltersTestJSON-365964503-project Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 203b0141d9574732971db25586457f8c Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServerFiltersTestJSON-365964503-project Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb could not be found. Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb'} Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb could not be found. Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb could not be found. Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:07.805603 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb could not be found. Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Returning 404 to user: Instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:19:07.810826 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-885c4a89-dbbf-4866-b0a6-7f6594e04d4d tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb" status: 404 len: 111 microversion: 2.1 time: 0.075386 Oct 28 18:19:07.814115 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2105/3872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:07 2022] GET /compute/v2.1/servers/bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:19:07.829433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-093ca554-b25b-4f67-8e38-2650bb3855a4 req-5dedac50-17f4-4338-83d1-c71fee498890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb", "name": "network-vif-deleted", "tag": "d2e52b98-0a61-4dc7-a814-41da8d8d57ce"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:07.858355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-093ca554-b25b-4f67-8e38-2650bb3855a4 req-5dedac50-17f4-4338-83d1-c71fee498890 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.859529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-093ca554-b25b-4f67-8e38-2650bb3855a4 req-5dedac50-17f4-4338-83d1-c71fee498890 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.860312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-093ca554-b25b-4f67-8e38-2650bb3855a4 req-5dedac50-17f4-4338-83d1-c71fee498890 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.876423 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-093ca554-b25b-4f67-8e38-2650bb3855a4 req-5dedac50-17f4-4338-83d1-c71fee498890 service nova] Creating event network-vif-deleted:d2e52b98-0a61-4dc7-a814-41da8d8d57ce for instance bfd4f0dd-0d59-4885-b1d2-0a4a015d72cb on n-h2-862404-2 Oct 28 18:19:07.889831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-093ca554-b25b-4f67-8e38-2650bb3855a4 req-5dedac50-17f4-4338-83d1-c71fee498890 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074389 Oct 28 18:19:07.891351 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2106/3873] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:07.897281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:07.898039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:07.910585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.911011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.911468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.915992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.916486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.916934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.949058 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e HTTP/1.1 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2164efc4-61e1-437d-870f-98fbae5d329e'} Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:07.951504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:19:07.970407 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8b4c13ce-fc07-4fe6-8e96-2a3e0238b0a0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 404 len: 111 microversion: 2.1 time: 0.060467 Oct 28 18:19:07.973199 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2107/3874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:07 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:19:07.978941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:07.979565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:07.997634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.998142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.998594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.999321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.999790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:08.003063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:08.403977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:08.423005 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40d2899b-881c-4736-bfd9-ee002032fa49 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1522 microversion: 2.1 time: 0.446329 Oct 28 18:19:08.427952 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2108/3875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:07 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:08.441890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:08.442720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:08.453528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:08.454254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:08.455488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:08.456495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:08.457306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:08.458370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:08.879345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:08.889755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:08.895637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:08.905352 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a21ac1f-0409-447d-b0ff-1a6f0ce7b4e9 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1706 microversion: 2.42 time: 0.475749 Oct 28 18:19:08.905948 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2109/3876] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:08 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1706 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:08.929439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:08.930278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:08.937970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:08.938675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:08.939307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:08.940369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:08.941160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:08.941766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:08.969895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:19:08.977502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:09.109953 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a4de8c1-6e63-434b-b19f-b2cc0ab7ab3f tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 204 len: 0 microversion: 2.1 time: 0.188532 Oct 28 18:19:09.110700 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2110/3877] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:19:08 2022] DELETE /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:19:09.124236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-794498935", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "70c5abb7-d4bd-4b29-a58f-099ce9f71832"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:09.236103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] validate_networks() for [('70c5abb7-d4bd-4b29-a58f-099ce9f71832', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:19:09.691111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:09.748021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:10.047682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:19:10.049047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:19:10.049788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:19:10.050491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:19:10.051157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:19:10.078406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:10.081008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:10.081720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:10.082756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:10.083473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:10.084241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:10.106566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:19:10.114137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for user 84bb8a18e9264efbaef518e6a5ae0e32 and project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:19:10.159366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:19:10.166165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:19:10.307914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9517d7e-b323-4dfa-ac8d-1167c480d082 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189650 Oct 28 18:19:10.309671 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2111/3878] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:19:10.326567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:10.327561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:10.342778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:10.360287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:10.361042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:10.364752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:10.368695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:10.369214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:10.710859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:10.721553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8dd7f0af-3230-48ac-9a9d-9c7b2bee101a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1322 microversion: 2.1 time: 0.409744 Oct 28 18:19:10.727349 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2112/3879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:10 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:10.745848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:10.747403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:10.769065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:10.771055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:10.774454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:10.775533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:10.778803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:10.781175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:11.335099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203b0141d9574732971db25586457f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17172ae3971e4810ac1f8afca2b8f8f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:11.353717 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c4c682f-e0a8-4871-8505-1f9998998774 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 200 len: 1517 microversion: 2.1 time: 0.624332 Oct 28 18:19:11.355095 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2113/3880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:10 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 1517 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:11.730147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-23e4cbdf-c7b1-4bdc-b827-7f550be44f3d tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Action: 'create', calling method: .version_select at 0x7f78de0fd4c0>, body: {"keypair": {"name": "tempest-keypair-851021345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG82ffeWisz2ucH3Rop0+iUvevO+tb9MG2uDALCvZEls+iTQ5GQLSeEQmvMyuB56Z9g3yZwTgOj8RgwNwUulYL4kEXZYwRzaZykPHeTLuhM1WaF+K6Owjay2lfC+0aZrKA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:11.850164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-23e4cbdf-c7b1-4bdc-b827-7f550be44f3d tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Getting quotas for project ff38b8a9be3b4011b9dd8e87cf6c7d15. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:19:11.900132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-23e4cbdf-c7b1-4bdc-b827-7f550be44f3d tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Getting quotas for user cea8b13fa210445baa6f6b76e930e6a3 and project ff38b8a9be3b4011b9dd8e87cf6c7d15. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:19:11.928585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:11.964827 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-23e4cbdf-c7b1-4bdc-b827-7f550be44f3d tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.608196 Oct 28 18:19:11.977318 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2114/3881] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:19:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:11.985896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:11.989186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:12.008076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:12.013530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:12.016394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:12.017761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:12.018391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:12.019971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:13.036893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:13.050789 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7d526510-ba2d-42d9-bf07-d5b33e492f26 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1522 microversion: 2.1 time: 1.071242 Oct 28 18:19:13.054442 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2115/3882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:11 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1522 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:13.218684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-382b1761-9324-4210-af71-29df15e8abfa req-ff943787-0116-46f4-8f45-793e42169096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce795a9-e731-4e75-8e78-7d756f17ba80", "tag": "992d9d58-181c-4500-a14d-21b430851087"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:13.237948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-382b1761-9324-4210-af71-29df15e8abfa req-ff943787-0116-46f4-8f45-793e42169096 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:13.246124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-382b1761-9324-4210-af71-29df15e8abfa req-ff943787-0116-46f4-8f45-793e42169096 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:13.248869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-382b1761-9324-4210-af71-29df15e8abfa req-ff943787-0116-46f4-8f45-793e42169096 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:13.276145 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-382b1761-9324-4210-af71-29df15e8abfa req-ff943787-0116-46f4-8f45-793e42169096 service nova] Creating event network-changed:992d9d58-181c-4500-a14d-21b430851087 for instance dce795a9-e731-4e75-8e78-7d756f17ba80 on n-h1-862404-2 Oct 28 18:19:13.286775 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-382b1761-9324-4210-af71-29df15e8abfa req-ff943787-0116-46f4-8f45-793e42169096 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230084 Oct 28 18:19:13.288784 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2116/3883] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:13.297949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-25afc644-7a0c-46bc-8026-7bca7cea955a req-a3a129eb-2a79-4eb6-9051-47f7ea13c3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2164efc4-61e1-437d-870f-98fbae5d329e", "name": "network-vif-deleted", "tag": "e677cb09-2070-4c19-a8c5-c0c6ad01a11d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:13.328749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25afc644-7a0c-46bc-8026-7bca7cea955a req-a3a129eb-2a79-4eb6-9051-47f7ea13c3d2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:13.329646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25afc644-7a0c-46bc-8026-7bca7cea955a req-a3a129eb-2a79-4eb6-9051-47f7ea13c3d2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:13.330321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25afc644-7a0c-46bc-8026-7bca7cea955a req-a3a129eb-2a79-4eb6-9051-47f7ea13c3d2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:13.354897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.server_external_events [req-25afc644-7a0c-46bc-8026-7bca7cea955a req-a3a129eb-2a79-4eb6-9051-47f7ea13c3d2 service nova] Unable to find a host for instance 2164efc4-61e1-437d-870f-98fbae5d329e. Dropping event network-vif-deleted {{(pid=120680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 18:19:13.360298 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-25afc644-7a0c-46bc-8026-7bca7cea955a req-a3a129eb-2a79-4eb6-9051-47f7ea13c3d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.067153 Oct 28 18:19:13.361202 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2117/3884] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 18:19:13.380226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:13.384436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:13.402299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:13.407408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:13.408099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:13.408967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:13.410504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:13.416926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:13.895352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:13.920878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:13.924275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:13.928408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2dec194-d877-421c-9975-dd6cb74e9939 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1798 microversion: 2.42 time: 0.563997 Oct 28 18:19:13.933795 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2118/3885] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:13 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1798 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:13.943888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:13.945729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:13.963297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:13.964178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:13.965901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:13.968395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:13.970331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:13.972503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:14.161803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:14.184362 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce676e52-74f9-47df-8dc5-32e666a63dd2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1272 microversion: 2.1 time: 0.247977 Oct 28 18:19:14.195236 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2119/3886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:13 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:14.213718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:14.214583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:14.231056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:14.233913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:14.234449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:14.235206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:14.258330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:14.258900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:15.056841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:15.068521 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e694b4d-f5e3-4d02-849a-13d35c681b30 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1322 microversion: 2.1 time: 0.867138 Oct 28 18:19:15.070686 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2120/3887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:14 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1322 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:15.082154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:15.084564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] [instance: 9d7e9fed-6ab0-496b-b537-02fa9be99935] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:15.108522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:15.109335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:15.110934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:15.112204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:15.113479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:15.113932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:15.150423 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] HTTP exception thrown: Instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 could not be found. Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Request method failure captured: Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 HTTP/1.1 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBysKIOju90GpHXckvVPH4lRGftBAlJOcr_JbPypfYnHfrJbbd_YSYfahVYOTw6Lymp3-5L-7MtsFYKHSHEriwZ-Y1gU18p9MnDhBYyv-rPMhlAl6UJ-FR7mGZodF-D7DSzppPem2FZyqhrlVzD_7NezrDSPiPfSkPrvi41y0CNBHlI Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 17172ae3971e4810ac1f8afca2b8f8f6 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_17172ae3971e4810ac1f8afca2b8f8f6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/17172ae3971e4810ac1f8afca2b8f8f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 17172ae3971e4810ac1f8afca2b8f8f6 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-365964503 Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ListServerFiltersTestJSON-365964503-project Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 203b0141d9574732971db25586457f8c Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ListServerFiltersTestJSON-365964503-project Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 could not be found. Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '9d7e9fed-6ab0-496b-b537-02fa9be99935'} Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 could not be found. Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 could not be found. Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:15.155017 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:15.160640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:15.160640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:15.160640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:15.160640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:19:15.160640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:19:15.160640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 could not be found. Oct 28 18:19:15.160640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:15.161236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] Returning 404 to user: Instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:19:15.162197 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee74d054-3c00-4e9e-ad6e-1552a0368fc6 tempest-ListServerFiltersTestJSON-365964503 tempest-ListServerFiltersTestJSON-365964503-project] 10.222.0.16 "GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935" status: 404 len: 111 microversion: 2.1 time: 0.089117 Oct 28 18:19:15.167146 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2121/3888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:15 2022] GET /compute/v2.1/servers/9d7e9fed-6ab0-496b-b537-02fa9be99935 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:19:15.177528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:15.179693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:15.190586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:15.195288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:15.198175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:15.198175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:15.198175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:15.198175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:16.281051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:16.295032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f7cad961-35ba-4f60-9a9a-6e63e8fbed8b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1522 microversion: 2.1 time: 1.128562 Oct 28 18:19:16.295410 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2122/3889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:15 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1522 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:16.319902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:16.320980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:16.333421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:16.347666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:16.348593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:16.349532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:16.350167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:16.350769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:16.815068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:16.847695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:16.867354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:16.869211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-edaab8b2-b4a3-42ee-9c08-918beaefcc43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1844 microversion: 2.42 time: 0.572504 Oct 28 18:19:16.874379 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2123/3890] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:16 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1844 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:16.880133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:16.881354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:16.891552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:16.892831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:16.893541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:16.895118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:16.895868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:16.896526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:17.295180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:17.315494 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07be7ed6-7fbe-4a37-85ef-a27ff89d3fd3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1314 microversion: 2.1 time: 0.436919 Oct 28 18:19:17.317787 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2124/3891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:16 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:17.332983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a84a186c-e68f-4dec-827b-7e861510b604 req-5aa0560a-b617-4be2-8cfa-b53ced929141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7e9fed-6ab0-496b-b537-02fa9be99935", "name": "network-vif-deleted", "tag": "c32a0d9d-8272-4689-8881-9411b9e4d880"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:17.391355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a84a186c-e68f-4dec-827b-7e861510b604 req-5aa0560a-b617-4be2-8cfa-b53ced929141 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:17.392743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a84a186c-e68f-4dec-827b-7e861510b604 req-5aa0560a-b617-4be2-8cfa-b53ced929141 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:17.393384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a84a186c-e68f-4dec-827b-7e861510b604 req-5aa0560a-b617-4be2-8cfa-b53ced929141 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:17.439912 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a84a186c-e68f-4dec-827b-7e861510b604 req-5aa0560a-b617-4be2-8cfa-b53ced929141 service nova] Creating event network-vif-deleted:c32a0d9d-8272-4689-8881-9411b9e4d880 for instance 9d7e9fed-6ab0-496b-b537-02fa9be99935 on n-h1-862404-2 Oct 28 18:19:17.454132 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a84a186c-e68f-4dec-827b-7e861510b604 req-5aa0560a-b617-4be2-8cfa-b53ced929141 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134459 Oct 28 18:19:17.462173 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2125/3892] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:17.478305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:17.480285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:17.489598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:17.490973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:17.491862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:17.493171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:17.494680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:17.495392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:18.259065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:18.273485 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a65fe3f5-8cdb-4735-b925-37bd189f21ff tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1322 microversion: 2.1 time: 0.808553 Oct 28 18:19:18.292533 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2126/3893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:17 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1322 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:18.300607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:18.301291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:18.316953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:18.318989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:18.320686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:18.323202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:18.323791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:18.325445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:18.692884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:18.704649 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d531da6-2b75-4bd5-acfe-275ef6ba0da6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1522 microversion: 2.1 time: 0.410324 Oct 28 18:19:18.721232 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2127/3894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:18 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:18.732987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:18.733613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:18.765470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:18.766169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:18.766803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:18.767758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:18.768492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:18.769132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:19.161235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:19.179638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:19.183615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:19.187617 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1fadacd9-f123-40af-b6d7-fa6a9c87cb60 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1844 microversion: 2.42 time: 0.465241 Oct 28 18:19:19.194848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2128/3895] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:18 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1844 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:19.201725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:19.204850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:19.219757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:19.221760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:19.223265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:19.225356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:19.226109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:19.226759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:19.722525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:19.739008 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3efc8a98-70e0-4a90-948d-af92cc951d8d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1314 microversion: 2.1 time: 0.544734 Oct 28 18:19:19.739681 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2129/3896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:19 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:19.764421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d3381afd-0b5a-489b-acf1-994083278cba req-dd4e3bed-2dff-4ada-af95-9c6ee0f24433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce795a9-e731-4e75-8e78-7d756f17ba80", "name": "network-vif-plugged", "status": "completed", "tag": "992d9d58-181c-4500-a14d-21b430851087"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:19.796675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d3381afd-0b5a-489b-acf1-994083278cba req-dd4e3bed-2dff-4ada-af95-9c6ee0f24433 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:19.797170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d3381afd-0b5a-489b-acf1-994083278cba req-dd4e3bed-2dff-4ada-af95-9c6ee0f24433 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:19.797615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d3381afd-0b5a-489b-acf1-994083278cba req-dd4e3bed-2dff-4ada-af95-9c6ee0f24433 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:19.811532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:19.828025 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d3381afd-0b5a-489b-acf1-994083278cba req-dd4e3bed-2dff-4ada-af95-9c6ee0f24433 service nova] Creating event network-vif-plugged:992d9d58-181c-4500-a14d-21b430851087 for instance dce795a9-e731-4e75-8e78-7d756f17ba80 on n-h1-862404-2 Oct 28 18:19:19.845201 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d3381afd-0b5a-489b-acf1-994083278cba req-dd4e3bed-2dff-4ada-af95-9c6ee0f24433 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103178 Oct 28 18:19:19.847499 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2130/3897] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:19.878052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:19.890515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:19.916318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:19.918590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:19.919511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:19.921915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:19.932668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:19.935533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:20.098447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:20.361675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:20.378354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef078152-6767-4976-b5e9-ed0a39fc05a8 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1322 microversion: 2.1 time: 0.516450 Oct 28 18:19:20.380971 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2131/3898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:19 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:20.388693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-328496859", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3401849d-5dbb-4148-96ae-cc4f3ee3ceeb"}], "security_groups": [{"name": "tempest-securitygroup--917134815"}], "key_name": "tempest-keypair-851021345", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:20.545520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] validate_networks() for [('3401849d-5dbb-4148-96ae-cc4f3ee3ceeb', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:19:21.881154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Getting quotas for project ff38b8a9be3b4011b9dd8e87cf6c7d15. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:19:21.909057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Getting quotas for user cea8b13fa210445baa6f6b76e930e6a3 and project ff38b8a9be3b4011b9dd8e87cf6c7d15. Resources: dict_keys(['metadata_items']) {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:19:21.961540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:19:21.963992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:19:21.967209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:19:21.968032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:19:21.969652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:19:21.999072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:22.000777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:22.001776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:22.003801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:22.005632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:22.008192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:22.084955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Getting quotas for project ff38b8a9be3b4011b9dd8e87cf6c7d15. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:19:22.094016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Getting quotas for user cea8b13fa210445baa6f6b76e930e6a3 and project ff38b8a9be3b4011b9dd8e87cf6c7d15. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:19:22.128340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:19:22.139889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:19:22.279312 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c4134c85-fc34-46dd-9759-3d3286372589 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.896415 Oct 28 18:19:22.288842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2132/3899] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:19:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:19:22.294773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:22.295423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:22.320894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:22.321677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:22.322341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:22.325329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:22.327347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:22.328677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:22.808850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:22.822914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-321359ba-f1ab-4200-95b4-8b871e363ab9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1522 microversion: 2.1 time: 0.536736 Oct 28 18:19:22.823664 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2133/3900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:22 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:22.844067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6298727c-a499-4232-815a-81aca3fabddc req-1d10476b-cfde-4a7b-b829-035ef2e7da15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1fd814-42d1-4740-ab93-b0667a11bd4d", "tag": "a0667783-8a04-4752-bc96-adb6beb40efe"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:22.868448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6298727c-a499-4232-815a-81aca3fabddc req-1d10476b-cfde-4a7b-b829-035ef2e7da15 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:22.868972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6298727c-a499-4232-815a-81aca3fabddc req-1d10476b-cfde-4a7b-b829-035ef2e7da15 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:22.873868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6298727c-a499-4232-815a-81aca3fabddc req-1d10476b-cfde-4a7b-b829-035ef2e7da15 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:22.904874 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6298727c-a499-4232-815a-81aca3fabddc req-1d10476b-cfde-4a7b-b829-035ef2e7da15 service nova] Creating event network-changed:a0667783-8a04-4752-bc96-adb6beb40efe for instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d on n-h2-862404-2 Oct 28 18:19:22.923183 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6298727c-a499-4232-815a-81aca3fabddc req-1d10476b-cfde-4a7b-b829-035ef2e7da15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094082 Oct 28 18:19:22.926677 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2134/3901] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:22.936901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3e391636-e43e-4134-857d-2de9556db27d req-fbe083ed-383f-4b27-8437-fb9843d1cae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "tag": "98221312-7849-4682-b29b-3081bd5426a5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:22.954184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3e391636-e43e-4134-857d-2de9556db27d req-fbe083ed-383f-4b27-8437-fb9843d1cae2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:22.954947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3e391636-e43e-4134-857d-2de9556db27d req-fbe083ed-383f-4b27-8437-fb9843d1cae2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:22.955970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3e391636-e43e-4134-857d-2de9556db27d req-fbe083ed-383f-4b27-8437-fb9843d1cae2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:22.973441 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3e391636-e43e-4134-857d-2de9556db27d req-fbe083ed-383f-4b27-8437-fb9843d1cae2 service nova] Creating event network-changed:98221312-7849-4682-b29b-3081bd5426a5 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:19:22.983036 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3e391636-e43e-4134-857d-2de9556db27d req-fbe083ed-383f-4b27-8437-fb9843d1cae2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052658 Oct 28 18:19:22.984397 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2135/3902] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:22.997431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:22.999082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:23.008869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:23.009741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:23.010554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:23.011883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:23.013266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:23.014060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:24.315943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:24.359028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:24.363020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:24.367244 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f63e2f5-9ffa-4f3e-9988-3ad365b29f3d tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1886 microversion: 2.42 time: 1.381405 Oct 28 18:19:24.374404 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2136/3903] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:22 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1886 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:24.411861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:24.412945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:24.432121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:24.433293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:24.435030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:24.438603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:24.439336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:24.443468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:24.992579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:25.004634 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b7fdb06c-a6e6-488d-8e76-579153b3c104 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1314 microversion: 2.1 time: 0.604749 Oct 28 18:19:25.005981 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2137/3904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:24 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:25.015552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:25.017128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:25.025621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:25.027394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:25.028175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:25.030029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:25.030841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:25.031718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:25.514127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:25.532720 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26559183-dcc5-4009-bf7f-8fabf303b00c tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1516 microversion: 2.1 time: 0.525031 Oct 28 18:19:25.533341 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2138/3905] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:25 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1516 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:25.538164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:25.539140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:25.559459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:25.560206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:25.560834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:25.561974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:25.562340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:25.562771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:25.976199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:25.988485 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0672af2a-a062-449c-a2f4-6cb42e5e07f9 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1334 microversion: 2.1 time: 0.451665 Oct 28 18:19:25.989131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2139/3906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:25 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1334 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:26.002454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:26.017278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:26.034488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:26.047592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:26.048384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:26.049342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:26.051094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:26.051836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:26.469153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:26.478135 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b29ec48f-618b-4a8b-a824-30f9a3616159 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1522 microversion: 2.1 time: 0.482441 Oct 28 18:19:26.478800 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2140/3907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:25 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:26.499606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7cfe7275-a76f-4172-88a5-1a38f3414d59 req-0950406f-47ca-4d31-8859-191919c4e042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "tag": "f6faaf47-a79d-4a83-8673-436e23fd58c2"}, {"name": "network-changed", "server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "tag": "9d47d85a-5cef-4716-bd46-75acc348c1ba"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:26.514110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7cfe7275-a76f-4172-88a5-1a38f3414d59 req-0950406f-47ca-4d31-8859-191919c4e042 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:26.515159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7cfe7275-a76f-4172-88a5-1a38f3414d59 req-0950406f-47ca-4d31-8859-191919c4e042 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:26.537391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7cfe7275-a76f-4172-88a5-1a38f3414d59 req-0950406f-47ca-4d31-8859-191919c4e042 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:26.571068 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7cfe7275-a76f-4172-88a5-1a38f3414d59 req-0950406f-47ca-4d31-8859-191919c4e042 service nova] Creating event network-changed:f6faaf47-a79d-4a83-8673-436e23fd58c2 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:19:26.571627 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7cfe7275-a76f-4172-88a5-1a38f3414d59 req-0950406f-47ca-4d31-8859-191919c4e042 service nova] Creating event network-changed:9d47d85a-5cef-4716-bd46-75acc348c1ba for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:19:26.599116 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7cfe7275-a76f-4172-88a5-1a38f3414d59 req-0950406f-47ca-4d31-8859-191919c4e042 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118678 Oct 28 18:19:26.601949 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2141/3908] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:26.619779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:26.621662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:26.635926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:26.636425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:26.637122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:26.649704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:26.650240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:26.650694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:28.042399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:28.059178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:28.063113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:28.064823 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c7d2741-0d5a-48ab-82a9-7c04536781a4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1886 microversion: 2.42 time: 1.461708 Oct 28 18:19:28.066087 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2142/3909] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:26 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1886 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:28.080360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:28.083223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:28.095626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:28.096618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:28.100820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:28.102184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:28.102920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:28.103611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:28.156510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lazy-loading 'flavor' on Instance uuid dce795a9-e731-4e75-8e78-7d756f17ba80 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:19:28.325526 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c722635-2960-414c-b2b2-2f9c3922170b tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action" status: 200 len: 32 microversion: 2.1 time: 0.256319 Oct 28 18:19:28.331558 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2143/3910] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:28 2022] POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:19:28.345638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-99416efa-a0d6-4e4c-bd9f-a810fa07b603 req-efcd158b-f051-487c-ab46-9bcd20284d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1fd814-42d1-4740-ab93-b0667a11bd4d", "name": "network-vif-plugged", "status": "completed", "tag": "a0667783-8a04-4752-bc96-adb6beb40efe"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:28.377402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-99416efa-a0d6-4e4c-bd9f-a810fa07b603 req-efcd158b-f051-487c-ab46-9bcd20284d93 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:28.382084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-99416efa-a0d6-4e4c-bd9f-a810fa07b603 req-efcd158b-f051-487c-ab46-9bcd20284d93 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:28.382728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-99416efa-a0d6-4e4c-bd9f-a810fa07b603 req-efcd158b-f051-487c-ab46-9bcd20284d93 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:28.429722 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-99416efa-a0d6-4e4c-bd9f-a810fa07b603 req-efcd158b-f051-487c-ab46-9bcd20284d93 service nova] Creating event network-vif-plugged:a0667783-8a04-4752-bc96-adb6beb40efe for instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d on n-h2-862404-2 Oct 28 18:19:28.457304 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-99416efa-a0d6-4e4c-bd9f-a810fa07b603 req-efcd158b-f051-487c-ab46-9bcd20284d93 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122414 Oct 28 18:19:28.460813 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2144/3911] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:28.474956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:28.485474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:28.495972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:28.502693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:28.503428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:28.505658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:28.506786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:28.508465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:29.729531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:29.738522 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe72fd76-584c-4f1c-9dae-250967fcc8bd tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1314 microversion: 2.1 time: 1.276009 Oct 28 18:19:29.742506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2145/3912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:28 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1314 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:29.757239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:29.763297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:29.777887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:29.783189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:29.784039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:29.785063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:29.785799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:29.786485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:30.424443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:30.436381 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab6df2ea-dd01-4126-89a1-6ede968fc660 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1401 microversion: 2.1 time: 0.685805 Oct 28 18:19:30.437723 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2146/3913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:29 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1401 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:30.448043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:30.455704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:30.474739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:30.487537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:30.488495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:30.489738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:30.497552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:30.498298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:31.328504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:31.343120 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32693d4c-b77e-4799-800b-94cfe21812af tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1522 microversion: 2.1 time: 0.900893 Oct 28 18:19:31.345039 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2147/3914] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:30 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1522 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:31.359336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:31.360164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:31.373661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:31.374173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:31.374620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:31.376737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:31.378444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:31.380475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:32.038174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:32.114056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=20 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:32.207935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:32.220435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:32.230648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-762aba4e-d4cb-4fbf-ba2b-038a5ae747d2 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.884231 Oct 28 18:19:32.240581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2148/3915] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:31 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:32.256536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:32.257910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:32.274056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:32.274576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:32.275707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:32.277424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:32.277915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:32.278345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:32.666036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:32.677871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:32.679851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:32.681368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0ac1bdc-7a3a-49a2-a178-68271d1e6acf tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1886 microversion: 2.42 time: 0.439797 Oct 28 18:19:32.682138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2149/3916] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:32 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1886 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:32.702017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4f4a63de-4633-4a25-90ce-252e1fa2aebe req-3b3f6be5-2b9e-4186-9336-866fbc38ee97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "tag": "b3f16ee9-aa1b-4bfe-ab8f-58f3ae67670d"}, {"name": "network-changed", "server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "tag": "03e8b09a-848b-412a-8be4-c81f0cfb8232"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:32.719983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f4a63de-4633-4a25-90ce-252e1fa2aebe req-3b3f6be5-2b9e-4186-9336-866fbc38ee97 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:32.720466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f4a63de-4633-4a25-90ce-252e1fa2aebe req-3b3f6be5-2b9e-4186-9336-866fbc38ee97 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:32.720900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f4a63de-4633-4a25-90ce-252e1fa2aebe req-3b3f6be5-2b9e-4186-9336-866fbc38ee97 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:32.733286 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4f4a63de-4633-4a25-90ce-252e1fa2aebe req-3b3f6be5-2b9e-4186-9336-866fbc38ee97 service nova] Creating event network-changed:b3f16ee9-aa1b-4bfe-ab8f-58f3ae67670d for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:19:32.733801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4f4a63de-4633-4a25-90ce-252e1fa2aebe req-3b3f6be5-2b9e-4186-9336-866fbc38ee97 service nova] Creating event network-changed:03e8b09a-848b-412a-8be4-c81f0cfb8232 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:19:32.739021 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4f4a63de-4633-4a25-90ce-252e1fa2aebe req-3b3f6be5-2b9e-4186-9336-866fbc38ee97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041465 Oct 28 18:19:32.739640 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2150/3917] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:32.746582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:32.747478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:32.753399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:32.754992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:32.755671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:32.756383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:32.757377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:32.758069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:32.758669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:33.022086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:33.031707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00716e4e-143d-4ae6-a573-1b3c831a1dec tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1501 microversion: 2.1 time: 0.290672 Oct 28 18:19:33.065896 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2151/3918] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:32 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:33.073710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:33.075406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:33.084443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:33.085316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:33.085766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:33.086494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:33.086954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:33.087451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:33.449477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:33.457376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51e2fc6b-1037-463a-bd06-4e1eb45efd10 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1401 microversion: 2.1 time: 0.390029 Oct 28 18:19:33.458411 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2152/3919] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:33 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1401 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:33.478978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:33.479902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:33.486858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:33.487630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:33.488301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:33.489196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:33.489824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:33.490426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:33.910420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:33.919905 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34d31381-1bfd-4fc8-8bfa-ce12e9e47104 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1502 microversion: 2.1 time: 0.446388 Oct 28 18:19:33.920511 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2153/3920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:33 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1502 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:33.937803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6c953b2-d0c4-4f9f-a6b4-aabca4ed847c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:33.944632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6c953b2-d0c4-4f9f-a6b4-aabca4ed847c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:33.945126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6c953b2-d0c4-4f9f-a6b4-aabca4ed847c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:33.945674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6c953b2-d0c4-4f9f-a6b4-aabca4ed847c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:34.001552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6c953b2-d0c4-4f9f-a6b4-aabca4ed847c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:19:34.093730 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6c953b2-d0c4-4f9f-a6b4-aabca4ed847c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.171571 Oct 28 18:19:34.095235 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2154/3921] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:33 2022] POST /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:19:34.120353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:34.125944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:34.133775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:34.134447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:34.135160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:34.136208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:34.137000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:34.137795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:34.423329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:34.442217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-493e6ecd-9106-480e-be1b-3bd4176706fa tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.332117 Oct 28 18:19:34.456073 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2155/3922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:34 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:34.467285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:34.467939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:34.474663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:34.475454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:34.476133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:34.477021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:34.477693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:34.478389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:34.746710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:34.805499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:34.810936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:34.814639 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a9bde03-324f-4d9a-a64b-644b098d4b91 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.355964 Oct 28 18:19:34.815761 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2156/3923] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:34 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:34.821995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:34.823082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:34.834296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:34.835347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:34.856533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:34.857358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:34.857855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:34.858305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:35.129849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:35.141220 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-631d0a10-d7e1-475b-825e-2cb6a1cc592e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1515 microversion: 2.1 time: 0.323967 Oct 28 18:19:35.142109 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2157/3924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:34 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1515 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:35.147204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:35.148436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:35.157158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:35.158448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:35.158981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:35.160085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:35.160631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:35.161288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:35.448182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:35.463529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe7a4dc5-5171-46d7-9e31-aa63e4b051b7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.320163 Oct 28 18:19:35.468393 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2158/3925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:35 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:35.474758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:35.475631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:35.483889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:35.484425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:35.484868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:35.485584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:35.486049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:35.486478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:35.847422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:35.890994 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7dcc9662-55ab-41cd-8ef8-443dbf3253e0 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1401 microversion: 2.1 time: 0.419512 Oct 28 18:19:35.903271 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2159/3926] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:35 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1401 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:35.913638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6af34df9-2633-4203-99aa-a1beab2a343d req-6e1223e1-d3c1-47fe-ab5f-1cddcb420bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf96e27-7b5e-49a2-ad6b-890c5d9414e0", "tag": "783e50a9-3c23-4025-bbc5-86393fd2b19d"}, {"name": "network-changed", "server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "tag": "6286b241-00fe-4b70-9042-5ad2ecad758c"}, {"name": "network-changed", "server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "tag": "aba7f5c0-e589-4ffc-8505-f1d44a018e7d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:35.945507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6af34df9-2633-4203-99aa-a1beab2a343d req-6e1223e1-d3c1-47fe-ab5f-1cddcb420bf2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:35.949572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6af34df9-2633-4203-99aa-a1beab2a343d req-6e1223e1-d3c1-47fe-ab5f-1cddcb420bf2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:35.952885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6af34df9-2633-4203-99aa-a1beab2a343d req-6e1223e1-d3c1-47fe-ab5f-1cddcb420bf2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:35.985570 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6af34df9-2633-4203-99aa-a1beab2a343d req-6e1223e1-d3c1-47fe-ab5f-1cddcb420bf2 service nova] Creating event network-changed:783e50a9-3c23-4025-bbc5-86393fd2b19d for instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 on n-h1-862404-2 Oct 28 18:19:35.986091 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6af34df9-2633-4203-99aa-a1beab2a343d req-6e1223e1-d3c1-47fe-ab5f-1cddcb420bf2 service nova] Creating event network-changed:6286b241-00fe-4b70-9042-5ad2ecad758c for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:19:35.986602 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6af34df9-2633-4203-99aa-a1beab2a343d req-6e1223e1-d3c1-47fe-ab5f-1cddcb420bf2 service nova] Creating event network-changed:aba7f5c0-e589-4ffc-8505-f1d44a018e7d for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:19:35.996035 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6af34df9-2633-4203-99aa-a1beab2a343d req-6e1223e1-d3c1-47fe-ab5f-1cddcb420bf2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.089751 Oct 28 18:19:35.996841 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2160/3927] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:36.004284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-137a437c-2f18-45ee-9a42-d3eeb1b40f3a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:36.007443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-137a437c-2f18-45ee-9a42-d3eeb1b40f3a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:36.015003 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-137a437c-2f18-45ee-9a42-d3eeb1b40f3a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Instance b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b could not be found. Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-137a437c-2f18-45ee-9a42-d3eeb1b40f3a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b/action HTTP/1.1 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 14 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: {"rescue": {}} Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b could not be found. Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b', 'body': {'rescue': {}}} Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b could not be found. Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b could not be found. Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:36.026813 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b could not be found. Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-137a437c-2f18-45ee-9a42-d3eeb1b40f3a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 404 to user: Instance b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-137a437c-2f18-45ee-9a42-d3eeb1b40f3a tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b/action" status: 404 len: 111 microversion: 2.1 time: 0.031719 Oct 28 18:19:36.034944 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2161/3928] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:35 2022] POST /compute/v2.1/servers/b5638a0f-6bbc-4a6e-9eaa-3e3678ab7c7b/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:19:36.039205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:36.042539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:36.056530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:36.061485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:36.062150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:36.068963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:36.069695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:36.070491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:36.842603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:36.878630 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b773892c-f616-40f0-b978-7b33c2b883bb tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.844230 Oct 28 18:19:36.880548 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2162/3929] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:36 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:36.901038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:36.901959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:36.915068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:36.916202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:36.918565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:36.920467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:36.923338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:36.924121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:37.436760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:37.446631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:37.449859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:37.451339 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-447d7dcc-f589-4869-a5ac-894625685142 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.566946 Oct 28 18:19:37.468304 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2163/3930] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:36 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:37.481983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:37.482926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:37.504922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:37.505677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:37.507119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:37.509965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:37.510671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:37.511491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:37.616194 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4ad4c91-cf08-4e15-b7b2-3d08de2a75c2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action" status: 202 len: 0 microversion: 2.1 time: 0.145656 Oct 28 18:19:37.623316 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2164/3931] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:37 2022] POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:19:37.629424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:37.630499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:37.646162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:37.646975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:37.647458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:37.649228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:37.649964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:37.650567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:37.927531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:37.934530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:37.946106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dee3cb4b-52b3-4ad9-8703-703eb0096509 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.320886 Oct 28 18:19:37.961162 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2165/3932] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:37 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:37.972808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:37.974007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:37.982842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:37.983745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:37.984491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:37.985880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:37.986673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:37.987386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:38.399241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:38.412614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77adf8a4-ddff-43d9-9450-a938457aacc5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1401 microversion: 2.1 time: 0.450001 Oct 28 18:19:38.413616 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2166/3933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:37 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1401 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:38.693909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-640088838", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "54c4af72-15f5-4d9a-ac13-285c94717e7d"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:38.799724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] validate_networks() for [('54c4af72-15f5-4d9a-ac13-285c94717e7d', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:19:39.647155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:19:39.647751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:19:39.648085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:19:39.648505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:19:39.649030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:19:39.673817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:39.674330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:39.674779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:39.675710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:39.676370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:39.676979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:39.723401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Getting quotas for project de631944ce47488f903028dc0d54f282. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:19:39.741967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Getting quotas for user 2367b2d496d84c169c4d24c9a2bed7c2 and project de631944ce47488f903028dc0d54f282. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:19:39.786499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:19:39.795721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:19:39.877435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf30563f-d7fe-4627-a8d5-cca58917ebe1 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462568 Oct 28 18:19:39.878736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2167/3934] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:19:39.885605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:39.887220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:39.895331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:39.896332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:39.897020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:39.897911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:39.898735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:39.899916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:40.347609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:40.355985 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9bbcd106-dbcc-400e-b3dc-73adbac97fc9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1500 microversion: 2.1 time: 0.475701 Oct 28 18:19:40.356592 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2168/3935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:39 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1500 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:40.361605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:40.362412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:40.368759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:40.369502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:40.370115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:40.371060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:40.371686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:40.372304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:40.587515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:40.602322 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d0d4ea6-d6aa-400b-8b2a-cc64e17242df tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.243620 Oct 28 18:19:40.605394 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2169/3936] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:40 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:40.629159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:40.630253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:40.642769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:40.643666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:40.644509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:40.645404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:40.646037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:40.646674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:41.035391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:41.066540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:41.069210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:41.070929 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c2e0c6b-7f0f-485d-b93e-98dccc56f7d3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.464175 Oct 28 18:19:41.093844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2170/3937] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:40 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:41.100184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:41.100885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:41.111221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:41.111706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:41.112183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:41.112901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:41.113356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:41.113778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:41.415760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:41.431770 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0dad390d-1434-409a-815f-b8e66a13d8d3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.334755 Oct 28 18:19:41.432457 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2171/3938] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:41 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:41.445950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-03c48c0a-c6e9-42b5-8c97-83d180521656 req-fb38c99c-5d7e-4a0f-b797-212b73500d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf96e27-7b5e-49a2-ad6b-890c5d9414e0", "name": "network-vif-plugged", "status": "completed", "tag": "783e50a9-3c23-4025-bbc5-86393fd2b19d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:41.465574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-03c48c0a-c6e9-42b5-8c97-83d180521656 req-fb38c99c-5d7e-4a0f-b797-212b73500d3a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:41.466060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-03c48c0a-c6e9-42b5-8c97-83d180521656 req-fb38c99c-5d7e-4a0f-b797-212b73500d3a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:41.466557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-03c48c0a-c6e9-42b5-8c97-83d180521656 req-fb38c99c-5d7e-4a0f-b797-212b73500d3a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:41.493523 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-03c48c0a-c6e9-42b5-8c97-83d180521656 req-fb38c99c-5d7e-4a0f-b797-212b73500d3a service nova] Creating event network-vif-plugged:783e50a9-3c23-4025-bbc5-86393fd2b19d for instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 on n-h1-862404-2 Oct 28 18:19:41.509546 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-03c48c0a-c6e9-42b5-8c97-83d180521656 req-fb38c99c-5d7e-4a0f-b797-212b73500d3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073716 Oct 28 18:19:41.510773 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2172/3939] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:41.529872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:41.530889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:41.540448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:41.541477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:41.542294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:41.544317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:41.545163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:41.545973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:42.507757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:42.516109 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c14bc85-9534-4f4a-90cf-28ed44b647ab tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1401 microversion: 2.1 time: 1.003798 Oct 28 18:19:42.516709 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2173/3940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:41 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1401 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:42.521338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:42.522179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:42.528519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:42.529249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:42.529881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:42.530772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:42.531403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:42.532028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:42.660514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367b2d496d84c169c4d24c9a2bed7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de631944ce47488f903028dc0d54f282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:42.671250 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c53789c-c013-4c86-93d9-5c8db419ed54 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77" status: 200 len: 1274 microversion: 2.1 time: 0.153364 Oct 28 18:19:42.672421 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2174/3941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:42 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:42.678518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:42.683968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:42.693749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:42.694300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:42.694749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:42.705165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:42.708172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:42.708879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:42.737260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lazy-loading 'flavor' on Instance uuid f57a499d-80c7-4ac5-88fb-07b9192dc6a0 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:19:42.752617 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Cannot 'rescue' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state paused Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action HTTP/1.1 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 14 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: {"rescue": {}} Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot 'rescue' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state paused Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f57a499d-80c7-4ac5-88fb-07b9192dc6a0', 'body': {'rescue': {}}} Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 in vm_state paused. Cannot rescue while the instance is in this state. Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state paused Oct 28 18:19:42.754793 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state paused Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 409 to user: Cannot 'rescue' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state paused {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a81b56f7-a8e5-492c-abba-a24243f91c54 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action" status: 409 len: 144 microversion: 2.1 time: 0.082241 Oct 28 18:19:42.762695 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2175/3942] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:42 2022] POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action => generated 144 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:19:42.768409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:42.769138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:42.776703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:42.777711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:42.778251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:42.779041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:42.779576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:42.780141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:43.142391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:43.155981 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-14e8f399-f273-4cee-a920-6464d489b897 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.392624 Oct 28 18:19:43.172441 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2176/3943] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:42 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:43.180425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:43.181356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:43.189256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:43.190080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:43.190746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:43.191677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:43.192485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:43.193126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:43.687919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:43.700425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:43.702182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:43.703454 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be9a2c9d-b21f-4ae4-8fb0-d2264eb3c914 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.529592 Oct 28 18:19:43.704068 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2177/3944] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:43 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:43.731880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:43.733060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:43.748296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:43.749238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:43.749908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:43.751856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:43.752556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:43.753066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:44.085221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:44.091546 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab1fbb81-b300-4a14-a420-777278d29bce tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.364660 Oct 28 18:19:44.093178 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2178/3945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:43 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:44.109896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:44.111055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:44.118882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:44.119374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:44.120068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:44.122143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:44.122629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:44.123064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:44.225473 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4fed046-29f0-4f95-b83a-30391f29d571 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action" status: 202 len: 0 microversion: 2.1 time: 0.129460 Oct 28 18:19:44.230557 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2179/3946] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:44 2022] POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:19:44.237705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:44.238702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:44.248637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:44.249376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:44.250051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:44.250997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:44.252356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:44.253035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:44.717481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:44.730632 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7054700-061b-4c72-90c5-206931336478 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1401 microversion: 2.1 time: 0.498270 Oct 28 18:19:44.731967 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2180/3947] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:44 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1401 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:44.747473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:44.748458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:44.767248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:44.768062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:44.768738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:44.769724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:44.770411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:44.771067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:45.157297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367b2d496d84c169c4d24c9a2bed7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de631944ce47488f903028dc0d54f282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:45.165903 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86339ede-1c24-4756-b4f4-ba923665f726 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77" status: 200 len: 1316 microversion: 2.1 time: 0.430471 Oct 28 18:19:45.182463 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2181/3948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:44 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:45.182463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:45.182463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:45.193916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:45.194438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:45.194898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:45.195640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:45.196131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:45.199269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:45.495182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:45.500379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:45.512216 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5d4de0c-ab01-42b1-ba2a-21c2f7d538a1 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.340668 Oct 28 18:19:45.513867 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2182/3949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:45 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:45.520373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:45.521548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:45.531462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:45.532350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:45.533060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:45.534044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:45.534809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:45.535595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:45.799275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:45.829257 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0597d4e7-eb9d-4c34-bb6b-fd2087a937a2 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1515 microversion: 2.1 time: 0.313558 Oct 28 18:19:45.830318 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2183/3950] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:45 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:45.840319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:45.841259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:45.851914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:45.852692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:45.853133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:45.853843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:45.854497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:45.854929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:46.296558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:46.311630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:46.320418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:46.323520 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a11235df-2241-46b7-8c21-a2adb0ae767c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.491857 Oct 28 18:19:46.326147 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2184/3951] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:45 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:46.340744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:46.354663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:46.370713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:46.371496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:46.372214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:46.373740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:46.375267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:46.376061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:46.906053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:46.916564 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dd21d3b4-6ae3-47dd-898f-2c78b87c47db tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.588957 Oct 28 18:19:46.926375 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2185/3952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:46 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:46.932168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:46.934762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:46.951187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:46.953889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:46.956431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:46.957660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:46.958380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:46.959071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:47.325797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:47.341301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3f2273a-4e0c-4fd4-ad00-c27a8bcceaae tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1589 microversion: 2.1 time: 0.412803 Oct 28 18:19:47.342183 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2186/3953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:46 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1589 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:47.346959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-89714f3a-bfe9-4b0d-8e22-fe8e391d49e7 req-f9cee02d-a44e-49ac-bbca-0ec2097ad809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a9256eb-d868-4f7d-88ee-1cd5158d8d77", "tag": "84997fd6-e938-4e61-b348-43add7818817"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:47.368898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-89714f3a-bfe9-4b0d-8e22-fe8e391d49e7 req-f9cee02d-a44e-49ac-bbca-0ec2097ad809 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:47.369815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-89714f3a-bfe9-4b0d-8e22-fe8e391d49e7 req-f9cee02d-a44e-49ac-bbca-0ec2097ad809 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:47.370433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-89714f3a-bfe9-4b0d-8e22-fe8e391d49e7 req-f9cee02d-a44e-49ac-bbca-0ec2097ad809 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:47.395040 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-89714f3a-bfe9-4b0d-8e22-fe8e391d49e7 req-f9cee02d-a44e-49ac-bbca-0ec2097ad809 service nova] Creating event network-changed:84997fd6-e938-4e61-b348-43add7818817 for instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 on n-h2-862404-2 Oct 28 18:19:47.404292 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-89714f3a-bfe9-4b0d-8e22-fe8e391d49e7 req-f9cee02d-a44e-49ac-bbca-0ec2097ad809 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060747 Oct 28 18:19:47.405246 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2187/3954] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:47.411842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:47.412679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:47.425982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:47.426503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:47.426941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:47.427663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:47.428155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:47.428603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:48.020794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367b2d496d84c169c4d24c9a2bed7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de631944ce47488f903028dc0d54f282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:48.053909 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c266b25d-2e3f-406d-b3da-b7d504ec5741 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77" status: 200 len: 1316 microversion: 2.1 time: 0.647372 Oct 28 18:19:48.055191 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2188/3955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:47 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:48.071694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:48.085378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:48.095353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:48.096177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:48.097402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:48.098667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:48.099183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:48.100345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:48.441025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:48.471375 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06375823-cd72-43b1-90c4-364d1732ff24 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.413723 Oct 28 18:19:48.474009 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2189/3956] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:48 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:48.501390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:48.502152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:48.511363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:48.515015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:48.518073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:48.519369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:48.520059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:48.520665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:48.868277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:48.882445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:48.888322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:48.890388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c2753d26-3b1c-4ccc-822d-0e74eb8f77f0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.412376 Oct 28 18:19:48.903886 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2190/3957] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:48 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:48.906190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:48.906958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:48.914672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:48.915445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:48.916267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:48.917221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:48.917968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:48.918579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:49.118896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ccb9803a-d1f9-4d4e-bfd1-53e4ff912363 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222010 Oct 28 18:19:49.121448 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2191/3958] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:19:48 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:49.132827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:49.133921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:49.141839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:49.143365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:49.145350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:49.146763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:49.147545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:49.148249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:49.611367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:49.619356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-895376e6-9445-4f01-97b9-076557490556 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.495772 Oct 28 18:19:49.620000 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2192/3959] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:49 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:49.640305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:49.643256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:49.649966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:49.650736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:49.651389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:49.653013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:49.653665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:49.654302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:49.693058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:49.707257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lazy-loading 'flavor' on Instance uuid f57a499d-80c7-4ac5-88fb-07b9192dc6a0 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:19:49.785434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:49.902221 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f1dad847-f7e0-4566-b0a3-86ba2b8f4c90 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action" status: 200 len: 32 microversion: 2.1 time: 0.264197 Oct 28 18:19:49.906664 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2193/3960] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:49 2022] POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:19:49.924968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:49.927996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:49.944168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:49.946681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:49.947507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:49.948288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:49.949478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:49.950559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:49.951510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:50.394329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367b2d496d84c169c4d24c9a2bed7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de631944ce47488f903028dc0d54f282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:50.405655 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dfba7ae9-1df0-463b-8bc0-f878dddc9788 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77" status: 200 len: 1316 microversion: 2.1 time: 0.497170 Oct 28 18:19:50.406273 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2194/3961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:49 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:50.416093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:50.418610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:50.444341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:50.444955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:50.445430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:50.446513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:50.446801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:50.447220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:50.938962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:50.952660 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-468e7ddd-97be-40fd-8894-55cd5289e573 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.545309 Oct 28 18:19:50.954171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2195/3962] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:50 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:50.959878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:50.960748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:50.970082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:50.971628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:50.972471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:50.973410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:50.974176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:50.974786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:51.647778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:51.668365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c528932a-6c77-437b-bbe3-88d1e7d96740 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.712585 Oct 28 18:19:51.669377 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2196/3963] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:50 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:51.674414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:51.676056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:51.692380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:51.693646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:51.694319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:51.696803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:51.697602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:51.698449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:52.315423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:52.327273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:52.337991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:52.340878 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c5cfd6b-1fdf-43c6-92b3-f0d61d3274e3 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.668944 Oct 28 18:19:52.342470 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2197/3964] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:51 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:52.363170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:52.364070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:52.371919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:52.372637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:52.373249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:52.374130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:52.376685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:52.377125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:52.411494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:52.783891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:52.799105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5bcafd5b-11bb-4118-992e-3aafc435644a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.439687 Oct 28 18:19:52.803881 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2198/3965] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:52 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:52.817590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:52.818227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:52.844203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:52.845059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:52.846786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:52.847959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:52.848659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:52.849156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:53.086738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367b2d496d84c169c4d24c9a2bed7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de631944ce47488f903028dc0d54f282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:53.099003 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6e30fe8-12af-4c49-904f-ccaa145c9e3d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77" status: 200 len: 1316 microversion: 2.1 time: 0.289530 Oct 28 18:19:53.119386 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2199/3966] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:52 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:53.125972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-edac2656-da98-4bb5-9d1c-79ecb3c79835 req-4cb69606-987d-4f9f-a254-ba1aba44d04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9256eb-d868-4f7d-88ee-1cd5158d8d77", "name": "network-vif-plugged", "status": "completed", "tag": "84997fd6-e938-4e61-b348-43add7818817"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:53.145271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-edac2656-da98-4bb5-9d1c-79ecb3c79835 req-4cb69606-987d-4f9f-a254-ba1aba44d04d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:53.150436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-edac2656-da98-4bb5-9d1c-79ecb3c79835 req-4cb69606-987d-4f9f-a254-ba1aba44d04d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:53.151220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-edac2656-da98-4bb5-9d1c-79ecb3c79835 req-4cb69606-987d-4f9f-a254-ba1aba44d04d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:53.176271 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-edac2656-da98-4bb5-9d1c-79ecb3c79835 req-4cb69606-987d-4f9f-a254-ba1aba44d04d service nova] Creating event network-vif-plugged:84997fd6-e938-4e61-b348-43add7818817 for instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 on n-h2-862404-2 Oct 28 18:19:53.181945 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-edac2656-da98-4bb5-9d1c-79ecb3c79835 req-4cb69606-987d-4f9f-a254-ba1aba44d04d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061003 Oct 28 18:19:53.182779 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2200/3967] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:53.189695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:53.195576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:53.215276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:53.215790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:53.216369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:53.217247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:53.218126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:53.218404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:53.543437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:53.557734 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55f543a6-04fa-4a6e-b35b-94a436115065 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1522 microversion: 2.1 time: 0.372882 Oct 28 18:19:53.559257 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2201/3968] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:53 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:53.566008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:53.566883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:53.579347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:53.580447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:53.581148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:53.582110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:53.582864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:53.583525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:53.798259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:53.808857 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-58beee63-6520-4a1c-8064-a5edb2bbabe5 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1589 microversion: 2.1 time: 0.246545 Oct 28 18:19:53.812037 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2202/3969] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:53 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1589 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:53.828752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-36592df5-2901-4472-801c-ed58c3d94b44 req-b87d05d1-6ac3-4ebb-9bce-e88a84089766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf96e27-7b5e-49a2-ad6b-890c5d9414e0", "tag": "783e50a9-3c23-4025-bbc5-86393fd2b19d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:53.854917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-36592df5-2901-4472-801c-ed58c3d94b44 req-b87d05d1-6ac3-4ebb-9bce-e88a84089766 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:53.855625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-36592df5-2901-4472-801c-ed58c3d94b44 req-b87d05d1-6ac3-4ebb-9bce-e88a84089766 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:53.856252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-36592df5-2901-4472-801c-ed58c3d94b44 req-b87d05d1-6ac3-4ebb-9bce-e88a84089766 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:53.887943 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-36592df5-2901-4472-801c-ed58c3d94b44 req-b87d05d1-6ac3-4ebb-9bce-e88a84089766 service nova] Creating event network-changed:783e50a9-3c23-4025-bbc5-86393fd2b19d for instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 on n-h1-862404-2 Oct 28 18:19:53.894899 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-36592df5-2901-4472-801c-ed58c3d94b44 req-b87d05d1-6ac3-4ebb-9bce-e88a84089766 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080935 Oct 28 18:19:53.895551 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2203/3970] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:53.901291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:53.902986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:53.927587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:53.928496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:53.929156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:53.931494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:53.933876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:53.934576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:54.177462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:54.188871 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2bb1ce17-e4b7-4a38-98ef-c2e1dad9aec5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.291159 Oct 28 18:19:54.192711 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2204/3971] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:53 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:54.207671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:54.208678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:54.226018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:54.226949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:54.227600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:54.228516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:54.229265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:54.229954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:54.637153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:54.649368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:54.651081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:54.652828 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f800f02-d8db-4f4a-8c40-5ae67b0111b0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.457873 Oct 28 18:19:54.653274 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2205/3972] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:54 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:54.663921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:54.666572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:54.679502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:54.686554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:54.687440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:54.688806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:54.689453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:54.690375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:54.939517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:54.956731 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0dc90124-6457-4a06-87a2-a36fc64222e7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.300286 Oct 28 18:19:54.957654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2206/3973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:54 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:54.964838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:54.965676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:54.978144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:54.978924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:54.979717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:54.981914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:54.983339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:54.984009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:55.215465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2367b2d496d84c169c4d24c9a2bed7c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de631944ce47488f903028dc0d54f282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:55.225295 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-659d6d71-9ca5-42ed-8fc7-901b79dfb60d tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77" status: 200 len: 1503 microversion: 2.1 time: 0.266507 Oct 28 18:19:55.239919 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2207/3974] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:54 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:55.243246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:55.247119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:55.265033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:55.268387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:55.268949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:55.269452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:55.270154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:55.270767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:55.457611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:55.468192 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a009d302-c601-4f20-94fb-8c27e326c187 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1502 microversion: 2.1 time: 0.233135 Oct 28 18:19:55.470272 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2208/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:55 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:55.477081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:55.478075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:55.485997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:55.486839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:55.488852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:55.489985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:55.490892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:55.491471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:55.681808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:55.692788 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73ae919f-40e8-46d8-b343-1275e1688b3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.220546 Oct 28 18:19:55.694162 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2209/3976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:55 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:55.699584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:55.702012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:55.708443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:55.709214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:55.709824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:55.710774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:55.711487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:55.712118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:55.752605 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8097041b-f04e-47c3-9bb2-7c51cd3e6fcc tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77/ips" status: 200 len: 107 microversion: 2.1 time: 0.056586 Oct 28 18:19:55.755527 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2210/3977] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:19:55 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77/ips => generated 107 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:55.761500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52a09367-8aff-449b-a35a-17f449fd55cf tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Action: 'create', calling method: .version_select at 0x7f78dd705820>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-162702901", "description": "tempest-description-961445517"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:56.187301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52a09367-8aff-449b-a35a-17f449fd55cf tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.430023 Oct 28 18:19:56.188367 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2211/3978] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 18:19:55 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:56.200455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:56.201096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:56.209102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:56.209598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:56.210236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:56.211199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:56.211859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:56.212464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:56.522362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:56.533440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:56.534940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:56.536481 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e5337e1-8783-4d54-a639-b64e3f4055cd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.347025 Oct 28 18:19:56.537130 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2212/3979] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:56 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:56.544516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:56.545096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:56.551252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:56.551739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:56.552476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:56.553258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:56.553806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:56.554465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:56.580931 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d0fcfe6-d722-4c57-8885-e649de5c1a25 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77/ips" status: 200 len: 107 microversion: 2.1 time: 0.042288 Oct 28 18:19:56.587700 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2213/3980] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:19:56 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77/ips => generated 107 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:56.593928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:56.594583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:56.600647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:56.601143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:56.602216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:56.602799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:56.603410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:56.604109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:56.811247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:56.820614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-352a7f71-2795-406b-8106-2b7a242c5911 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.231514 Oct 28 18:19:56.836278 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2214/3981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:56 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:57.006022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Calling method '.version_select at 0x7f78e2535e50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:57.008018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:57.008663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:57.009171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:57.025460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:57.026895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:57.027301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:57.038449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:57.039020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:57.039732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:57.047649 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8a471d7-d03c-4c67-8ae9-bdfec83b2a10 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474 tempest-PortsAdminExtendedAttrsIpV6TestJSON-945508474-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.210145 Oct 28 18:19:57.048626 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2215/3982] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:19:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:57.053977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-162702901"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:57.054811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:57.063101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:57.063585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:57.064056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:57.064797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:57.065203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:57.065623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:57.320094 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Adding security group 5d5395ed-0c70-4f4a-8e6e-16a1bfc24744 to port 992d9d58-181c-4500-a14d-21b430851087 Oct 28 18:19:58.557091 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af5267d3-8925-4551-89d3-275e165ba03a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action" status: 202 len: 0 microversion: 2.1 time: 1.506874 Oct 28 18:19:58.561802 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2216/3983] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:57 2022] POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action => generated 0 bytes in 1512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:19:58.568028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:58.568459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:58.586851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:58.587567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:58.588204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:58.590643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:58.593752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:58.594386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:58.654065 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-060927fd-3964-45fb-a058-e85697462970 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77/ips/tempest-ServerAddressesTestJSON-36399821-network" status: 200 len: 92 microversion: 2.1 time: 0.091007 Oct 28 18:19:58.659001 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2217/3984] 10.222.0.16 () {58 vars in 1395 bytes} [Fri Oct 28 18:19:58 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77/ips/tempest-ServerAddressesTestJSON-36399821-network => generated 92 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:19:58.668986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:58.675757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:58.689137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:58.689926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:58.690545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:58.691441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:58.692094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:58.692696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:59.176744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:59.181405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:59.191741 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92e164f8-d112-416b-9f09-74aa98acd1e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.531443 Oct 28 18:19:59.221028 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2218/3985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:58 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:59.254170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:59.255016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:59.273801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:59.274739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:59.275424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:59.276406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:59.277969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:59.278742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:59.811116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:59.829250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:59.835635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:59.845665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c327c9a-61f5-4a1a-bbbc-81f65b05f149 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.617783 Oct 28 18:19:59.846573 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2219/3986] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:19:59 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:19:59.852148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:59.853069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:19:59.860456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:59.861239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:59.862020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:59.862973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:59.863663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:59.864356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:00.188660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:00.204609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78df29bc-9c57-4bc6-9643-49db742df420 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.355197 Oct 28 18:20:00.208207 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2220/3987] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:59 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:00.217928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-162702901"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:00.218857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:00.251894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:00.256139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:00.258313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:00.260457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:00.265548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:00.267389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:00.610151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Removing security group 5d5395ed-0c70-4f4a-8e6e-16a1bfc24744 from port 992d9d58-181c-4500-a14d-21b430851087 Oct 28 18:20:01.389107 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-795c27aa-0905-4ec3-b40c-c9b96fa637f4 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action" status: 202 len: 0 microversion: 2.1 time: 1.179498 Oct 28 18:20:01.390118 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2221/3988] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:20:00 2022] POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action => generated 0 bytes in 1181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:20:01.402582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0d147f54-e5d7-4e7e-939e-94fb1cac992e req-e9da3b50-95b9-4572-8a5f-0cce6d9798e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce795a9-e731-4e75-8e78-7d756f17ba80", "tag": "992d9d58-181c-4500-a14d-21b430851087"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:01.421166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d147f54-e5d7-4e7e-939e-94fb1cac992e req-e9da3b50-95b9-4572-8a5f-0cce6d9798e3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:01.421926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d147f54-e5d7-4e7e-939e-94fb1cac992e req-e9da3b50-95b9-4572-8a5f-0cce6d9798e3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:01.423447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d147f54-e5d7-4e7e-939e-94fb1cac992e req-e9da3b50-95b9-4572-8a5f-0cce6d9798e3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:01.441941 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0d147f54-e5d7-4e7e-939e-94fb1cac992e req-e9da3b50-95b9-4572-8a5f-0cce6d9798e3 service nova] Creating event network-changed:992d9d58-181c-4500-a14d-21b430851087 for instance dce795a9-e731-4e75-8e78-7d756f17ba80 on n-h1-862404-2 Oct 28 18:20:01.451735 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0d147f54-e5d7-4e7e-939e-94fb1cac992e req-e9da3b50-95b9-4572-8a5f-0cce6d9798e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059901 Oct 28 18:20:01.453033 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2222/3989] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:01.460720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:01.461339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:01.483186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:01.483679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:01.484159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:01.485081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:01.485328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:01.488328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:01.540685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:20:01.710261 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-404a4932-1982-4295-9031-c92c124922ec tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77" status: 204 len: 0 microversion: 2.1 time: 0.255551 Oct 28 18:20:01.711207 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2223/3990] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:01 2022] DELETE /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:20:01.717767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:01.718494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:01.736069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:01.744551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:01.752633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:01.753438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:01.753935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:01.754378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:02.153509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:02.164820 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a87c5fec-e3a2-478b-9bc2-86a0294926a9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.452313 Oct 28 18:20:02.167121 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2224/3991] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:01 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:02.183670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:02.184710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:02.193944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:02.195158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:02.197867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:02.199201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:02.202227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:02.202682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:02.584437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:02.608655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:02.629629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:02.630882 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9bb7c891-4f27-4264-a267-e1107246ee52 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.462266 Oct 28 18:20:02.649565 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2225/3992] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:02 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:02.649565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:02.649565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:02.659561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:02.660111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:02.660552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:02.661285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:02.661747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:02.662186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:03.034252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:03.055338 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fcd3368a-239e-42be-a8ba-7f10790ac5c4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1511 microversion: 2.1 time: 0.419316 Oct 28 18:20:03.059209 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2226/3993] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:02 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:03.076235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-719174a5-e40e-4abb-b68d-ecba87ad419e tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Action: 'create', calling method: .version_select at 0x7f78e23c4820>, body: {"pool": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:05.782376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-719174a5-e40e-4abb-b68d-ecba87ad419e tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.721572 Oct 28 18:20:05.783170 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2227/3994] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 18:20:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:05.788122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:05.789076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] [instance: 7a9256eb-d868-4f7d-88ee-1cd5158d8d77] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:05.799357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:05.799878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:05.800331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:05.801048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:05.801524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:05.801956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:05.817119 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] HTTP exception thrown: Instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 could not be found. Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Request method failure captured: Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 HTTP/1.1 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB0462R-BdIv-zH_HA7WJ3v-u474byJ6kxNbuChgLh2R4Yxbi1biRqnrNro1hxhGbGiZ55fZECqAOwEWt8e5uYRX1YmAEPxw7bFPiFbJhJDLbNVv1ikrEpKlgKRHnZXZa7Ak3ZdEJjYlouaz_OHpPkRJTYSF27Qa_vmeBOLU5MASCuk Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: de631944ce47488f903028dc0d54f282 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerAddressesTestJSON-1068625801 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de631944ce47488f903028dc0d54f282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de631944ce47488f903028dc0d54f282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_de631944ce47488f903028dc0d54f282", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/de631944ce47488f903028dc0d54f282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerAddressesTestJSON-1068625801 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: de631944ce47488f903028dc0d54f282 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1068625801 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerAddressesTestJSON-1068625801-project Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2367b2d496d84c169c4d24c9a2bed7c2 Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerAddressesTestJSON-1068625801-project Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 could not be found. Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '7a9256eb-d868-4f7d-88ee-1cd5158d8d77'} Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 could not be found. Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 could not be found. Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:05.818814 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 could not be found. Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] Returning 404 to user: Instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:05.825013 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55c938c3-f4cb-42d7-8623-6d4656ec86d6 tempest-ServerAddressesTestJSON-1068625801 tempest-ServerAddressesTestJSON-1068625801-project] 10.222.0.16 "GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77" status: 404 len: 111 microversion: 2.1 time: 0.036134 Oct 28 18:20:05.826485 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2228/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:05 2022] GET /compute/v2.1/servers/7a9256eb-d868-4f7d-88ee-1cd5158d8d77 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:05.830791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:05.831635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:05.838850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:05.840730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:05.840884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:05.841479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:05.841947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:05.842635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:06.135444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:06.147793 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29786412-95de-4580-9bdc-2a241b532806 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.320855 Oct 28 18:20:06.148922 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2229/3996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:05 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:06.224470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-285877549", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "52372820-5f08-4c75-99de-5ea135861a65"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:06.286455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] validate_networks() for [('52372820-5f08-4c75-99de-5ea135861a65', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:20:07.139255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:20:07.139940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:20:07.140398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:20:07.140938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:20:07.141540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:20:07.156413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:07.159023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:07.160438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:07.162803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:07.163523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:07.164248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:07.188951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Getting quotas for project 2433a50e3dd84abfab218218d5aeab1b. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:20:07.194739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Getting quotas for user b3e45d4d9c87495fa87409484bef5f70 and project 2433a50e3dd84abfab218218d5aeab1b. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:20:07.210191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:20:07.212920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:20:07.294218 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a598e909-d25e-4ee1-9410-a1c85ec2498e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143601 Oct 28 18:20:07.295242 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2230/3997] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:20:07.302724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-72790e8b-c3c2-48d6-b6a0-37dc96720498 req-eeac2f16-ffee-4388-8790-7baeba107084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce795a9-e731-4e75-8e78-7d756f17ba80", "tag": "992d9d58-181c-4500-a14d-21b430851087"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:07.316753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-72790e8b-c3c2-48d6-b6a0-37dc96720498 req-eeac2f16-ffee-4388-8790-7baeba107084 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:07.317459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-72790e8b-c3c2-48d6-b6a0-37dc96720498 req-eeac2f16-ffee-4388-8790-7baeba107084 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:07.318496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-72790e8b-c3c2-48d6-b6a0-37dc96720498 req-eeac2f16-ffee-4388-8790-7baeba107084 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:07.355779 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-72790e8b-c3c2-48d6-b6a0-37dc96720498 req-eeac2f16-ffee-4388-8790-7baeba107084 service nova] Creating event network-changed:992d9d58-181c-4500-a14d-21b430851087 for instance dce795a9-e731-4e75-8e78-7d756f17ba80 on n-h1-862404-2 Oct 28 18:20:07.362538 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-72790e8b-c3c2-48d6-b6a0-37dc96720498 req-eeac2f16-ffee-4388-8790-7baeba107084 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065403 Oct 28 18:20:07.364215 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2231/3998] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:07.376387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:07.377794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:07.387097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:07.388469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:07.400494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:07.413771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:07.415442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:07.415777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:07.909131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:07.925597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:07.929647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:07.931997 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a5fd5fd-59e4-426b-b869-a3e2532cac8e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.564303 Oct 28 18:20:07.935970 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2232/3999] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:07 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:07.944947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:07.945707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:07.959317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:07.960188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:07.960882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:07.964942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:07.965690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:07.966265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:08.966047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:08.975643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-316854b4-59e8-44ac-bf2c-35c85ab7a0fc tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1488 microversion: 2.1 time: 1.037123 Oct 28 18:20:08.991299 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2233/4000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:07 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1488 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:08.991299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.137"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:08.991299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:09.011872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:09.015051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:09.015925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:09.018479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:09.020128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:09.022237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:09.087847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "refresh_cache-dce795a9-e731-4e75-8e78-7d756f17ba80" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:20:09.088461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquired lock "refresh_cache-dce795a9-e731-4e75-8e78-7d756f17ba80" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:20:12.222821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Building network info cache for instance {{(pid=120680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:20:13.210545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Updating instance_info_cache with network_info: [{"id": "992d9d58-181c-4500-a14d-21b430851087", "address": "fa:16:3e:22:e8:26", "network": {"id": "cf67e321-0643-4611-86f4-f2705daf5cd0", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-174877673-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "73143b013601482688c81ecf99ea17b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap992d9d58-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:20:13.227299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Releasing lock "refresh_cache-dce795a9-e731-4e75-8e78-7d756f17ba80" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:20:13.229001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1621a172-202c-4d0c-887f-98fa25e8e0ad tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action" status: 202 len: 0 microversion: 2.1 time: 4.248907 Oct 28 18:20:13.230579 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2234/4001] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:20:08 2022] POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action => generated 0 bytes in 4251 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:20:13.237136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:13.238443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:13.242495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:13.246556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:13.247895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:13.248579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:13.250145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:13.250786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:13.251431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:13.561234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:13.569860 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e10f629d-6063-45d2-9934-f22f620cb433 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.337586 Oct 28 18:20:13.570607 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2235/4002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:13 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:13.587980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:13.589469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:13.599943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:13.600668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:13.601911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:13.605325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:13.606646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:13.607631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:13.955450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:13.975052 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cb8461a8-a3fd-4c18-9243-aeae9b548a30 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1327 microversion: 2.1 time: 0.403140 Oct 28 18:20:13.975717 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2236/4003] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:13 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1327 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:13.982054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:13.983098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:13.996692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.001862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.002328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.003084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.003520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.003984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.010032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:14.526349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:14.550579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:14.557050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:14.559194 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-039b3be6-7fc8-4685-8799-7b03dde69198 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.582307 Oct 28 18:20:14.560421 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2237/4004] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:13 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:14.565830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:14.566536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:14.578299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.579266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.579772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.580532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.581033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.581597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.614400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:20:14.713171 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6bc27482-13b7-48c6-b772-a4fa656716f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 204 len: 0 microversion: 2.1 time: 0.151164 Oct 28 18:20:14.714779 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2238/4005] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:14 2022] DELETE /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:20:14.723023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-26a3ae90-f22a-4038-a73f-6aac71822abc req-914c5bc2-226e-4423-aa65-0945aae00526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9256eb-d868-4f7d-88ee-1cd5158d8d77", "name": "network-vif-deleted", "tag": "84997fd6-e938-4e61-b348-43add7818817"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:14.735771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-26a3ae90-f22a-4038-a73f-6aac71822abc req-914c5bc2-226e-4423-aa65-0945aae00526 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.736297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-26a3ae90-f22a-4038-a73f-6aac71822abc req-914c5bc2-226e-4423-aa65-0945aae00526 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.736877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-26a3ae90-f22a-4038-a73f-6aac71822abc req-914c5bc2-226e-4423-aa65-0945aae00526 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.748993 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-26a3ae90-f22a-4038-a73f-6aac71822abc req-914c5bc2-226e-4423-aa65-0945aae00526 service nova] Creating event network-vif-deleted:84997fd6-e938-4e61-b348-43add7818817 for instance 7a9256eb-d868-4f7d-88ee-1cd5158d8d77 on n-h2-862404-2 Oct 28 18:20:14.754717 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-26a3ae90-f22a-4038-a73f-6aac71822abc req-914c5bc2-226e-4423-aa65-0945aae00526 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038274 Oct 28 18:20:14.755598 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2239/4006] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:14.763003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.137"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:14.907293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:14.914736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.915242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.915692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.916439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.917428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.917870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:15.141327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "refresh_cache-dce795a9-e731-4e75-8e78-7d756f17ba80" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 18:20:15.141797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquired lock "refresh_cache-dce795a9-e731-4e75-8e78-7d756f17ba80" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 18:20:15.806503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Building network info cache for instance {{(pid=120680) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 18:20:16.707640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Updating instance_info_cache with network_info: [{"id": "992d9d58-181c-4500-a14d-21b430851087", "address": "fa:16:3e:22:e8:26", "network": {"id": "cf67e321-0643-4611-86f4-f2705daf5cd0", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-174877673-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "73143b013601482688c81ecf99ea17b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap992d9d58-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120680) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:20:16.724401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Releasing lock "refresh_cache-dce795a9-e731-4e75-8e78-7d756f17ba80" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 18:20:16.727181 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a24819a9-47c0-4dcc-a82d-1abeae28a690 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action" status: 202 len: 0 microversion: 2.1 time: 1.969682 Oct 28 18:20:16.727933 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2240/4007] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:20:14 2022] POST /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80/action => generated 0 bytes in 1972 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 18:20:16.739496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:16.740873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:16.751325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:16.752150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:16.753457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:16.754952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:16.755622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:16.756227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:16.932334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:16.943144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-23f5cd1f-7411-4e3a-a537-75869fae0122 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.212671 Oct 28 18:20:16.964416 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2241/4008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:16 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:17.179840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:17.205183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:17.257529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:17.259135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:17.275351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:17.278304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:17.279058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:17.280517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:17.284544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:17.288448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:17.647308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:17.659430 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1494 microversion: 2.1 time: 0.693325 Oct 28 18:20:17.660400 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2242/4009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:16 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1494 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:17.661722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:17.662614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5a45f74-74e2-4a5c-8d49-31b1307f2d50 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001182 Oct 28 18:20:17.663379 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2243/4010] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 18:20:17 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 18:20:17.688525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:17.689841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:17.710219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:17.710939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:17.715067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:17.718584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:17.719365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:17.722481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:18.187174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:18.199086 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59da3bd1-8662-4c64-ac6f-fa516a96a72b tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1327 microversion: 2.1 time: 0.533991 Oct 28 18:20:18.216529 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2244/4011] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:17 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1327 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:18.222708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:18.223600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:18.231085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:18.232052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:18.232696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:18.233612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:18.234262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:18.234706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:18.476465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:18.488320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:18.490588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:18.491912 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ff91916-0189-4ebf-9291-b41c07f12656 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.273232 Oct 28 18:20:18.492488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2245/4012] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:18 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:18.500109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3e9f3a8e-4796-431c-8a6f-8550c83855dd req-29ae82db-26bd-4d1f-a20d-2301bc216b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-plugged", "status": "completed", "tag": "f6faaf47-a79d-4a83-8673-436e23fd58c2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:18.512497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3e9f3a8e-4796-431c-8a6f-8550c83855dd req-29ae82db-26bd-4d1f-a20d-2301bc216b17 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:18.513655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3e9f3a8e-4796-431c-8a6f-8550c83855dd req-29ae82db-26bd-4d1f-a20d-2301bc216b17 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:18.514414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3e9f3a8e-4796-431c-8a6f-8550c83855dd req-29ae82db-26bd-4d1f-a20d-2301bc216b17 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:18.529028 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3e9f3a8e-4796-431c-8a6f-8550c83855dd req-29ae82db-26bd-4d1f-a20d-2301bc216b17 service nova] Creating event network-vif-plugged:f6faaf47-a79d-4a83-8673-436e23fd58c2 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:20:18.535779 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3e9f3a8e-4796-431c-8a6f-8550c83855dd req-29ae82db-26bd-4d1f-a20d-2301bc216b17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041359 Oct 28 18:20:18.536471 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2246/4013] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:18.543491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffcb2ca0-753c-4ad0-b5ee-754ee811fe22 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '.version_select at 0x7f78dd5f7040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:19.694044 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffcb2ca0-753c-4ad0-b5ee-754ee811fe22 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/d332812b-43f8-4f34-a142-55c877b1f5ea" status: 202 len: 0 microversion: 2.1 time: 1.155758 Oct 28 18:20:19.699754 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2247/4014] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:20:18 2022] DELETE /compute/v2.1/os-floating-ips/d332812b-43f8-4f34-a142-55c877b1f5ea => generated 0 bytes in 1162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:20:19.704596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4f5403cd-c1c8-4435-9623-f9d7c1f160d9 req-0a170f0f-d617-4e42-b5ee-71a064153afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce795a9-e731-4e75-8e78-7d756f17ba80", "tag": "992d9d58-181c-4500-a14d-21b430851087"}, {"name": "network-changed", "server_uuid": "b7924a83-fe3c-4866-bfda-3416f5a59dec", "tag": "8cea003e-29ea-4fac-97e9-abc55575e756"}, {"name": "network-changed", "server_uuid": "dce795a9-e731-4e75-8e78-7d756f17ba80", "tag": "992d9d58-181c-4500-a14d-21b430851087"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:19.719548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f5403cd-c1c8-4435-9623-f9d7c1f160d9 req-0a170f0f-d617-4e42-b5ee-71a064153afb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:19.720356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f5403cd-c1c8-4435-9623-f9d7c1f160d9 req-0a170f0f-d617-4e42-b5ee-71a064153afb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:19.720956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4f5403cd-c1c8-4435-9623-f9d7c1f160d9 req-0a170f0f-d617-4e42-b5ee-71a064153afb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:19.735568 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4f5403cd-c1c8-4435-9623-f9d7c1f160d9 req-0a170f0f-d617-4e42-b5ee-71a064153afb service nova] Creating event network-changed:992d9d58-181c-4500-a14d-21b430851087 for instance dce795a9-e731-4e75-8e78-7d756f17ba80 on n-h1-862404-2 Oct 28 18:20:19.736517 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4f5403cd-c1c8-4435-9623-f9d7c1f160d9 req-0a170f0f-d617-4e42-b5ee-71a064153afb service nova] Creating event network-changed:8cea003e-29ea-4fac-97e9-abc55575e756 for instance b7924a83-fe3c-4866-bfda-3416f5a59dec on n-h2-862404-2 Oct 28 18:20:19.737218 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4f5403cd-c1c8-4435-9623-f9d7c1f160d9 req-0a170f0f-d617-4e42-b5ee-71a064153afb service nova] Creating event network-changed:992d9d58-181c-4500-a14d-21b430851087 for instance dce795a9-e731-4e75-8e78-7d756f17ba80 on n-h1-862404-2 Oct 28 18:20:19.749122 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4f5403cd-c1c8-4435-9623-f9d7c1f160d9 req-0a170f0f-d617-4e42-b5ee-71a064153afb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.047999 Oct 28 18:20:19.751206 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2248/4015] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:19.773870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:19.777310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:19.801160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:19.801671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:19.802114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:19.802842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:19.803304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:19.803735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.014553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:20.023648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8adcf59e-754f-4b92-a4f7-a0287c9da1b8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.257734 Oct 28 18:20:20.036042 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2249/4016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:19 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:20.045699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:20.045945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:20.052543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.053287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.053942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.055117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.055575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.056256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.091280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.092073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.093019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.093516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lazy-loading 'fault' on Instance uuid 0a1fd814-42d1-4740-ab93-b0667a11bd4d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:20:20.146088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:20.156641 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb3db447-1b41-4af5-b17e-3c020b4384a7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 200 len: 1304 microversion: 2.1 time: 0.119112 Oct 28 18:20:20.158358 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2250/4017] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:20 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:20.164160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:20.164921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:20.172139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.172921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.173673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.174799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.175559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.176279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.546660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:20.568151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb3c76b5-ce75-46dd-a02f-71a045c5e08c tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1327 microversion: 2.1 time: 0.408036 Oct 28 18:20:20.568769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2251/4018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:20 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1327 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:20.594057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:20.597534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:20.605150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.605915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.606540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.608149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.608796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.609413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:21.195262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:21.208321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:21.210377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:21.211984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d9c4e85d-57a5-4c3f-96d8-507887059a00 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.623055 Oct 28 18:20:21.212832 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2252/4019] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:20 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:21.218058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84c13061-c737-42dc-956a-84c729a8f26a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '.version_select at 0x7f78dd542430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:22.225008 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84c13061-c737-42dc-956a-84c729a8f26a tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5d5395ed-0c70-4f4a-8e6e-16a1bfc24744" status: 202 len: 0 microversion: 2.1 time: 1.010844 Oct 28 18:20:22.227521 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2253/4020] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 18:20:21 2022] DELETE /compute/v2.1/os-security-groups/5d5395ed-0c70-4f4a-8e6e-16a1bfc24744 => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:20:22.233443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-plugged", "status": "completed", "tag": "98221312-7849-4682-b29b-3081bd5426a5"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-plugged", "status": "completed", "tag": "b3f16ee9-aa1b-4bfe-ab8f-58f3ae67670d"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-plugged", "status": "completed", "tag": "aba7f5c0-e589-4ffc-8505-f1d44a018e7d"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-plugged", "status": "completed", "tag": "6286b241-00fe-4b70-9042-5ad2ecad758c"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-plugged", "status": "completed", "tag": "03e8b09a-848b-412a-8be4-c81f0cfb8232"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-plugged", "status": "completed", "tag": "9d47d85a-5cef-4716-bd46-75acc348c1ba"}, {"server_uuid": "b7924a83-fe3c-4866-bfda-3416f5a59dec", "name": "network-vif-plugged", "status": "completed", "tag": "8cea003e-29ea-4fac-97e9-abc55575e756"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:22.266256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.266753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.267779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.284226 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Creating event network-vif-plugged:98221312-7849-4682-b29b-3081bd5426a5 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:20:22.284754 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Creating event network-vif-plugged:b3f16ee9-aa1b-4bfe-ab8f-58f3ae67670d for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:20:22.285397 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Creating event network-vif-plugged:aba7f5c0-e589-4ffc-8505-f1d44a018e7d for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:20:22.286038 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Creating event network-vif-plugged:6286b241-00fe-4b70-9042-5ad2ecad758c for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:20:22.286773 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Creating event network-vif-plugged:03e8b09a-848b-412a-8be4-c81f0cfb8232 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:20:22.287438 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Creating event network-vif-plugged:9d47d85a-5cef-4716-bd46-75acc348c1ba for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:20:22.288160 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] Creating event network-vif-plugged:8cea003e-29ea-4fac-97e9-abc55575e756 for instance b7924a83-fe3c-4866-bfda-3416f5a59dec on n-h2-862404-2 Oct 28 18:20:22.298224 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a31dce9f-fce2-492c-9298-ad92897ffc21 req-8bb47a16-0c53-4b69-937f-f846c138a7eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.069088 Oct 28 18:20:22.299192 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2254/4021] 10.222.0.16 () {64 vars in 1318 bytes} [Fri Oct 28 18:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:22.304808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:22.305525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:22.312537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.313051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.313487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.314405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.315070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.315512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.544492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:22.553938 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39b19f1a-6fe4-4d14-a3d7-c646b4f7e650 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1501 microversion: 2.1 time: 0.253133 Oct 28 18:20:22.567916 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2255/4022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:22 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1501 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:22.581019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:22.581797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:22.594690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.595309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.595881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.596712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.597399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.597910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.618481 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d HTTP/1.1 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0a1fd814-42d1-4740-ab93-b0667a11bd4d'} Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:22.621467 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca55f78b-7a5f-4fc8-bbfe-0026f1aa2908 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 404 len: 111 microversion: 2.1 time: 0.053929 Oct 28 18:20:22.628046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2256/4023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:22 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:22.632591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:22.633527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:22.645832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.646415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.646935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.647723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.648456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.649061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.654798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:22.863929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:22.877389 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2f48818-5c03-4d02-a4e7-82176a95918e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1327 microversion: 2.1 time: 0.251107 Oct 28 18:20:22.889301 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2257/4024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:22 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1327 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:23.070033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9294f574-a929-446b-9f5b-e7de54c8dca2 tempest-ComputeTenantNetworksTest-888854815 tempest-ComputeTenantNetworksTest-888854815-project] Calling method '.version_select at 0x7f78e23cd5e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:23.233089 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9294f574-a929-446b-9f5b-e7de54c8dca2 tempest-ComputeTenantNetworksTest-888854815 tempest-ComputeTenantNetworksTest-888854815-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.336200 Oct 28 18:20:23.239875 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2258/4025] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 18:20:22 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:23.245561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ef49ba25-a219-4ccb-992c-4ab3b87e7ae4 req-c46a7092-e926-4935-9a0c-ef0c1c2f9a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1fd814-42d1-4740-ab93-b0667a11bd4d", "name": "network-vif-deleted", "tag": "a0667783-8a04-4752-bc96-adb6beb40efe"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:23.255629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ef49ba25-a219-4ccb-992c-4ab3b87e7ae4 req-c46a7092-e926-4935-9a0c-ef0c1c2f9a56 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.256152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ef49ba25-a219-4ccb-992c-4ab3b87e7ae4 req-c46a7092-e926-4935-9a0c-ef0c1c2f9a56 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.256585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ef49ba25-a219-4ccb-992c-4ab3b87e7ae4 req-c46a7092-e926-4935-9a0c-ef0c1c2f9a56 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.268297 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ef49ba25-a219-4ccb-992c-4ab3b87e7ae4 req-c46a7092-e926-4935-9a0c-ef0c1c2f9a56 service nova] Creating event network-vif-deleted:a0667783-8a04-4752-bc96-adb6beb40efe for instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d on n-h2-862404-2 Oct 28 18:20:23.273184 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ef49ba25-a219-4ccb-992c-4ab3b87e7ae4 req-c46a7092-e926-4935-9a0c-ef0c1c2f9a56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Oct 28 18:20:23.274037 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2259/4026] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:23.281071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:23.281662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:23.288074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.288568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.289007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.289705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.290381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.291023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.319676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:20:23.410643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7abcc2de-30bd-4744-af47-f19e67fbd451 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 204 len: 0 microversion: 2.1 time: 0.134867 Oct 28 18:20:23.411185 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2260/4027] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:23 2022] DELETE /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:20:23.418418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:23.419211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:23.425484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.426131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.426870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.427883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.428432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.428946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.659775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:23.669395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:23.670925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:23.672151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7eb7583d-26d1-42eb-9089-1e329c4536b1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.258927 Oct 28 18:20:23.672730 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2261/4028] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:23 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:23.677794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e60a9b0-5921-45f6-a98f-e00510e2dcec"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:23.680620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:23.688549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.689434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.690603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.691570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.692288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.692739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.724856 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Cannot 'attach_volume' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state rescued Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/os-volume_attachments HTTP/1.1 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 74 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: {"volumeAttachment": {"volumeId": "7e60a9b0-5921-45f6-a98f-e00510e2dcec"}} Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot 'attach_volume' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state rescued Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': 'f57a499d-80c7-4ac5-88fb-07b9192dc6a0', 'body': {'volumeAttachment': {'volumeId': '7e60a9b0-5921-45f6-a98f-e00510e2dcec'}}} Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 28 18:20:23.726953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state rescued Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state rescued Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 409 to user: Cannot 'attach_volume' instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 while it is in vm_state rescued {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d7d235c-3d25-43f6-8b58-4548a108458d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054472 Oct 28 18:20:23.731953 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2262/4029] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:20:23 2022] POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:20:23.733695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1179211535", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "70c5abb7-d4bd-4b29-a58f-099ce9f71832"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:23.797373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] validate_networks() for [('70c5abb7-d4bd-4b29-a58f-099ce9f71832', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:20:24.202182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:20:24.202609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:20:24.203107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:20:24.203523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:20:24.204126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:20:24.213434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:24.213935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:24.214396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:24.215212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:24.215671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:24.216124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:24.236546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:20:24.241934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Getting quotas for user 84bb8a18e9264efbaef518e6a5ae0e32 and project 86cc417f82d747d4b311c864b9743f90. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:20:24.256804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:20:24.260134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:20:24.327662 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64e6eafa-d43c-47c5-88ce-f40abb11bbb2 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597551 Oct 28 18:20:24.331977 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2263/4030] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:20:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:20:24.339293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f22366d-e58d-4fdb-be85-0ff7f7fae304 tempest-ComputeTenantNetworksTest-888854815 tempest-ComputeTenantNetworksTest-888854815-project] Calling method '.version_select at 0x7f78e23cd790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:24.457295 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f22366d-e58d-4fdb-be85-0ff7f7fae304 tempest-ComputeTenantNetworksTest-888854815 tempest-ComputeTenantNetworksTest-888854815-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/079c7696-1e6d-4113-9362-0fa4cb678a77" status: 200 len: 140 microversion: 2.1 time: 0.123657 Oct 28 18:20:24.458371 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2264/4031] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:20:24 2022] GET /compute/v2.1/os-tenant-networks/079c7696-1e6d-4113-9362-0fa4cb678a77 => generated 140 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:24.473260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:24.474195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:24.483633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:24.484166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:24.484670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:24.485554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:24.486222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:24.486923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:24.795172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:24.861312 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d265b1c-68a1-4b12-b828-cabe5be46097 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1508 microversion: 2.1 time: 0.392902 Oct 28 18:20:24.875841 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2265/4032] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:24 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:24.875841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:24.875841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:24.876383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:24.876665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:24.877579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:24.888288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:24.888881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:24.889610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:25.006939 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae1ed7cd-2263-44a9-b013-6eee43cf2177 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action" status: 202 len: 0 microversion: 2.1 time: 0.141613 Oct 28 18:20:25.009888 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2266/4033] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:20:24 2022] POST /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:20:25.027121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:25.027929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:25.050122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:25.050718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:25.051156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:25.051925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:25.052431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:25.052912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:25.392643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:25.401845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad3ee5a5-3828-4185-ab43-a7a4f3c1121a tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1527 microversion: 2.1 time: 0.388340 Oct 28 18:20:25.402905 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2267/4034] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:25 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1527 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:25.408174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:25.409132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:25.424007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:25.425811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:25.426254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:25.426978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:25.427438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:25.427891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:25.558411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:25.574217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-acc242ba-b15e-4c17-a821-3245055071a4 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1219 microversion: 2.1 time: 0.169896 Oct 28 18:20:25.575502 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2268/4035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:25 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:25.582581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:25.583705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:25.598265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:25.599163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:25.601087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:25.602308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:25.603184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:25.603852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:26.097113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:26.121736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:26.123940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:26.125395 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b6ca342-889c-4252-86a6-e795835f3b7a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1874 microversion: 2.42 time: 0.548642 Oct 28 18:20:26.125966 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2269/4036] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:25 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1874 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:26.132566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:26.133435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:26.152774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:26.153595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:26.154354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:26.155769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:26.156429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:26.158499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:26.482278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:26.491959 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2840778-7056-41aa-ac88-a26e0ed1b24e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1509 microversion: 2.1 time: 0.364743 Oct 28 18:20:26.493213 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2270/4037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:26 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:26.510355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:26.511985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:26.531799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:26.532584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:26.533792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:26.534777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:26.535472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:26.536173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:26.782034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:26.788249 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f44526fb-c9b1-4f08-8261-4a93655d5fdc tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1527 microversion: 2.1 time: 0.293916 Oct 28 18:20:26.788977 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2271/4038] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:26 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:26.798869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:26.801200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:26.813591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:26.814253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:26.815269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:26.816372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:26.817454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:26.818156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:27.056002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df00f0289484016a60bf76bf36e5b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73143b013601482688c81ecf99ea17b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:27.070262 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c424843-3c45-45d9-9044-fe317914fd20 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 200 len: 1508 microversion: 2.1 time: 0.279785 Oct 28 18:20:27.077178 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2272/4039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:26 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:27.081781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:27.082400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:27.093694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:27.093694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:27.093694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:27.094914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:27.094914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:27.095251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:27.168112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:27.177958 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5fe85bc-31d8-4f39-a8c3-1bac633d33fa tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1273 microversion: 2.1 time: 0.099920 Oct 28 18:20:27.187488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2273/4040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:27 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:27.459569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:27.460590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:27.473769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:27.474514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:27.475720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:27.477378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:27.478264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:27.478965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:27.505118 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] HTTP exception thrown: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Request method failure captured: Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec HTTP/1.1 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB1StEla1TSu4iXZGIHq6o0urTdoLm09HP7TWnYqUmv-HvXnK3yKDonc-Bi3arsCaV8XGkBto6pcG_RS11L2cXt9sWnICiTLwCJOJF6IuFO7w-Gpq4GTPV_Fxdyz7BSzB-ITonl68I90C_EoH4j0utjQTprpFKBz6FF65L3wJYa6rfk Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: becb641e9495437e982fc73c00b51f00 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1094320662 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/becb641e9495437e982fc73c00b51f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/becb641e9495437e982fc73c00b51f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_becb641e9495437e982fc73c00b51f00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/becb641e9495437e982fc73c00b51f00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1094320662 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: becb641e9495437e982fc73c00b51f00 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1094320662 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1094320662-project Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b11adcc0bc974f6eaa56ef422c0cb097 Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1094320662-project Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'b7924a83-fe3c-4866-bfda-3416f5a59dec'} Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:27.508731 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:27.517541 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:27.522071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Returning 404 to user: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:27.523196 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0420b51-fca8-49e8-958e-de6e82bed931 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 404 len: 111 microversion: 2.1 time: 0.343513 Oct 28 18:20:27.524067 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2274/4041] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:27 2022] DELETE /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 111 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:27.589506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9457317-8ba3-439e-817f-621dec804551 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Action: 'create', calling method: .version_select at 0x7f78dd52ae50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-606737404"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:28.101121 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9457317-8ba3-439e-817f-621dec804551 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.575642 Oct 28 18:20:28.101785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2275/4042] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Oct 28 18:20:27 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 577 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 18:20:28.118145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:28.124394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:28.133067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.133772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.134443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:28.136498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.137549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.138158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:28.165668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:28.466806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:28.492111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:28.493585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:28.495462 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-832db4c3-98b3-4b2b-8710-d49d87adeadb tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2828 microversion: 2.42 time: 0.389191 Oct 28 18:20:28.497186 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2276/4043] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:28 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2828 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:28.501940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0b8aa237-2bc8-488e-9cd8-d77caa1a5da1 req-973e235b-e378-4556-8c5c-284b99b6627d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce795a9-e731-4e75-8e78-7d756f17ba80", "name": "network-vif-deleted", "tag": "992d9d58-181c-4500-a14d-21b430851087"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:28.523345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:28.526375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b8aa237-2bc8-488e-9cd8-d77caa1a5da1 req-973e235b-e378-4556-8c5c-284b99b6627d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.527565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b8aa237-2bc8-488e-9cd8-d77caa1a5da1 req-973e235b-e378-4556-8c5c-284b99b6627d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.528120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b8aa237-2bc8-488e-9cd8-d77caa1a5da1 req-973e235b-e378-4556-8c5c-284b99b6627d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:28.540983 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0b8aa237-2bc8-488e-9cd8-d77caa1a5da1 req-973e235b-e378-4556-8c5c-284b99b6627d service nova] Creating event network-vif-deleted:992d9d58-181c-4500-a14d-21b430851087 for instance dce795a9-e731-4e75-8e78-7d756f17ba80 on n-h1-862404-2 Oct 28 18:20:28.548805 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0b8aa237-2bc8-488e-9cd8-d77caa1a5da1 req-973e235b-e378-4556-8c5c-284b99b6627d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049395 Oct 28 18:20:28.549781 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2277/4044] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:28.559792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:28.560998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:28.568063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.568771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.569436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:28.570490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.571456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.572222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:28.751173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:28.762791 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-49999f3c-ebf8-4fe8-88c5-9b7b5b89040e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1515 microversion: 2.1 time: 0.210905 Oct 28 18:20:28.764046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2278/4045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:28 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:28.783709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:28.784755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:28.793592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.794299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.794992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:28.796324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.797295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.797898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.045700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:29.055954 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff0a53ae-a4e7-4a50-a9c5-9fbf197cb04e tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1527 microversion: 2.1 time: 0.290621 Oct 28 18:20:29.084970 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2279/4046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:28 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1527 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:29.113823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:29.114879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] [instance: dce795a9-e731-4e75-8e78-7d756f17ba80] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:29.123077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:29.124005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:29.124653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.125840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:29.126498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:29.128103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.152923 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] HTTP exception thrown: Instance dce795a9-e731-4e75-8e78-7d756f17ba80 could not be found. Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Request method failure captured: Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 HTTP/1.1 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB0PCJVuFNndoM-u0tBviZXpzuogGFehoRRqLNWVjXuSqtWTrv85NOvZVWiFwKRgct2V9he1Ds5YsM9tMRGrsx3jJkz9_jRbvGR38xTrB1iRGjO5-knjKsmFTpBZrpCH5NRD9UTojhUaGp4HFUaKKC-mUcbtwHclMyHmCWmQWtdWUJI Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 73143b013601482688c81ecf99ea17b2 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-586649277 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73143b013601482688c81ecf99ea17b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73143b013601482688c81ecf99ea17b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73143b013601482688c81ecf99ea17b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73143b013601482688c81ecf99ea17b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-586649277 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 73143b013601482688c81ecf99ea17b2 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-586649277 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueTestJSONUnderV235-586649277-project Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 6df00f0289484016a60bf76bf36e5b16 Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-586649277-project Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance dce795a9-e731-4e75-8e78-7d756f17ba80 could not be found. Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'dce795a9-e731-4e75-8e78-7d756f17ba80'} Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce795a9-e731-4e75-8e78-7d756f17ba80 could not be found. Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce795a9-e731-4e75-8e78-7d756f17ba80 could not be found. Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:29.166965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce795a9-e731-4e75-8e78-7d756f17ba80 could not be found. Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] Returning 404 to user: Instance dce795a9-e731-4e75-8e78-7d756f17ba80 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:29.171511 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3267c745-6a1c-4f2d-89e8-be717a82c6c6 tempest-ServerRescueTestJSONUnderV235-586649277 tempest-ServerRescueTestJSONUnderV235-586649277-project] 10.222.0.16 "GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80" status: 404 len: 111 microversion: 2.1 time: 0.083990 Oct 28 18:20:29.207528 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2280/4047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:29 2022] GET /compute/v2.1/servers/dce795a9-e731-4e75-8e78-7d756f17ba80 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:29.247168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e74ed6a4-aa95-4543-bbbb-7434def6278e tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78de1483a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:29.374386 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e74ed6a4-aa95-4543-bbbb-7434def6278e tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 200 len: 344 microversion: 2.1 time: 0.165520 Oct 28 18:20:29.375560 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2281/4048] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:20:29 2022] GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:29.389158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:29.390448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:29.400862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:29.402276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:29.403223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.405028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:29.405945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:29.406854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.780504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:29.791521 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-103d7e4b-d86d-4976-b722-a176268b4a15 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1315 microversion: 2.1 time: 0.414622 Oct 28 18:20:29.792345 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2282/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:29 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:29.802806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:29.807546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:29.821840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:29.822355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:29.822808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.824281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:29.824749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:29.826770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.992360 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a053bf44-5c70-4365-8877-93e203f63d28 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.197707 Oct 28 18:20:29.994219 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2283/4050] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 18:20:29 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0/os-interface => generated 1828 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:30.013171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Action: 'update', calling method: >, body: {"server": {"name": "b7924a83-fe3c-4866-bfda-3416f5a59dec_new"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:30.016050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:30.044325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.045059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.045766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:30.046850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.047479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.048623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:30.086286 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] HTTP exception thrown: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Request method failure captured: Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec HTTP/1.1 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 64 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB1StEla1TSu4iXZGIHq6o0urTdoLm09HP7TWnYqUmv-HvXnK3yKDonc-Bi3arsCaV8XGkBto6pcG_RS11L2cXt9sWnICiTLwCJOJF6IuFO7w-Gpq4GTPV_Fxdyz7BSzB-ITonl68I90C_EoH4j0utjQTprpFKBz6FF65L3wJYa6rfk Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: becb641e9495437e982fc73c00b51f00 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1094320662 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/becb641e9495437e982fc73c00b51f00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/becb641e9495437e982fc73c00b51f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_becb641e9495437e982fc73c00b51f00", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/becb641e9495437e982fc73c00b51f00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1094320662 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: becb641e9495437e982fc73c00b51f00 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1094320662 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1094320662-project Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b11adcc0bc974f6eaa56ef422c0cb097 Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1094320662-project Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "b7924a83-fe3c-4866-bfda-3416f5a59dec_new"}} Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'b7924a83-fe3c-4866-bfda-3416f5a59dec', 'body': {'server': {'name': 'b7924a83-fe3c-4866-bfda-3416f5a59dec_new'}}} Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:20:30.093367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:30.097818 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:30.101498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] Returning 404 to user: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:30.103325 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60b236da-e140-4995-a4dc-5c54f36fa9b4 tempest-ServersNegativeTestMultiTenantJSON-1094320662 tempest-ServersNegativeTestMultiTenantJSON-1094320662-project] 10.222.0.16 "PUT /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 404 len: 111 microversion: 2.1 time: 0.107438 Oct 28 18:20:30.104884 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2284/4051] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:20:29 2022] PUT /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:30.118447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:30.119076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:30.126608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.127482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.128858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:30.130324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.131850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.133310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:30.211500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:20:30.375913 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-21ae3e8f-4e4b-4ae4-a53c-76c513cc062d tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 204 len: 0 microversion: 2.1 time: 0.261634 Oct 28 18:20:30.376856 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2285/4052] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:30 2022] DELETE /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:20:30.394224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:30.401831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:30.424430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.430129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.433221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:30.440252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.442926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.444336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:31.199068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:31.214323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a0ae554f-c42d-4b8d-a41a-0d7ac4ee54db tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1533 microversion: 2.1 time: 0.828244 Oct 28 18:20:31.302791 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2286/4053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:30 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1533 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:31.302791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8aead61d-fca5-489f-9717-484f71be63db tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd50ab80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:31.302791 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8aead61d-fca5-489f-9717-484f71be63db tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 200 len: 345 microversion: 2.1 time: 0.069448 Oct 28 18:20:31.302791 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2287/4054] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:20:31 2022] GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:31.321034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a0899cd1-b4de-4ef4-8694-b5221ee0570d req-aabbb2b5-0f94-4fe7-aaa4-038b1c54c3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9afe13-9d43-43f8-b7f9-6cb4a0745852", "tag": "ecab7337-b58b-4aba-aef2-03d0445dee37"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:31.331744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0899cd1-b4de-4ef4-8694-b5221ee0570d req-aabbb2b5-0f94-4fe7-aaa4-038b1c54c3bd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:31.332263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0899cd1-b4de-4ef4-8694-b5221ee0570d req-aabbb2b5-0f94-4fe7-aaa4-038b1c54c3bd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:31.332702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0899cd1-b4de-4ef4-8694-b5221ee0570d req-aabbb2b5-0f94-4fe7-aaa4-038b1c54c3bd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:31.345648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a0899cd1-b4de-4ef4-8694-b5221ee0570d req-aabbb2b5-0f94-4fe7-aaa4-038b1c54c3bd service nova] Creating event network-changed:ecab7337-b58b-4aba-aef2-03d0445dee37 for instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 on n-h1-862404-2 Oct 28 18:20:31.351174 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a0899cd1-b4de-4ef4-8694-b5221ee0570d req-aabbb2b5-0f94-4fe7-aaa4-038b1c54c3bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056667 Oct 28 18:20:31.352247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2288/4055] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:31.358173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:31.359730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:31.367205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:31.367732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:31.368212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:31.368937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:31.369407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:31.370462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:31.716089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:31.728919 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c13bf741-860e-4f25-a4a0-5ecaff21c0c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1315 microversion: 2.1 time: 0.375377 Oct 28 18:20:31.730622 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2289/4056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:31 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:31.735761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d1eef54-524e-4466-9862-077482ccd730 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Action: 'create', calling method: .version_select at 0x7f78dd4a99d0>, body: {"snapshot": {"volume_id": "94fb46bd-c7f9-4b2f-ac6f-34675f98f381", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1809071756"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:32.046567 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d1eef54-524e-4466-9862-077482ccd730 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.314657 Oct 28 18:20:32.047758 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2290/4057] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Oct 28 18:20:31 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:32.059870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-750f1037-c4ff-4d22-a7e1-72f0edb011c3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'create', calling method: .version_select at 0x7f78dd5f3af0>, body: {"keypair": {"name": "tempest-keypair-473419009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5kFu+/qvJVgk8FTUpZu1Wss119+p2+K5xMNcYQZ2prj9fCZzICJW05YfuY1zZQHtaYMfPDGfzpW6exbwtaOtsOCPdUFHUUKttaSmHMJh32aiKUMK1QdlHduAS9bIfQ/g=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:32.085527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-750f1037-c4ff-4d22-a7e1-72f0edb011c3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Getting quotas for project ce634b9e301b4619a1f0ce89cfc1ed68. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:20:32.095118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-750f1037-c4ff-4d22-a7e1-72f0edb011c3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Getting quotas for user b7740749fbc24944ac581deab9701f53 and project ce634b9e301b4619a1f0ce89cfc1ed68. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:20:32.136243 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-750f1037-c4ff-4d22-a7e1-72f0edb011c3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085806 Oct 28 18:20:32.138041 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2291/4058] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:20:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:32.145243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ece04fc-9086-411f-b0d8-8128c090fd2f tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd5553a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:32.248243 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ece04fc-9086-411f-b0d8-8128c090fd2f tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f" status: 200 len: 287 microversion: 2.1 time: 0.108552 Oct 28 18:20:32.248834 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2292/4059] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:20:32 2022] GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:32.257697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:32.258499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:32.268062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:32.268776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:32.269855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:32.272294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:32.272935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:32.277516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:32.952410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:32.960894 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d86a184-5c67-4604-9af2-03720a7dc7f9 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1533 microversion: 2.1 time: 0.710785 Oct 28 18:20:32.964568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2293/4060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:32 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1533 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:32.973344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb5f7520-9228-4be4-8b8c-56a9222fea6c tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78e23cd5e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:33.047777 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb5f7520-9228-4be4-8b8c-56a9222fea6c tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.082106 Oct 28 18:20:33.054646 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2294/4061] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 18:20:32 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:33.070991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:33.071775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:33.081546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:33.082213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:33.082794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:33.083642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:33.084276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:33.084838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:34.221779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:34.231754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:34.241162 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-090d1e2b-1915-4022-8e78-9b731528f317 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1315 microversion: 2.1 time: 1.183120 Oct 28 18:20:34.242189 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2295/4062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:33 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1315 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:34.258286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e3d4be2-3d21-410b-8923-8926e49008b7 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd5a3040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:34.335746 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e3d4be2-3d21-410b-8923-8926e49008b7 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f" status: 200 len: 287 microversion: 2.1 time: 0.087298 Oct 28 18:20:34.336437 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2296/4063] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:20:34 2022] GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:34.343279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:34.345771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:34.376583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:34.382984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:34.388452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:34.392352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:34.398260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:34.399002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:34.591635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e45d4d9c87495fa87409484bef5f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2433a50e3dd84abfab218218d5aeab1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:34.607996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca4cc69d-c6f7-4e1e-8eb2-37cdc7933f93 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 200 len: 1312 microversion: 2.1 time: 0.270218 Oct 28 18:20:34.614781 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2297/4064] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:34 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:34.628254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-13b95247-645d-4e7b-b309-1b53e0d0a9bc req-1f988dcf-5249-4895-b107-e0ac1ac42b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "tag": "98221312-7849-4682-b29b-3081bd5426a5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:34.665854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13b95247-645d-4e7b-b309-1b53e0d0a9bc req-1f988dcf-5249-4895-b107-e0ac1ac42b3a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:34.682093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13b95247-645d-4e7b-b309-1b53e0d0a9bc req-1f988dcf-5249-4895-b107-e0ac1ac42b3a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:34.683242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13b95247-645d-4e7b-b309-1b53e0d0a9bc req-1f988dcf-5249-4895-b107-e0ac1ac42b3a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:34.709046 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-13b95247-645d-4e7b-b309-1b53e0d0a9bc req-1f988dcf-5249-4895-b107-e0ac1ac42b3a service nova] Creating event network-changed:98221312-7849-4682-b29b-3081bd5426a5 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:20:34.720130 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-13b95247-645d-4e7b-b309-1b53e0d0a9bc req-1f988dcf-5249-4895-b107-e0ac1ac42b3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101435 Oct 28 18:20:34.723140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2298/4065] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:35.270091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:35.271014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:35.291316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:35.292465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:35.292939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:35.293726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:35.294148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:35.294594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:35.858658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:35.872607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-14cde43a-7e83-4754-9256-d76203c73974 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1315 microversion: 2.1 time: 0.607021 Oct 28 18:20:35.876112 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2299/4066] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:35 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:35.884650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8b8476e-a004-45f4-ac78-22028504ec59 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78e2466dc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:35.966047 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8b8476e-a004-45f4-ac78-22028504ec59 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f" status: 200 len: 288 microversion: 2.1 time: 0.088233 Oct 28 18:20:35.966990 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2300/4067] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:20:35 2022] GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f => generated 288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:35.979747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:35.980780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] [instance: b7924a83-fe3c-4866-bfda-3416f5a59dec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:35.993037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:35.993929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:35.997162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:35.998179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:35.999149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:35.999747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:36.037834 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] HTTP exception thrown: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Request method failure captured: Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec HTTP/1.1 Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB1J0gJ9jIpgySuiQ7ELBk6fkWPwgq_-1by69ibpCd-oKIlgHB12N2-3IAYIu4r2EmIV0UG8eOkXoqS0AcfVl8eShOiOq0jTwFy_g5hUZ8OCBLblDceYVN7kbWHPhnqf-CmBLIOK5KXbq3kpumGZX62Bju5k2UHeHef7xPDFpZfevQQ Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 2433a50e3dd84abfab218218d5aeab1b Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1925177720 Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2433a50e3dd84abfab218218d5aeab1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2433a50e3dd84abfab218218d5aeab1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2433a50e3dd84abfab218218d5aeab1b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2433a50e3dd84abfab218218d5aeab1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1925177720 Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 2433a50e3dd84abfab218218d5aeab1b Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1925177720 Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1925177720-project Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b3e45d4d9c87495fa87409484bef5f70 Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1925177720-project Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'b7924a83-fe3c-4866-bfda-3416f5a59dec'} Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:36.044492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. Oct 28 18:20:36.047885 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:36.061139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] Returning 404 to user: Instance b7924a83-fe3c-4866-bfda-3416f5a59dec could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:36.065683 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8ce4dfb-b7ab-43d0-9898-eec674ca1749 tempest-ServersNegativeTestMultiTenantJSON-1925177720 tempest-ServersNegativeTestMultiTenantJSON-1925177720-project] 10.222.0.16 "GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec" status: 404 len: 111 microversion: 2.1 time: 0.096674 Oct 28 18:20:36.070082 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2301/4068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:35 2022] GET /compute/v2.1/servers/b7924a83-fe3c-4866-bfda-3416f5a59dec => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:36.087015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c076b4e6-8075-48c4-af7f-c947bc096a79 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd5f7940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:36.226204 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c076b4e6-8075-48c4-af7f-c947bc096a79 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f" status: 202 len: 0 microversion: 2.1 time: 0.152166 Oct 28 18:20:36.227469 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2302/4069] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 18:20:36 2022] DELETE /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:20:36.237625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47168c00-c40b-45bf-86b2-df246872c73a tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78de4e5f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:36.351989 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47168c00-c40b-45bf-86b2-df246872c73a tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f" status: 200 len: 287 microversion: 2.1 time: 0.120147 Oct 28 18:20:36.354618 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2303/4070] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:20:36 2022] GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:36.779663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e185f322-d134-4658-928d-291a1ccdd9ab req-54f15e86-997b-4311-8184-69fb0f42dd61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7924a83-fe3c-4866-bfda-3416f5a59dec", "name": "network-vif-deleted", "tag": "8cea003e-29ea-4fac-97e9-abc55575e756"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:36.809037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e185f322-d134-4658-928d-291a1ccdd9ab req-54f15e86-997b-4311-8184-69fb0f42dd61 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:36.814645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e185f322-d134-4658-928d-291a1ccdd9ab req-54f15e86-997b-4311-8184-69fb0f42dd61 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:36.815274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e185f322-d134-4658-928d-291a1ccdd9ab req-54f15e86-997b-4311-8184-69fb0f42dd61 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:36.856733 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e185f322-d134-4658-928d-291a1ccdd9ab req-54f15e86-997b-4311-8184-69fb0f42dd61 service nova] Creating event network-vif-deleted:8cea003e-29ea-4fac-97e9-abc55575e756 for instance b7924a83-fe3c-4866-bfda-3416f5a59dec on n-h2-862404-2 Oct 28 18:20:36.876858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e185f322-d134-4658-928d-291a1ccdd9ab req-54f15e86-997b-4311-8184-69fb0f42dd61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102268 Oct 28 18:20:36.877881 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2304/4071] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:36.905054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:36.906043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:36.923716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:36.924996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:36.925909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:36.928248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:36.928999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:36.929803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:37.546501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:37.564421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-374c6e80-54dd-45ad-a40c-29cec78f01c9 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1315 microversion: 2.1 time: 0.665608 Oct 28 18:20:37.568113 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2305/4072] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:36 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:37.580945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25f7c0eb-3fc1-43b3-b113-96875fde1373 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd555280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:37.648211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25f7c0eb-3fc1-43b3-b113-96875fde1373 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f" status: 200 len: 287 microversion: 2.1 time: 0.078469 Oct 28 18:20:37.649307 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2306/4073] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:20:37 2022] GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:38.009832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-552929608", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ef5dac1-d901-4add-a069-15c2a8da687c"}], "security_groups": [{"name": "tempest-securitygroup--1627805230"}], "key_name": "tempest-keypair-473419009", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:38.777074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] validate_networks() for [('1ef5dac1-d901-4add-a069-15c2a8da687c', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:20:40.010684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:20:40.012220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:20:40.012873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:20:40.013432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:20:40.014075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:20:40.031627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:40.037258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:40.044648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:40.046016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:40.046654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:40.047269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:40.082746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Getting quotas for project ce634b9e301b4619a1f0ce89cfc1ed68. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:20:40.090157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Getting quotas for user b7740749fbc24944ac581deab9701f53 and project ce634b9e301b4619a1f0ce89cfc1ed68. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:20:40.132053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:20:40.134635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:20:40.241216 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-620037ab-bf07-483d-b003-7e754255d361 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.232340 Oct 28 18:20:40.251180 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2307/4074] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:20:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:20:40.260049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:40.262026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:40.270380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:40.271201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:40.272048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:40.272912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:40.273379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:40.273814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:40.279666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:40.650751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:40.663380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50d97d07-6b96-41d4-87e7-cf712e0c71c6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1315 microversion: 2.1 time: 0.410590 Oct 28 18:20:40.671515 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2308/4075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:40 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:40.672815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4748fe51-c21a-4d55-9d2c-1c01c07c8e9a tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd542820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:40.728550 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4748fe51-c21a-4d55-9d2c-1c01c07c8e9a tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] HTTP exception thrown: Snapshot a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f could not be found. Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4748fe51-c21a-4d55-9d2c-1c01c07c8e9a tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Request method failure captured: Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f HTTP/1.1 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB1q76jSFa_1UlnpYEQRSF5FrKEoWn8c6NRKwgy9FqoUT6TVphpO3Rom8sKIQf_rLnf3JhGz240qI8bQOb186rxokFGLA6fqQDojo5ZyKxJ2Tb2yRZ-DLokX16_CJn-IASCrpJoNYK58a7RMP4lQJKVO_EYi4ljDpj2dKfS4STXmyGY Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f83fd3a0e0174eaa8f43fd1444643a96 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f83fd3a0e0174eaa8f43fd1444643a96", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f83fd3a0e0174eaa8f43fd1444643a96 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotsTestJSON-932195773-project Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 37197a7c59fc4987993ec75a88c9ed56 Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-932195773-project Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: exception: Snapshot a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f could not be found. Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f'} Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f could not be found. (HTTP 404) (Request-ID: req-2d19732b-2387-431c-b3b1-4c87604cc272) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:20:40.750837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f could not be found. Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f could not be found. Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f could not be found. Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4748fe51-c21a-4d55-9d2c-1c01c07c8e9a tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Returning 404 to user: Snapshot a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:40.755279 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4748fe51-c21a-4d55-9d2c-1c01c07c8e9a tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f" status: 404 len: 111 microversion: 2.1 time: 0.085695 Oct 28 18:20:40.768421 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2309/4076] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 18:20:40 2022] GET /compute/v2.1/os-snapshots/a2b07ea5-4b78-4e77-bf68-f1e7ca371c8f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:40.768421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ba86eb01-4c42-47fb-9051-4450a53a55fc req-826c6b87-ea48-437a-b3f3-fe0747be9834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9afe13-9d43-43f8-b7f9-6cb4a0745852", "name": "network-vif-plugged", "status": "completed", "tag": "ecab7337-b58b-4aba-aef2-03d0445dee37"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:40.795304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba86eb01-4c42-47fb-9051-4450a53a55fc req-826c6b87-ea48-437a-b3f3-fe0747be9834 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:40.799784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba86eb01-4c42-47fb-9051-4450a53a55fc req-826c6b87-ea48-437a-b3f3-fe0747be9834 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:40.803809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba86eb01-4c42-47fb-9051-4450a53a55fc req-826c6b87-ea48-437a-b3f3-fe0747be9834 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:40.826858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ba86eb01-4c42-47fb-9051-4450a53a55fc req-826c6b87-ea48-437a-b3f3-fe0747be9834 service nova] Creating event network-vif-plugged:ecab7337-b58b-4aba-aef2-03d0445dee37 for instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 on n-h1-862404-2 Oct 28 18:20:40.845712 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ba86eb01-4c42-47fb-9051-4450a53a55fc req-826c6b87-ea48-437a-b3f3-fe0747be9834 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088163 Oct 28 18:20:40.853752 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2310/4077] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:40.865997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55e2fe0d-5d27-4bfd-9935-a4191f66e2ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:40.869311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55e2fe0d-5d27-4bfd-9935-a4191f66e2ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:41.152122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-55e2fe0d-5d27-4bfd-9935-a4191f66e2ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:41.171353 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55e2fe0d-5d27-4bfd-9935-a4191f66e2ef tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1244 microversion: 2.1 time: 0.315303 Oct 28 18:20:41.172420 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2311/4078] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:40 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1244 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:41.177089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b5e200d-40d7-43ec-a29d-ed8e8fdb0795 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd678f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:41.377688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b5e200d-40d7-43ec-a29d-ed8e8fdb0795 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 202 len: 0 microversion: 2.1 time: 0.203954 Oct 28 18:20:41.378890 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2312/4079] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:20:41 2022] DELETE /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:20:41.390675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a98d3b5-3c32-42f1-bd23-a52c026112d2 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd4a9040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:41.536319 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a98d3b5-3c32-42f1-bd23-a52c026112d2 tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 200 len: 344 microversion: 2.1 time: 0.152262 Oct 28 18:20:41.538126 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2313/4080] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:20:41 2022] GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:41.687386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:41.688258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:41.697162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:41.699039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:41.702689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:41.704792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:41.708382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:41.709066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:42.048542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:42.065904 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72ca0cd9-1c77-422b-aa45-17679b63a3f3 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1315 microversion: 2.1 time: 0.382343 Oct 28 18:20:42.079518 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2314/4081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:41 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:42.199360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:42.200783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:42.221519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:42.222402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:42.226427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:42.227447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:42.228691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:42.231084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:42.411668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:42.421810 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2094fdc-ce80-4cca-911a-a4dc008726dd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1296 microversion: 2.1 time: 0.228645 Oct 28 18:20:42.426759 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2315/4082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:42 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1296 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:42.758431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1121445933", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": "none"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:42.882367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:20:42.888979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:20:42.890380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:20:42.890964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:20:42.891534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:20:42.912226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:42.915149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:42.916975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:42.920128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:42.922014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:42.922642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:42.976290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Getting quotas for project 9578de9c6e8440fd9c5019c489b013ea. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:20:42.992446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Getting quotas for user 2b4d4c77ea67406c92c90b3e6ec4f40f and project 9578de9c6e8440fd9c5019c489b013ea. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:20:43.026713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:20:43.033301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: 0203643b-a83e-4d2b-88b4-597ebe5cc673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:20:43.102803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:43.148353 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2889b72b-630f-45ac-bdb7-1f2d20fe9dc3 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.709917 Oct 28 18:20:43.150566 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2316/4083] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:20:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:20:43.160754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86bac385-888d-4627-8b0d-bc0a3b84a00f tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd5f3550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:43.341452 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86bac385-888d-4627-8b0d-bc0a3b84a00f tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 200 len: 344 microversion: 2.1 time: 0.189131 Oct 28 18:20:43.342105 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2317/4084] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:20:43 2022] GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:43.358937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:43.371604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:43.392418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:43.393247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:43.394022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:43.394989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:43.396503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:43.397114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:44.066697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:44.077914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f319649b-e1be-4f8f-b470-47167768a861 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1501 microversion: 2.1 time: 0.726000 Oct 28 18:20:44.081099 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2318/4085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:43 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1501 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:44.103247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80595c96-0397-4836-a224-9c8d965b98cf tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:44.106559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80595c96-0397-4836-a224-9c8d965b98cf tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: 0203643b-a83e-4d2b-88b4-597ebe5cc673] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:44.381995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80595c96-0397-4836-a224-9c8d965b98cf tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:44.401244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80595c96-0397-4836-a224-9c8d965b98cf tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:44.409275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80595c96-0397-4836-a224-9c8d965b98cf tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:44.411265 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80595c96-0397-4836-a224-9c8d965b98cf tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673" status: 200 len: 1278 microversion: 2.47 time: 0.328466 Oct 28 18:20:44.412997 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2319/4086] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:44 2022] GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673 => generated 1278 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:44.437020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:44.439562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:44.473046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:44.477215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:44.489137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:44.490318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:44.494406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:44.496389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:44.691448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:44.703067 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6b177ed-ee81-4c59-8337-c9f655c7839b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1302 microversion: 2.1 time: 0.288714 Oct 28 18:20:44.705813 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2320/4087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:44 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1302 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:44.734371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:44.739407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:44.753495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:44.754709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:44.756605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:44.758108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:44.759011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:44.759845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:44.797641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lazy-loading 'flavor' on Instance uuid de9afe13-9d43-43f8-b7f9-6cb4a0745852 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:20:44.992492 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2950fd76-efb7-4596-88cf-6dfe56f3f583 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "POST /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852/action" status: 202 len: 0 microversion: 2.1 time: 0.284975 Oct 28 18:20:44.998026 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2321/4088] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:20:44 2022] POST /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:20:45.012397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ecdf89a7-e56d-43c7-ad05-e3766048dc6d tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd4a94c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:45.115974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ecdf89a7-e56d-43c7-ad05-e3766048dc6d tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 200 len: 344 microversion: 2.1 time: 0.118275 Oct 28 18:20:45.116809 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2322/4089] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:20:44 2022] GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 344 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:45.123548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1834475495", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": "none"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:45.232809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:20:45.234437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:20:45.236636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:20:45.238598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:20:45.240989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:20:45.266491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:45.267735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:45.269060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:45.269929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:45.270521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:45.271029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:45.293545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Getting quotas for project 9578de9c6e8440fd9c5019c489b013ea. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:20:45.300618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Getting quotas for user 2b4d4c77ea67406c92c90b3e6ec4f40f and project 9578de9c6e8440fd9c5019c489b013ea. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:20:45.315749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:20:45.319022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:20:45.452440 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6d7b1cd-bc67-416e-8782-e6dc4eadf403 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.329846 Oct 28 18:20:45.453865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2323/4090] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 336 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:20:45.466605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:45.481702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:45.505393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:45.506653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:45.508294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:45.509465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:45.512815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:45.513667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:46.262143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:46.282711 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee65a188-d4ea-40b5-a27e-05393a237e8e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1509 microversion: 2.1 time: 0.820745 Oct 28 18:20:46.288000 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2324/4091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:45 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1509 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:46.304481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5474a077-8236-434f-9664-48bb63f3a5ec tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:46.311130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5474a077-8236-434f-9664-48bb63f3a5ec tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:46.415244 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5474a077-8236-434f-9664-48bb63f3a5ec tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "PUT /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 992 microversion: 2.47 time: 0.120589 Oct 28 18:20:46.434740 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2325/4092] 10.222.0.16 () {62 vars in 1297 bytes} [Fri Oct 28 18:20:46 2022] PUT /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 992 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:20:46.440224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:46.441092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:46.448746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:46.449741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:46.450336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:46.451291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:46.451989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:46.452565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:46.652872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:46.673118 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6674c8a-ffb1-49b0-b671-65c67a8c202c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1370 microversion: 2.1 time: 0.237005 Oct 28 18:20:46.673769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2326/4093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:46 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:46.680047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1cc0a6d-b538-4384-8bc2-ad879c2db9cd tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd5553a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:46.755529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f1cc0a6d-b538-4384-8bc2-ad879c2db9cd tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] HTTP exception thrown: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1cc0a6d-b538-4384-8bc2-ad879c2db9cd tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Request method failure captured: Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 HTTP/1.1 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB1q76jSFa_1UlnpYEQRSF5FrKEoWn8c6NRKwgy9FqoUT6TVphpO3Rom8sKIQf_rLnf3JhGz240qI8bQOb186rxokFGLA6fqQDojo5ZyKxJ2Tb2yRZ-DLokX16_CJn-IASCrpJoNYK58a7RMP4lQJKVO_EYi4ljDpj2dKfS4STXmyGY Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f83fd3a0e0174eaa8f43fd1444643a96 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f83fd3a0e0174eaa8f43fd1444643a96", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f83fd3a0e0174eaa8f43fd1444643a96 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotsTestJSON-932195773-project Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 37197a7c59fc4987993ec75a88c9ed56 Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-932195773-project Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: exception: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '94fb46bd-c7f9-4b2f-ac6f-34675f98f381'} Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. (HTTP 404) (Request-ID: req-657b1bd6-681e-4516-98df-2a87ab4b7fcd) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:20:46.757879 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1cc0a6d-b538-4384-8bc2-ad879c2db9cd tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Returning 404 to user: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:46.762268 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f1cc0a6d-b538-4384-8bc2-ad879c2db9cd tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 404 len: 109 microversion: 2.1 time: 0.083312 Oct 28 18:20:46.765028 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2327/4094] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:20:46 2022] GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:46.771337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:46.777963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:46.793771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:46.794996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:46.795917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:46.796834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:46.797571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:46.798023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:46.942538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:46.953566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:46.955032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:46.956229 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f620243a-ecd1-4ab4-8680-a4d40e18b01d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1274 microversion: 2.47 time: 0.190288 Oct 28 18:20:46.956797 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2328/4095] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:46 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:46.968114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3904db9b-2266-4b33-a896-ac1e6de91c0e tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd5550d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:47.046279 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3904db9b-2266-4b33-a896-ac1e6de91c0e tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] HTTP exception thrown: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3904db9b-2266-4b33-a896-ac1e6de91c0e tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Request method failure captured: Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 HTTP/1.1 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB1q76jSFa_1UlnpYEQRSF5FrKEoWn8c6NRKwgy9FqoUT6TVphpO3Rom8sKIQf_rLnf3JhGz240qI8bQOb186rxokFGLA6fqQDojo5ZyKxJ2Tb2yRZ-DLokX16_CJn-IASCrpJoNYK58a7RMP4lQJKVO_EYi4ljDpj2dKfS4STXmyGY Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f83fd3a0e0174eaa8f43fd1444643a96 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f83fd3a0e0174eaa8f43fd1444643a96", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f83fd3a0e0174eaa8f43fd1444643a96 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotsTestJSON-932195773-project Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 37197a7c59fc4987993ec75a88c9ed56 Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-932195773-project Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: exception: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '94fb46bd-c7f9-4b2f-ac6f-34675f98f381'} Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. (HTTP 404) (Request-ID: req-1416292b-bef7-4f6c-8565-87dc9cc583b9) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:20:47.048779 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.052898 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.055961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3904db9b-2266-4b33-a896-ac1e6de91c0e tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Returning 404 to user: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:47.057060 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3904db9b-2266-4b33-a896-ac1e6de91c0e tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 404 len: 109 microversion: 2.1 time: 0.099263 Oct 28 18:20:47.058757 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2329/4096] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:20:46 2022] DELETE /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:47.072377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a48b40f-47f9-4dd8-907f-5907f316badf tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Calling method '.version_select at 0x7f78dd534280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:47.146311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8a48b40f-47f9-4dd8-907f-5907f316badf tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] HTTP exception thrown: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a48b40f-47f9-4dd8-907f-5907f316badf tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Request method failure captured: Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 HTTP/1.1 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB1q76jSFa_1UlnpYEQRSF5FrKEoWn8c6NRKwgy9FqoUT6TVphpO3Rom8sKIQf_rLnf3JhGz240qI8bQOb186rxokFGLA6fqQDojo5ZyKxJ2Tb2yRZ-DLokX16_CJn-IASCrpJoNYK58a7RMP4lQJKVO_EYi4ljDpj2dKfS4STXmyGY Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f83fd3a0e0174eaa8f43fd1444643a96 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f83fd3a0e0174eaa8f43fd1444643a96", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f83fd3a0e0174eaa8f43fd1444643a96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f83fd3a0e0174eaa8f43fd1444643a96 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-932195773 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotsTestJSON-932195773-project Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 37197a7c59fc4987993ec75a88c9ed56 Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-932195773-project Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: method: Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: exception: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '94fb46bd-c7f9-4b2f-ac6f-34675f98f381'} Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. (HTTP 404) (Request-ID: req-3b1b1ff4-e7f9-4f0c-b223-5a65380e82bb) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 18:20:47.149587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. Oct 28 18:20:47.153470 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:47.156549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a48b40f-47f9-4dd8-907f-5907f316badf tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] Returning 404 to user: Volume 94fb46bd-c7f9-4b2f-ac6f-34675f98f381 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:47.157544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a48b40f-47f9-4dd8-907f-5907f316badf tempest-VolumesSnapshotsTestJSON-932195773 tempest-VolumesSnapshotsTestJSON-932195773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381" status: 404 len: 109 microversion: 2.1 time: 0.094883 Oct 28 18:20:47.158889 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2330/4097] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:20:47 2022] GET /compute/v2.1/os-volumes/94fb46bd-c7f9-4b2f-ac6f-34675f98f381 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:47.313286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:47.314725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:47.327520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:47.328390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:47.330570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:47.331535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:47.333413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:47.336220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:47.770920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:47.793365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-74adae74-3254-49c0-ac8d-14a2e3e6e939 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1492 microversion: 2.1 time: 0.484018 Oct 28 18:20:47.819214 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2331/4098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:47 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1492 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:47.830914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:47.835007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:47.855701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:47.866209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:47.871723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:47.877374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:47.881285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:47.882073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:48.326653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:48.347429 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6edadb83-5bc5-4782-8e52-b309e40688e8 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1370 microversion: 2.1 time: 0.526172 Oct 28 18:20:48.348413 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2332/4099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:47 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1370 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:48.358055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:48.358890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:48.366995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:48.367795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:48.368831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:48.370392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:48.371184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:48.373860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:48.408470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:20:48.561900 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-602c73ca-dd89-43a1-a747-986a0ccfc9c0 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 204 len: 0 microversion: 2.1 time: 0.208498 Oct 28 18:20:48.561900 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2333/4100] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:48 2022] DELETE /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:20:48.576540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:48.577406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:48.585669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:48.586280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:48.589420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:48.590353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:48.596569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:48.597034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:48.648773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:48.798375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:48.837887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:48.846328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:48.849075 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35c49ec1-10ec-409d-8f6c-31fc2dde8935 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1336 microversion: 2.47 time: 0.288316 Oct 28 18:20:48.870886 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2334/4101] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:48 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1336 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:48.886981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:48.888188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:48.895300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:48.896062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:48.896690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:48.898187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:48.898846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:48.899467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:49.230328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:49.263072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9dc8c14-653c-4158-91d5-76c09adeac9d tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1498 microversion: 2.1 time: 0.370009 Oct 28 18:20:49.263977 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2335/4102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:48 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1498 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:49.270091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-42d64b10-b633-4f78-a20d-3df578679f51 req-ca15ac26-acb3-4ce1-91f4-7d7a2596af60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829508d1-3732-4715-8cf2-7eb0c46ad1e8", "tag": "d23e6dd8-35c1-45d5-a25a-5974d1471990"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:49.302840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42d64b10-b633-4f78-a20d-3df578679f51 req-ca15ac26-acb3-4ce1-91f4-7d7a2596af60 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:49.304328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42d64b10-b633-4f78-a20d-3df578679f51 req-ca15ac26-acb3-4ce1-91f4-7d7a2596af60 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:49.304762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-42d64b10-b633-4f78-a20d-3df578679f51 req-ca15ac26-acb3-4ce1-91f4-7d7a2596af60 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:49.320787 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-42d64b10-b633-4f78-a20d-3df578679f51 req-ca15ac26-acb3-4ce1-91f4-7d7a2596af60 service nova] Creating event network-changed:d23e6dd8-35c1-45d5-a25a-5974d1471990 for instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 on n-h2-862404-2 Oct 28 18:20:49.339329 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-42d64b10-b633-4f78-a20d-3df578679f51 req-ca15ac26-acb3-4ce1-91f4-7d7a2596af60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072169 Oct 28 18:20:49.341915 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2336/4103] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:49.374397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:49.375664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:49.387356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:49.389200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:49.390001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:49.391732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:49.392586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:49.393037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:49.642283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:49.653604 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-851a6742-091a-4791-a784-c853aecc3ec7 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1370 microversion: 2.1 time: 0.284482 Oct 28 18:20:49.659053 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2337/4104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:49 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:49.892281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:49.895558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:49.909127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:49.910106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:49.910713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:49.911593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:49.912267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:49.912852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:50.011999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:50.024593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:50.026740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:50.028563 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-74ac6645-8eeb-43e0-9aa3-2ebebd989021 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1336 microversion: 2.47 time: 0.145660 Oct 28 18:20:50.038015 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2338/4105] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:49 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1336 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:50.288788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:50.289852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:50.304486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:50.305939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:50.308448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:50.310059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:50.311635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:50.312912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:50.926499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:50.938502 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7edfb12-52cd-45a5-8668-447fab509d0b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1498 microversion: 2.1 time: 0.653417 Oct 28 18:20:50.940101 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2339/4106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:50 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1498 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:50.950299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:50.951186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:50.962847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:50.966225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:50.967396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:50.970370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:50.971312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:50.972482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:51.313619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:51.355091 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-617a0e0c-8e1b-407c-85f1-4375d4441b6c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1370 microversion: 2.1 time: 0.411110 Oct 28 18:20:51.361365 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2340/4107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:50 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1370 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:51.381996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:51.384282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:51.399622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:51.400425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:51.401245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:51.402983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:51.403802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:51.404745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:51.568830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:51.580039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:51.581608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:51.583149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96a28a5d-1f96-474d-a125-beeaf3a215a1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1357 microversion: 2.47 time: 0.217522 Oct 28 18:20:51.584193 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2341/4108] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:51 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:51.636697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:51.642393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:51.684357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:51.685888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:51.687038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:51.691287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:51.692818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:51.693612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:51.846686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:20:51.851985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:20:51.853170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:20:51.856857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:20:51.857656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:20:51.939515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:51.965516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:51.967100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:51.969306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:51.973590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:51.975544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:51.977549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:52.061303 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-298d4f57-7f8e-4df7-ac7f-41e3cec2fc2a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "POST /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44/action" status: 202 len: 1079 microversion: 2.47 time: 0.444128 Oct 28 18:20:52.066811 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2342/4109] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:20:51 2022] POST /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44/action => generated 1079 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 18:20:52.077414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:52.079510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:52.099069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:52.108044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:52.108830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:52.109767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:52.110452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:52.111089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:52.861944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:52.894826 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8839a11-93bf-4d6b-934b-a6552f04ad61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1498 microversion: 2.1 time: 0.827193 Oct 28 18:20:52.897380 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2343/4110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:52 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1498 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:52.908456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:52.909511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:52.930490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:52.933472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:52.935713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:52.937173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:52.938785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:52.939626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:53.313052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:53.323701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:53.325285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:53.326495 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e316e70f-d43e-4728-9d21-4448ac360a09 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.427847 Oct 28 18:20:53.340072 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2344/4111] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:52 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:53.365316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:53.369942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:53.395400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:53.401835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:53.402485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:53.407751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:53.413182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:53.413907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:54.289206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:54.305229 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7c90b47-f514-4dfb-a947-8aad9e17780c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1370 microversion: 2.1 time: 0.968215 Oct 28 18:20:54.325198 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2345/4112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:53 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1370 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:54.332101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:54.333473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:54.341761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:54.342497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:54.343643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:54.345404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:54.347291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:54.347872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:54.714996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84bb8a18e9264efbaef518e6a5ae0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cc417f82d747d4b311c864b9743f90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:54.728121 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72175be8-85a1-4268-9fb4-2dc6958c9847 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 200 len: 1498 microversion: 2.1 time: 0.401387 Oct 28 18:20:54.728769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2346/4113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:54 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 1498 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:54.748534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:54.753388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:54.764124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:54.764890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:54.766067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:54.766960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:54.767595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:54.768228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:54.949867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:54.964038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:54.969718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:54.973147 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c722543-c50c-4ee4-b2f6-a2f9d563b4f8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.241230 Oct 28 18:20:54.973942 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2347/4114] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:54 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:55.019079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-23f1e045-2967-4b9f-b8ce-dce26c534b60 req-bc693a91-2564-4f4c-bf20-45e2d238f12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9afe13-9d43-43f8-b7f9-6cb4a0745852", "name": "network-vif-deleted", "tag": "ecab7337-b58b-4aba-aef2-03d0445dee37"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:55.040016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-23f1e045-2967-4b9f-b8ce-dce26c534b60 req-bc693a91-2564-4f4c-bf20-45e2d238f12e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:55.040689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-23f1e045-2967-4b9f-b8ce-dce26c534b60 req-bc693a91-2564-4f4c-bf20-45e2d238f12e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:55.042235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-23f1e045-2967-4b9f-b8ce-dce26c534b60 req-bc693a91-2564-4f4c-bf20-45e2d238f12e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:55.076234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-23f1e045-2967-4b9f-b8ce-dce26c534b60 req-bc693a91-2564-4f4c-bf20-45e2d238f12e service nova] Creating event network-vif-deleted:ecab7337-b58b-4aba-aef2-03d0445dee37 for instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 on n-h1-862404-2 Oct 28 18:20:55.101768 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-23f1e045-2967-4b9f-b8ce-dce26c534b60 req-bc693a91-2564-4f4c-bf20-45e2d238f12e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073374 Oct 28 18:20:55.106081 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2348/4115] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:55.336687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:55.338842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:55.356265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:55.357089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=32 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:55.366369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:55.376451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:55.377415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:55.378349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:55.379073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:55.379665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:55.840429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:55.881494 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1635f954-0e20-4467-8810-3713974c9f37 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1370 microversion: 2.1 time: 0.550184 Oct 28 18:20:55.882244 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2349/4116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:55 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1370 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:55.905105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:55.905877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:55.918092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:55.918782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:55.919248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:55.920677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:55.921169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:55.921607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:55.952882 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 HTTP/1.1 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'de9afe13-9d43-43f8-b7f9-6cb4a0745852'} Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:55.956851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:55.961020 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7af0c087-cf75-4270-a3c9-903c6980fe16 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 404 len: 111 microversion: 2.1 time: 0.059712 Oct 28 18:20:55.965914 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2350/4117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:55 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:55.972222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:55.972742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:55.981383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:55.982799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:55.983359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:55.988865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:55.990933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:55.991422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.004354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:56.033091 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 HTTP/1.1 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'de9afe13-9d43-43f8-b7f9-6cb4a0745852'} Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.034734 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.038594 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.044366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.045893 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4cd6495e-41e4-46a5-83ec-de4d80271f7b tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 404 len: 111 microversion: 2.1 time: 0.078687 Oct 28 18:20:56.048284 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2351/4118] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:55 2022] DELETE /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:56.099217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.101364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.117468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.122545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.123925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.124857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.128226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.129320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.321552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:56.336292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:56.340095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:56.343213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c782442-1b9e-49ee-8a42-23cf65b88e4c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.293518 Oct 28 18:20:56.343966 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2352/4119] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:56 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:56.375893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.376979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: de9afe13-9d43-43f8-b7f9-6cb4a0745852] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.387740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.388640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.389247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.390337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.390952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.391635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.413379 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 HTTP/1.1 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'de9afe13-9d43-43f8-b7f9-6cb4a0745852'} Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.420183 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.424316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.424316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.424316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.424316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.424316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.424316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. Oct 28 18:20:56.424316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.428115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance de9afe13-9d43-43f8-b7f9-6cb4a0745852 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.429189 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cacc04cc-aa9d-4431-a5b6-3394986bd68a tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852" status: 404 len: 111 microversion: 2.1 time: 0.058646 Oct 28 18:20:56.434401 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2353/4120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:56 2022] GET /compute/v2.1/servers/de9afe13-9d43-43f8-b7f9-6cb4a0745852 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:56.441727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-94be883a-ae20-4706-a13c-e64527c672f9 req-d0f9efe2-b042-4a09-85ef-357dd04702e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829508d1-3732-4715-8cf2-7eb0c46ad1e8", "name": "network-vif-plugged", "status": "completed", "tag": "d23e6dd8-35c1-45d5-a25a-5974d1471990"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:56.459505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-94be883a-ae20-4706-a13c-e64527c672f9 req-d0f9efe2-b042-4a09-85ef-357dd04702e6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.460436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-94be883a-ae20-4706-a13c-e64527c672f9 req-d0f9efe2-b042-4a09-85ef-357dd04702e6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.461063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-94be883a-ae20-4706-a13c-e64527c672f9 req-d0f9efe2-b042-4a09-85ef-357dd04702e6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.483649 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-94be883a-ae20-4706-a13c-e64527c672f9 req-d0f9efe2-b042-4a09-85ef-357dd04702e6 service nova] Creating event network-vif-plugged:d23e6dd8-35c1-45d5-a25a-5974d1471990 for instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 on n-h2-862404-2 Oct 28 18:20:56.493736 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-94be883a-ae20-4706-a13c-e64527c672f9 req-d0f9efe2-b042-4a09-85ef-357dd04702e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057836 Oct 28 18:20:56.495863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2354/4121] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:20:56.501989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.503938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.515946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:56.518524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.519249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.520088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.521624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.523014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.524368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.552323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d HTTP/1.1 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0a1fd814-42d1-4740-ab93-b0667a11bd4d'} Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.555338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.560108 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.563269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.565840 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-758c9336-953b-4a1b-83fc-60c7beadf8d7 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 404 len: 111 microversion: 2.1 time: 0.067662 Oct 28 18:20:56.566896 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2355/4122] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:56 2022] DELETE /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:56.577442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.578512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 0a1fd814-42d1-4740-ab93-b0667a11bd4d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.587848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.588600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.589195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.590230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.590841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.591444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.610194 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d HTTP/1.1 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0a1fd814-42d1-4740-ab93-b0667a11bd4d'} Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.612236 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.616314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.616314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.616314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.616314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.616314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.616314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. Oct 28 18:20:56.616314 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.621405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 0a1fd814-42d1-4740-ab93-b0667a11bd4d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.622549 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82e14896-c50a-4e17-9949-a57b6a483302 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d" status: 404 len: 111 microversion: 2.1 time: 0.051179 Oct 28 18:20:56.626821 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2356/4123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:56 2022] GET /compute/v2.1/servers/0a1fd814-42d1-4740-ab93-b0667a11bd4d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:56.642284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.643919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.653317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.653824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.654272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.655097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.656375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.659062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.717908 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e HTTP/1.1 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2164efc4-61e1-437d-870f-98fbae5d329e'} Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.720530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.723680 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01376ade-5d01-445a-87a7-b5fa47523a4e tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 404 len: 111 microversion: 2.1 time: 0.094575 Oct 28 18:20:56.727239 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2357/4124] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:56 2022] DELETE /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:56.739157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.740313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 2164efc4-61e1-437d-870f-98fbae5d329e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.749080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.749804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.750424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.751465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.752700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.753294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.773793 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e HTTP/1.1 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2164efc4-61e1-437d-870f-98fbae5d329e'} Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.775931 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 2164efc4-61e1-437d-870f-98fbae5d329e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3400393d-7da1-4584-8199-58660902f544 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e" status: 404 len: 111 microversion: 2.1 time: 0.044620 Oct 28 18:20:56.779836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2358/4125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:56 2022] GET /compute/v2.1/servers/2164efc4-61e1-437d-870f-98fbae5d329e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:56.788284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.788787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.796300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.796955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.797404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.798288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.798611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.799043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.818145 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b HTTP/1.1 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f7be3a9b-2eea-47b7-bd7b-2d84527eda5b'} Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.821530 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.825565 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.828508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.829831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56840f38-da76-4691-b8e2-cc1f602d588f tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 404 len: 111 microversion: 2.1 time: 0.046583 Oct 28 18:20:56.833342 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2359/4126] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:56 2022] DELETE /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:56.840209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.840839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: f7be3a9b-2eea-47b7-bd7b-2d84527eda5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.850140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.850979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.851838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.853748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.854767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.856733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.882504 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b HTTP/1.1 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f7be3a9b-2eea-47b7-bd7b-2d84527eda5b'} Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.884802 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance f7be3a9b-2eea-47b7-bd7b-2d84527eda5b could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.889394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a1bac0b-20f1-4a32-9869-8dd4d81ad27c tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b" status: 404 len: 111 microversion: 2.1 time: 0.053283 Oct 28 18:20:56.891672 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2360/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:56 2022] GET /compute/v2.1/servers/f7be3a9b-2eea-47b7-bd7b-2d84527eda5b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:20:56.902812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.903337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: fb82eee7-37ae-402d-b372-2cb97204b5b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.910449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.911525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.912278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.913191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.914332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.914852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.939636 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6 HTTP/1.1 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'fb82eee7-37ae-402d-b372-2cb97204b5b6'} Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:56.941867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:56.945566 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:56.951249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:56.953635 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f985fdb-29c8-404d-ab5d-19ed62720321 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6" status: 404 len: 111 microversion: 2.1 time: 0.060753 Oct 28 18:20:56.954364 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2361/4128] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:20:56 2022] DELETE /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:56.965425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:56.966331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:56.973682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.974274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.974778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:56.976206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:56.977138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:56.977809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:57.301727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:57.316157 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e179864-e055-4309-a469-ce494580076d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1370 microversion: 2.1 time: 0.355865 Oct 28 18:20:57.334748 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2362/4129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:56 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1370 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:57.344025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:57.345191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: fb82eee7-37ae-402d-b372-2cb97204b5b6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:57.357514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:57.358856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:57.359700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:57.360269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:57.361216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:57.361719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:57.390261 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6 HTTP/1.1 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'fb82eee7-37ae-402d-b372-2cb97204b5b6'} Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:20:57.392287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance fb82eee7-37ae-402d-b372-2cb97204b5b6 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:20:57.395699 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-127b5770-2e57-4af9-8698-32ad8c905762 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6" status: 404 len: 111 microversion: 2.1 time: 0.059057 Oct 28 18:20:57.400312 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2363/4130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:57 2022] GET /compute/v2.1/servers/fb82eee7-37ae-402d-b372-2cb97204b5b6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:20:57.407166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:57.408057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:57.417952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:57.418452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:57.418901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:57.423336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:57.423879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:57.424355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:57.561625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:57.580528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:57.586819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:57.590569 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b78a6af2-dc00-4c0e-bd89-430e18969839 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.186054 Oct 28 18:20:57.598450 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2364/4131] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:57 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:58.343695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:58.345701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:58.393587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:58.394308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:58.395455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:58.396353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:58.396822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:58.397322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:58.779628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:58.788129 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44283f62-4a7a-43ae-81c1-7ae2213a2cd6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1565 microversion: 2.1 time: 0.451401 Oct 28 18:20:58.790406 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2365/4132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:58 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1565 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:20:58.816274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:58.817189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:58.835647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:58.836236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:58.845359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:58.847064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:58.850544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:58.851289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:59.033517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:59.048011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:59.049748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:59.054508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9721e7d9-2722-4179-a7be-5b65d36a4b13 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.262261 Oct 28 18:20:59.075223 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2366/4133] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:20:58 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:20:59.088940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:59.089598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:20:59.105180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:59.106147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:59.108582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:59.109476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:59.113567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:59.114152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:59.262610 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-16d014fa-61ad-4e9c-9014-eebabcc66166 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185676 Oct 28 18:20:59.263509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2367/4134] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:20:59 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:00.085844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:00.086471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:00.109001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:00.111170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:00.111632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:00.116107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:00.117757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:00.119970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:00.303850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:00.325476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:00.328977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:00.335270 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a1c3dc1-a58f-448a-9108-51f7655e1dd8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.252737 Oct 28 18:21:00.348494 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2368/4135] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:00 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:01.187697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5a53547a-e16a-47f4-a39a-2535ca98ef1f req-0418836f-e23f-4871-801b-e3365d383a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829508d1-3732-4715-8cf2-7eb0c46ad1e8", "tag": "d23e6dd8-35c1-45d5-a25a-5974d1471990"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:01.217533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5a53547a-e16a-47f4-a39a-2535ca98ef1f req-0418836f-e23f-4871-801b-e3365d383a84 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:01.220854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5a53547a-e16a-47f4-a39a-2535ca98ef1f req-0418836f-e23f-4871-801b-e3365d383a84 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:01.222935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5a53547a-e16a-47f4-a39a-2535ca98ef1f req-0418836f-e23f-4871-801b-e3365d383a84 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:01.264788 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5a53547a-e16a-47f4-a39a-2535ca98ef1f req-0418836f-e23f-4871-801b-e3365d383a84 service nova] Creating event network-changed:d23e6dd8-35c1-45d5-a25a-5974d1471990 for instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 on n-h2-862404-2 Oct 28 18:21:01.280857 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5a53547a-e16a-47f4-a39a-2535ca98ef1f req-0418836f-e23f-4871-801b-e3365d383a84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098797 Oct 28 18:21:01.282065 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2369/4136] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:21:01.365873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:01.366586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:01.385688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:01.390584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:01.392344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:01.398154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:01.406441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:01.407206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:01.566097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:01.576145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:01.580609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:01.583517 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd6de6a8-cf1d-430c-b19b-8e55fca8792d tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.222297 Oct 28 18:21:01.585801 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2370/4137] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:01 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:02.623983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:02.624690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:02.649151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:02.659073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:02.659761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:02.660578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:02.662066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:02.662529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.016700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:03.035440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:03.051619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:03.053235 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db7f1f81-3d8a-4261-85c1-e5e89905fbdb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.439223 Oct 28 18:21:03.095243 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2371/4138] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:02 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:03.218154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:03.218741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:03.248501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:03.269241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:03.269862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.272397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:03.277414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:03.278623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.332150 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc HTTP/1.1 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '1f49b0af-abe0-4242-9f3d-1d789b7965dc'} Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:03.335650 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.343254 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.350537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:03.352913 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-89ced313-9a8d-4669-98b8-2f01d56b1b61 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 404 len: 111 microversion: 2.1 time: 0.141933 Oct 28 18:21:03.356279 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2372/4139] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:21:03 2022] DELETE /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:21:03.369772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:03.370542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 1f49b0af-abe0-4242-9f3d-1d789b7965dc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:03.379146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:03.380029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:03.380460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.381182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:03.381768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:03.382201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.425572 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc HTTP/1.1 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '1f49b0af-abe0-4242-9f3d-1d789b7965dc'} Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:03.440837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 1f49b0af-abe0-4242-9f3d-1d789b7965dc could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:03.444438 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c8b06c0-962a-48c1-9c28-47015e70eeb1 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc" status: 404 len: 111 microversion: 2.1 time: 0.082252 Oct 28 18:21:03.446983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2373/4140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:03 2022] GET /compute/v2.1/servers/1f49b0af-abe0-4242-9f3d-1d789b7965dc => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:21:03.454243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:03.454793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:03.485185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:03.485750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:03.486333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.487143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:03.487679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:03.490670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.565750 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 HTTP/1.1 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '60149d17-0678-447c-9e50-6afaaec7c0c9'} Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:03.567404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.573184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:03.582943 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-290b32f4-461d-48f7-83ac-28495c2ab959 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 404 len: 111 microversion: 2.1 time: 0.119145 Oct 28 18:21:03.583644 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2374/4141] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:21:03 2022] DELETE /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:21:03.591990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:03.592478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] [instance: 60149d17-0678-447c-9e50-6afaaec7c0c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:03.612972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:03.613476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:03.613920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.614644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:03.615109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:03.615544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:03.667576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] HTTP exception thrown: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Request method failure captured: Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 HTTP/1.1 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBwzWFRlC_Oi6ydJUXQhnwu9NcefRREP8dHDOAyFwiomRBvVa_fDiYTigMg3mipoTP3ShFQQYbv7FpjG9Fp8Udzr_Nb3n0990BZ--g-k_QDM_uFiZfSSsMIZbbdxh-FxQZfE8p6dEbPoh9yBcJJ3ycyj6j5StQuVx8aRBuWIvaZJZyA Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_86cc417f82d747d4b311c864b9743f90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/86cc417f82d747d4b311c864b9743f90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 86cc417f82d747d4b311c864b9743f90 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-123512873 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 84bb8a18e9264efbaef518e6a5ae0e32 Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-123512873-project Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '60149d17-0678-447c-9e50-6afaaec7c0c9'} Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:03.669389 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] Returning 404 to user: Instance 60149d17-0678-447c-9e50-6afaaec7c0c9 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:03.674349 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a923b79-52e4-4040-8f6b-7a379c5870f6 tempest-DeleteServersTestJSON-123512873 tempest-DeleteServersTestJSON-123512873-project] 10.222.0.16 "GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9" status: 404 len: 111 microversion: 2.1 time: 0.082756 Oct 28 18:21:03.684052 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2375/4142] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:03 2022] GET /compute/v2.1/servers/60149d17-0678-447c-9e50-6afaaec7c0c9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:21:04.117811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:04.118442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:04.132329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:04.133118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:04.133763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:04.134690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:04.135982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:04.136596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:04.264256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:04.297143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:04.302080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:04.306011 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e5b52aca-6623-4adf-aaf6-cd868fb6c7cb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.192183 Oct 28 18:21:04.314790 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2376/4143] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:04 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:05.352183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:05.353831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:05.376282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:05.383806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:05.384594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:05.386648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:05.387611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:05.388243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:05.687881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:05.705799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:05.708991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:05.711666 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca3f4add-b0b0-476f-919d-358a99567168 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.367813 Oct 28 18:21:05.715768 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2377/4144] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:05 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:06.083184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:06.090178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:06.092528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Searching by: {'deleted': False, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:21:06.105584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:06.107217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:06.109281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:06.110257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:06.111457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:06.112395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:06.182881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:21:06.247683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:06.249842 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35f763c4-4b54-4c6f-9c97-e80389fe7420 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.171599 Oct 28 18:21:06.254130 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2378/4145] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 18:21:06 2022] GET /compute/v2.1/servers => generated 339 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:21:06.270534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:06.286087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:06.286891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Searching by: {'deleted': False, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:21:06.293639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:06.294401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:06.294593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:06.298221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:06.298707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:06.299148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:06.375161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:21:06.437176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:06.449359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:06.449813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:06.450261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:06.778572 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0635fab8-982d-4f4c-bbaa-516e9815b59b tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.518543 Oct 28 18:21:06.779584 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2379/4146] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:21:06 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:21:06.795722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:06.796608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:06.814214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:06.816206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:06.817803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:06.820077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:06.822150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:06.823454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:07.060615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:07.080955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:07.086635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:07.090491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dbfe327d-a926-4d13-ad1e-c8578787ce0c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.309460 Oct 28 18:21:07.092192 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2380/4147] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:06 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:07.102233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06acd969-45ce-40a5-8416-c146980e6892 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:07.130528 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06acd969-45ce-40a5-8416-c146980e6892 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035787 Oct 28 18:21:07.133164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2381/4148] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:21:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:07.453505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:07.454915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:07.467082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:07.474668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:07.475557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:07.476792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:07.477799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:07.479400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:07.535073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:21:07.677124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe728ff7-7905-492b-9ffc-eedc72e22932 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 204 len: 0 microversion: 2.1 time: 0.230492 Oct 28 18:21:07.680102 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2382/4149] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:21:07 2022] DELETE /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:21:07.692022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:07.692754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:07.700079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:07.700814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:07.701440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:07.702320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:07.702933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:07.703519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:08.044887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:08.087346 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e9638de-4d01-4fa7-a17e-07f92b1ed6aa tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1713 microversion: 2.1 time: 0.402101 Oct 28 18:21:08.090521 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2383/4150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:07 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1713 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:21:08.123716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:08.125033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:08.137571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:08.138171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:08.138621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:08.145225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:08.146040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:08.146594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:08.250017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:08.272607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:08.278140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:08.282742 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-741143fb-104c-4c0b-87ec-381bbebcf170 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.162719 Oct 28 18:21:08.301973 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2384/4151] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:08 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:09.116817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:09.118207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:09.141497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:09.143165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:09.144276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:09.147061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:09.148639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:09.150873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:09.766823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:09.782789 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0fbac2ff-28a0-4882-83be-b41e32631ccc tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1713 microversion: 2.1 time: 0.670250 Oct 28 18:21:09.786849 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2385/4152] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:09 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1713 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:21:09.803491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:09.805139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:09.828266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:09.830853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:09.831783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:09.832951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:09.835349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:09.836056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:10.116962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:10.130350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:10.132837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:10.136563 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13d78518-6fab-4810-8762-545b70f7dfe4 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.343437 Oct 28 18:21:10.139274 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2386/4153] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:09 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:10.819020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:10.819899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:10.849166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:10.859349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:10.861035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:10.862286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:10.862992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:10.864232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:11.655325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:11.666542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af50ac66-dc09-4a7d-829e-136ff476c421 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1713 microversion: 2.1 time: 0.852478 Oct 28 18:21:11.667385 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2387/4154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:10 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1713 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:21:11.678818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:11.685620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:11.700107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:11.700847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:11.701446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:11.707896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:11.708681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:11.709282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:11.848579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:11.863205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:11.864729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:11.865938 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b9d17b4-3bbf-44ca-b679-aefdbaadbdce tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.191051 Oct 28 18:21:11.866891 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2388/4155] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:11 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:12.704328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:12.705112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:12.713774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:12.715976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:12.718071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:12.719075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:12.723740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:12.724728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:12.865499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:12.892549 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c55db8a1-5ca1-4f72-9837-db5c9f1b47c8 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1646 microversion: 2.1 time: 0.192149 Oct 28 18:21:12.898503 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2389/4156] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:12 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1646 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:21:12.915997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:12.916630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:12.938290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:12.938798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:12.939247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:12.939999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:12.950591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:12.951158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:13.193740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:13.251121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:13.258455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:13.272346 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03c6732a-e6e8-4685-8f99-361cbd9a16c1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.366360 Oct 28 18:21:13.274722 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2390/4157] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:12 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:13.312107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e70604c0-d261-44aa-a8d4-3eb33bd6d696 req-361d469a-b306-4189-bb45-af7dcbf0747a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf96e27-7b5e-49a2-ad6b-890c5d9414e0", "name": "network-vif-deleted", "tag": "783e50a9-3c23-4025-bbc5-86393fd2b19d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:13.326028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e70604c0-d261-44aa-a8d4-3eb33bd6d696 req-361d469a-b306-4189-bb45-af7dcbf0747a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:13.326930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e70604c0-d261-44aa-a8d4-3eb33bd6d696 req-361d469a-b306-4189-bb45-af7dcbf0747a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:13.328049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e70604c0-d261-44aa-a8d4-3eb33bd6d696 req-361d469a-b306-4189-bb45-af7dcbf0747a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:13.368533 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e70604c0-d261-44aa-a8d4-3eb33bd6d696 req-361d469a-b306-4189-bb45-af7dcbf0747a service nova] Creating event network-vif-deleted:783e50a9-3c23-4025-bbc5-86393fd2b19d for instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 on n-h1-862404-2 Oct 28 18:21:13.392952 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e70604c0-d261-44aa-a8d4-3eb33bd6d696 req-361d469a-b306-4189-bb45-af7dcbf0747a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111738 Oct 28 18:21:13.397677 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2391/4158] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:14.080420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-833b31d3-7516-492a-9678-5d76dc776a91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'create', calling method: .version_select at 0x7f78dcb16a60>, body: {"keypair": {"name": "tempest-keypair-1414937885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPyK2JdW/O5vhxfGtw+knf2e7y8x/TVmKGiV1ibr8U2GaWaijqYpVKK6CSIv6J3a9S522/WARiC4bYO/zh8+BgxEJHFyeaDXnEmMV+71C0e0rxs0lUhA7uiNanQ1AhbHw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:14.106891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-833b31d3-7516-492a-9678-5d76dc776a91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Getting quotas for project e9840a126cf845f49cd9c80b8cc61c8c. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:21:14.129097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-833b31d3-7516-492a-9678-5d76dc776a91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Getting quotas for user d438d70603114d2e8e9e6bbf9fb96991 and project e9840a126cf845f49cd9c80b8cc61c8c. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:21:14.186205 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-833b31d3-7516-492a-9678-5d76dc776a91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.689642 Oct 28 18:21:14.188156 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2392/4159] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:21:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 692 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 18:21:14.194750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:14.195786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:14.208548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:14.209553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:14.210722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:14.211670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:14.212623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:14.214057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:14.299705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:14.299705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:14.300190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:14.300698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lazy-loading 'fault' on Instance uuid faf96e27-7b5e-49a2-ad6b-890c5d9414e0 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:21:14.585805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cea8b13fa210445baa6f6b76e930e6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff38b8a9be3b4011b9dd8e87cf6c7d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:14.636105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d36ae701-faf7-4378-b420-50defdfcd791 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 200 len: 1366 microversion: 2.1 time: 0.442458 Oct 28 18:21:14.636105 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2393/4160] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:14 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:21:14.680027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:14.680424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:14.707998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:14.708530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:14.708985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:14.720059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:14.720597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:14.721580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:15.027436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:15.048178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:15.051157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:15.052682 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6ebb4ef-5107-4775-a389-ebc52914a4c2 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.402790 Oct 28 18:21:15.053488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2394/4161] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:14 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:15.659620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:15.661096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] [instance: faf96e27-7b5e-49a2-ad6b-890c5d9414e0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:15.669814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:15.679219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:15.683241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:15.683876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:15.684771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:15.696551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:15.697275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:15.702600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:15.735847 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] HTTP exception thrown: Instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 could not be found. Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Request method failure captured: Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 HTTP/1.1 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB0dAN3NqkzUfhUM1ZBSwn-VX9a4I4A6-r4LFc1IQqsdD4KF94pge36inKOiglH2DmHLccR4_X3Wl74mScBNRHIIYtLpiIG6B6Gjo92vFdBVEJE7hSoO1IVvQGuj4_Sb4ASQuXYzub7wTP5GlhHD4-usKOFUCkM8GsQ8Osi5Io9OW_E Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ff38b8a9be3b4011b9dd8e87cf6c7d15 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestManualDisk-1507832551 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff38b8a9be3b4011b9dd8e87cf6c7d15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ff38b8a9be3b4011b9dd8e87cf6c7d15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ff38b8a9be3b4011b9dd8e87cf6c7d15", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ff38b8a9be3b4011b9dd8e87cf6c7d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestManualDisk-1507832551 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ff38b8a9be3b4011b9dd8e87cf6c7d15 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestManualDisk-1507832551 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestManualDisk-1507832551-project Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: cea8b13fa210445baa6f6b76e930e6a3 Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestManualDisk-1507832551-project Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 could not be found. Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'faf96e27-7b5e-49a2-ad6b-890c5d9414e0'} Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 could not be found. Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 could not be found. Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:15.743127 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:15.749055 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:15.749055 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:15.749055 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:15.749055 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:15.749055 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:15.749055 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 could not be found. Oct 28 18:21:15.749055 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:15.749055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Returning 404 to user: Instance faf96e27-7b5e-49a2-ad6b-890c5d9414e0 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:15.750597 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69cc2f91-0592-41c8-9f05-ba2d7d53aa74 tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0" status: 404 len: 111 microversion: 2.1 time: 0.091840 Oct 28 18:21:15.755550 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2395/4162] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:15 2022] GET /compute/v2.1/servers/faf96e27-7b5e-49a2-ad6b-890c5d9414e0 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:21:15.779963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-592755ec-0446-4207-8116-182274d7ac6d tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] Calling method '.version_select at 0x7f78dcb18e50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:15.859073 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-592755ec-0446-4207-8116-182274d7ac6d tempest-ServersTestManualDisk-1507832551 tempest-ServersTestManualDisk-1507832551-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-851021345" status: 202 len: 0 microversion: 2.1 time: 0.101364 Oct 28 18:21:15.862619 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2396/4163] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:21:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-851021345 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:21:16.090430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:16.091986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:16.137410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:16.138061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:16.138605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:16.139693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:16.140348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:16.141200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:16.332729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:16.451632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:16.466714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:16.469996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:16.475632 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1e19e9e9-e29b-4265-83ba-92a6dc964d70 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.392402 Oct 28 18:21:16.477353 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2397/4164] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:16 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:16.521998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:16.522827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:16.543398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:16.545060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:16.548470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:16.552761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:16.554050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:16.556370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:17.096451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:17.118065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:17.121883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:17.125624 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ce32436-546d-4dc3-9f67-bfeba5380180 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2946 microversion: 2.42 time: 0.613619 Oct 28 18:21:17.129536 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2398/4165] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:16 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2946 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:17.161645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:17.162164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:17.175224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:17.177199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:17.177982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:17.178865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:17.182214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:17.184947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:17.520839 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee953755-d544-44e5-a6ab-8a4b135c1ae1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.364986 Oct 28 18:21:17.522071 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2399/4166] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 18:21:17 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0/os-interface => generated 1828 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:17.528274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:17.530017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:17.538166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:17.540044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:17.541765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:17.542687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:17.543331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:17.544053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:17.643179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:17.655409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:17.657629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:17.659205 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1893e978-dd77-4b17-bef8-32a219968518 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.136033 Oct 28 18:21:17.660265 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2400/4167] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:17 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:18.691174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:18.691870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:18.701380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:18.701976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:18.702382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:18.703112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:18.703580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:18.706123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:18.875384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:18.899945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:18.927669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:18.930614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ef4141c-b851-41c5-9c70-527df83e9387 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.243758 Oct 28 18:21:18.954629 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2401/4168] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:18 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:19.874770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1829877703", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": "none"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:20.023485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:21:20.023957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:21:20.024531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:21:20.025169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:21:20.027327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:21:20.070326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:20.073040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:20.075088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:20.079955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:20.081558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:20.083154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:20.110900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Getting quotas for project 13a98cab0f4f4109b229e998a666031f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:21:20.120850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Getting quotas for user 3176adc1c9cb4e11a052f17b44fb0ec5 and project 13a98cab0f4f4109b229e998a666031f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:21:20.143615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:21:20.146712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:21:20.225011 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-def7ad09-d88f-4373-b4b8-151e5d2084ac tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.926529 Oct 28 18:21:20.226747 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2402/4169] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 18:21:20.238939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:20.241578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:20.258331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:20.259134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:20.263436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:20.265274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:20.266290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:20.266918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:21.293405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:21.306618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:21.317461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:21.325963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64ee0e6d-5c9f-41db-b47c-2c1cb095231b tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 1.091475 Oct 28 18:21:21.328400 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2403/4170] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:20 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:21.335902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07b7a23f-0aab-4aba-8492-6626ae1c97f4 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:21.341309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07b7a23f-0aab-4aba-8492-6626ae1c97f4 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:21.608298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07b7a23f-0aab-4aba-8492-6626ae1c97f4 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:21.624578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07b7a23f-0aab-4aba-8492-6626ae1c97f4 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:21.630217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07b7a23f-0aab-4aba-8492-6626ae1c97f4 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:21.631672 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07b7a23f-0aab-4aba-8492-6626ae1c97f4 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1281 microversion: 2.47 time: 0.302065 Oct 28 18:21:21.633274 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2404/4171] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:21 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1281 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:21.661069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1628314305", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7cf7d39-4823-4157-a645-af8e2ff314bd"}], "security_groups": [{"name": "tempest-securitygroup--776018371"}], "key_name": "tempest-keypair-1414937885", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:22.106644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] validate_networks() for [('a7cf7d39-4823-4157-a645-af8e2ff314bd', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:21:23.418402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:21:23.420124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:21:23.425284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:21:23.425908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:21:23.426538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:21:23.438010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:23.438832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:23.439717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:23.440966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:23.441618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:23.442242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:23.483551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Getting quotas for project e9840a126cf845f49cd9c80b8cc61c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:21:23.494845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Getting quotas for user d438d70603114d2e8e9e6bbf9fb96991 and project e9840a126cf845f49cd9c80b8cc61c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:21:23.523892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:21:23.526776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:21:23.611788 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db62d253-7f9c-4eb1-9b44-ebc3c0e0c8d1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.976973 Oct 28 18:21:23.613298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2405/4172] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:21:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:21:23.618699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:23.619632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:23.629770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:23.630510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:23.631786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:23.632860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:23.634336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:23.636770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:23.993375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.005976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.013439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.014928 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35f5ab37-35f1-44c8-b0e0-87d05eef526c tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1366 microversion: 2.47 time: 0.400483 Oct 28 18:21:24.019011 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2406/4173] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:23 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:24.033153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:24.041582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:24.053906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:24.055029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:24.055768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:24.057316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:24.058015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:24.058595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:24.254826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.268720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.270471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.278157 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-123f5269-9791-41bd-87a7-5a745701cfae tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1339 microversion: 2.47 time: 0.257724 Oct 28 18:21:24.295255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2407/4174] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:24 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:24.300656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd859335-97b9-48bc-a8b3-a505b6245dd1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:24.301284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd859335-97b9-48bc-a8b3-a505b6245dd1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:24.520551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bd859335-97b9-48bc-a8b3-a505b6245dd1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.553428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bd859335-97b9-48bc-a8b3-a505b6245dd1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.564595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bd859335-97b9-48bc-a8b3-a505b6245dd1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:24.568909 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd859335-97b9-48bc-a8b3-a505b6245dd1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1282 microversion: 2.20 time: 0.277824 Oct 28 18:21:24.571562 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2408/4175] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:24 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:25.045636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:25.047063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:25.075673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:25.076203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:25.076652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:25.077397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:25.077860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:25.082244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:25.404462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.416240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.418445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.420576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1333bd70-e588-4e02-831a-66d29b68c335 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1372 microversion: 2.47 time: 0.378885 Oct 28 18:21:25.440665 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2409/4176] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:25 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1372 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:25.447548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:25.449240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:25.462631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:25.463217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:25.463662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:25.464407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:25.465247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:25.465686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:25.578339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.595546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.600567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.604209 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c34ae3d1-ed5c-4e0a-9f64-e868c88f00bd tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1339 microversion: 2.47 time: 0.170332 Oct 28 18:21:25.615836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2410/4177] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:25 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1339 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:25.624698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:25.627198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:25.635911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:25.636416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:25.637181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:25.638862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:25.639644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:25.640220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:25.717361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.728887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.730728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:25.732189 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-924248bf-a362-4c00-b847-6823e8055eb5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1278 microversion: 2.20 time: 0.120796 Oct 28 18:21:25.747954 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2411/4178] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:25 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:26.449641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:26.450236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:26.469142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:26.469656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:26.470103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:26.470958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:26.471277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:26.471704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:26.600578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.622976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.624458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.625846 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2d24eae-439c-44e1-aa65-014a8b1c774f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1372 microversion: 2.47 time: 0.181368 Oct 28 18:21:26.628586 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2412/4179] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:26 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:26.655736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:26.656390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:26.666301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:26.667085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:26.667872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:26.668734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:26.669335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:26.669904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:26.801067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.813123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.815532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.823562 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca57597f-22e3-4961-b496-c43062eafba6 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1360 microversion: 2.47 time: 0.171807 Oct 28 18:21:26.824798 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2413/4180] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:26 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:26.835452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:26.836115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:26.844239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:26.848107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:26.849346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:26.850442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:26.850988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:26.851421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:26.972335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.984520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.985931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:26.987074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5bddeba-8267-44ea-a6ca-4b1308a9de4f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1334 microversion: 2.20 time: 0.160986 Oct 28 18:21:26.988051 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2414/4181] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:26 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:26.992909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1913399780"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:26.995740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:27.003010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:27.003957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:27.004601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:27.005534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:27.006217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:27.006853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:27.327576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:27.358259 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0999e631-ce17-4adf-a6aa-8a8d0e5f4c4c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "POST /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b/action" status: 202 len: 52 microversion: 2.47 time: 0.366535 Oct 28 18:21:27.368602 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2415/4182] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:21:26 2022] POST /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b/action => generated 52 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 28 18:21:27.380552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:27.382397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:27.394318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:27.394804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:27.395246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:27.396186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:27.396690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:27.397992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:27.445013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:21:27.670727 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-620f57ea-372f-4676-89b6-87e1664e0b8b tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 204 len: 0 microversion: 2.47 time: 0.294718 Oct 28 18:21:27.675722 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2416/4183] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:21:27 2022] DELETE /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:21:27.694781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:27.696620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:27.711466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:27.713654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:27.715557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:27.717157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:27.718386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:27.720263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:27.875379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:27.891582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:27.894310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:27.896189 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91f9f7eb-6831-460a-8a4d-56e3eeecbe1a tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1357 microversion: 2.47 time: 0.218752 Oct 28 18:21:27.910346 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2417/4184] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:27 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:27.933776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:27.934708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:27.943972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:27.944769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:27.945416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:27.946417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:27.948228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:27.949074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:28.052923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.073227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.079692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.081302 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bdad2606-6890-4985-8e7d-b6a31998b114 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1366 microversion: 2.47 time: 0.169347 Oct 28 18:21:28.083736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2418/4185] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:27 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:28.092224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:28.102461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.105549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Searching by: {'deleted': False, 'project_id': '9578de9c6e8440fd9c5019c489b013ea'} {{(pid=120680) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 18:21:28.120277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:28.120982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:28.121617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:28.123234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:28.123903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:28.124509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:28.293943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.multi_cell_list [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:21:28.409560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.418962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:28.419374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:28.419987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:28.435961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.438065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.499103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5072c466-6379-415e-8b82-66ebb2e799fb tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.413375 Oct 28 18:21:28.499968 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2419/4186] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 18:21:28 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:28.518962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:28.521845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:28.535416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:28.535938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:28.536511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:28.537074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:28.537527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:28.537978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:28.689818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.725781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.732408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:28.738429 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-227fc8b4-307b-4559-a77d-5126a595f957 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1340 microversion: 2.20 time: 0.224748 Oct 28 18:21:28.740566 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2420/4187] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:28 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1340 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:28.748083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:28.748814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:28.762640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:28.763505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:28.763742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:28.764492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:28.764947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:28.765418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:28.797049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:21:28.954868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:28.974992 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-49e4a355-4b87-4a8d-af0c-d217c0eefdbc tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 204 len: 0 microversion: 2.47 time: 0.232700 Oct 28 18:21:28.975889 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2421/4188] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:21:28 2022] DELETE /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:21:29.013893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:29.015032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:29.035300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:29.036612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:29.037323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:29.038974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:29.040038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:29.044032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:29.218743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:29.242403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:29.249670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:29.253472 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f179ced-22c2-4786-844f-dd8b86196cbe tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1363 microversion: 2.47 time: 0.253804 Oct 28 18:21:29.255712 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2422/4189] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:28 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:29.265987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:29.267010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:29.288200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:29.289263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:29.289989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:29.293330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:29.296308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:29.296986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:29.468866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:29.496376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:29.500433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:29.505612 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0124ccee-20c5-4968-a182-2a53123824cb tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1366 microversion: 2.47 time: 0.246044 Oct 28 18:21:29.508125 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2423/4190] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:29 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:29.765500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:29.767923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:29.782184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:29.784862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:29.785554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:29.787548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:29.789773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:29.791114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:30.201566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.210793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.213114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.214608 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e51ecd4a-ae2e-4b6f-a40e-8f14ec426754 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.453671 Oct 28 18:21:30.231107 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2424/4191] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:29 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:30.293794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:30.295168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:30.303683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:30.305684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:30.307496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:30.308622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:30.309605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:30.310274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:30.427174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.443920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.447310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.448955 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-18ca35e2-8b3d-4383-8c1a-cc8fa5878f16 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 200 len: 1363 microversion: 2.47 time: 0.166592 Oct 28 18:21:30.450299 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2425/4192] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:30 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:30.541317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:30.542002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:30.562080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:30.562482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:30.562931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:30.563662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:30.565953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:30.566414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:30.799253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.817247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.819001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:30.820546 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3778b69-d8fd-4532-8934-1fb75635425c tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1366 microversion: 2.47 time: 0.284980 Oct 28 18:21:30.821275 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2426/4193] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:30 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:31.241082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:31.241764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:31.251045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:31.251697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:31.252172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:31.256689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:31.256689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:31.256689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:31.724841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:31.738623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:31.740327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:31.742514 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9650bbd-4931-4fd9-bcd0-6caaa8a0ab5d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.505447 Oct 28 18:21:31.743570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2427/4194] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:31 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:31.751332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:31.752340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: e686ef08-6849-41ba-9775-f4332f77ae44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:31.772656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:31.773778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:31.776458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:31.778065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:31.778723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:31.779310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:31.800898 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] HTTP exception thrown: Instance e686ef08-6849-41ba-9775-f4332f77ae44 could not be found. Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Request method failure captured: Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 HTTP/1.1 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB16_cf2gx4eFBPB21IUaEic8A6bSeCXT1Wz6u0gHcIQB-nWbDbTTpkyGOHq_3AiDaPeVbvoyCMXiltLLwbyxqSx4vmypTzLJKM7Nw1y_qCWqbe2Ba8UyIpjVUqKVOBeITvCcFEHlytmNkTh5tPPQQ2vqITukJQVSy4C5QqXPMJEuV8 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 9578de9c6e8440fd9c5019c489b013ea Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerShowV247Test-138839933 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9578de9c6e8440fd9c5019c489b013ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9578de9c6e8440fd9c5019c489b013ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9578de9c6e8440fd9c5019c489b013ea", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9578de9c6e8440fd9c5019c489b013ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerShowV247Test-138839933 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 9578de9c6e8440fd9c5019c489b013ea Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerShowV247Test-138839933 Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerShowV247Test-138839933-project Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2b4d4c77ea67406c92c90b3e6ec4f40f Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerShowV247Test-138839933-project Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance e686ef08-6849-41ba-9775-f4332f77ae44 could not be found. Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'e686ef08-6849-41ba-9775-f4332f77ae44'} Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e686ef08-6849-41ba-9775-f4332f77ae44 could not be found. Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e686ef08-6849-41ba-9775-f4332f77ae44 could not be found. Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:31.803665 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:31.809487 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:31.809487 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:31.809487 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:31.809487 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:31.809487 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:31.809487 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e686ef08-6849-41ba-9775-f4332f77ae44 could not be found. Oct 28 18:21:31.809487 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:31.815213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Returning 404 to user: Instance e686ef08-6849-41ba-9775-f4332f77ae44 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:31.817209 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b0158aa-a334-466a-8ed1-a4ae608808e6 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44" status: 404 len: 111 microversion: 2.47 time: 0.070992 Oct 28 18:21:31.820525 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2428/4195] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:31 2022] GET /compute/v2.1/servers/e686ef08-6849-41ba-9775-f4332f77ae44 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:21:31.838986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:31.840423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: 0203643b-a83e-4d2b-88b4-597ebe5cc673] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:31.852254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:31.853671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:31.854712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:31.865666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:31.866430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:31.867067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:31.877952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:31.940645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: 0203643b-a83e-4d2b-88b4-597ebe5cc673] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:21:32.105459 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cb325642-4817-4b8c-8b68-2b03420d2ba1 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673" status: 204 len: 0 microversion: 2.47 time: 0.279195 Oct 28 18:21:32.107476 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2429/4196] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:21:31 2022] DELETE /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:21:32.115719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:32.131900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:32.154027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:32.154778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:32.155447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:32.159855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:32.160355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:32.160849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:32.324289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:32.334135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:32.335943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:32.338145 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c3026a5f-26c4-4b9b-b712-292cc6f00f35 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1366 microversion: 2.47 time: 0.228762 Oct 28 18:21:32.338910 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2430/4197] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:32 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:32.344143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:32.345047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: 0203643b-a83e-4d2b-88b4-597ebe5cc673] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:32.351798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:32.352591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:32.354023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:32.354948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:32.356199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:32.356894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:32.538984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:32.552350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:32.553810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:32.559847 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6bfc021-7f01-4b3b-8c58-c6bd63d9c103 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673" status: 200 len: 1363 microversion: 2.47 time: 0.214971 Oct 28 18:21:32.560532 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2431/4198] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:32 2022] GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:32.780361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:32.782332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:32.804409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:32.805877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:32.806617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:32.807509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:32.808228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:32.809971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:33.511963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:33.524639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:33.531994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:33.535893 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2016fcc1-0582-4140-97b0-b5d7bfe85ca8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.766422 Oct 28 18:21:33.558484 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2432/4199] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:32 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:33.565850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f8cfb4df-264e-4d6e-be8c-929197e88911 req-80f9e16d-b6f3-42b6-885f-a89a64051ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24fe0daa-955e-40da-b95e-c00125d1f92a", "tag": "e8004f4a-7b2a-405e-b161-4d9d7552bdde"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:33.580951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f8cfb4df-264e-4d6e-be8c-929197e88911 req-80f9e16d-b6f3-42b6-885f-a89a64051ae6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:33.582476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f8cfb4df-264e-4d6e-be8c-929197e88911 req-80f9e16d-b6f3-42b6-885f-a89a64051ae6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:33.584163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f8cfb4df-264e-4d6e-be8c-929197e88911 req-80f9e16d-b6f3-42b6-885f-a89a64051ae6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:33.600288 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f8cfb4df-264e-4d6e-be8c-929197e88911 req-80f9e16d-b6f3-42b6-885f-a89a64051ae6 service nova] Creating event network-changed:e8004f4a-7b2a-405e-b161-4d9d7552bdde for instance 24fe0daa-955e-40da-b95e-c00125d1f92a on n-h2-862404-2 Oct 28 18:21:33.607660 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f8cfb4df-264e-4d6e-be8c-929197e88911 req-80f9e16d-b6f3-42b6-885f-a89a64051ae6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047213 Oct 28 18:21:33.609420 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2433/4200] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:33.618523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:33.621815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:33.637772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:33.640444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:33.641445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:33.642880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:33.643604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:33.644760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:33.734452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:33.735126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:33.735758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:33.736382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lazy-loading 'fault' on Instance uuid aefe2553-dca0-4cc9-9695-01431c5ad30b {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:21:33.862019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:33.894087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:33.899438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3176adc1c9cb4e11a052f17b44fb0ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a98cab0f4f4109b229e998a666031f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:33.914967 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-952d420f-90bb-40ba-831a-4d2da7d490d9 tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 200 len: 1371 microversion: 2.47 time: 0.291380 Oct 28 18:21:33.922214 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2434/4201] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:33 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:33.948638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:33.949275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: 0203643b-a83e-4d2b-88b4-597ebe5cc673] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:33.959149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:33.959742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:33.960216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:33.960963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:33.961434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:33.961854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:34.123837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:34.160218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:34.163520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:34.165314 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-013e7368-6980-493a-8b7b-83c3e02f652f tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673" status: 200 len: 1363 microversion: 2.47 time: 0.241912 Oct 28 18:21:34.166648 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2435/4202] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:33 2022] GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:34.567304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:34.568027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:34.582587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:34.583093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:34.583590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:34.584502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:34.585098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:34.585571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:34.856159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:34.868169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:34.871425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:34.872947 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cfd61527-55f4-45f7-b38c-a21d7f885424 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.310562 Oct 28 18:21:34.893642 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2436/4203] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:34 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:34.973901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:34.974532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] [instance: aefe2553-dca0-4cc9-9695-01431c5ad30b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:35.010864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:35.011659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:35.012290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:35.015546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:35.016072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:35.016509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:35.092740 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] HTTP exception thrown: Instance aefe2553-dca0-4cc9-9695-01431c5ad30b could not be found. Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Request method failure captured: Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b HTTP/1.1 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB2fcLa3-UXz1LGBI34rEPUCQLwov6eeQ0GyWkc4Rz3lpwd2Wc46S7nmIOAou7X_t9_9N2k1Vt8PyrEIA1X8aBHeZs0WlORPOpup1bmIJGCp0a7vzAnJRNdt1tlqTitOSZTmtrE01BwrOLjDkKzvQP2sBIvN2tphPNjxW6WVL4XKrQg Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 13a98cab0f4f4109b229e998a666031f Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAaction247Test-2070601664 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13a98cab0f4f4109b229e998a666031f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/13a98cab0f4f4109b229e998a666031f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_13a98cab0f4f4109b229e998a666031f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/13a98cab0f4f4109b229e998a666031f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAaction247Test-2070601664 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 13a98cab0f4f4109b229e998a666031f Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAaction247Test-2070601664 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAaction247Test-2070601664-project Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 3176adc1c9cb4e11a052f17b44fb0ec5 Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAaction247Test-2070601664-project Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance aefe2553-dca0-4cc9-9695-01431c5ad30b could not be found. Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'aefe2553-dca0-4cc9-9695-01431c5ad30b'} Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aefe2553-dca0-4cc9-9695-01431c5ad30b could not be found. Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aefe2553-dca0-4cc9-9695-01431c5ad30b could not be found. Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:35.094718 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aefe2553-dca0-4cc9-9695-01431c5ad30b could not be found. Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:35.098433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] Returning 404 to user: Instance aefe2553-dca0-4cc9-9695-01431c5ad30b could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:35.101899 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2303da8-7785-48a9-aa14-514170d731cf tempest-ServersAaction247Test-2070601664 tempest-ServersAaction247Test-2070601664-project] 10.222.0.16 "GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b" status: 404 len: 111 microversion: 2.47 time: 0.146634 Oct 28 18:21:35.104046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2437/4204] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:34 2022] GET /compute/v2.1/servers/aefe2553-dca0-4cc9-9695-01431c5ad30b => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:21:35.199955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:35.200853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: 0203643b-a83e-4d2b-88b4-597ebe5cc673] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:35.230843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:35.231404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:35.231877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:35.238837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:35.239344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:35.239788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:35.380197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:35.381880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:35.383641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:35.408827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lazy-loading 'fault' on Instance uuid 0203643b-a83e-4d2b-88b4-597ebe5cc673 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:21:35.585680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:35.602872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:35.605162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b4d4c77ea67406c92c90b3e6ec4f40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9578de9c6e8440fd9c5019c489b013ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:35.606374 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ba97827-6a68-4cf3-b88f-7b84f56c6022 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673" status: 200 len: 1368 microversion: 2.47 time: 0.417262 Oct 28 18:21:35.607292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2438/4205] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:35 2022] GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673 => generated 1368 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:35.900655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:35.902069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:35.911423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:35.917119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:35.918292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:35.919645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:35.920467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:35.921889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:36.632394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:36.644246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:36.657781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:36.662475 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3ff4d70-9637-4d3e-a6da-bfba6745906f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.765874 Oct 28 18:21:36.663109 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2439/4206] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:35 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:36.670085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ca08cf-889b-4b33-ac79-732483c5ef62"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:36.676220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:36.704737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:36.705791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:36.706537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:36.707520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:36.708259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:36.708937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:37.284642 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f3b3269-2db7-4aed-8f04-28badf76debd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619854 Oct 28 18:21:37.324058 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2440/4207] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:21:36 2022] POST /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments => generated 194 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:37.352197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:37.363559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] [instance: 0203643b-a83e-4d2b-88b4-597ebe5cc673] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:37.375873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:37.378219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:37.381285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:37.382162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:37.382726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:37.383247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:37.420246 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] HTTP exception thrown: Instance 0203643b-a83e-4d2b-88b4-597ebe5cc673 could not be found. Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Request method failure captured: Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673 HTTP/1.1 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB16_cf2gx4eFBPB21IUaEic8A6bSeCXT1Wz6u0gHcIQB-nWbDbTTpkyGOHq_3AiDaPeVbvoyCMXiltLLwbyxqSx4vmypTzLJKM7Nw1y_qCWqbe2Ba8UyIpjVUqKVOBeITvCcFEHlytmNkTh5tPPQQ2vqITukJQVSy4C5QqXPMJEuV8 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 9578de9c6e8440fd9c5019c489b013ea Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerShowV247Test-138839933 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9578de9c6e8440fd9c5019c489b013ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9578de9c6e8440fd9c5019c489b013ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9578de9c6e8440fd9c5019c489b013ea", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9578de9c6e8440fd9c5019c489b013ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerShowV247Test-138839933 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 9578de9c6e8440fd9c5019c489b013ea Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerShowV247Test-138839933 Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerShowV247Test-138839933-project Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2b4d4c77ea67406c92c90b3e6ec4f40f Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerShowV247Test-138839933-project Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0203643b-a83e-4d2b-88b4-597ebe5cc673 could not be found. Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0203643b-a83e-4d2b-88b4-597ebe5cc673'} Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0203643b-a83e-4d2b-88b4-597ebe5cc673 could not be found. Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0203643b-a83e-4d2b-88b4-597ebe5cc673 could not be found. Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:37.423059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:37.428292 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:37.428292 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:37.428292 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:37.428292 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:37.428292 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:37.428292 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0203643b-a83e-4d2b-88b4-597ebe5cc673 could not be found. Oct 28 18:21:37.428292 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:21:37.436572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] Returning 404 to user: Instance 0203643b-a83e-4d2b-88b4-597ebe5cc673 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:37.437824 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c118b6d6-b80b-4b9a-8164-fe27751957d8 tempest-ServerShowV247Test-138839933 tempest-ServerShowV247Test-138839933-project] 10.222.0.16 "GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673" status: 404 len: 111 microversion: 2.47 time: 0.111007 Oct 28 18:21:37.447978 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2441/4208] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:37 2022] GET /compute/v2.1/servers/0203643b-a83e-4d2b-88b4-597ebe5cc673 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:21:37.698102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:37.698837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:37.707682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:37.708486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:37.709061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:37.710013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:37.710667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:37.717061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:38.095419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:38.108104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:38.112949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:38.121451 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5bd36214-9fae-449d-8f3e-a79fec6c3ce1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.423642 Oct 28 18:21:38.122677 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2442/4209] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:37 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:39.156758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:39.158037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:39.172850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:39.174744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=24 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:39.177693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:39.178401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:39.179003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:39.179978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:39.189565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:39.200384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:39.802604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:39.812363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:39.813829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:39.814988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c7ef1f1-8b47-4be0-9847-2b487226155b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.664867 Oct 28 18:21:39.815571 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2443/4210] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:39 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:40.864981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:40.866237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:40.886422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:40.886919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:40.887359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:40.888118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:40.888575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:40.889000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:40.933973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:41.249576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:41.263402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:41.267419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:41.268853 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ccc2e62-e88d-455f-a57e-a27582b8f9e0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.422343 Oct 28 18:21:41.269788 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2444/4211] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:40 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:21:41.275850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5f33d06d-ba78-4be8-afbb-a5e1616b568e req-e585ad95-b300-4f7f-894d-cd9e2a467ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fe0daa-955e-40da-b95e-c00125d1f92a", "name": "network-vif-plugged", "status": "completed", "tag": "e8004f4a-7b2a-405e-b161-4d9d7552bdde"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:41.289685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f33d06d-ba78-4be8-afbb-a5e1616b568e req-e585ad95-b300-4f7f-894d-cd9e2a467ceb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:41.291549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f33d06d-ba78-4be8-afbb-a5e1616b568e req-e585ad95-b300-4f7f-894d-cd9e2a467ceb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:41.292007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f33d06d-ba78-4be8-afbb-a5e1616b568e req-e585ad95-b300-4f7f-894d-cd9e2a467ceb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:41.309798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5f33d06d-ba78-4be8-afbb-a5e1616b568e req-e585ad95-b300-4f7f-894d-cd9e2a467ceb service nova] Creating event network-vif-plugged:e8004f4a-7b2a-405e-b161-4d9d7552bdde for instance 24fe0daa-955e-40da-b95e-c00125d1f92a on n-h2-862404-2 Oct 28 18:21:41.318198 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5f33d06d-ba78-4be8-afbb-a5e1616b568e req-e585ad95-b300-4f7f-894d-cd9e2a467ceb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046568 Oct 28 18:21:41.319535 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2445/4212] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:42.299532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:42.300606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:42.312547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:42.317357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:42.318009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:42.319881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:42.323871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:42.324529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:42.532782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:42.545024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:42.546746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:42.548497 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eeba0afa-c4be-4602-8928-2f7e4eee74bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1407 microversion: 2.20 time: 0.254210 Oct 28 18:21:42.549732 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2446/4213] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:42 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:43.577894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:43.578524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:43.592171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:43.592684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:43.593396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:43.599098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:43.599614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:43.600088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:44.094308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:44.120604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:44.131953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:44.138405 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d48aea7-3a2f-4289-9f5b-543563f6ff26 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1599 microversion: 2.20 time: 0.562675 Oct 28 18:21:44.152925 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2447/4214] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:21:43 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1599 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:21:44.182225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:44.184361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:44.218718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:44.219234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:44.219855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:44.233592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:44.235636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:44.240742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:44.476891 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e1a9be0d-f363-4bb2-875b-b35285b55cb0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.314120 Oct 28 18:21:44.479033 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2448/4215] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 18:21:44 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-interface => generated 284 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:21:46.923699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4d8c1f0f-1285-4e13-a50f-675fd2388669 req-b1fb00b6-bfd7-406f-9875-d825cd6f1bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24fe0daa-955e-40da-b95e-c00125d1f92a", "tag": "e8004f4a-7b2a-405e-b161-4d9d7552bdde"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:46.949155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4d8c1f0f-1285-4e13-a50f-675fd2388669 req-b1fb00b6-bfd7-406f-9875-d825cd6f1bda service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:46.952977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4d8c1f0f-1285-4e13-a50f-675fd2388669 req-b1fb00b6-bfd7-406f-9875-d825cd6f1bda service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:46.954747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4d8c1f0f-1285-4e13-a50f-675fd2388669 req-b1fb00b6-bfd7-406f-9875-d825cd6f1bda service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:46.988992 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4d8c1f0f-1285-4e13-a50f-675fd2388669 req-b1fb00b6-bfd7-406f-9875-d825cd6f1bda service nova] Creating event network-changed:e8004f4a-7b2a-405e-b161-4d9d7552bdde for instance 24fe0daa-955e-40da-b95e-c00125d1f92a on n-h2-862404-2 Oct 28 18:21:47.003225 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4d8c1f0f-1285-4e13-a50f-675fd2388669 req-b1fb00b6-bfd7-406f-9875-d825cd6f1bda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085582 Oct 28 18:21:47.005386 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2449/4216] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:52.543097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-953578331", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "bc60d4b6-ed9a-4c3f-9682-7128ba4fff94"}, {"uuid": "db631650-cb4b-4993-a975-8555212fa3c4"}, {"uuid": "bc60d4b6-ed9a-4c3f-9682-7128ba4fff94"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:52.669839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] validate_networks() for [('bc60d4b6-ed9a-4c3f-9682-7128ba4fff94', None, None, None, None, None), ('db631650-cb4b-4993-a975-8555212fa3c4', None, None, None, None, None), ('bc60d4b6-ed9a-4c3f-9682-7128ba4fff94', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:21:56.639510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:21:56.640442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:21:56.641560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:21:56.641560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:21:56.644285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:21:56.681322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:56.684221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:56.684920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:56.688802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:56.694719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:56.695189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:56.757367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Getting quotas for project 00004db1da4048c9aebe0ed35749d56f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:21:56.770467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Getting quotas for user 970c770865b448839659d3884b8b42c6 and project 00004db1da4048c9aebe0ed35749d56f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:21:56.798076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:21:56.800590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:21:56.904184 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d26fee8-4be6-4a9f-bf0f-acd3e00a44b3 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.364142 Oct 28 18:21:56.907719 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2450/4217] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:21:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:21:56.925471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:56.928555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:21:56.936820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:56.937331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:56.937782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:56.938503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:56.939612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:56.940266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:57.006712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lazy-loading 'flavor' on Instance uuid 829508d1-3732-4715-8cf2-7eb0c46ad1e8 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:21:57.450760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-226c02b8-1cdb-4170-be45-2fc0ccf178a6 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/action" status: 200 len: 32 microversion: 2.1 time: 0.539780 Oct 28 18:21:57.451411 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2451/4218] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:21:56 2022] POST /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/action => generated 32 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:21:58.406044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1040613786", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:58.509920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] validate_networks() for [('270637fb-3b8e-462e-a6c5-0be4df14ac52', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:21:59.908183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:21:59.909480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:21:59.910182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:21:59.910833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:21:59.911484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:21:59.918233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:59.932233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:59.933670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:59.934947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:59.936123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:59.937034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:59.938555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:59.963465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Getting quotas for project e0c57f517556450286614a53b91a5464. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:21:59.972317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Getting quotas for user aa6c205b1e564145ae55583d0c8fd6c1 and project e0c57f517556450286614a53b91a5464. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:21:59.995414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:21:59.999764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:22:00.077530 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-969e2e5c-da77-46b9-a990-fea2dbaee61a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.619155 Oct 28 18:22:00.085921 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2452/4219] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:21:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:22:00.096491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:00.097463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:00.125242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:00.126982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:00.127641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:00.128416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:00.128875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:00.129461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:00.319983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:00.338450 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51dcab70-eb13-4258-89d9-e60aaf0de77d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1270 microversion: 2.1 time: 0.250853 Oct 28 18:22:00.339046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2453/4220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:00 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1270 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:00.345236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:00.346389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:00.357120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:00.357883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:00.358535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:00.359880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:00.360873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:00.361605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:00.823844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:00.836529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26b4115e-84c1-4979-aead-c9205e79d5cb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1736 microversion: 2.1 time: 0.495694 Oct 28 18:22:00.844394 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2454/4221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:00 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1736 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:00.865257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75472424-956d-4f8c-b365-ad99ea323bef tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:00.866527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75472424-956d-4f8c-b365-ad99ea323bef tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:01.014104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75472424-956d-4f8c-b365-ad99ea323bef tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:01.023490 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75472424-956d-4f8c-b365-ad99ea323bef tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1214 microversion: 2.1 time: 0.172786 Oct 28 18:22:01.024030 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2455/4222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:00 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:01.367088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:01.368320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:01.388516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:01.389344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:01.392895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:01.393878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:01.395980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:01.396702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:01.606217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:01.624927 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bea7ecac-fe5a-480c-82fe-a2d04505367d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1270 microversion: 2.1 time: 0.262959 Oct 28 18:22:01.630959 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2456/4223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:01 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:01.872403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:01.873276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:01.891024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:01.891542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:01.897302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:01.903388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:01.903958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:01.904424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:02.329495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:02.346957 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56b68389-628d-4f74-b9d7-2040922e579f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1736 microversion: 2.1 time: 0.477064 Oct 28 18:22:02.347861 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2457/4224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:01 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1736 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:02.359319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:02.360304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:02.390271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:02.391651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:02.393052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:02.397508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:02.401295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:02.401956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:02.611009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:02.624880 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f542a0c0-104b-4c22-8fc5-639234556dec tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1274 microversion: 2.1 time: 0.273590 Oct 28 18:22:02.625694 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2458/4225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:02 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:02.657384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:02.658214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:02.676460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:02.677307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:02.677918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:02.678818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:02.679470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:02.681431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:03.065875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:03.075239 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d45e40ff-d026-4037-b514-bf8861666d60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1312 microversion: 2.1 time: 0.425197 Oct 28 18:22:03.088118 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2459/4226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:02 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:03.380718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:03.381345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:03.410265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:03.419554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:03.420218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:03.423863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:03.426157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:03.427174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:03.941480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:03.953966 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c01a2281-9c23-434b-996f-62e2e6a6d2f0 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1736 microversion: 2.1 time: 0.581182 Oct 28 18:22:03.979163 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2460/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:03 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1736 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:03.985287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:03.986078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:03.999875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:04.000564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:04.001136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:04.001958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:04.002946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:04.003601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:04.190803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:04.209057 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d17a3b63-068a-4492-9d35-b83701cc1042 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1272 microversion: 2.1 time: 0.227776 Oct 28 18:22:04.209984 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2461/4228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:03 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:04.220897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:04.221683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:04.234992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:04.236725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:04.240458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:04.241359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:04.242045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:04.242678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:04.622993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:04.626523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:04.631549 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f09dbb9-7f98-4d00-929e-f051c26ffa13 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1333 microversion: 2.1 time: 0.420434 Oct 28 18:22:04.633070 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2462/4229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:04 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1333 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:05.005687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:05.008277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:05.041791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:05.047627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:05.048115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:05.048889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:05.049365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:05.049803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:05.622506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:05.639363 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0daa0ac-1cdd-4266-9781-18f86334c5b1 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1736 microversion: 2.1 time: 0.642944 Oct 28 18:22:05.659721 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2463/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:04 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1736 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:05.668937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:05.669849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:05.679580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:05.680385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:05.681202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:05.682278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:05.683101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:05.684394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:06.080618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:06.092834 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-98129c1c-08f8-439c-bcb1-8255fcc5c7b2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.431721 Oct 28 18:22:06.100879 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2464/4231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:05 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:06.114259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:06.124257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:06.150483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:06.151141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:06.160626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:06.161402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:06.162027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:06.162465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:06.658626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:06.673469 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-37de32f5-d7c7-4225-9a66-3967f70e25e8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.571332 Oct 28 18:22:06.676554 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2465/4232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:06 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:06.691339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:06.692254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:06.726303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:06.727073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:06.729603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:06.732923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:06.736350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:06.737009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:07.120355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:07.136067 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45ee1f78-1a27-48ae-b1fa-56a89564a598 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1736 microversion: 2.1 time: 0.456893 Oct 28 18:22:07.136695 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2466/4233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:06 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1736 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:07.150919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:07.151596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:07.166266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:07.166778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:07.167363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:07.168207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:07.170298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:07.170838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:08.302982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:08.316742 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef1de095-2513-4b24-a081-d29b9314d845 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 1.174862 Oct 28 18:22:08.332475 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2467/4234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:07 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:08.332475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:08.333118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:08.362123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:08.362634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:08.363079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:08.366444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:08.366938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:08.369751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:08.761004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:08.772635 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c70a3c06-6b72-4929-aa78-b17186d19685 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.452730 Oct 28 18:22:08.773275 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2468/4235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:08 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:08.798732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ba12809e-ed34-4eda-9327-714f3790a74d req-1f0525ff-b43b-4b62-a772-b75de25069dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8e7a44-2654-444b-8a69-a43ecf5ba74f", "tag": "9cf42436-23da-4681-b7dd-0f0e0fe5670e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:08.828100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba12809e-ed34-4eda-9327-714f3790a74d req-1f0525ff-b43b-4b62-a772-b75de25069dc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:08.828899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba12809e-ed34-4eda-9327-714f3790a74d req-1f0525ff-b43b-4b62-a772-b75de25069dc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:08.831481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba12809e-ed34-4eda-9327-714f3790a74d req-1f0525ff-b43b-4b62-a772-b75de25069dc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:08.856745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ba12809e-ed34-4eda-9327-714f3790a74d req-1f0525ff-b43b-4b62-a772-b75de25069dc service nova] Creating event network-changed:9cf42436-23da-4681-b7dd-0f0e0fe5670e for instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f on n-h1-862404-2 Oct 28 18:22:08.872354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ba12809e-ed34-4eda-9327-714f3790a74d req-1f0525ff-b43b-4b62-a772-b75de25069dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086688 Oct 28 18:22:08.874580 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2469/4236] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:08.887203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:08.888201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:08.898022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:08.900261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:08.900887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:08.901797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:08.902400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:08.903142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:09.335747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:09.355071 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eaec74cc-d468-4082-91cf-577799566813 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1736 microversion: 2.1 time: 0.479172 Oct 28 18:22:09.356859 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2470/4237] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:08 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1736 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:09.365318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:09.373277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:09.392439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:09.395938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:09.396630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:09.402713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:09.403428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:09.405625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:09.744266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:09.756828 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c916cee8-eed3-428a-856d-85903754b23b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.396988 Oct 28 18:22:09.760096 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2471/4238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:09 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:09.798951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:09.800366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:09.816319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:09.816838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:09.818425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:09.819485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:09.823414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:09.824038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:09.952009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:10.184725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:10.201782 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce641054-63e4-4800-a5d9-cf1c044ae9df tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.408414 Oct 28 18:22:10.204489 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2472/4239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:09 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:10.384915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:10.386700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:10.398976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:10.400528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:10.402234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:10.403172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:10.406963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:10.408282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:10.797195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:10.808924 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43028c86-d450-434b-b86a-0446b2e96b73 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1736 microversion: 2.1 time: 0.428897 Oct 28 18:22:10.826792 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2473/4240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:10 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1736 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:10.840168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:10.841828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:10.852113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:10.854455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:10.855332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:10.857682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:10.858372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:10.859183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:11.022000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=14 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:11.145781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:11.157052 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9022c263-334e-4573-a58d-be4a40b92559 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.324141 Oct 28 18:22:11.158468 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2474/4241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:10 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:11.164374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9de5ed3e-789e-42c7-ad83-227b2453e0e3 req-a3589f2a-d5b2-4248-9515-02f73a63adcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "tag": "712f078c-6018-4b5b-a096-b887fb899364"}, {"name": "network-changed", "server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "tag": "910299a5-9ea5-438d-afc2-474acc6b297b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:11.201253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9de5ed3e-789e-42c7-ad83-227b2453e0e3 req-a3589f2a-d5b2-4248-9515-02f73a63adcc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:11.202192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9de5ed3e-789e-42c7-ad83-227b2453e0e3 req-a3589f2a-d5b2-4248-9515-02f73a63adcc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:11.202192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9de5ed3e-789e-42c7-ad83-227b2453e0e3 req-a3589f2a-d5b2-4248-9515-02f73a63adcc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:11.241033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9de5ed3e-789e-42c7-ad83-227b2453e0e3 req-a3589f2a-d5b2-4248-9515-02f73a63adcc service nova] Creating event network-changed:712f078c-6018-4b5b-a096-b887fb899364 for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:11.246252 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9de5ed3e-789e-42c7-ad83-227b2453e0e3 req-a3589f2a-d5b2-4248-9515-02f73a63adcc service nova] Creating event network-changed:910299a5-9ea5-438d-afc2-474acc6b297b for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:11.259886 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9de5ed3e-789e-42c7-ad83-227b2453e0e3 req-a3589f2a-d5b2-4248-9515-02f73a63adcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099740 Oct 28 18:22:11.262798 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2475/4242] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:11.271637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:11.278288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:11.294648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:11.295532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:11.299079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:11.300134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:11.300797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:11.301427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:11.731790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:11.749998 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a276128-ebe9-4d9d-aac7-f8e80e1bfc97 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.483779 Oct 28 18:22:11.751279 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2476/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:11 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:11.839887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:11.840813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:11.850434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:11.853253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:11.854481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:11.857788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:11.860254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:11.861396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:12.122205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:12.135364 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c0dc14b-e980-412f-af11-cf7bcc68d392 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1736 microversion: 2.1 time: 0.301289 Oct 28 18:22:12.148848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2477/4244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:11 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1736 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:12.189391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:12.190928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:12.201699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:12.202738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:12.203382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:12.205222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:12.206142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:12.206769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:12.397719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:12.407158 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2cea4bba-d8f6-482b-a94d-b21b34def10e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.227175 Oct 28 18:22:12.420454 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2478/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:12 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:12.776898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:12.778787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:12.788433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:12.789140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:12.789806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:12.791206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:12.793525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:12.794004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:13.112591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:13.121348 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be06c4b9-12df-4f68-a6f4-ff8d2048e5e6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.350035 Oct 28 18:22:13.122359 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2479/4246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:12 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:13.160969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:13.161779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:13.171104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:13.171760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:13.172432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:13.173353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:13.175024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:13.175704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:13.538071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:13.542962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:13.548982 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2bc44e77-463c-44a7-afa6-f4a9302ea59d tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1716 microversion: 2.1 time: 0.392116 Oct 28 18:22:13.564882 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2480/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:13 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1716 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:13.582101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:13.582916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:13.589834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:13.590616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:13.591201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:13.592434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:13.593035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:13.593870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:13.967756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:13.978896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c265362b-da30-4d96-ad18-414e843c75f7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.412266 Oct 28 18:22:13.979857 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2481/4248] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:13 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:13.985000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:13.985773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:13.992291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:13.993747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:13.994691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:13.995603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:13.996426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:13.997096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:14.116735 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Cannot 'detach_volume' instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 while it is in vm_state rescued Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments/b0ca08cf-889b-4b33-ac79-732483c5ef62 HTTP/1.1 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot 'detach_volume' instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 while it is in vm_state rescued Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '829508d1-3732-4715-8cf2-7eb0c46ad1e8', 'id': 'b0ca08cf-889b-4b33-ac79-732483c5ef62'} Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 while it is in vm_state rescued Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:14.119726 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 while it is in vm_state rescued Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 409 to user: Cannot 'detach_volume' instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 while it is in vm_state rescued {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99e89ee2-002e-4d5b-8810-19dec4a06afb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments/b0ca08cf-889b-4b33-ac79-732483c5ef62" status: 409 len: 152 microversion: 2.1 time: 0.140292 Oct 28 18:22:14.127844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2482/4249] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:22:13 2022] DELETE /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments/b0ca08cf-889b-4b33-ac79-732483c5ef62 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:22:14.137762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:14.138368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:14.149698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:14.151121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:14.152375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:14.153636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:14.154317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:14.154922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:14.264884 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d75551c8-6a6a-4519-9817-071c886fc2dc tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/action" status: 202 len: 0 microversion: 2.1 time: 0.135604 Oct 28 18:22:14.266270 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2483/4250] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:22:14 2022] POST /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:22:14.274480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:14.275634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:14.285201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:14.286610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:14.287228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:14.288779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:14.289592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:14.290392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:14.713718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:14.725245 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ebe00497-86ae-4abc-85d0-f887aec4b877 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.455721 Oct 28 18:22:14.727667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2484/4251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:14 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:14.747721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:14.748800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:14.764377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:14.765249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:14.765816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:14.766879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:14.767766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:14.768672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:15.054832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:15.073980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99584cf3-da0e-4913-baea-70ee8e02f763 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1724 microversion: 2.1 time: 0.344592 Oct 28 18:22:15.075397 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2485/4252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:14 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:15.125507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cb011c8e-9b42-434b-ba99-5b22a69c9c5c req-72d10971-5b1d-4fd4-9d0f-391809664035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "tag": "181b2480-321f-48a5-b250-d764e9e15527"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:15.149996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cb011c8e-9b42-434b-ba99-5b22a69c9c5c req-72d10971-5b1d-4fd4-9d0f-391809664035 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:15.150497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cb011c8e-9b42-434b-ba99-5b22a69c9c5c req-72d10971-5b1d-4fd4-9d0f-391809664035 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:15.150930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cb011c8e-9b42-434b-ba99-5b22a69c9c5c req-72d10971-5b1d-4fd4-9d0f-391809664035 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:15.168215 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cb011c8e-9b42-434b-ba99-5b22a69c9c5c req-72d10971-5b1d-4fd4-9d0f-391809664035 service nova] Creating event network-changed:181b2480-321f-48a5-b250-d764e9e15527 for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:15.179589 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cb011c8e-9b42-434b-ba99-5b22a69c9c5c req-72d10971-5b1d-4fd4-9d0f-391809664035 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101795 Oct 28 18:22:15.182328 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2486/4253] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:15.191156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:15.193505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:15.202726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:15.203607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:15.204252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:15.206791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:15.207801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:15.209060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:15.766718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:15.792556 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ed1e872-425e-49b5-b427-c72ddbdd747c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.607212 Oct 28 18:22:15.793454 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2487/4254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:15 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:15.801027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:15.801652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:15.826364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:15.829907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:15.830311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:15.831062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:15.831719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:15.834921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:16.301276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:16.310961 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0eeab2ee-5c09-43b5-bcd8-997a21c4a12d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.516722 Oct 28 18:22:16.316154 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2488/4255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:15 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:16.323053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:16.323920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:16.331203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:16.332202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:16.332827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:16.333534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:16.333991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:16.334575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:16.521414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:16.533935 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5818c607-b095-4353-8576-f86882cfb0fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1724 microversion: 2.1 time: 0.215503 Oct 28 18:22:16.534725 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2489/4256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:16 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:16.551996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8cd32a43-86cb-4124-b423-965364fa5634 req-27f24c8e-b13d-4e8a-b4cb-294f312fa5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8e7a44-2654-444b-8a69-a43ecf5ba74f", "name": "network-vif-plugged", "status": "completed", "tag": "9cf42436-23da-4681-b7dd-0f0e0fe5670e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:16.564578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8cd32a43-86cb-4124-b423-965364fa5634 req-27f24c8e-b13d-4e8a-b4cb-294f312fa5c9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:16.565850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8cd32a43-86cb-4124-b423-965364fa5634 req-27f24c8e-b13d-4e8a-b4cb-294f312fa5c9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:16.566324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8cd32a43-86cb-4124-b423-965364fa5634 req-27f24c8e-b13d-4e8a-b4cb-294f312fa5c9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:16.588559 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8cd32a43-86cb-4124-b423-965364fa5634 req-27f24c8e-b13d-4e8a-b4cb-294f312fa5c9 service nova] Creating event network-vif-plugged:9cf42436-23da-4681-b7dd-0f0e0fe5670e for instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f on n-h1-862404-2 Oct 28 18:22:16.595479 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8cd32a43-86cb-4124-b423-965364fa5634 req-27f24c8e-b13d-4e8a-b4cb-294f312fa5c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059203 Oct 28 18:22:16.596515 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2490/4257] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:16.830088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:16.830953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:16.853782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:16.855712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:16.856866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:16.858116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:16.861071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:16.861627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:17.265325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:17.282700 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd39fef4-3caa-4a57-b74d-9b38631a6333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.463438 Oct 28 18:22:17.286127 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2491/4258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:16 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:17.339827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:17.341316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:17.350114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:17.352810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:17.353727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:17.354755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:17.355560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:17.357012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:17.841097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:17.854218 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a51ae60e-27d0-433e-8e94-6cefc4a46a2c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.519375 Oct 28 18:22:17.857442 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2492/4259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:17 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:17.862609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:17.863466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:17.878645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:17.879432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:17.880283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:17.881575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:17.882202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:17.882991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:18.346737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:18.369613 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ac34363-d728-42a5-a42e-81879ae6b4f4 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1730 microversion: 2.1 time: 0.510694 Oct 28 18:22:18.370801 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2493/4260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:17 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1730 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:18.375889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:18.378694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:18.406955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:18.409174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:18.411448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:18.413585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:18.420801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:18.421522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:18.776634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:18.789127 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c3f7649-1309-46b6-93a3-53802115d613 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.417011 Oct 28 18:22:18.803848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2494/4261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:18 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:18.803848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:18.803848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:18.820679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:18.822827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:18.823334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:18.823782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:18.824707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:18.825168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:18.825605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:19.062455 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5ee728a-36e6-4bfa-b015-d04c00a0db5b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270760 Oct 28 18:22:19.063634 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2495/4262] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:22:18 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-interface => generated 285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:19.070271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:19.072856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:19.128138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:19.132874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:19.140388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:19.143320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:19.144766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:19.145573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:19.598922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:19.607412 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48fdc0ec-fb70-4e73-a01e-da5344ddfde0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.542529 Oct 28 18:22:19.608313 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2496/4263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:19 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:19.815227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:19.816451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:19.824347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:19.825259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:19.825856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:19.827252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:19.827905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:19.828520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:20.147258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:20.157617 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82c88ff6-e813-4ef8-9f08-06b243452f7b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1314 microversion: 2.1 time: 0.346664 Oct 28 18:22:20.172703 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2497/4264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:19 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:20.630819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:20.632493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:20.639520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:20.640045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:20.640487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:20.641405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:20.641861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:20.642289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:20.647527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:21.067385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:21.085807 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-599b879f-639f-4f40-aea7-38d834886ba2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.458470 Oct 28 18:22:21.088370 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2498/4265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:20 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:21.095665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-632db857-215d-4235-8f60-6da6572a09fa req-769658cf-d7a4-40ec-896e-d3879c71affe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829508d1-3732-4715-8cf2-7eb0c46ad1e8", "tag": "d23e6dd8-35c1-45d5-a25a-5974d1471990"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:21.129905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-632db857-215d-4235-8f60-6da6572a09fa req-769658cf-d7a4-40ec-896e-d3879c71affe service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:21.130481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-632db857-215d-4235-8f60-6da6572a09fa req-769658cf-d7a4-40ec-896e-d3879c71affe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:21.130987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-632db857-215d-4235-8f60-6da6572a09fa req-769658cf-d7a4-40ec-896e-d3879c71affe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:21.147791 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-632db857-215d-4235-8f60-6da6572a09fa req-769658cf-d7a4-40ec-896e-d3879c71affe service nova] Creating event network-changed:d23e6dd8-35c1-45d5-a25a-5974d1471990 for instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 on n-h2-862404-2 Oct 28 18:22:21.156087 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-632db857-215d-4235-8f60-6da6572a09fa req-769658cf-d7a4-40ec-896e-d3879c71affe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066376 Oct 28 18:22:21.157349 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2499/4266] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:21.196355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:21.200335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:21.212760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:21.213360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:21.214079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:21.215019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:21.215778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:21.216493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:21.504152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:21.520354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ca8924c-3ef2-41b2-b296-010d0eb73a02 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1499 microversion: 2.1 time: 0.335540 Oct 28 18:22:21.525482 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2500/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:21 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1499 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:21.549601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:21.552899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:21.569603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:21.570104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:21.570722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:21.572593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:21.573227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:21.573811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:21.627074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lazy-loading 'flavor' on Instance uuid ce8e7a44-2654-444b-8a69-a43ecf5ba74f {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:22:21.755566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dccc52fb-9517-400f-a165-ab6298410cbf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "POST /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f/action" status: 200 len: 32 microversion: 2.1 time: 0.209856 Oct 28 18:22:21.757413 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2501/4268] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:22:21 2022] POST /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:22:21.769061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:21.770880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:21.779193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:21.779686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:21.780341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:21.781931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:21.783172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:21.784075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:22.191213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:22.208974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7f1227b-937e-4fed-8755-ff5b55ffd69d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.444180 Oct 28 18:22:22.219846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2502/4269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:21 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:22.219846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:22.219846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:22.227936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:22.232535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:22.233020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:22.233793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:22.234274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:22.234710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:22.281314 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aaa74718-96f6-434e-8f4d-dd8adc1fbff6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/ips" status: 200 len: 152 microversion: 2.20 time: 0.070001 Oct 28 18:22:22.282152 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2503/4270] 10.222.0.16 () {60 vars in 1289 bytes} [Fri Oct 28 18:22:22 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/ips => generated 152 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:22:22.297444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:22.298250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:22.311858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:22.312465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:22.314200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:22.316469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:22.317171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:22.318223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:22.886274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:22.899764 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-93f17f1f-6edf-4d54-aa64-14abf901850a tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.613006 Oct 28 18:22:22.900707 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2504/4271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:22 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:23.202049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e18eaa6b-3e49-42c7-a427-e2f32090ae9d req-e02bb062-3993-4f4c-8f57-7407e840d150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829508d1-3732-4715-8cf2-7eb0c46ad1e8", "tag": "d23e6dd8-35c1-45d5-a25a-5974d1471990"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:23.233157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e18eaa6b-3e49-42c7-a427-e2f32090ae9d req-e02bb062-3993-4f4c-8f57-7407e840d150 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:23.235363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e18eaa6b-3e49-42c7-a427-e2f32090ae9d req-e02bb062-3993-4f4c-8f57-7407e840d150 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:23.236032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e18eaa6b-3e49-42c7-a427-e2f32090ae9d req-e02bb062-3993-4f4c-8f57-7407e840d150 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:23.282962 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e18eaa6b-3e49-42c7-a427-e2f32090ae9d req-e02bb062-3993-4f4c-8f57-7407e840d150 service nova] Creating event network-changed:d23e6dd8-35c1-45d5-a25a-5974d1471990 for instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 on n-h2-862404-2 Oct 28 18:22:23.294954 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e18eaa6b-3e49-42c7-a427-e2f32090ae9d req-e02bb062-3993-4f4c-8f57-7407e840d150 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097825 Oct 28 18:22:23.295686 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2505/4272] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:22:23.307845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:23.308769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:23.315460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:23.316223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:23.317303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:23.318197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:23.318814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:23.319433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:23.653503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:23.664092 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c564b35b-f0c5-45a6-a9b4-46e439ef78d5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.362904 Oct 28 18:22:23.669997 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2506/4273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:23 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:23.932566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:23.933205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:23.943623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:23.945536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:23.946385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:23.947502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:23.949607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:23.952532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:24.674888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:24.690886 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c7496cf-ee86-4891-bf4b-b27cb4620ed0 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.762860 Oct 28 18:22:24.714446 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2507/4274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:23 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:24.723226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:24.724127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:24.736353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:24.739571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:24.740496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:24.742245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:24.746246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:24.747535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:25.391731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:25.409844 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbcd110c-d066-431d-9e88-fddf355e5fd8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.693130 Oct 28 18:22:25.411259 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2508/4275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:24 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:25.642919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:25.644407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:25.667375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:25.669074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:25.669557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:25.672578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:25.673386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:25.673837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:25.758948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lazy-loading 'flavor' on Instance uuid 24fe0daa-955e-40da-b95e-c00125d1f92a {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:22:26.191107 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-de5bfe94-a55f-4465-830a-5e1ccbefbaea tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/action" status: 202 len: 0 microversion: 2.20 time: 0.552936 Oct 28 18:22:26.193506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2509/4276] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:22:25 2022] POST /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:22:26.218313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:26.219760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:26.238129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:26.239635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:26.241542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:26.243425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:26.244319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:26.246086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:26.566009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:26.576213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5d7905a-6746-4c9c-9e6f-31dcfeaaf136 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.379722 Oct 28 18:22:26.577015 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2510/4277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:26 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:26.586624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:26.587561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:26.597168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:26.601766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:26.603626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:26.605042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:26.605718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:26.606307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:26.931552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:26.945651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:26.948081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:26.950289 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1908d283-5135-4541-9133-e7c253c33d90 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.371861 Oct 28 18:22:26.951402 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2511/4278] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:26 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:26.958047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:26.958892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:26.967872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:26.969047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:26.969876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:26.970917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:26.971622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:26.972484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:27.008794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:27.379531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:27.392562 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6ab1ce0-6bcc-4cb3-98ca-6f92a69b4d2a tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.439743 Oct 28 18:22:27.406270 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2512/4279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:26 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:27.601023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:27.602922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:27.609961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:27.610690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:27.611311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:27.612226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:27.612840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:27.613424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:27.954437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:27.971118 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-793b909f-168a-4bc8-97c7-d1faaeda9eb8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.376124 Oct 28 18:22:27.988494 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2513/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:27 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:27.996622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:27.997525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:28.004796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:28.005548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:28.006169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:28.007038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:28.007665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:28.008347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:28.380087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:28.392419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:28.393910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:28.395618 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5b82c58-97cc-4704-bcd6-262610e72e2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.405641 Oct 28 18:22:28.396264 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2514/4281] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:27 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:28.423042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:28.423685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:28.447791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:28.449107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:28.449918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:28.451422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:28.452473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:28.455443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:28.774325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:28.788090 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-761cbd1a-a935-41f1-9716-e649474ecd26 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.373007 Oct 28 18:22:28.790481 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2515/4282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:28 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:28.998297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:28.999102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:29.010797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:29.011217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:29.011666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:29.012409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:29.018505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:29.019363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:29.638788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:29.653258 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45fc910a-7aba-4881-b3f5-a91f0e35ce35 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.660773 Oct 28 18:22:29.673374 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2516/4283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:28 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:29.685431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1bb8b6f4-001d-418b-8cec-e11c8671c971 req-dcd221d2-642f-4039-b011-d98b85ef9068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "name": "network-vif-plugged", "status": "completed", "tag": "181b2480-321f-48a5-b250-d764e9e15527"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:29.711708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1bb8b6f4-001d-418b-8cec-e11c8671c971 req-dcd221d2-642f-4039-b011-d98b85ef9068 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:29.712237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1bb8b6f4-001d-418b-8cec-e11c8671c971 req-dcd221d2-642f-4039-b011-d98b85ef9068 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:29.714783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1bb8b6f4-001d-418b-8cec-e11c8671c971 req-dcd221d2-642f-4039-b011-d98b85ef9068 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:29.746180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1bb8b6f4-001d-418b-8cec-e11c8671c971 req-dcd221d2-642f-4039-b011-d98b85ef9068 service nova] Creating event network-vif-plugged:181b2480-321f-48a5-b250-d764e9e15527 for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:29.754683 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1bb8b6f4-001d-418b-8cec-e11c8671c971 req-dcd221d2-642f-4039-b011-d98b85ef9068 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075372 Oct 28 18:22:29.758385 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2517/4284] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:29.766301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:29.767293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:29.787799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:29.793638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:29.795109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:29.796037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:29.798620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:29.799470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:30.221453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:30.272668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:30.276583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:30.280033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3cde832-0156-49c9-8201-18074acfc7ca tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.518396 Oct 28 18:22:30.281187 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2518/4285] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:29 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:30.288430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:30.291060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:30.308042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:30.309551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:30.310194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:30.312825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:30.313804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:30.314882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:30.673978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:30.694329 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f662b812-5996-4894-99fa-f2db9520b4ae tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.411690 Oct 28 18:22:30.695958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2519/4286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:30 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:30.701766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:30.702454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:30.709804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:30.710517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:30.711802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:30.714516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:30.715322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:30.716774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:30.906096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:30.918874 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-682aaecf-7a56-4a0f-9098-e73b421737f7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.221368 Oct 28 18:22:30.919486 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2520/4287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:30 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:31.309897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:31.310640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:31.319297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:31.319931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:31.320450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:31.322089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:31.322849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:31.323508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:31.472873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:31.481370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:31.483102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:31.484862 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-172fb4ae-da4e-4b0f-8253-80cba0d0457b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.180926 Oct 28 18:22:31.485676 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2521/4288] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:31 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:22:31.720453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:31.721805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:31.733076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:31.733874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:31.734301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:31.735380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:31.735910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:31.736479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:32.006062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:32.014831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36d69ac4-5b02-41f9-9074-6ef787850ca8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.299478 Oct 28 18:22:32.015446 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2522/4289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:31 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:32.028009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f38a1db1-ca4d-418b-9cfa-237273c4dc1d req-755f479a-c956-42a2-8ca0-2a47610806cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "name": "network-vif-plugged", "status": "completed", "tag": "712f078c-6018-4b5b-a096-b887fb899364"}, {"server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "name": "network-vif-plugged", "status": "completed", "tag": "910299a5-9ea5-438d-afc2-474acc6b297b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:32.050167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f38a1db1-ca4d-418b-9cfa-237273c4dc1d req-755f479a-c956-42a2-8ca0-2a47610806cf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:32.050791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f38a1db1-ca4d-418b-9cfa-237273c4dc1d req-755f479a-c956-42a2-8ca0-2a47610806cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:32.051273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f38a1db1-ca4d-418b-9cfa-237273c4dc1d req-755f479a-c956-42a2-8ca0-2a47610806cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:32.083195 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f38a1db1-ca4d-418b-9cfa-237273c4dc1d req-755f479a-c956-42a2-8ca0-2a47610806cf service nova] Creating event network-vif-plugged:712f078c-6018-4b5b-a096-b887fb899364 for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:32.083725 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f38a1db1-ca4d-418b-9cfa-237273c4dc1d req-755f479a-c956-42a2-8ca0-2a47610806cf service nova] Creating event network-vif-plugged:910299a5-9ea5-438d-afc2-474acc6b297b for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:32.097647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f38a1db1-ca4d-418b-9cfa-237273c4dc1d req-755f479a-c956-42a2-8ca0-2a47610806cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077878 Oct 28 18:22:32.111659 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2523/4290] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:32.117187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:32.118482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:32.127057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:32.127559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:32.132439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:32.133816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:32.137740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:32.138424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:32.481159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:32.488987 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c73df2b4-1f9a-42f9-9fee-f62744dc8aba tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.375969 Oct 28 18:22:32.489583 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2524/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:32 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:32.510807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:32.511774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:32.518306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:32.519093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:32.519752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:32.520719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:32.521434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:32.522193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:32.835320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:32.847319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:32.849364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:32.850921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2fbf180e-1943-4d8b-a50d-2e64ac91a1fd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.344057 Oct 28 18:22:32.851508 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2525/4292] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:32 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:33.041585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:33.042236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:33.051968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:33.052463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:33.053142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:33.054092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:33.054757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:33.055524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:33.325807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:33.346361 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d71daef-8a9f-479d-a7fe-00db4e3d052c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.298598 Oct 28 18:22:33.347348 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2526/4293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:33 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:33.513413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:33.514678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:33.521282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:33.522081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:33.522955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:33.524522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:33.525345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:33.525867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:33.792140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:33.803802 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59846c29-e73b-4aa5-92c6-f7724d99fa03 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1354 microversion: 2.1 time: 0.293231 Oct 28 18:22:33.807378 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2527/4294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:33 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1354 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:33.879988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:33.880917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:33.892920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:33.898062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:33.898860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:33.899704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:33.900386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:33.900884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:34.213166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:34.223194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:34.225392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:34.229162 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92caa9a5-a409-4e80-8fc7-eebd47b9ee04 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.352715 Oct 28 18:22:34.230283 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2528/4295] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:33 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:22:34.373738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:34.374654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:34.384861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:34.385644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:34.386267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:34.387155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:34.387976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:34.389515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:34.642420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:34.668893 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7614deba-6cd3-4a1c-84c6-7e1d45302d32 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.301532 Oct 28 18:22:34.674494 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2529/4296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:34 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:34.831533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:34.832201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:34.845729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:34.846527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:34.847371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:34.849171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:34.850761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:34.851560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:34.887357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:35.372932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:35.392586 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1d72ffd4-2ab6-47a9-9eca-bf650806112d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1806 microversion: 2.1 time: 0.565770 Oct 28 18:22:35.393667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2530/4297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:34 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1806 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:35.398601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:35.400445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:35.411176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:35.415657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:35.416491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:35.417483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:35.418288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:35.419062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:35.738682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:35.750171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:35.752070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:35.753504 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a839236-9e02-4250-8fee-5c9a0070c2cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.358575 Oct 28 18:22:35.767863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2531/4298] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:35 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:35.776981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:35.777494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:35.786777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:35.787290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:35.787743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:35.788644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:35.789115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:35.790112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:35.825883 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7beee467-63c2-49f3-a798-34eda8f394ea tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491/ips" status: 200 len: 220 microversion: 2.1 time: 0.058392 Oct 28 18:22:35.826825 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2532/4299] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:22:35 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491/ips => generated 220 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:35.831403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:35.832072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:35.840505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:35.840994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:35.841435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:35.842139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:35.842590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:35.843319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:36.093572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:36.106734 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a12ccf3-52d4-487e-b571-939a2beee2eb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.278724 Oct 28 18:22:36.107352 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2533/4300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:35 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:36.128180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:36.128686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:36.140048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:36.140736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:36.141026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:36.142483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:36.142483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:36.142680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:36.171566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:22:36.275028 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-46b79cff-0e9c-463b-a18f-8a8ba4739df9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "DELETE /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 204 len: 0 microversion: 2.1 time: 0.149284 Oct 28 18:22:36.280250 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2534/4301] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:22:36 2022] DELETE /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:22:36.292438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:36.293138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:36.299842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:36.300776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:36.300776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:36.301485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:36.301951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:36.302383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:36.634372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:36.644923 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68c6a795-600c-4ccc-bf0f-cb5664c6fbf2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1812 microversion: 2.1 time: 0.361896 Oct 28 18:22:36.645528 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2535/4302] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:36 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1812 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:36.779561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:36.780215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:36.794731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:36.795358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:36.795826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:36.800851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:36.800851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:36.800851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:37.171302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:37.187055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:37.188923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:37.192654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29b381ab-201d-4037-baf1-69412c17b9b6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.414724 Oct 28 18:22:37.193291 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2536/4303] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:36 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:22:37.210400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:37.211019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:37.221954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:37.222553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:37.223099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:37.223740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:37.224240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:37.224681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:37.600396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:37.613289 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbb23241-1c3d-4795-b83a-1a1c03fc1c85 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.418851 Oct 28 18:22:37.614291 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2537/4304] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:37 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:37.674768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:37.676111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:37.683298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:37.683869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:37.684310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:37.685367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:37.685977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:37.686881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:38.017654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:38.030481 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c0b2c13-51c0-4a85-8161-a5aa6c4d63a5 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1812 microversion: 2.1 time: 0.360477 Oct 28 18:22:38.032561 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2538/4305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:37 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1812 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:38.233652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:38.234672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:38.242840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:38.243874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:38.244567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:38.246795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:38.248727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:38.249607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:38.832012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:38.846319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:38.848148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:38.849507 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7716105b-021f-4928-983b-64790c182f70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.620278 Oct 28 18:22:38.850375 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2539/4306] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:38 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:38.857561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:38.858629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:38.869918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:38.870867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:38.871614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:38.872388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:38.873067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:38.873829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:39.124082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:39.189101 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30624bea-8738-45e5-be14-51d9fe7cc47b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.336700 Oct 28 18:22:39.205870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2540/4307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:38 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:39.236966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:39.237833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:39.250724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:39.251663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:39.252315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:39.254153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:39.254934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:39.256421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:39.807744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:39.820513 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0ec0b62-e450-4f51-a6e6-56995b643210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1791 microversion: 2.1 time: 0.610218 Oct 28 18:22:39.822632 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2541/4308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:39 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1791 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:39.833564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f74d2204-7930-42c2-a539-f4333fa3f1ab req-ae66890a-315b-4e86-8caa-79475e1a6d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "name": "network-vif-deleted", "tag": "181b2480-321f-48a5-b250-d764e9e15527"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:39.848564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:39.856497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f74d2204-7930-42c2-a539-f4333fa3f1ab req-ae66890a-315b-4e86-8caa-79475e1a6d60 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:39.860499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f74d2204-7930-42c2-a539-f4333fa3f1ab req-ae66890a-315b-4e86-8caa-79475e1a6d60 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:39.861296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f74d2204-7930-42c2-a539-f4333fa3f1ab req-ae66890a-315b-4e86-8caa-79475e1a6d60 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:39.904035 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f74d2204-7930-42c2-a539-f4333fa3f1ab req-ae66890a-315b-4e86-8caa-79475e1a6d60 service nova] Creating event network-vif-deleted:181b2480-321f-48a5-b250-d764e9e15527 for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:39.911453 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f74d2204-7930-42c2-a539-f4333fa3f1ab req-ae66890a-315b-4e86-8caa-79475e1a6d60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085407 Oct 28 18:22:39.912297 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2542/4309] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:39.933954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:39.938205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:39.952802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:39.953309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:39.953765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:39.954480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:39.954938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:39.955369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:40.344307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:40.355349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:40.356813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:40.358378 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79b9c074-39e5-433a-9a4a-e97b863d3501 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.444605 Oct 28 18:22:40.359292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2543/4310] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:39 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:40.365255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:40.367419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:40.378352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:40.379113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:40.379602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:40.380393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:40.380854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:40.381496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:40.713033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:40.725130 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df7d52ae-0e76-48d9-a1be-8edb3b678f50 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.364531 Oct 28 18:22:40.725818 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2544/4311] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:40 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:40.855217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:40.855894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:40.867375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:40.867906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:40.868351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:40.869076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:40.869572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:40.870006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:40.964431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:40.964931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:40.965376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:40.965834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lazy-loading 'fault' on Instance uuid 502d93b0-c188-4ae7-9837-b7764ea49491 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:22:41.138730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:41.148280 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6c169fb-ef9d-434a-bec3-180ce6bac6e2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 200 len: 1302 microversion: 2.1 time: 0.302851 Oct 28 18:22:41.148920 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2545/4312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:40 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 1302 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:41.388251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:41.389529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:41.397215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:41.397701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:41.398333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:41.402958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:41.403642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:41.404119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:41.409993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:41.671800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:41.692854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:41.698611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:41.702931 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d6d7fb4-addd-4d1a-9c8f-80eb8608e871 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.319757 Oct 28 18:22:41.708002 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2546/4313] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:41 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:41.750281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:41.751305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:41.762624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:41.762999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:41.772139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:41.773102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:41.774881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:41.775339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:42.049024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:42.079203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b65acbc1-c252-49e8-8f77-c6f742004e2d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.333030 Oct 28 18:22:42.092903 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2547/4314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:41 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:42.103902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6d3c63cb-9826-4ec7-b84d-8b54dd2b1b42 req-b1c01e2b-5f84-4503-adf7-d8e2e60277d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "name": "network-vif-deleted", "tag": "712f078c-6018-4b5b-a096-b887fb899364"}, {"server_uuid": "502d93b0-c188-4ae7-9837-b7764ea49491", "name": "network-vif-deleted", "tag": "910299a5-9ea5-438d-afc2-474acc6b297b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:42.114340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6d3c63cb-9826-4ec7-b84d-8b54dd2b1b42 req-b1c01e2b-5f84-4503-adf7-d8e2e60277d0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:42.115196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6d3c63cb-9826-4ec7-b84d-8b54dd2b1b42 req-b1c01e2b-5f84-4503-adf7-d8e2e60277d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:42.116446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6d3c63cb-9826-4ec7-b84d-8b54dd2b1b42 req-b1c01e2b-5f84-4503-adf7-d8e2e60277d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:42.130039 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6d3c63cb-9826-4ec7-b84d-8b54dd2b1b42 req-b1c01e2b-5f84-4503-adf7-d8e2e60277d0 service nova] Creating event network-vif-deleted:712f078c-6018-4b5b-a096-b887fb899364 for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:42.130954 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6d3c63cb-9826-4ec7-b84d-8b54dd2b1b42 req-b1c01e2b-5f84-4503-adf7-d8e2e60277d0 service nova] Creating event network-vif-deleted:910299a5-9ea5-438d-afc2-474acc6b297b for instance 502d93b0-c188-4ae7-9837-b7764ea49491 on n-h1-862404-2 Oct 28 18:22:42.137304 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6d3c63cb-9826-4ec7-b84d-8b54dd2b1b42 req-b1c01e2b-5f84-4503-adf7-d8e2e60277d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042496 Oct 28 18:22:42.138457 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2548/4315] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:42.189169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:42.190148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:42.198474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:42.198977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:42.199610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:42.200562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:42.201199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:42.201620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:42.218029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] HTTP exception thrown: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Request method failure captured: Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 HTTP/1.1 Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB23ScdEAYETrDWkKsRchLa2Yul_IBIMyXcuuv-rZKtpiIgUvM73wFZe3RNjVBSuf_PgdBLLKYg8HonlwYqhEwz6JTHaupktHK2KuPsKB2IbijAcXI7g3C_Fa-daVURhv6MPYe79yfVKFBjC-dm2urKnT2h0QUTl90lMw0MrN2fZFRM Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_00004db1da4048c9aebe0ed35749d56f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestMultiNic-364769518 Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestMultiNic-364769518-project Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 970c770865b448839659d3884b8b42c6 Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestMultiNic-364769518-project Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '502d93b0-c188-4ae7-9837-b7764ea49491'} Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:22:42.220039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Returning 404 to user: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:22:42.223979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-16b56534-ae3f-4d58-9c9f-b6362ca59ff7 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 404 len: 111 microversion: 2.1 time: 0.046952 Oct 28 18:22:42.225550 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2549/4316] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:42 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:22:42.737358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:42.738064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:42.752910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:42.753411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:42.753853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:42.754574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:42.755079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:42.755702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:43.151144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:43.164981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:43.166688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:43.168117 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5a9eb1a-82a7-4c8a-932d-1fa9ef52c3f1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1745 microversion: 2.20 time: 0.435534 Oct 28 18:22:43.169221 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2550/4317] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:42 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1745 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:22:43.174959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:43.175779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:43.193591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:43.194374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:43.195070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:43.196732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:43.197419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:43.198014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:43.451589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:43.464335 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd2a6607-cc11-429f-92d1-a05d50ff9117 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.291386 Oct 28 18:22:43.466120 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2551/4318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:43 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:44.198655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:44.199525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:44.211684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:44.212422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:44.212911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:44.214564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:44.215298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:44.215919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:44.403534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:44.415750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:44.418392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:44.420510 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82f691e6-0424-40d6-9236-18ac45f4319c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.226773 Oct 28 18:22:44.421588 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2552/4319] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:44 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:22:44.492123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:44.494501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:44.504106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:44.505010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:44.505673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:44.506679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:44.507666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:44.510203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:44.728220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:44.737789 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c5d970a-8604-458d-b166-b39d6dd05d05 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.251334 Oct 28 18:22:44.738751 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2553/4320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:44 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:44.744245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-935661e9-59c9-4520-8094-a6de980e25f4 req-5b548ec5-d324-471b-a107-2611273ea318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fe0daa-955e-40da-b95e-c00125d1f92a", "name": "network-vif-plugged", "status": "completed", "tag": "e8004f4a-7b2a-405e-b161-4d9d7552bdde"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:44.762023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-935661e9-59c9-4520-8094-a6de980e25f4 req-5b548ec5-d324-471b-a107-2611273ea318 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:44.762512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-935661e9-59c9-4520-8094-a6de980e25f4 req-5b548ec5-d324-471b-a107-2611273ea318 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:44.762950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-935661e9-59c9-4520-8094-a6de980e25f4 req-5b548ec5-d324-471b-a107-2611273ea318 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:44.776102 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-935661e9-59c9-4520-8094-a6de980e25f4 req-5b548ec5-d324-471b-a107-2611273ea318 service nova] Creating event network-vif-plugged:e8004f4a-7b2a-405e-b161-4d9d7552bdde for instance 24fe0daa-955e-40da-b95e-c00125d1f92a on n-h2-862404-2 Oct 28 18:22:44.786677 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-935661e9-59c9-4520-8094-a6de980e25f4 req-5b548ec5-d324-471b-a107-2611273ea318 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046236 Oct 28 18:22:44.798490 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2554/4321] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:45.450023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:45.450750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:45.463290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:45.467010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:45.467947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:45.469338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:45.470908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:45.471619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:45.646957 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:22:45.647696 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:22:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:22:45.648176 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:22:45.648290 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:22:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:22:45.822866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:45.856301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:45.861188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:45.862639 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-520261db-6f69-479d-a4e7-8afbb2ad560c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.419860 Oct 28 18:22:45.865455 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2555/4322] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:45 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:22:45.885191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:45.886730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:45.906609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:45.907436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:45.908610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:45.909928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:45.910594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:45.911215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:46.189952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:46.205080 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f9c558a-c576-45fc-9263-4fab1bd91f22 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.338280 Oct 28 18:22:46.215905 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2556/4323] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:45 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:46.897060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:46.900459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:46.911545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:46.912952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:46.913639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:46.915250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:46.915946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:46.917176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:47.132186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:47.144807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:47.146469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:47.152909 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8586ce05-a8a0-4936-8d9f-04460b59bff4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.259831 Oct 28 18:22:47.153715 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2557/4324] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:46 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:47.238475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:47.239005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:47.263658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:47.264252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:47.264718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:47.265478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:47.272755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:47.273239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:47.775867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:47.790682 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e205af84-82ab-4319-b204-5c7d55db80a0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.559310 Oct 28 18:22:47.791908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2558/4325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:47 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:48.188501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:48.189134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:48.207326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:48.208274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:48.208874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:48.209757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:48.219046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:48.219851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:48.584418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:48.596088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:48.597945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:48.599783 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13790979-6726-467f-89af-9a5e65b944cb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.415861 Oct 28 18:22:48.611949 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2559/4326] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:48 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:48.818085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:48.818850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:48.837924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:48.838438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:48.838887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:48.845923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:48.846493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:48.850572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:49.268126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:49.283433 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d688f5b7-6647-4047-944e-45f7bcfcbf51 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.469894 Oct 28 18:22:49.286655 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2560/4327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:48 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:49.745020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:49.745899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:49.759385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:49.760232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:49.761074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:49.762039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:49.763076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:49.765300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:50.042141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:50.074175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:50.085498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:50.085498 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-656e081c-eb3c-4528-93b0-b3b6c4296e07 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.340467 Oct 28 18:22:50.085498 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2561/4328] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:49 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:22:50.313165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:50.314383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:50.327219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:50.328119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:50.328570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:50.337430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:50.340050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:50.340756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:50.784084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:50.793260 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03b970fe-1594-44c4-92e2-27c7b39f3b86 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1505 microversion: 2.1 time: 0.485275 Oct 28 18:22:50.793866 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2562/4329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:50 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:50.801116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-609812311", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "3ef6d73e-f7f8-47af-8dd0-a8c7e73f9785"}, {"uuid": "53f4c077-0e19-4218-bd0c-59d14a6eba89"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:50.936801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] validate_networks() for [('3ef6d73e-f7f8-47af-8dd0-a8c7e73f9785', None, None, None, None, None), ('53f4c077-0e19-4218-bd0c-59d14a6eba89', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:22:52.972493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:22:52.973637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:22:52.974913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:22:52.975522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:22:52.976247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:22:53.009978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:53.013831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:53.014494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:53.015392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:53.017095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:53.019425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:53.090984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Getting quotas for project 00004db1da4048c9aebe0ed35749d56f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:22:53.099462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Getting quotas for user 970c770865b448839659d3884b8b42c6 and project 00004db1da4048c9aebe0ed35749d56f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:22:53.118974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:22:53.132565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:22:53.261961 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9998b06c-f6e9-4dd9-81e0-ce7976267abf tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.464443 Oct 28 18:22:53.265217 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2563/4330] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:22:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:22:53.283188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:53.288472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:53.322610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:53.329139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:53.332055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:53.332922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:53.362101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:53.363481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:54.179011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:54.198073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:54.201759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:54.209265 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-359fbeef-d292-43c3-9445-3142e4afa068 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.938997 Oct 28 18:22:54.211357 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2564/4331] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:53 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:54.232259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:54.245510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:54.268713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:54.272923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:54.277258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:54.286888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:54.290454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:54.291468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:54.359515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:55.467522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:55.483098 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-626bcdde-cc7c-4716-a228-b33bb8687fe7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1485 microversion: 2.1 time: 1.265486 Oct 28 18:22:55.511468 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2565/4332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:54 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1485 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:55.525767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:55.526685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:55.543487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:55.545824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:55.551647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:55.553285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:55.554178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:55.556218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:55.829509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:55.842044 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-10c4e254-ce82-4bed-be28-74ed99e13d4c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1282 microversion: 2.1 time: 0.329035 Oct 28 18:22:55.859373 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2566/4333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:55 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1282 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:55.859373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:55.859373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:55.874250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:55.874762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:55.875218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:55.875971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:55.876482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:55.876882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:56.038764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lazy-loading 'services' on Instance uuid 829508d1-3732-4715-8cf2-7eb0c46ad1e8 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:22:56.184049 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ad88b8c-4f36-43e1-b072-4048b7615680 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments/b0ca08cf-889b-4b33-ac79-732483c5ef62" status: 202 len: 0 microversion: 2.1 time: 0.333641 Oct 28 18:22:56.184860 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2567/4334] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:22:55 2022] DELETE /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments/b0ca08cf-889b-4b33-ac79-732483c5ef62 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:22:56.203075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:56.204507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:22:56.224910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:56.225454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:56.225981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:56.229776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:56.231398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:56.231867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:56.688731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:56.699381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:56.701453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:56.704698 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a9ff63c-8147-4009-9ca2-053df9746947 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.518389 Oct 28 18:22:56.721937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2568/4335] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:22:56 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:22:56.733890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1255175383", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:56.823983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] validate_networks() for [('270637fb-3b8e-462e-a6c5-0be4df14ac52', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:22:59.959943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:22:59.960697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:22:59.961599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:22:59.962241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:22:59.962917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:23:00.008457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:00.009663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:00.018697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:00.019563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:00.020264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:00.021052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:00.070969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Getting quotas for project e0c57f517556450286614a53b91a5464. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:23:00.080933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Getting quotas for user aa6c205b1e564145ae55583d0c8fd6c1 and project e0c57f517556450286614a53b91a5464. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:23:00.128034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:23:00.130598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:23:00.304849 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab722e08-7e72-490a-a68f-36cc254c305f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.578279 Oct 28 18:23:00.309906 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2569/4336] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:22:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:23:00.333670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:00.351885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:00.374242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:00.375935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:00.376419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:00.377078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:00.378079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:00.378947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:00.457414 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-421cd505-3f38-4c64-b71a-288b04642f09 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146140 Oct 28 18:23:00.475844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2570/4337] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:23:00 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:00.483608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:00.490534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:00.503096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:00.510577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:00.511383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:00.512426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:00.513125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:00.518815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:01.088285 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:23:01.088827 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:23:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:23:02.359042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:02.371384 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a37afb4a-8794-47f7-8475-1dfff8c6ac11 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 1.891660 Oct 28 18:23:02.402655 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2571/4338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:00 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:02.442276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:02.444912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:02.470314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:02.477806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:02.480286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:02.483683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:02.484263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:02.490005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:04.295034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:04.309537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:04.313818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:04.317251 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9eef9cc4-1ef1-400e-9cc0-e8a04f219f08 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 1.913165 Oct 28 18:23:04.318687 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2572/4339] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:02 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:04.332968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:04.333604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:04.356439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:04.359492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:04.363055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:04.364264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:04.365461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:04.365916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:04.800889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:04.823135 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69164bd9-4a63-4340-92df-315d90dcea77 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1272 microversion: 2.1 time: 0.497236 Oct 28 18:23:04.829400 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2573/4340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:04 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1272 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:04.868579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:04.874697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:04.904851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:04.905150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:04.910508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:04.915109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:04.916360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:04.917339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:05.003099 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5508700-46a3-43d7-99bf-dd1c18d7ad22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169264 Oct 28 18:23:05.011919 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2574/4341] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:23:04 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:05.018263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:05.025317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:05.041122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:05.043362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:05.045299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:05.051271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:05.054179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:05.079133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:05.625092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:05.655797 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e013c7b1-6fea-48ce-a989-a0e7033ce10c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.642211 Oct 28 18:23:05.661486 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2575/4342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:05 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:05.682110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:05.686852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:05.712304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:05.715763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:05.716523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:05.717853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:05.718519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:05.720727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:06.773716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:06.790057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:06.793005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:06.794915 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c52e8cc6-684b-4964-a669-8a5f119a50f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 1.129924 Oct 28 18:23:06.796509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2576/4343] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:05 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:06.805250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:06.806459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:06.812414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:06.819406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:06.820547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:06.821579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:06.824013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:06.824781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:06.825572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:07.029911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:07.052383 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-baa491da-85fe-4071-a7d2-070bef2777bf tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1272 microversion: 2.1 time: 0.251101 Oct 28 18:23:07.080556 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2577/4344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:06 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:07.097216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:07.100486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:07.110568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:07.112349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:07.113069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:07.115062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:07.116323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:07.118991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:07.172353 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c33ae7d-fb97-4182-bbbe-d012624bdf77 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083777 Oct 28 18:23:07.175101 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2578/4345] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:23:07 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:07.192416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2677323f-cc11-4360-bbfd-76ae8a06dfdd req-bdf363c2-604a-4ceb-9f71-b505262207d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3e11ab-9681-4e10-be51-21d7e418e467", "tag": "186ed6b3-b91d-4576-8bf7-609dd652b2ca"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:07.231571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2677323f-cc11-4360-bbfd-76ae8a06dfdd req-bdf363c2-604a-4ceb-9f71-b505262207d9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:07.232373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2677323f-cc11-4360-bbfd-76ae8a06dfdd req-bdf363c2-604a-4ceb-9f71-b505262207d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:07.233026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2677323f-cc11-4360-bbfd-76ae8a06dfdd req-bdf363c2-604a-4ceb-9f71-b505262207d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:07.262173 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2677323f-cc11-4360-bbfd-76ae8a06dfdd req-bdf363c2-604a-4ceb-9f71-b505262207d9 service nova] Creating event network-changed:186ed6b3-b91d-4576-8bf7-609dd652b2ca for instance aa3e11ab-9681-4e10-be51-21d7e418e467 on n-h1-862404-2 Oct 28 18:23:07.276688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2677323f-cc11-4360-bbfd-76ae8a06dfdd req-bdf363c2-604a-4ceb-9f71-b505262207d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099618 Oct 28 18:23:07.280338 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2579/4346] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:07.296411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:07.298781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:07.323297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:07.324477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:07.325274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:07.326632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:07.327502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:07.328304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:07.913445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:07.927595 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79d13d5b-ed60-4653-a1a9-95b01e4c2ee1 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.644636 Oct 28 18:23:07.930028 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2580/4347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:07 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:07.954162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:07.970355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:07.982774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:07.991216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:07.992626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:07.993689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:07.994419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:07.997960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:08.865454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:08.906574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:08.917494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:08.918813 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2566a75d-d472-494d-9530-ec6fa32ab51b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.968677 Oct 28 18:23:08.928648 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2581/4348] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:07 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:08.959028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:08.960404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:08.968890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:08.970954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:08.971681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:08.972872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:08.973607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:08.974340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:09.181312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:09.185565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:09.195615 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0bf5bdf3-3069-4cd7-81c6-f19a08721f66 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1314 microversion: 2.1 time: 0.249719 Oct 28 18:23:09.201189 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2582/4349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:08 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:09.217568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:09.224513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:09.248282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:09.248920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:09.249477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:09.250903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:09.252360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:09.255910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:09.330762 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9073d597-9517-4f7c-a111-b5db759e12db tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127924 Oct 28 18:23:09.331486 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2583/4350] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:23:09 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:23:09.362501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:09.364562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:09.378822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:09.391245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:09.391777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:09.392780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:09.393365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:09.396181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:10.039399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:10.102651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:10.150827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:10.165397 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4dcb145-56a6-4623-9d95-18c1a20b7b22 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.832680 Oct 28 18:23:10.165994 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2584/4351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:09 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:10.178462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:10.190854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:10.208873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:10.209806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:10.210681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:10.222062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:10.222062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:10.224684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:10.308836 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Cannot 'reboot' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93/action HTTP/1.1 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 28 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: {"reboot": {"type": "HARD"}} Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot 'reboot' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f416cc1a-709e-4417-84dc-7f62b7e1bf93', 'body': {'reboot': {'type': 'HARD'}}} Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3554, in reboot Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:23:10.310775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:10.316129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 409 to user: Cannot 'reboot' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:10.322609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b19e249-7969-42e3-8b17-696e5eb7dfd5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93/action" status: 409 len: 145 microversion: 2.1 time: 0.145428 Oct 28 18:23:10.330709 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2585/4352] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:23:10 2022] POST /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93/action => generated 145 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:23:10.330709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ba88a033-866c-4485-afbd-92bada70e533 req-a2c205fb-068e-421d-8dd6-d9f1257fb8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331b89f8-e068-40b3-a7b4-4a7ac2464c46", "tag": "4a84caf4-c98e-4277-a788-fced83ff6c3b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:10.368057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba88a033-866c-4485-afbd-92bada70e533 req-a2c205fb-068e-421d-8dd6-d9f1257fb8d1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:10.369393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba88a033-866c-4485-afbd-92bada70e533 req-a2c205fb-068e-421d-8dd6-d9f1257fb8d1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:10.370210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ba88a033-866c-4485-afbd-92bada70e533 req-a2c205fb-068e-421d-8dd6-d9f1257fb8d1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:10.394802 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ba88a033-866c-4485-afbd-92bada70e533 req-a2c205fb-068e-421d-8dd6-d9f1257fb8d1 service nova] Creating event network-changed:4a84caf4-c98e-4277-a788-fced83ff6c3b for instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 on n-h2-862404-2 Oct 28 18:23:10.416775 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ba88a033-866c-4485-afbd-92bada70e533 req-a2c205fb-068e-421d-8dd6-d9f1257fb8d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085124 Oct 28 18:23:10.417928 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2586/4353] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:10.427041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cff346f4-f07a-4fec-abbc-c51126e61233 req-8186f47c-8fef-4e6b-8c30-b2d9f7fa47fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3e11ab-9681-4e10-be51-21d7e418e467", "tag": "14bd572e-9fcf-4faf-9d12-8ec5f595dccb"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:10.457609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cff346f4-f07a-4fec-abbc-c51126e61233 req-8186f47c-8fef-4e6b-8c30-b2d9f7fa47fd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:10.458288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cff346f4-f07a-4fec-abbc-c51126e61233 req-8186f47c-8fef-4e6b-8c30-b2d9f7fa47fd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:10.460312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cff346f4-f07a-4fec-abbc-c51126e61233 req-8186f47c-8fef-4e6b-8c30-b2d9f7fa47fd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:10.485858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cff346f4-f07a-4fec-abbc-c51126e61233 req-8186f47c-8fef-4e6b-8c30-b2d9f7fa47fd service nova] Creating event network-changed:14bd572e-9fcf-4faf-9d12-8ec5f595dccb for instance aa3e11ab-9681-4e10-be51-21d7e418e467 on n-h1-862404-2 Oct 28 18:23:10.495240 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cff346f4-f07a-4fec-abbc-c51126e61233 req-8186f47c-8fef-4e6b-8c30-b2d9f7fa47fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072845 Oct 28 18:23:10.499148 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2587/4354] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:10.506042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:10.506951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:10.514906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:10.515640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:10.516281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:10.517502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:10.518118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:10.518857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:10.870994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:10.882454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:10.884370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:10.885988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-62f8cdac-7424-414a-b22a-a5f4bd664437 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.385355 Oct 28 18:23:10.904638 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2588/4355] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:10 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:10.911407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:10.912660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:10.925259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:10.926703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:10.927790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:10.930475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:10.931345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:10.933404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:11.263616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:11.278713 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba72e55a-7634-422b-bdd5-8fc60a0bc460 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1314 microversion: 2.1 time: 0.372134 Oct 28 18:23:11.281367 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2589/4356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:10 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:11.296939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:11.296939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:11.303707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:11.308576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:11.309242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:11.310105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:11.310687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:11.311253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:11.348901 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Cannot 'rebuild' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93/action HTTP/1.1 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 65 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot 'rebuild' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f416cc1a-709e-4417-84dc-7f62b7e1bf93', 'body': {'rebuild': {'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46'}}} Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:23:11.350896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 409 to user: Cannot 'rebuild' instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 while it is in vm_state rescued {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:11.356219 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a9fbe01-00ec-42d5-ade4-ac80c053de57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "POST /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93/action" status: 409 len: 146 microversion: 2.1 time: 0.069473 Oct 28 18:23:11.359015 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2590/4357] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:23:11 2022] POST /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93/action => generated 146 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:23:11.364558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:11.365278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:11.387689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:11.388431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:11.389877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:11.390919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:11.391682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:11.392300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:11.689276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:11.698010 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-831aea04-73f1-4a68-8b42-d0c9fe4a6a60 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.337898 Oct 28 18:23:11.702832 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2591/4358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:11 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:11.713937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:11.714278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:11.740282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:11.740803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:11.741252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:11.743214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:11.743557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:11.744080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:11.808254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:23:11.967433 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8a8eeea-5cbc-488e-a61f-6eb362ab16fb tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 204 len: 0 microversion: 2.1 time: 0.261694 Oct 28 18:23:11.968117 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2592/4359] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:23:11 2022] DELETE /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:23:11.985913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:11.988256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:11.995943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:11.997569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:11.998503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:11.999302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:11.999854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:12.000363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:12.266329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:12.277776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:12.279213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:12.280598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3caf606f-9bfa-4e54-82aa-bd89fc034485 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1740 microversion: 2.20 time: 0.309142 Oct 28 18:23:12.286931 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2593/4360] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:11 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:12.299771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:12.300788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:12.315703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:12.316517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:12.317152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:12.317869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:12.318320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:12.322452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:12.736138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:12.745321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c42028e-7b9f-4567-b435-fd29143d3000 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1690 microversion: 2.1 time: 0.457022 Oct 28 18:23:12.768889 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2594/4361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:12 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1690 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:12.776766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:12.777405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:12.784043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:12.784549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:12.784996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:12.785864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:12.786425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:12.786865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:13.017384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:13.045124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b94dab99-d2ba-473c-8cb4-9a908081a14b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1314 microversion: 2.1 time: 0.274794 Oct 28 18:23:13.047444 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2595/4362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:12 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:13.062072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:13.062947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:13.100832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:13.102831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:13.104235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:13.107128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:13.107616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:13.108067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:13.303423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:13.340980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5516b895-98ee-4c2e-b68a-a17ef729e55c tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.291804 Oct 28 18:23:13.341487 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2596/4363] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:13 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:13.363002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:13.363675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:13.375561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:13.376155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:13.376599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:13.383785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:13.384390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:13.384857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:13.665186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:13.684040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:13.685800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:13.697546 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6b678ef-a7d4-4e12-ae27-6a46638a98e8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1722 microversion: 2.20 time: 0.338197 Oct 28 18:23:13.698528 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2597/4364] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:13 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:13.774231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:13.775492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:13.784115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:13.784602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:13.789935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:13.791863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:13.794352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:13.795460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:14.193834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:14.207350 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4598318e-a3d9-46a5-8fcf-82158c16b8ad tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1690 microversion: 2.1 time: 0.437923 Oct 28 18:23:14.219992 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2598/4365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:13 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1690 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:14.226320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:14.227143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:14.234004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:14.236728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:14.237331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:14.238217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:14.244221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:14.244953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:14.494730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:14.499448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:14.507531 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45bc4876-579d-437c-96a9-e4df76212b63 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1314 microversion: 2.1 time: 0.285720 Oct 28 18:23:14.513484 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2599/4366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:14 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:14.533988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:14.540312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:14.547151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:14.561154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:14.561890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:14.576268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:14.577223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:14.578059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:14.922470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:14.931574 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a5ff0a1-8e42-486e-b873-f9c76fede654 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.416733 Oct 28 18:23:14.938335 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2600/4367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:14 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:14.943397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:14.945415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:14.963189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:14.963888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:14.964506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:14.965546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:14.973255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:14.973918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:15.206022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:15.255872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:15.265346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:15.267982 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0ecee5c9-9247-4cb6-9604-91b46496139a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1722 microversion: 2.20 time: 0.328459 Oct 28 18:23:15.282641 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2601/4368] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:14 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:15.300627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e44e7853-e467-49ff-aeec-7b349779ce56 req-18312e03-c58b-412f-8e73-ddb1a2cbd5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331b89f8-e068-40b3-a7b4-4a7ac2464c46", "name": "network-vif-plugged", "status": "completed", "tag": "4a84caf4-c98e-4277-a788-fced83ff6c3b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:15.319120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e44e7853-e467-49ff-aeec-7b349779ce56 req-18312e03-c58b-412f-8e73-ddb1a2cbd5f0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:15.320454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e44e7853-e467-49ff-aeec-7b349779ce56 req-18312e03-c58b-412f-8e73-ddb1a2cbd5f0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:15.325648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e44e7853-e467-49ff-aeec-7b349779ce56 req-18312e03-c58b-412f-8e73-ddb1a2cbd5f0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:15.340953 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e44e7853-e467-49ff-aeec-7b349779ce56 req-18312e03-c58b-412f-8e73-ddb1a2cbd5f0 service nova] Creating event network-vif-plugged:4a84caf4-c98e-4277-a788-fced83ff6c3b for instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 on n-h2-862404-2 Oct 28 18:23:15.346343 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e44e7853-e467-49ff-aeec-7b349779ce56 req-18312e03-c58b-412f-8e73-ddb1a2cbd5f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062121 Oct 28 18:23:15.347351 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2602/4369] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:15.354785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:15.355660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:15.363706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:15.364550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:15.365305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:15.366217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:15.366862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:15.367450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:16.068028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:16.089850 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8b9d6d2-f33c-478e-9b78-813ac944cd2c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1690 microversion: 2.1 time: 0.740495 Oct 28 18:23:16.106375 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2603/4370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:15 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1690 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:16.111790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:16.112763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:16.119522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:16.120395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:16.121045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:16.121968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:16.122665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:16.123291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:16.857359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:16.888558 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-318bcb4e-1753-4a10-89b5-841a461a74da tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1314 microversion: 2.1 time: 0.780629 Oct 28 18:23:16.904750 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2604/4371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:16 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:16.910371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:16.911200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:16.918605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:16.919330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:16.919951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:16.920820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:16.921465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:16.922047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:17.428456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:17.438231 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad59c0e9-6fbf-4ab3-b236-11437ab2a343 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.531956 Oct 28 18:23:17.439027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2605/4372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:16 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:17.445567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:17.446443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:17.456411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:17.457764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:17.458469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:17.459964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:17.460755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:17.461462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:17.785531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:17.794901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:17.796707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:17.798159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e28eac3c-059f-461f-9945-9d04b1d37cc1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1722 microversion: 2.20 time: 0.358013 Oct 28 18:23:17.799319 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2606/4373] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:17 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:17.804287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:17.805524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:17.813263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:17.814013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:17.814679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:17.815674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:17.816386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:17.817034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:17.986747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:18.000760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0809f98d-0b1a-42ad-85ea-a4a3994ce374 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1622 microversion: 2.1 time: 0.199995 Oct 28 18:23:18.019307 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2607/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:17 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1622 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:18.040515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9ee50ec9-fef3-4254-bbcf-0c7b2a9cbbe2 req-bf54a9e8-623a-46c5-b180-863cefbdb9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fe0daa-955e-40da-b95e-c00125d1f92a", "name": "network-vif-unplugged", "status": "completed", "tag": "e8004f4a-7b2a-405e-b161-4d9d7552bdde"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:18.067915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9ee50ec9-fef3-4254-bbcf-0c7b2a9cbbe2 req-bf54a9e8-623a-46c5-b180-863cefbdb9fa service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:18.068656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9ee50ec9-fef3-4254-bbcf-0c7b2a9cbbe2 req-bf54a9e8-623a-46c5-b180-863cefbdb9fa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:18.070338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9ee50ec9-fef3-4254-bbcf-0c7b2a9cbbe2 req-bf54a9e8-623a-46c5-b180-863cefbdb9fa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:18.108355 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9ee50ec9-fef3-4254-bbcf-0c7b2a9cbbe2 req-bf54a9e8-623a-46c5-b180-863cefbdb9fa service nova] Creating event network-vif-unplugged:e8004f4a-7b2a-405e-b161-4d9d7552bdde for instance 24fe0daa-955e-40da-b95e-c00125d1f92a on n-h2-862404-2 Oct 28 18:23:18.114452 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9ee50ec9-fef3-4254-bbcf-0c7b2a9cbbe2 req-bf54a9e8-623a-46c5-b180-863cefbdb9fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093684 Oct 28 18:23:18.119108 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2608/4375] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:18.154391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:18.155209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:18.173358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:18.173874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:18.175580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:18.177928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:18.178850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:18.181682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:18.869141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:18.886256 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2cdbe6d-5517-4041-8524-1043619a32c2 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1500 microversion: 2.1 time: 0.765526 Oct 28 18:23:18.889852 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2609/4376] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:18 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1500 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:18.909502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:18.912145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:18.936636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:18.940070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:18.940726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:18.941625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:18.943544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:18.945388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:19.858420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:19.871523 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a4c2c1ac-1460-4d4a-a2bf-4352ca1ea99d tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.976744 Oct 28 18:23:19.872212 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2610/4377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:18 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:19.885526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5effe309-52c0-477c-9b05-b7fbdb4f597c req-3a705747-36c0-482d-9363-7fc2f7ab4953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829508d1-3732-4715-8cf2-7eb0c46ad1e8", "name": "network-vif-deleted", "tag": "d23e6dd8-35c1-45d5-a25a-5974d1471990"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:19.928256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5effe309-52c0-477c-9b05-b7fbdb4f597c req-3a705747-36c0-482d-9363-7fc2f7ab4953 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:19.928649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5effe309-52c0-477c-9b05-b7fbdb4f597c req-3a705747-36c0-482d-9363-7fc2f7ab4953 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:19.933350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5effe309-52c0-477c-9b05-b7fbdb4f597c req-3a705747-36c0-482d-9363-7fc2f7ab4953 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:19.997619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5effe309-52c0-477c-9b05-b7fbdb4f597c req-3a705747-36c0-482d-9363-7fc2f7ab4953 service nova] Creating event network-vif-deleted:d23e6dd8-35c1-45d5-a25a-5974d1471990 for instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 on n-h2-862404-2 Oct 28 18:23:20.015439 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5effe309-52c0-477c-9b05-b7fbdb4f597c req-3a705747-36c0-482d-9363-7fc2f7ab4953 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139791 Oct 28 18:23:20.017242 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2611/4378] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:20.027108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:20.035062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:20.056616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.077470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.078062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.079113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.081501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.083306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.379083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:20.391964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:20.394231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:20.395672 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0129d607-3f68-4a7e-a929-6d6c2ffdbedb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1722 microversion: 2.20 time: 0.376041 Oct 28 18:23:20.413105 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2612/4379] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:20 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:20.424147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:20.426644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:20.433880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.434494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.435031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.435848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.436436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.436958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.465261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lazy-loading 'flavor' on Instance uuid 331b89f8-e068-40b3-a7b4-4a7ac2464c46 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:23:20.580449 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec5de489-78eb-4c06-8d9a-be02e743cc0e tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "POST /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46/action" status: 200 len: 32 microversion: 2.1 time: 0.164831 Oct 28 18:23:20.581840 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2613/4380] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:23:20 2022] POST /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:23:20.589764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:20.590784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:20.599028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.600050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.600667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.602760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.603587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.604223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.647225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.648070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.648948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.649814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lazy-loading 'fault' on Instance uuid 829508d1-3732-4715-8cf2-7eb0c46ad1e8 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:23:20.743789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:20.756632 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-edb99da5-1a4a-4328-a0ef-e83f9a60123e tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 200 len: 1334 microversion: 2.1 time: 0.172962 Oct 28 18:23:20.778894 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2614/4381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:20 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 1334 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:20.787958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fb05607f-59e7-405b-b82f-c95f84fdb840 req-ec5b93c4-76f1-459f-8a4a-5151e93f5ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3e11ab-9681-4e10-be51-21d7e418e467", "name": "network-vif-plugged", "status": "completed", "tag": "186ed6b3-b91d-4576-8bf7-609dd652b2ca"}, {"server_uuid": "aa3e11ab-9681-4e10-be51-21d7e418e467", "name": "network-vif-plugged", "status": "completed", "tag": "14bd572e-9fcf-4faf-9d12-8ec5f595dccb"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:20.798457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb05607f-59e7-405b-b82f-c95f84fdb840 req-ec5b93c4-76f1-459f-8a4a-5151e93f5ba7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.798950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb05607f-59e7-405b-b82f-c95f84fdb840 req-ec5b93c4-76f1-459f-8a4a-5151e93f5ba7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.799383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb05607f-59e7-405b-b82f-c95f84fdb840 req-ec5b93c4-76f1-459f-8a4a-5151e93f5ba7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.815339 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fb05607f-59e7-405b-b82f-c95f84fdb840 req-ec5b93c4-76f1-459f-8a4a-5151e93f5ba7 service nova] Creating event network-vif-plugged:186ed6b3-b91d-4576-8bf7-609dd652b2ca for instance aa3e11ab-9681-4e10-be51-21d7e418e467 on n-h1-862404-2 Oct 28 18:23:20.815876 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fb05607f-59e7-405b-b82f-c95f84fdb840 req-ec5b93c4-76f1-459f-8a4a-5151e93f5ba7 service nova] Creating event network-vif-plugged:14bd572e-9fcf-4faf-9d12-8ec5f595dccb for instance aa3e11ab-9681-4e10-be51-21d7e418e467 on n-h1-862404-2 Oct 28 18:23:20.822592 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fb05607f-59e7-405b-b82f-c95f84fdb840 req-ec5b93c4-76f1-459f-8a4a-5151e93f5ba7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043243 Oct 28 18:23:20.823708 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2615/4382] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:20.829791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:20.831675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:20.838597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.839131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.839536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.840336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.840862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.841915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:21.349183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:21.354350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:21.361647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30999213-d0e0-4676-9745-e8e2b3d0fe0f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.536147 Oct 28 18:23:21.362463 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2616/4383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:20 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:21.393606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:21.397341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:21.404201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:21.404702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:21.405144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:21.412176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:21.412176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:21.412176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:21.986841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:22.004560 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f18bf59-a764-4415-82e9-1bbfe4837210 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1333 microversion: 2.1 time: 0.629828 Oct 28 18:23:22.020234 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2617/4384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:21 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1333 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:22.026299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:22.027137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:22.033449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:22.034154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:22.034773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:22.035656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:22.036128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:22.036708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:23.150340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:23.159908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:23.162032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:23.164768 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f80d86c-77ce-4c27-aa62-3176bd586dbb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1665 microversion: 2.20 time: 1.142099 Oct 28 18:23:23.165793 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2618/4385] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:22 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1665 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:23.439070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:23.440012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: 829508d1-3732-4715-8cf2-7eb0c46ad1e8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:23.451471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:23.452286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:23.453262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:23.454344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:23.455056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:23.455654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:23.487006 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 could not be found. Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 HTTP/1.1 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 could not be found. Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '829508d1-3732-4715-8cf2-7eb0c46ad1e8'} Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 could not be found. Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 could not be found. Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:23.488716 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:23.493287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:23.493287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:23.493287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:23.493287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:23.493287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:23.493287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:23.493287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 could not be found. Oct 28 18:23:23.493287 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:23.498829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 404 to user: Instance 829508d1-3732-4715-8cf2-7eb0c46ad1e8 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:23.499968 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87d88ba7-32d6-458d-b840-2affa058dc22 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8" status: 404 len: 111 microversion: 2.1 time: 0.332583 Oct 28 18:23:23.500729 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2619/4386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:23 2022] GET /compute/v2.1/servers/829508d1-3732-4715-8cf2-7eb0c46ad1e8 => generated 111 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:23:23.506450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:23.508119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:23.514340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:23.514906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:23.515600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:23.516524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:23.517196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:23.517944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:23.854978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:23.864711 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25423d6b-5e7f-4603-ac02-07a4dbb80ae6 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.362541 Oct 28 18:23:23.876666 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2620/4387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:23 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:23.882386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:23.883650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:23.891053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:23.891548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:23.892174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:23.893199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:23.893799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:23.894366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:24.216165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:24.229356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-afb6f3f2-81f5-4125-b225-bff1505625c9 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1667 microversion: 2.1 time: 0.348715 Oct 28 18:23:24.242235 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2621/4388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:23 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1667 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:24.250838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a53df83e-5f91-4af1-afba-be75e8a231a9"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:24.259630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:24.265923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:24.266426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:24.266872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:24.267584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:24.268126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:24.268989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:24.750552 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50a7c690-da73-4bed-9aff-202189dfd74e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.515504 Oct 28 18:23:24.756978 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2622/4389] 10.222.0.16 () {62 vars in 1364 bytes} [Fri Oct 28 18:23:24 2022] POST /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments => generated 188 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:23:25.041498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:25.042247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:25.044503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:25.055993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.056689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.057132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.068199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.068199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.068491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.107991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:23:25.216907 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-686fd31d-c38b-4216-b8b0-ca44a3f1a40a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 204 len: 0 microversion: 2.42 time: 0.455028 Oct 28 18:23:25.218878 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2623/4390] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:23:24 2022] DELETE /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:23:25.228368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b1329d3b-23b4-48ad-90c2-e57f62273c4f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '.version_select at 0x7f78dc8fe160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:25.252285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b1329d3b-23b4-48ad-90c2-e57f62273c4f tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-473419009" status: 202 len: 0 microversion: 2.1 time: 0.031378 Oct 28 18:23:25.252888 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2624/4391] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:23:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-473419009 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:23:25.259250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:25.259917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:25.266095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.266597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.267041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.268116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.268581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.269049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.294139 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43ec9edf-4a1f-45ec-a56d-423ce775b633 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467/ips" status: 200 len: 178 microversion: 2.1 time: 0.040025 Oct 28 18:23:25.302530 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2625/4392] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:23:25 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467/ips => generated 178 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:25.308711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:25.309512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:25.318229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.318950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.319611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.320747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.321374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.321996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.577478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:25.589658 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1c15bd4a-0a87-4db5-88ff-00c622b3e046 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.285792 Oct 28 18:23:25.607733 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2626/4393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:25 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:25.614401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:25.615508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:25.623639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.624637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.625282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.626261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.627160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.627878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.706104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120680) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 28 18:23:25.864609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad1538b6-1771-4f84-a4de-aa1ba4e20af7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/action" status: 202 len: 0 microversion: 2.20 time: 0.253985 Oct 28 18:23:25.866686 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2627/4394] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:23:25 2022] POST /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:23:25.885860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:25.886787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:25.904270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.904820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.905353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.906367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.912277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.912568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:26.310774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:26.324716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:26.327509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:26.328822 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31bb9bb2-b840-457f-b397-c2709d37bfc7 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2952 microversion: 2.42 time: 0.459627 Oct 28 18:23:26.329393 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2628/4395] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:25 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2952 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:26.342680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:26.344525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:26.357477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:26.363116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:26.363607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:26.364399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:26.364874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:26.365307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:26.418398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:23:26.433884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:26.504749 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2035a86-5f1d-4fc7-9309-c7a4547344c8 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 204 len: 0 microversion: 2.1 time: 0.166644 Oct 28 18:23:26.505382 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2629/4396] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:23:26 2022] DELETE /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:23:26.511528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:26.512268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:26.518598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:26.519103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:26.519553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:26.520371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:26.520764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:26.521196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:27.167251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:27.178444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:27.182237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:27.193420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-62d85a25-fb63-45f0-8cbe-5c0a0b418790 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1751 microversion: 2.20 time: 0.677602 Oct 28 18:23:27.198099 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2630/4397] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:26 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1751 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:27.221526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:27.223690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:27.234908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:27.236486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:27.237274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:27.240281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:27.241079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:27.242445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:27.643727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:27.652505 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-646ae4d4-eff0-4fba-9b4b-4fbb12267569 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1673 microversion: 2.1 time: 0.453115 Oct 28 18:23:27.656813 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2631/4398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:27 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1673 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:27.671777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:27.674806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:27.688553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:27.689978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:27.691017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:27.693851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:27.694651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:27.696299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:27.963462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:27.974499 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c7124d77-2f4f-4e5c-a524-b6fe84465a89 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.316025 Oct 28 18:23:27.980632 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2632/4399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:27 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:28.000729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:28.001621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:28.015897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:28.016401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:28.023331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:28.032222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:28.033173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:28.036561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:28.615288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:28.647257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:28.656170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:28.660881 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4d1d32f-7051-40df-9a63-8d827901fc4c tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2952 microversion: 2.42 time: 0.678382 Oct 28 18:23:28.669895 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2633/4400] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:27 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2952 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:28.676278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:28.680290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:28.705372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:28.709738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:28.710787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:28.714568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:28.717218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:28.717749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:29.280270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:29.294144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:29.295911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:29.299770 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d1940b31-6a20-43da-bf03-d3361dff3312 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1753 microversion: 2.20 time: 0.628570 Oct 28 18:23:29.300882 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2634/4401] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:28 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1753 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:29.306462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:29.308074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:29.315681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:29.316290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:29.316754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:29.317484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:29.318231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:29.318814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:29.920226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:29.937910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-424a4343-6a05-432e-94c1-2fa5f1d41d04 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1673 microversion: 2.1 time: 0.631974 Oct 28 18:23:29.938756 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2635/4402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:29 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1673 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:29.955875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:29.964771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:29.985529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:29.990406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:29.990866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:29.994207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:29.995016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:29.996605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:30.598218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:30.610537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b7fe985c-21d8-4ed3-a33e-3949163db2a5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.665826 Oct 28 18:23:30.611138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2636/4403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:29 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:30.638943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:30.640485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:30.658966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:30.659632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:30.669703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:30.670827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:30.671551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:30.672231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:31.278153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:31.297647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:31.299202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:31.305375 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ab34efc-7eba-4588-9a5a-9826100220e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2952 microversion: 2.42 time: 0.693041 Oct 28 18:23:31.324736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2637/4404] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:30 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2952 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:31.342869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:31.343752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:31.352101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:31.352876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:31.353490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:31.354373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:31.355061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:31.355977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:31.753434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:31.765455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:31.767464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:31.769653 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f793e11-63ff-46c7-8f56-33cec08f1a0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1753 microversion: 2.20 time: 0.441814 Oct 28 18:23:31.773167 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2638/4405] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:31 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1753 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:31.796782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:31.797769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:31.806929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:31.807893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:31.808637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:31.809661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:31.810324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:31.811104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:31.957321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '970c770865b448839659d3884b8b42c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00004db1da4048c9aebe0ed35749d56f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:31.971159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe8091d3-e227-4200-adf7-10243ec993db tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 200 len: 1610 microversion: 2.1 time: 0.195691 Oct 28 18:23:31.974285 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2639/4406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:31 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 1610 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:31.987981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-53a15101-88a6-41e9-9cc7-978f84f5ceb5 req-1384a714-7fe6-42a9-8c2e-81e76e5e2d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3e11ab-9681-4e10-be51-21d7e418e467", "name": "network-vif-deleted", "tag": "14bd572e-9fcf-4faf-9d12-8ec5f595dccb"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:32.013394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53a15101-88a6-41e9-9cc7-978f84f5ceb5 req-1384a714-7fe6-42a9-8c2e-81e76e5e2d2a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:32.019095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53a15101-88a6-41e9-9cc7-978f84f5ceb5 req-1384a714-7fe6-42a9-8c2e-81e76e5e2d2a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:32.020097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-53a15101-88a6-41e9-9cc7-978f84f5ceb5 req-1384a714-7fe6-42a9-8c2e-81e76e5e2d2a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:32.085690 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-53a15101-88a6-41e9-9cc7-978f84f5ceb5 req-1384a714-7fe6-42a9-8c2e-81e76e5e2d2a service nova] Creating event network-vif-deleted:14bd572e-9fcf-4faf-9d12-8ec5f595dccb for instance aa3e11ab-9681-4e10-be51-21d7e418e467 on n-h1-862404-2 Oct 28 18:23:32.110826 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-53a15101-88a6-41e9-9cc7-978f84f5ceb5 req-1384a714-7fe6-42a9-8c2e-81e76e5e2d2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134653 Oct 28 18:23:32.112386 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2640/4407] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:32.122049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:32.122763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:32.147392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:32.148663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:32.148936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:32.149658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:32.150577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:32.150577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:32.620578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:32.633853 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7889cf30-002d-45f1-8a48-87b323b5844f tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.519998 Oct 28 18:23:32.641815 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2641/4408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:32 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:33.168367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Calling method '.version_select at 0x7f78dc9833a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:33.170598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:33.171100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:33.171551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:33.233038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:33.233550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:33.234003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:33.276959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:33.292214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:33.300177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:33.316109 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1651037e-ad09-4df2-b6b1-589c412d969b tempest-PortsAdminExtendedAttrsTestJSON-1359240687 tempest-PortsAdminExtendedAttrsTestJSON-1359240687-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.671039 Oct 28 18:23:33.317086 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2642/4409] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:23:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:33.331754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:33.345402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:33.353012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:33.355650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:33.356459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:33.364888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:33.365890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:33.367112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:33.920632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:33.955598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:33.960653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:33.967019 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf178751-d0f9-4835-95d4-01d0d85b874a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2931 microversion: 2.42 time: 0.639089 Oct 28 18:23:33.972396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2643/4410] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:33 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2931 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:33.988042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:33.988042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:34.011082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:34.011591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:34.012065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:34.012799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:34.013262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:34.013694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:35.008472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:35.025160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:35.027017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:35.028285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38aa8acd-edbc-4979-a042-26a98179734c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1753 microversion: 2.20 time: 1.054676 Oct 28 18:23:35.028869 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2644/4411] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:33 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1753 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:35.039855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:35.040474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:35.086981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:35.087454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:35.087952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:35.088674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:35.089147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:35.089556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:35.125008 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] HTTP exception thrown: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Request method failure captured: Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 HTTP/1.1 Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB23ScdEAYETrDWkKsRchLa2Yul_IBIMyXcuuv-rZKtpiIgUvM73wFZe3RNjVBSuf_PgdBLLKYg8HonlwYqhEwz6JTHaupktHK2KuPsKB2IbijAcXI7g3C_Fa-daVURhv6MPYe79yfVKFBjC-dm2urKnT2h0QUTl90lMw0MrN2fZFRM Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_00004db1da4048c9aebe0ed35749d56f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 970c770865b448839659d3884b8b42c6 Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'aa3e11ab-9681-4e10-be51-21d7e418e467'} Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:35.136144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:35.139883 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:35.139883 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:35.139883 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:35.139883 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:35.139883 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:35.139883 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:35.139883 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:35.143799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Returning 404 to user: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:35.144908 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2d7bfab-c56a-4a4d-8d35-b84a03a5c0f2 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 404 len: 111 microversion: 2.1 time: 0.115114 Oct 28 18:23:35.149702 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2645/4412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:35 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:23:35.162703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0cc129bb-cebf-4696-99e7-97c85b79a1df req-f8e0b05a-3291-4a3d-9ca1-d8f550c80668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-unplugged", "status": "completed", "tag": "98221312-7849-4682-b29b-3081bd5426a5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:35.185597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0cc129bb-cebf-4696-99e7-97c85b79a1df req-f8e0b05a-3291-4a3d-9ca1-d8f550c80668 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:35.192088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0cc129bb-cebf-4696-99e7-97c85b79a1df req-f8e0b05a-3291-4a3d-9ca1-d8f550c80668 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:35.192865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0cc129bb-cebf-4696-99e7-97c85b79a1df req-f8e0b05a-3291-4a3d-9ca1-d8f550c80668 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:35.214482 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0cc129bb-cebf-4696-99e7-97c85b79a1df req-f8e0b05a-3291-4a3d-9ca1-d8f550c80668 service nova] Creating event network-vif-unplugged:98221312-7849-4682-b29b-3081bd5426a5 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:35.237027 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0cc129bb-cebf-4696-99e7-97c85b79a1df req-f8e0b05a-3291-4a3d-9ca1-d8f550c80668 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085730 Oct 28 18:23:35.240664 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2646/4413] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:35.249760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:35.253699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:35.264577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:35.269686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:35.272078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:35.276156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:35.279120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:35.279799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:35.284648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:35.688610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:35.713861 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a29bc9f-d920-43f6-a85a-c8c77debc5ac tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.471677 Oct 28 18:23:35.714735 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2647/4414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:35 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:35.722990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-db8570d7-0fa5-4d8a-9f9c-8a8be827d357 req-4699ad5d-8da9-4404-8505-3b887b074d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3e11ab-9681-4e10-be51-21d7e418e467", "name": "network-vif-deleted", "tag": "186ed6b3-b91d-4576-8bf7-609dd652b2ca"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:35.744516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-db8570d7-0fa5-4d8a-9f9c-8a8be827d357 req-4699ad5d-8da9-4404-8505-3b887b074d69 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:35.746210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-db8570d7-0fa5-4d8a-9f9c-8a8be827d357 req-4699ad5d-8da9-4404-8505-3b887b074d69 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:35.746835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-db8570d7-0fa5-4d8a-9f9c-8a8be827d357 req-4699ad5d-8da9-4404-8505-3b887b074d69 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:35.779595 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-db8570d7-0fa5-4d8a-9f9c-8a8be827d357 req-4699ad5d-8da9-4404-8505-3b887b074d69 service nova] Creating event network-vif-deleted:186ed6b3-b91d-4576-8bf7-609dd652b2ca for instance aa3e11ab-9681-4e10-be51-21d7e418e467 on n-h1-862404-2 Oct 28 18:23:35.810304 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-db8570d7-0fa5-4d8a-9f9c-8a8be827d357 req-4699ad5d-8da9-4404-8505-3b887b074d69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091555 Oct 28 18:23:35.813452 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2648/4415] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:35.830217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:35.836353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:35.849821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:35.852297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:35.852913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:35.853815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:35.855432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:35.856387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:36.529192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:36.552252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:36.558088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:36.564214 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-94edea0d-1234-4a30-802d-5f731fe0f2bc tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2864 microversion: 2.42 time: 0.747823 Oct 28 18:23:36.582411 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2649/4416] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:35 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2864 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:36.593605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:36.594928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:36.603131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:36.604331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:36.606375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:36.607543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:36.608943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:36.610292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:37.115024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:37.127988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:37.129525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:37.130939 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a142f888-41b9-4cfb-98f0-ccbaef339709 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.547355 Oct 28 18:23:37.132454 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2650/4417] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:36 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:37.137311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:37.137919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:37.144035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:37.144524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:37.144960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:37.145648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:37.146341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:37.147260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:37.674542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:37.697858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f403d7f-de92-4710-a1ba-eb0a6877c438 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.563287 Oct 28 18:23:37.698867 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2651/4418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:37 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:37.715958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:37.716727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:37.759268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:37.761059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:37.762990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:37.767103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:37.769317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:37.769777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:37.823980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:23:37.989063 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe6807fa-9bdb-477c-8814-806f4c94a82c tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 204 len: 0 microversion: 2.1 time: 0.287344 Oct 28 18:23:37.990016 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2652/4419] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:23:37 2022] DELETE /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:23:38.001261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-unplugged", "status": "completed", "tag": "b3f16ee9-aa1b-4bfe-ab8f-58f3ae67670d"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-unplugged", "status": "completed", "tag": "6286b241-00fe-4b70-9042-5ad2ecad758c"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-unplugged", "status": "completed", "tag": "03e8b09a-848b-412a-8be4-c81f0cfb8232"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-unplugged", "status": "completed", "tag": "aba7f5c0-e589-4ffc-8505-f1d44a018e7d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:38.021610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:38.022166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:38.022857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:38.045399 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] Creating event network-vif-unplugged:b3f16ee9-aa1b-4bfe-ab8f-58f3ae67670d for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:38.046298 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] Creating event network-vif-unplugged:6286b241-00fe-4b70-9042-5ad2ecad758c for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:38.048082 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] Creating event network-vif-unplugged:03e8b09a-848b-412a-8be4-c81f0cfb8232 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:38.048616 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] Creating event network-vif-unplugged:aba7f5c0-e589-4ffc-8505-f1d44a018e7d for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:38.057288 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-25ae8a3e-4d21-4871-9df7-66d0dfcd4b6d req-b561a798-a976-496a-8bb0-c252f91f3bd0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.064830 Oct 28 18:23:38.068292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2653/4420] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:38.075809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:38.077365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:38.085655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:38.088928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:38.089729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:38.090741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:38.091393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:38.092110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:38.915972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:38.935290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:38.937022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:38.941310 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ab759a6-44e0-4223-ba6d-2dc6903ac2dd tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2818 microversion: 2.42 time: 0.871214 Oct 28 18:23:38.960842 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2654/4421] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:38 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2818 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:38.970221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:38.971318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:38.981791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:38.982919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:38.983631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:38.984672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:38.985938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:38.986804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:39.314255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:39.329066 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86e7e9b8-1a0b-4678-9ebb-9b97cb986e3b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1508 microversion: 2.1 time: 0.363119 Oct 28 18:23:39.336547 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2655/4422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:38 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:39.341817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-56742fe8-f04a-4b79-966e-8ba9eb7b9c18 req-de8a1b1f-fd38-4cb7-8796-1692e0ae575b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-deleted", "tag": "6286b241-00fe-4b70-9042-5ad2ecad758c"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-deleted", "tag": "b3f16ee9-aa1b-4bfe-ab8f-58f3ae67670d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:39.356790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-56742fe8-f04a-4b79-966e-8ba9eb7b9c18 req-de8a1b1f-fd38-4cb7-8796-1692e0ae575b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:39.357309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-56742fe8-f04a-4b79-966e-8ba9eb7b9c18 req-de8a1b1f-fd38-4cb7-8796-1692e0ae575b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:39.357714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-56742fe8-f04a-4b79-966e-8ba9eb7b9c18 req-de8a1b1f-fd38-4cb7-8796-1692e0ae575b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:39.378909 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-56742fe8-f04a-4b79-966e-8ba9eb7b9c18 req-de8a1b1f-fd38-4cb7-8796-1692e0ae575b service nova] Creating event network-vif-deleted:6286b241-00fe-4b70-9042-5ad2ecad758c for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:39.379416 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-56742fe8-f04a-4b79-966e-8ba9eb7b9c18 req-de8a1b1f-fd38-4cb7-8796-1692e0ae575b service nova] Creating event network-vif-deleted:b3f16ee9-aa1b-4bfe-ab8f-58f3ae67670d for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:39.393889 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-56742fe8-f04a-4b79-966e-8ba9eb7b9c18 req-de8a1b1f-fd38-4cb7-8796-1692e0ae575b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056008 Oct 28 18:23:39.397006 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2656/4423] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:39.404732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:39.405523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:39.414852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:39.416199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:39.418256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:39.420660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:39.421390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:39.422423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:39.869213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:39.878328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:39.879771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:39.881038 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4436fdb3-652e-4c43-b745-c935379d2aa2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.481475 Oct 28 18:23:39.882444 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2657/4424] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:39 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:39.887006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:39.887654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:39.894358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:39.894907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:39.895359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:39.896119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:39.896900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:39.897081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:40.522288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:40.531194 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e6048a8-55ff-414c-a1b3-0ca4c9485be8 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.647664 Oct 28 18:23:40.531806 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2658/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:39 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:40.545570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:40.546208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:40.549380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:40.557393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:40.558691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:40.559152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:40.559935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:40.560449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:40.561039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.021839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:41.036980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:41.040050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:41.041943 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e836f3d-bcf9-4ca1-abe7-c81fb002d7e1 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2500 microversion: 2.42 time: 0.499953 Oct 28 18:23:41.064220 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2659/4426] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:40 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2500 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:41.077445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:41.078590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:41.086077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.087149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.088023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.089002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.089718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.090939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.108929 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] HTTP exception thrown: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Request method failure captured: Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 HTTP/1.1 Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB23ScdEAYETrDWkKsRchLa2Yul_IBIMyXcuuv-rZKtpiIgUvM73wFZe3RNjVBSuf_PgdBLLKYg8HonlwYqhEwz6JTHaupktHK2KuPsKB2IbijAcXI7g3C_Fa-daVURhv6MPYe79yfVKFBjC-dm2urKnT2h0QUTl90lMw0MrN2fZFRM Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_00004db1da4048c9aebe0ed35749d56f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 970c770865b448839659d3884b8b42c6 Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'aa3e11ab-9681-4e10-be51-21d7e418e467'} Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:23:41.110821 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.115796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Returning 404 to user: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:41.118113 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8777876-c7ea-468c-a1cb-2b1629d307fb tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 404 len: 111 microversion: 2.1 time: 0.043785 Oct 28 18:23:41.118886 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2660/4427] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:23:41 2022] DELETE /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:23:41.125700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:41.126349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:41.134266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.135140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.135985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.137214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.138070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.138762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.393101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:41.408268 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-20282f1e-1cde-4d76-b893-4ab5986d2a7b tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1508 microversion: 2.1 time: 0.287957 Oct 28 18:23:41.421231 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2661/4428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:41 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:41.431730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:41.433022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:41.440670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.441485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.442109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.442814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.443449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.444159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.695064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:41.715260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:41.718136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:41.721381 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdf79862-fd49-4e4e-8279-c0b903b3585b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.298837 Oct 28 18:23:41.737725 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2662/4429] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:41 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:41.753415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:41.758582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: aa3e11ab-9681-4e10-be51-21d7e418e467] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:41.773113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.778544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.779242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.780272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.781402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.785206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.821491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] HTTP exception thrown: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Request method failure captured: Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 HTTP/1.1 Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB23ScdEAYETrDWkKsRchLa2Yul_IBIMyXcuuv-rZKtpiIgUvM73wFZe3RNjVBSuf_PgdBLLKYg8HonlwYqhEwz6JTHaupktHK2KuPsKB2IbijAcXI7g3C_Fa-daVURhv6MPYe79yfVKFBjC-dm2urKnT2h0QUTl90lMw0MrN2fZFRM Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_00004db1da4048c9aebe0ed35749d56f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 970c770865b448839659d3884b8b42c6 Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'aa3e11ab-9681-4e10-be51-21d7e418e467'} Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:41.830465 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.836075 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:41.836075 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:41.836075 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:41.836075 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:41.836075 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:41.836075 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. Oct 28 18:23:41.836075 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:41.838984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Returning 404 to user: Instance aa3e11ab-9681-4e10-be51-21d7e418e467 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:41.840108 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5517e006-a0a2-4cd9-9291-ff23842e1082 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467" status: 404 len: 111 microversion: 2.1 time: 0.093312 Oct 28 18:23:41.841338 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2663/4430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:41 2022] GET /compute/v2.1/servers/aa3e11ab-9681-4e10-be51-21d7e418e467 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:23:41.853298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:41.856579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:41.879143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.880069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.880746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:41.881709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:41.882737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:41.883378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:42.673997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:42.686854 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8b96b50c-496d-47a6-b0b9-8efb49f62099 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.844255 Oct 28 18:23:42.687472 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2664/4431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:41 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:42.700502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6f567089-addc-421b-81bc-fc15d61a6274 req-43fbddc3-b6ae-4f46-8d98-92c5e99e7441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-deleted", "tag": "aba7f5c0-e589-4ffc-8505-f1d44a018e7d"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-deleted", "tag": "03e8b09a-848b-412a-8be4-c81f0cfb8232"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:42.721897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6f567089-addc-421b-81bc-fc15d61a6274 req-43fbddc3-b6ae-4f46-8d98-92c5e99e7441 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:42.722305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6f567089-addc-421b-81bc-fc15d61a6274 req-43fbddc3-b6ae-4f46-8d98-92c5e99e7441 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:42.722742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6f567089-addc-421b-81bc-fc15d61a6274 req-43fbddc3-b6ae-4f46-8d98-92c5e99e7441 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:42.776763 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6f567089-addc-421b-81bc-fc15d61a6274 req-43fbddc3-b6ae-4f46-8d98-92c5e99e7441 service nova] Creating event network-vif-deleted:aba7f5c0-e589-4ffc-8505-f1d44a018e7d for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:42.778566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6f567089-addc-421b-81bc-fc15d61a6274 req-43fbddc3-b6ae-4f46-8d98-92c5e99e7441 service nova] Creating event network-vif-deleted:03e8b09a-848b-412a-8be4-c81f0cfb8232 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:42.792372 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6f567089-addc-421b-81bc-fc15d61a6274 req-43fbddc3-b6ae-4f46-8d98-92c5e99e7441 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103485 Oct 28 18:23:42.796166 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2665/4432] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:42.812878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:42.832428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:42.848205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:42.852506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:42.853145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:42.855614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:42.858747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:42.859413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:42.871041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:42.906745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] HTTP exception thrown: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Request method failure captured: Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 HTTP/1.1 Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB23ScdEAYETrDWkKsRchLa2Yul_IBIMyXcuuv-rZKtpiIgUvM73wFZe3RNjVBSuf_PgdBLLKYg8HonlwYqhEwz6JTHaupktHK2KuPsKB2IbijAcXI7g3C_Fa-daVURhv6MPYe79yfVKFBjC-dm2urKnT2h0QUTl90lMw0MrN2fZFRM Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_00004db1da4048c9aebe0ed35749d56f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 970c770865b448839659d3884b8b42c6 Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '502d93b0-c188-4ae7-9837-b7764ea49491'} Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:23:42.909021 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Returning 404 to user: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:42.914105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8f9ad111-360e-4edc-912b-ef5803c9b9d6 tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "DELETE /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 404 len: 111 microversion: 2.1 time: 0.115543 Oct 28 18:23:42.920891 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2666/4433] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:23:42 2022] DELETE /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:23:42.936891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:42.937574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:42.953839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:42.954357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:42.954802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:42.958081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:42.958562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:42.959002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:43.392662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:43.418372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:43.460438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:43.484541 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-787992c0-e143-42ca-9d9a-615c05e2d865 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 2162 microversion: 2.42 time: 0.556524 Oct 28 18:23:43.487718 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2667/4434] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:42 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 2162 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:43.503091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:43.507966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:43.526234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:43.527363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:43.529783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:43.531472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:43.533148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:43.535150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:43.617314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:43.619403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:43.620049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:43.624277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lazy-loading 'fault' on Instance uuid f416cc1a-709e-4417-84dc-7f62b7e1bf93 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:23:43.761046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:43.768946 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e0347a2-f544-4adf-a700-d4bb870326f5 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 200 len: 1312 microversion: 2.1 time: 0.279611 Oct 28 18:23:43.769541 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2668/4435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:43 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:43.781165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:43.784366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:43.798640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:43.799602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:43.800891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:43.801977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:43.803104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:43.804801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:44.254516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:44.265879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:44.274559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:44.287595 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ba9fbc1-fad7-4147-87ba-45f33eb204fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.512150 Oct 28 18:23:44.288626 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2669/4436] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:43 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:44.318412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:44.320447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] [instance: 502d93b0-c188-4ae7-9837-b7764ea49491] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:44.338176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:44.338943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:44.339549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:44.340444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:44.341054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:44.341638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:44.368538 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] HTTP exception thrown: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Request method failure captured: Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 HTTP/1.1 Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB23ScdEAYETrDWkKsRchLa2Yul_IBIMyXcuuv-rZKtpiIgUvM73wFZe3RNjVBSuf_PgdBLLKYg8HonlwYqhEwz6JTHaupktHK2KuPsKB2IbijAcXI7g3C_Fa-daVURhv6MPYe79yfVKFBjC-dm2urKnT2h0QUTl90lMw0MrN2fZFRM Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_00004db1da4048c9aebe0ed35749d56f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/00004db1da4048c9aebe0ed35749d56f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 00004db1da4048c9aebe0ed35749d56f Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestMultiNic-364769518 Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 970c770865b448839659d3884b8b42c6 Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestMultiNic-364769518-project Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '502d93b0-c188-4ae7-9837-b7764ea49491'} Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:44.373508 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:44.378210 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:44.378210 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:44.378210 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:44.378210 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:44.378210 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:44.378210 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. Oct 28 18:23:44.378210 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:44.388339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] Returning 404 to user: Instance 502d93b0-c188-4ae7-9837-b7764ea49491 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:44.389819 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd76bff9-613c-4b29-9ed2-03f50187c5ec tempest-ServersTestMultiNic-364769518 tempest-ServersTestMultiNic-364769518-project] 10.222.0.16 "GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491" status: 404 len: 111 microversion: 2.1 time: 0.083255 Oct 28 18:23:44.394350 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2670/4437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:44 2022] GET /compute/v2.1/servers/502d93b0-c188-4ae7-9837-b7764ea49491 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:23:44.400674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:44.401526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:44.414876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:44.418528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:44.420071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:44.421580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:44.425353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:44.425992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:44.969784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:44.986785 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f48e2113-fc02-47eb-8605-17f8de730912 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.591032 Oct 28 18:23:44.987863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2671/4438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:44 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:44.993135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:44.993782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:45.005854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:45.013374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:45.014174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:45.015496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:45.016464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:45.017181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:45.167303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:45.186512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:45.188277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:45.191417 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c89dab88-545a-4572-a01e-ff140c453e2b tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.202526 Oct 28 18:23:45.197178 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2672/4439] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:44 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:45.205569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:45.224843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f416cc1a-709e-4417-84dc-7f62b7e1bf93] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:45.245712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:45.247124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:45.247856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:45.248762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:45.249383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:45.249979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:45.282763 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 could not be found. Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 HTTP/1.1 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 could not be found. Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f416cc1a-709e-4417-84dc-7f62b7e1bf93'} Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 could not be found. Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 could not be found. Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:45.289848 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:45.294334 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:45.294334 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:45.294334 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:45.294334 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:45.294334 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:45.294334 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:45.294334 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 could not be found. Oct 28 18:23:45.294334 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:45.307621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 404 to user: Instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:45.310731 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a9d8437-c4d8-4775-9e7e-8f4e9e368cda tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93" status: 404 len: 111 microversion: 2.1 time: 0.112290 Oct 28 18:23:45.314535 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2673/4440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:45 2022] GET /compute/v2.1/servers/f416cc1a-709e-4417-84dc-7f62b7e1bf93 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:23:45.323609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-285ca984-48af-4968-b149-6bbabbde579e req-4d89dfb9-40f0-487c-ba36-ac328015e6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f416cc1a-709e-4417-84dc-7f62b7e1bf93", "name": "network-vif-deleted", "tag": "8c1b112f-5a38-4e3e-8929-423c0e421423"}, {"server_uuid": "bb1244b9-6d27-4ea2-a5d5-c21a580440f0", "name": "network-vif-deleted", "tag": "98221312-7849-4682-b29b-3081bd5426a5"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:45.345774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-285ca984-48af-4968-b149-6bbabbde579e req-4d89dfb9-40f0-487c-ba36-ac328015e6eb service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:45.348365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-285ca984-48af-4968-b149-6bbabbde579e req-4d89dfb9-40f0-487c-ba36-ac328015e6eb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:45.358937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-285ca984-48af-4968-b149-6bbabbde579e req-4d89dfb9-40f0-487c-ba36-ac328015e6eb service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:45.377843 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-285ca984-48af-4968-b149-6bbabbde579e req-4d89dfb9-40f0-487c-ba36-ac328015e6eb service nova] Creating event network-vif-deleted:8c1b112f-5a38-4e3e-8929-423c0e421423 for instance f416cc1a-709e-4417-84dc-7f62b7e1bf93 on n-h2-862404-2 Oct 28 18:23:45.385634 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-285ca984-48af-4968-b149-6bbabbde579e req-4d89dfb9-40f0-487c-ba36-ac328015e6eb service nova] Creating event network-vif-deleted:98221312-7849-4682-b29b-3081bd5426a5 for instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 on n-h1-862404-2 Oct 28 18:23:45.400960 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-285ca984-48af-4968-b149-6bbabbde579e req-4d89dfb9-40f0-487c-ba36-ac328015e6eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084903 Oct 28 18:23:45.401935 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2674/4441] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:45.417769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:45.418675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:45.438400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:45.439166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:45.440007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:45.443845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:45.444849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:45.445684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:46.414178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:46.441875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:46.447093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:46.448879 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38e8eb8b-2019-4069-ba81-6d4b94ab5c4e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 1.045693 Oct 28 18:23:46.451688 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2675/4442] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:45 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:46.461835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:46.464966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:46.478600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:46.479455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:46.482015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:46.484972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:46.485897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:46.488461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:46.550540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:23:46.708972 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a4d7622-a8fc-4063-bbd0-405bd40557cd tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 204 len: 0 microversion: 2.1 time: 0.255001 Oct 28 18:23:46.714094 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2676/4443] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:23:46 2022] DELETE /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:23:46.721779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:46.722680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:46.735139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:46.735909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:46.736554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:46.738056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:46.738561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:46.739000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:47.541315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:47.550140 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e90f18bc-8a65-451b-a81e-55a23fba06e9 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.834612 Oct 28 18:23:47.567746 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2677/4444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:46 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:47.574016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:47.574635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:47.583347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:47.583871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:47.584577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:47.586355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:47.587003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:47.587603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:47.737073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:47.751506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:47.753247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:47.754812 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e1b21709-afcf-4fdd-93e4-8a576719221a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.185565 Oct 28 18:23:47.756163 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2678/4445] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:47 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:47.764986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:47.765781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:47.774325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:47.775330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:47.775976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:47.776882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:47.777346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:47.777782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:48.261680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:48.277059 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80ad5d40-0dc5-4cd6-b27e-d6b4c285c3e9 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.518794 Oct 28 18:23:48.277724 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2679/4446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:47 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:48.282245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:48.292698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:48.299703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:48.300487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:48.301858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:48.305622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:48.306336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:48.306949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:48.774047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:48.801559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:48.804948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:48.808882 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0ab899f4-45d1-4a0d-999a-433876b230db tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.530242 Oct 28 18:23:48.810508 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2680/4447] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:48 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:48.815405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:48.816437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:48.834375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:48.836838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:48.838705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:48.840123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:48.841196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:48.841839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:49.932001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:49.943168 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82faab7d-136e-4b24-8b3a-9f2f9637c51b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 1.131353 Oct 28 18:23:49.949451 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2681/4448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:48 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:49.962502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:49.963418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:49.978543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:49.981863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:49.982476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:49.983379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:49.985093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:49.985690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:50.393555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:50.407668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:50.411681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:50.419280 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af41d58a-675f-42bb-b19d-f6ce7fe4f98e tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.465048 Oct 28 18:23:50.420582 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2682/4449] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:49 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:50.425459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:50.431070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:50.446605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:50.448394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:50.450155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:50.456248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:50.457063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:50.457710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:50.495549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:51.103193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7740749fbc24944ac581deab9701f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce634b9e301b4619a1f0ce89cfc1ed68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:51.118451 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f1efc61-65a8-4548-9382-8149833474d3 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 200 len: 1521 microversion: 2.1 time: 0.696490 Oct 28 18:23:51.119676 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2683/4450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:50 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 1521 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:51.134569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:51.135510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:51.149397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:51.151690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:51.152333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:51.157541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:51.158343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:51.158968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:52.761199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:52.780097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:52.786632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:52.787962 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d1ac4571-551f-4ae7-b860-ef4f8f710e10 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 1.667095 Oct 28 18:23:52.791013 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2684/4451] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:51 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:52.807768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:52.814925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:52.834425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:52.837838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:52.843300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:52.844635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:52.846270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:52.848409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:54.573299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:54.584255 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-386d2b71-0fa0-4e2a-8daa-6c00e2c9aca3 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 1.785374 Oct 28 18:23:54.586695 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2685/4452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:52 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:54.601284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:54.610497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:54.633954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:54.634540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:54.636053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:54.637147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:54.637627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:54.638075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:55.081680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:55.122272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:55.125362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:55.126949 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cb1048bb-0b7b-4ba7-8459-dc6511f87bab tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.538600 Oct 28 18:23:55.129086 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2686/4453] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:54 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:55.135618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:55.136486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] [instance: f57a499d-80c7-4ac5-88fb-07b9192dc6a0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:55.143662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:55.144457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:55.145225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:55.146186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:55.153088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:55.153850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:55.186622 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] HTTP exception thrown: Instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 could not be found. Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Request method failure captured: Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 HTTP/1.1 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzt6qrvRidzy7JhpU1lM03V4y2EKIFA_b6h5Edb7hconVvcFqRMsS9WN_bTuauzfuzs0ihQuXUz7oo9HW1rtHf6_K0LQseXF7XnwjU7BkHynXDs3hfEKM22Z4PBxxtXiWtj_bicC2lWvkCJSXNnyrp_ZDqZG2PI9GRLLqtC-a9JvAs Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ce634b9e301b4619a1f0ce89cfc1ed68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ce634b9e301b4619a1f0ce89cfc1ed68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ce634b9e301b4619a1f0ce89cfc1ed68 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599654408 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: b7740749fbc24944ac581deab9701f53 Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599654408-project Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 could not be found. Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f57a499d-80c7-4ac5-88fb-07b9192dc6a0'} Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 could not be found. Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 could not be found. Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:55.192137 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:23:55.199316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:55.199316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:23:55.199316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:23:55.199316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:23:55.199316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:23:55.199316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:23:55.199316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 could not be found. Oct 28 18:23:55.199316 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:23:55.207169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] Returning 404 to user: Instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:23:55.211702 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d116644-3d01-400f-87bd-7aa9a8ecbb57 tempest-ServerRescueNegativeTestJSON-1599654408 tempest-ServerRescueNegativeTestJSON-1599654408-project] 10.222.0.16 "GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0" status: 404 len: 111 microversion: 2.1 time: 0.079544 Oct 28 18:23:55.212564 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2687/4454] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:55 2022] GET /compute/v2.1/servers/f57a499d-80c7-4ac5-88fb-07b9192dc6a0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:23:55.230540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6fac06ac-b1d3-41c1-95cd-527c95305412 req-5483f359-46c3-4563-a061-6c172804120a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57a499d-80c7-4ac5-88fb-07b9192dc6a0", "name": "network-vif-deleted", "tag": "735b0cb3-4ed0-491d-8cfa-60779929f25a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:55.263848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6fac06ac-b1d3-41c1-95cd-527c95305412 req-5483f359-46c3-4563-a061-6c172804120a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:55.266138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6fac06ac-b1d3-41c1-95cd-527c95305412 req-5483f359-46c3-4563-a061-6c172804120a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:55.269201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6fac06ac-b1d3-41c1-95cd-527c95305412 req-5483f359-46c3-4563-a061-6c172804120a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:55.309060 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6fac06ac-b1d3-41c1-95cd-527c95305412 req-5483f359-46c3-4563-a061-6c172804120a service nova] Creating event network-vif-deleted:735b0cb3-4ed0-491d-8cfa-60779929f25a for instance f57a499d-80c7-4ac5-88fb-07b9192dc6a0 on n-h2-862404-2 Oct 28 18:23:55.327018 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6fac06ac-b1d3-41c1-95cd-527c95305412 req-5483f359-46c3-4563-a061-6c172804120a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108473 Oct 28 18:23:55.331775 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2688/4455] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:55.347721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:55.354117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:55.384983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:55.385806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:55.387665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:55.388657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:55.391337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:55.392024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:55.750374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:55.772789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:55.774270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:55.775692 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-048de70e-978d-4122-ac88-75f27e7287e2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.441111 Oct 28 18:23:55.776299 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2689/4456] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:55 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:55.804909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:55.810559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:55.825637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:55.826544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:55.827485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:55.828388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:55.839702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:55.840383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:56.163139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:56.176352 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5a3402d2-52eb-407f-bd60-43eff4bf0c0b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1486 microversion: 2.1 time: 0.377013 Oct 28 18:23:56.177247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2690/4457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:55 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1486 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:56.189731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:56.191053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:56.203455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:56.205567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:56.206039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:56.206780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:56.207252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:56.207704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:56.345751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:56.360118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:56.361960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:56.365463 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6aa4d56e-369e-4644-974a-33c94ecb2f43 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.187234 Oct 28 18:23:56.372434 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2691/4458] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:56 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:56.381345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:56.382267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:56.398922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:56.399645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:56.403752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:56.404818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:56.405491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:56.406116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:56.611783 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c23f665-9cd5-40d8-982d-75f6c0342a44 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "POST /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46/action" status: 202 len: 0 microversion: 2.1 time: 0.237443 Oct 28 18:23:56.615136 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2692/4459] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:23:56 2022] POST /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:23:56.626382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:56.629604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:56.643192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:56.644018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:56.644448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:56.645243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:56.645781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:56.646445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:57.751013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:57.761541 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2fa379d9-5129-4bee-87d4-d5b88d52cafb tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1494 microversion: 2.1 time: 1.141321 Oct 28 18:23:57.776459 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2693/4460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:56 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1494 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:57.781790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:57.782380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:57.799127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:57.799626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:57.800156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:57.800850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:57.801275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:57.801709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:58.490969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:58.501559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:58.503130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:58.504644 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ee6682f-8714-40ec-9e99-532988162ccd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.738504 Oct 28 18:23:58.520828 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2694/4461] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:57 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:58.537040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:58.537797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:58.545860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:58.546322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:58.546798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:58.547513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:58.548078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:58.548500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:58.647391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:58.663724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:58.665254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:58.667632 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5823a90-463c-420e-836d-056ed14d8ac5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.144233 Oct 28 18:23:58.673233 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2695/4462] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:58 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:23:58.795267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:58.796800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:58.806123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:58.806972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:58.807683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:58.808721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:58.809373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:58.810056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:59.445220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:59.456969 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-16f50494-f8e1-4b49-9116-8c82d23ff480 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1494 microversion: 2.1 time: 0.671128 Oct 28 18:23:59.473863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2696/4463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:58 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1494 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:59.533790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:59.534365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:23:59.545068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:59.545573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:59.546017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:59.546736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:59.547197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:59.547634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:00.247252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:00.267838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:00.270765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:00.275956 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af0b2a32-698f-4228-bd2e-346e9a2bacae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.745513 Oct 28 18:24:00.303737 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2697/4464] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:23:59 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:00.325456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:00.328636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:00.350235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:00.355250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:00.356047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:00.356981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:00.357625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:00.361086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:00.706896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:00.736828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:00.739083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:00.745318 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4aa727ce-34c5-40ba-afdf-db4af240ad49 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.434261 Oct 28 18:24:00.770160 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2698/4465] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:00 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:00.807608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:00.808386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:00.827098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:00.827985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:00.829671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:00.842734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:00.848717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:00.870256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:02.541765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:02.552864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a991d1ee-5e4f-485b-9ec7-e7d3c1b2b9f0 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1500 microversion: 2.1 time: 1.781423 Oct 28 18:24:02.554273 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2699/4466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:00 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1500 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:02.949149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a4a5eb7c-7292-4955-bb86-f3ade7ce2eee tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-142786198", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:02.953340 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a4a5eb7c-7292-4955-bb86-f3ade7ce2eee tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] HTTP exception thrown: min_count must be <= max_count Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a4a5eb7c-7292-4955-bb86-f3ade7ce2eee tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Request method failure captured: Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 183 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5AiV6pomf9C8wygxW43JKJEWaRRFvEN-CMFi8Mb6XM6bmCPh1jC-Ii_adAHN-3gJCfv4d7_n0PVP7rwLZEkwn28ZjP2D7OsBZh7dAZHljg-A8UPXxWgDd7coR8JzYx63ALKr53Y4UkEq-Dkm46FvejggK9mYYsu9mH_1SmypN8OM0 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97ec160d289945a183ccee3e3e6b4044", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7109434ae14046dea78e3fd2490166e9 Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-142786198", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: exception: min_count must be <= max_count Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-142786198', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 28 18:24:02.960626 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:02.973072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a4a5eb7c-7292-4955-bb86-f3ade7ce2eee tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Returning 400 to user: min_count must be <= max_count {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:02.978152 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a4a5eb7c-7292-4955-bb86-f3ade7ce2eee tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.419959 Oct 28 18:24:02.982770 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2700/4467] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:24:02 2022] POST /compute/v2.1/servers => generated 74 bytes in 428 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:24:03.012044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:03.015126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:03.056668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:03.057148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:03.057605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:03.064096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:03.066044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:03.070352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:03.122365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:03.708330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:03.724487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:03.726558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:03.733916 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f08dab94-7859-4e23-81be-c632590a8115 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.749221 Oct 28 18:24:03.744032 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2701/4468] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:02 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:03.756714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:03.756714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:03.770321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:03.777848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:03.778461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:03.779313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:03.779801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:03.783577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:03.970371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:03.984267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:03.986157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:03.987732 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-674985a7-bbdf-4855-8177-1bb9b274e2c5 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.251873 Oct 28 18:24:04.001060 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2702/4469] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:03 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:04.016725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:04.017536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:04.025758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:04.026573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:04.027207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:04.028289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:04.029081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:04.029670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:04.059409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:24:04.181349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:04.190760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5fe60711-2238-46ad-b928-e0c918ee92d7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "DELETE /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 204 len: 0 microversion: 2.1 time: 0.188039 Oct 28 18:24:04.191785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2703/4470] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:24:04 2022] DELETE /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:24:04.203208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8930b5e2-ce59-4d06-95fa-3d86f7e9b0e2 tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1780773351", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "max_count": 0}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8930b5e2-ce59-4d06-95fa-3d86f7e9b0e2 tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Request method failure captured: Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 168 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5AiV6pomf9C8wygxW43JKJEWaRRFvEN-CMFi8Mb6XM6bmCPh1jC-Ii_adAHN-3gJCfv4d7_n0PVP7rwLZEkwn28ZjP2D7OsBZh7dAZHljg-A8UPXxWgDd7coR8JzYx63ALKr53Y4UkEq-Dkm46FvejggK9mYYsu9mH_1SmypN8OM0 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97ec160d289945a183ccee3e3e6b4044", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7109434ae14046dea78e3fd2490166e9 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1780773351", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "max_count": 0}} Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1780773351', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'max_count': 0}}} Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 0 Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:24:04.208612 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 18:24:04.213527 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.223282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8930b5e2-ce59-4d06-95fa-3d86f7e9b0e2 tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:04.224301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8930b5e2-ce59-4d06-95fa-3d86f7e9b0e2 tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031164 Oct 28 18:24:04.226850 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2704/4471] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:24:04 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:24:04.238145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:04.239331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:04.249690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:04.250479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:04.251159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:04.252115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:04.252919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:04.253557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:04.619557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:04.635394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0bd5ae7-d768-4c4b-ae6b-ccf9c26bf2b5 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.407259 Oct 28 18:24:04.636446 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2705/4472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:04 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:04.646003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1aaf8d49-0315-4cd0-8cb0-3ddaaea6f95f tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-655876184", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "max_count": 2.5}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1aaf8d49-0315-4cd0-8cb0-3ddaaea6f95f tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Request method failure captured: Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 169 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5AiV6pomf9C8wygxW43JKJEWaRRFvEN-CMFi8Mb6XM6bmCPh1jC-Ii_adAHN-3gJCfv4d7_n0PVP7rwLZEkwn28ZjP2D7OsBZh7dAZHljg-A8UPXxWgDd7coR8JzYx63ALKr53Y4UkEq-Dkm46FvejggK9mYYsu9mH_1SmypN8OM0 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97ec160d289945a183ccee3e3e6b4044", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7109434ae14046dea78e3fd2490166e9 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-655876184", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "max_count": 2.5}} Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-655876184', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'max_count': 2.5}}} Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:24:04.660039 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.664949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1aaf8d49-0315-4cd0-8cb0-3ddaaea6f95f tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:04.666389 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1aaf8d49-0315-4cd0-8cb0-3ddaaea6f95f tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027059 Oct 28 18:24:04.669973 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2706/4473] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:24:04 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:24:04.758876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b480824-d639-4e54-9f93-c70990d6416d tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1776605349", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 0}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b480824-d639-4e54-9f93-c70990d6416d tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Request method failure captured: Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 168 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5AiV6pomf9C8wygxW43JKJEWaRRFvEN-CMFi8Mb6XM6bmCPh1jC-Ii_adAHN-3gJCfv4d7_n0PVP7rwLZEkwn28ZjP2D7OsBZh7dAZHljg-A8UPXxWgDd7coR8JzYx63ALKr53Y4UkEq-Dkm46FvejggK9mYYsu9mH_1SmypN8OM0 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97ec160d289945a183ccee3e3e6b4044", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7109434ae14046dea78e3fd2490166e9 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1776605349", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 0}} Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1776605349', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'min_count': 0}}} Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 0 Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:24:04.770785 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 18:24:04.775247 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:04.777749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b480824-d639-4e54-9f93-c70990d6416d tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:04.778853 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9b480824-d639-4e54-9f93-c70990d6416d tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025157 Oct 28 18:24:04.791662 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2707/4474] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:24:04 2022] POST /compute/v2.1/servers => generated 130 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:24:04.806314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:04.822818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:04.837319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:04.838229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:04.842873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:04.844863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:04.845596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:04.846368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:05.305790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:05.325816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:05.328278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:05.329839 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9307a47f-4f6e-4e93-b095-6f4edd2e3417 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.536813 Oct 28 18:24:05.333244 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2708/4475] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:04 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:05.350062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53963e09-08b3-4f43-b35d-d4d00302f961 tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-328757141", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 2.5}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53963e09-08b3-4f43-b35d-d4d00302f961 tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Request method failure captured: Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 169 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5AiV6pomf9C8wygxW43JKJEWaRRFvEN-CMFi8Mb6XM6bmCPh1jC-Ii_adAHN-3gJCfv4d7_n0PVP7rwLZEkwn28ZjP2D7OsBZh7dAZHljg-A8UPXxWgDd7coR8JzYx63ALKr53Y4UkEq-Dkm46FvejggK9mYYsu9mH_1SmypN8OM0 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_97ec160d289945a183ccee3e3e6b4044", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/97ec160d289945a183ccee3e3e6b4044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 97ec160d289945a183ccee3e3e6b4044 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1099185293 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 7109434ae14046dea78e3fd2490166e9 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1099185293-project Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-328757141", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "min_count": 2.5}} Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-328757141', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'min_count': 2.5}}} Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:24:05.366946 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 18:24:05.371150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:05.380824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53963e09-08b3-4f43-b35d-d4d00302f961 tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:05.383707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-53963e09-08b3-4f43-b35d-d4d00302f961 tempest-MultipleCreateNegativeTestJSON-1099185293 tempest-MultipleCreateNegativeTestJSON-1099185293-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.049085 Oct 28 18:24:05.384595 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2709/4476] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:24:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:24:05.393918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:05.396089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:05.425845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:05.426743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:05.427663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:05.429473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:05.430600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:05.431264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:05.593831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:05.612873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:05.614373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:05.615637 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5010bcce-ddfa-4e54-8357-e296af80ac36 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.229842 Oct 28 18:24:05.621635 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2710/4477] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:05 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:05.663494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:05.664627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:05.675607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:05.678486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:05.679186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:05.680342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:05.694548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:05.698845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:06.511502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:06.519407 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a1b28b64-4d11-4819-b020-5d58fc113f5c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.860069 Oct 28 18:24:06.526205 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2711/4478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:05 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:06.543977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:06.544860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:06.557752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:06.558259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:06.558702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:06.559427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:06.560055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:06.560488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:07.170241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:07.180046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:07.187597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:07.195866 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b488911-7d92-497c-8caa-d15eeba28fa4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.663284 Oct 28 18:24:07.215598 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2712/4479] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:06 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:07.228807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:07.240745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:07.248867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:07.252784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:07.253347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:07.254249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:07.261846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:07.262650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:07.371600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:07.390963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:07.393831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '611e91c42dbe4519874fb2330e1ce75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9feb5dd23bd49ad8f9552e045838aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:07.399116 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2267b9b6-8f23-4d3a-8314-6721b710e500 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 200 len: 1604 microversion: 2.42 time: 0.181876 Oct 28 18:24:07.400541 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2713/4480] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:07 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:07.555126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:07.555939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:07.568309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:07.570912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:07.571473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:07.573821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:07.574440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:07.575721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:08.504182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:08.536749 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-182d0b2b-821e-4ad2-a995-1074028a141c tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1506 microversion: 2.1 time: 0.985902 Oct 28 18:24:08.540284 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2714/4481] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:07 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1506 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:08.548348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:08.549923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:08.563088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:08.565202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:08.567085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:08.569779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:08.571024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:08.571778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:08.891046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:08.906663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:08.908152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:08.909355 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-546ea2ac-29a3-42b9-bb68-885ae9e49e14 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.366987 Oct 28 18:24:08.924306 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2715/4482] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:08 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:08.924306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:08.924306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:08.937196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:08.937700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:08.938137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:08.938857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:08.939314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:08.946428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:08.968758 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] HTTP exception thrown: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Request method failure captured: Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 HTTP/1.1 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzHf0y_OIEH10cCorzzSurUkdGGqrZuvRRRAaU37UBo_p2q7czG1mYcEJ3P1abjEPjf07EpmZ2AGMbipTXHSDA9RU2OQ1mclCeZK0FJ3f3kFPEteY3ap8yyJZdPsBN0mmc0gsDu-Q6MxdW9HFEdjLIB6pVGAeTirUNHetnLOsw-guk Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f9feb5dd23bd49ad8f9552e045838aa4 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9feb5dd23bd49ad8f9552e045838aa4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f9feb5dd23bd49ad8f9552e045838aa4 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TaggedBootDevicesTest_v242-14226436-project Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 611e91c42dbe4519874fb2330e1ce75f Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TaggedBootDevicesTest_v242-14226436-project Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'bb1244b9-6d27-4ea2-a5d5-c21a580440f0'} Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.971563 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:08.978479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.978479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:08.978479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:08.978479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:08.978479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:24:08.978479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:24:08.978479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:08.978479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.980607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Returning 404 to user: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:08.982408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a38d791-a6cc-453e-8db4-54cb307ca797 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 404 len: 111 microversion: 2.42 time: 0.067307 Oct 28 18:24:08.983577 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2716/4483] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:08 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:24:08.993311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4111e9e1-e946-49b2-b973-2fc72e0e093a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '.version_select at 0x7f78dc92f4c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:09.034311 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4111e9e1-e946-49b2-b973-2fc72e0e093a tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018615621" status: 204 len: 0 microversion: 2.42 time: 0.046470 Oct 28 18:24:09.035720 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2717/4484] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018615621 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:24:09.567483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:09.568262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:09.582198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:09.582519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:09.582969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:09.583708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:09.584205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:09.584675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:09.764758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:09.778721 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-703160a5-bdde-403f-b9d8-c2896d8110b7 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 200 len: 1464 microversion: 2.1 time: 0.215865 Oct 28 18:24:09.783015 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2718/4485] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:09 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 1464 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:10.242972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b8c10d30-7d80-4553-9dc7-45df2fb6a017 req-2350e6d5-4e06-4a95-b5d7-f55b271fdae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fe0daa-955e-40da-b95e-c00125d1f92a", "name": "network-vif-plugged", "status": "completed", "tag": "e8004f4a-7b2a-405e-b161-4d9d7552bdde"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:10.255036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b8c10d30-7d80-4553-9dc7-45df2fb6a017 req-2350e6d5-4e06-4a95-b5d7-f55b271fdae3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.255599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b8c10d30-7d80-4553-9dc7-45df2fb6a017 req-2350e6d5-4e06-4a95-b5d7-f55b271fdae3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.256077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b8c10d30-7d80-4553-9dc7-45df2fb6a017 req-2350e6d5-4e06-4a95-b5d7-f55b271fdae3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.273713 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b8c10d30-7d80-4553-9dc7-45df2fb6a017 req-2350e6d5-4e06-4a95-b5d7-f55b271fdae3 service nova] Creating event network-vif-plugged:e8004f4a-7b2a-405e-b161-4d9d7552bdde for instance 24fe0daa-955e-40da-b95e-c00125d1f92a on n-h2-862404-2 Oct 28 18:24:10.280445 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b8c10d30-7d80-4553-9dc7-45df2fb6a017 req-2350e6d5-4e06-4a95-b5d7-f55b271fdae3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.436061 Oct 28 18:24:10.281540 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2719/4486] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:24:10.288184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:10.289345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:10.296302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.296800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.297238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.297955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.299010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.299580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.922475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:10.936709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:10.938557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:10.940379 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-57ba3aff-9246-44ed-bf75-4e60b27ab067 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.657330 Oct 28 18:24:10.941175 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2720/4487] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:10 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:10.947248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-abd454ca-360d-4efd-aa75-45a2fc7cb370 req-35967b8b-2413-40f4-978a-cedc5473cc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331b89f8-e068-40b3-a7b4-4a7ac2464c46", "name": "network-vif-deleted", "tag": "4a84caf4-c98e-4277-a788-fced83ff6c3b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:10.957614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-abd454ca-360d-4efd-aa75-45a2fc7cb370 req-35967b8b-2413-40f4-978a-cedc5473cc7f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.958448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-abd454ca-360d-4efd-aa75-45a2fc7cb370 req-35967b8b-2413-40f4-978a-cedc5473cc7f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.959088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-abd454ca-360d-4efd-aa75-45a2fc7cb370 req-35967b8b-2413-40f4-978a-cedc5473cc7f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.977998 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-abd454ca-360d-4efd-aa75-45a2fc7cb370 req-35967b8b-2413-40f4-978a-cedc5473cc7f service nova] Creating event network-vif-deleted:4a84caf4-c98e-4277-a788-fced83ff6c3b for instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 on n-h2-862404-2 Oct 28 18:24:10.986294 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-abd454ca-360d-4efd-aa75-45a2fc7cb370 req-35967b8b-2413-40f4-978a-cedc5473cc7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041787 Oct 28 18:24:10.988159 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2721/4488] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:10.993606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:10.994311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: 331b89f8-e068-40b3-a7b4-4a7ac2464c46] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:11.000863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.002607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.002607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.002607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.002930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.003877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.018694 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] HTTP exception thrown: Instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 could not be found. Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Request method failure captured: Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 HTTP/1.1 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB3D0-MSSwvRkgwJa4b3s3xlwVuMSelQx6RmnJfIoj8AX_hjLDRgLJpufmpKQhy3WgDLvJGUHePINFPJwhy5MEFqtkFrNw8pIqfKRQ8lS6oEvsrmkhl75Jfm4wPBOplC3Fc7acNy020KK1n0PTu6X_4fm1PgfQ60PF6vpX39R9KpxDE Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e0c57f517556450286614a53b91a5464 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueTestJSON-602460104 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0c57f517556450286614a53b91a5464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0c57f517556450286614a53b91a5464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0c57f517556450286614a53b91a5464", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0c57f517556450286614a53b91a5464"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueTestJSON-602460104 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e0c57f517556450286614a53b91a5464 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueTestJSON-602460104 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueTestJSON-602460104-project Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aa6c205b1e564145ae55583d0c8fd6c1 Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueTestJSON-602460104-project Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 could not be found. Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '331b89f8-e068-40b3-a7b4-4a7ac2464c46'} Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 could not be found. Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 could not be found. Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:11.021043 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:11.026581 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:11.026581 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:11.026581 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:11.026581 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:24:11.026581 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:24:11.026581 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 could not be found. Oct 28 18:24:11.026581 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:11.027944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Returning 404 to user: Instance 331b89f8-e068-40b3-a7b4-4a7ac2464c46 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:11.028992 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b73c5565-301e-4ca9-a0ba-f7cab15c670d tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46" status: 404 len: 111 microversion: 2.1 time: 0.039798 Oct 28 18:24:11.029561 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2722/4489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:10 2022] GET /compute/v2.1/servers/331b89f8-e068-40b3-a7b4-4a7ac2464c46 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:24:11.038969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:11.043700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:11.050071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.050648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.051092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.051943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.052408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.052837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.093938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:24:11.109599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:11.229482 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cb412e2a-1eaf-427c-ad2a-fc0f9e561e91 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 204 len: 0 microversion: 2.1 time: 0.194167 Oct 28 18:24:11.235519 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2723/4490] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:24:11 2022] DELETE /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:24:11.246812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:11.248351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:11.258384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.258894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.259331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.260499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.261330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.261772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.599876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:11.609939 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84573744-03fc-45bc-9b91-93d4e1083b74 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1491 microversion: 2.1 time: 0.371672 Oct 28 18:24:11.611306 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2724/4491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:11 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1491 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:11.969994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:11.971515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:11.980406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.981989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.982661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.983659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.984778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.985639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:12.568134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:12.581718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:12.585784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:12.589204 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08e98917-a040-4326-ab42-5b2aaa502074 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1809 microversion: 2.20 time: 0.624588 Oct 28 18:24:12.592566 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2725/4492] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:11 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1809 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:12.638141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:12.638959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:12.650923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:12.650923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:12.650923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:12.651287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:12.651694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:12.656233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:14.159993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:14.169667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-53546d19-6c64-41fd-94b4-9f3f95c2a484 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1491 microversion: 2.1 time: 1.535557 Oct 28 18:24:14.170387 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2726/4493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:12 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1491 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:14.176594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:14.177600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:14.192147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:14.193269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:14.194809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:14.195954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:14.196889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:14.197416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:14.596410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:14.613859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:14.618419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:14.622711 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2e1f0d7-16fc-4ae3-b70c-20d15dd2cade tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1796 microversion: 2.20 time: 0.450213 Oct 28 18:24:14.625962 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2727/4494] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:14 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1796 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:24:14.634028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41c47e93-0085-44ab-a73f-ae65cfb89799 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc8da8b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:14.702761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41c47e93-0085-44ab-a73f-ae65cfb89799 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/aceb9772-66a1-4891-b03a-bd0a1920ef46" status: 200 len: 350 microversion: 2.1 time: 0.074724 Oct 28 18:24:14.703339 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2728/4495] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:24:14 2022] GET /compute/v2.1/os-volumes/aceb9772-66a1-4891-b03a-bd0a1920ef46 => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:15.195642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:15.196403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:15.205578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:15.206089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:15.206633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:15.207252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:15.207721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:15.208221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:15.545626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:15.559533 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b9e27f16-f08c-4cb0-8240-da78817f23aa tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1491 microversion: 2.1 time: 0.368584 Oct 28 18:24:15.573173 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2729/4496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:15 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1491 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:16.588732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:16.589466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:16.603190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:16.603651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:16.607963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:16.610474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:16.611151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:16.614161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:16.827131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6c205b1e564145ae55583d0c8fd6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0c57f517556450286614a53b91a5464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:16.837850 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-871cf207-add9-42c0-82be-7de1dddfa05b tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 200 len: 1449 microversion: 2.1 time: 0.254297 Oct 28 18:24:16.839201 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2730/4497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:16 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 1449 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:17.293343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-479efaf9-a59f-4a18-86ec-8a2d2ad0e068 req-bfa69cb9-5632-49c1-802f-f597a74c8aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8e7a44-2654-444b-8a69-a43ecf5ba74f", "name": "network-vif-deleted", "tag": "9cf42436-23da-4681-b7dd-0f0e0fe5670e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:17.308287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-479efaf9-a59f-4a18-86ec-8a2d2ad0e068 req-bfa69cb9-5632-49c1-802f-f597a74c8aea service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:17.309013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-479efaf9-a59f-4a18-86ec-8a2d2ad0e068 req-bfa69cb9-5632-49c1-802f-f597a74c8aea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:17.310143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-479efaf9-a59f-4a18-86ec-8a2d2ad0e068 req-bfa69cb9-5632-49c1-802f-f597a74c8aea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:17.326597 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-479efaf9-a59f-4a18-86ec-8a2d2ad0e068 req-bfa69cb9-5632-49c1-802f-f597a74c8aea service nova] Creating event network-vif-deleted:9cf42436-23da-4681-b7dd-0f0e0fe5670e for instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f on n-h1-862404-2 Oct 28 18:24:17.337076 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-479efaf9-a59f-4a18-86ec-8a2d2ad0e068 req-bfa69cb9-5632-49c1-802f-f597a74c8aea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324136 Oct 28 18:24:17.338339 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2731/4498] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:17.512677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6424abb0-88bb-461f-ba31-ffc4abd58255 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc93d8b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:17.611989 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6424abb0-88bb-461f-ba31-ffc4abd58255 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/683a0a92-cca9-4a74-a235-01d1b2a47d4a" status: 200 len: 351 microversion: 2.1 time: 0.104078 Oct 28 18:24:17.612590 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2732/4499] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:24:17 2022] GET /compute/v2.1/os-volumes/683a0a92-cca9-4a74-a235-01d1b2a47d4a => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:24:17.869016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:17.870117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] [instance: ce8e7a44-2654-444b-8a69-a43ecf5ba74f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:17.881325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:17.889844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:17.890840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:17.891795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:17.892455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:17.893208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:17.922793 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] HTTP exception thrown: Instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f could not be found. Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Request method failure captured: Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f HTTP/1.1 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB3D0-MSSwvRkgwJa4b3s3xlwVuMSelQx6RmnJfIoj8AX_hjLDRgLJpufmpKQhy3WgDLvJGUHePINFPJwhy5MEFqtkFrNw8pIqfKRQ8lS6oEvsrmkhl75Jfm4wPBOplC3Fc7acNy020KK1n0PTu6X_4fm1PgfQ60PF6vpX39R9KpxDE Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e0c57f517556450286614a53b91a5464 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueTestJSON-602460104 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0c57f517556450286614a53b91a5464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0c57f517556450286614a53b91a5464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0c57f517556450286614a53b91a5464", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0c57f517556450286614a53b91a5464"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueTestJSON-602460104 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e0c57f517556450286614a53b91a5464 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueTestJSON-602460104 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerRescueTestJSON-602460104-project Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aa6c205b1e564145ae55583d0c8fd6c1 Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueTestJSON-602460104-project Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f could not be found. Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'ce8e7a44-2654-444b-8a69-a43ecf5ba74f'} Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f could not be found. Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f could not be found. Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:17.937713 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f could not be found. Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] Returning 404 to user: Instance ce8e7a44-2654-444b-8a69-a43ecf5ba74f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-083ea72e-47d7-490c-8534-10c10e515333 tempest-ServerRescueTestJSON-602460104 tempest-ServerRescueTestJSON-602460104-project] 10.222.0.16 "GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f" status: 404 len: 111 microversion: 2.1 time: 0.069759 Oct 28 18:24:17.952091 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2733/4500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:17 2022] GET /compute/v2.1/servers/ce8e7a44-2654-444b-8a69-a43ecf5ba74f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:24:19.611591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:19.612380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:19.624851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:19.625939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:19.626919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:19.628755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:19.629802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:19.631241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:19.648488 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] HTTP exception thrown: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Request method failure captured: Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 HTTP/1.1 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzHf0y_OIEH10cCorzzSurUkdGGqrZuvRRRAaU37UBo_p2q7czG1mYcEJ3P1abjEPjf07EpmZ2AGMbipTXHSDA9RU2OQ1mclCeZK0FJ3f3kFPEteY3ap8yyJZdPsBN0mmc0gsDu-Q6MxdW9HFEdjLIB6pVGAeTirUNHetnLOsw-guk Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f9feb5dd23bd49ad8f9552e045838aa4 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9feb5dd23bd49ad8f9552e045838aa4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f9feb5dd23bd49ad8f9552e045838aa4 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TaggedBootDevicesTest_v242-14226436-project Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 611e91c42dbe4519874fb2330e1ce75f Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TaggedBootDevicesTest_v242-14226436-project Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'bb1244b9-6d27-4ea2-a5d5-c21a580440f0'} Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:24:19.651661 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.656191 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.659850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Returning 404 to user: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:19.670075 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4de024db-0780-48f3-b28c-a72defdf41f4 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 404 len: 111 microversion: 2.42 time: 0.064029 Oct 28 18:24:19.671456 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2734/4501] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:24:19 2022] DELETE /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:24:19.685833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:19.705075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] [instance: bb1244b9-6d27-4ea2-a5d5-c21a580440f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:19.721412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:19.722383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:19.726642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:19.727763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:19.728495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:19.729156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:19.755029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] HTTP exception thrown: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Request method failure captured: Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 HTTP/1.1 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXBzHf0y_OIEH10cCorzzSurUkdGGqrZuvRRRAaU37UBo_p2q7czG1mYcEJ3P1abjEPjf07EpmZ2AGMbipTXHSDA9RU2OQ1mclCeZK0FJ3f3kFPEteY3ap8yyJZdPsBN0mmc0gsDu-Q6MxdW9HFEdjLIB6pVGAeTirUNHetnLOsw-guk Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f9feb5dd23bd49ad8f9552e045838aa4 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f9feb5dd23bd49ad8f9552e045838aa4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f9feb5dd23bd49ad8f9552e045838aa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f9feb5dd23bd49ad8f9552e045838aa4 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-14226436 Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TaggedBootDevicesTest_v242-14226436-project Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 611e91c42dbe4519874fb2330e1ce75f Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TaggedBootDevicesTest_v242-14226436-project Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'bb1244b9-6d27-4ea2-a5d5-c21a580440f0'} Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.764519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:19.769559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.769559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:19.769559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:19.769559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:19.769559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:24:19.769559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:24:19.769559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. Oct 28 18:24:19.769559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:24:19.771166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] Returning 404 to user: Instance bb1244b9-6d27-4ea2-a5d5-c21a580440f0 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:19.773190 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fce0c361-83c7-4c89-926e-7b8ee30768a0 tempest-TaggedBootDevicesTest_v242-14226436 tempest-TaggedBootDevicesTest_v242-14226436-project] 10.222.0.16 "GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0" status: 404 len: 111 microversion: 2.42 time: 0.096318 Oct 28 18:24:19.775867 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2735/4502] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:19 2022] GET /compute/v2.1/servers/bb1244b9-6d27-4ea2-a5d5-c21a580440f0 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:24:20.466935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07e5a783-f773-435e-a381-d573f9f5ca40 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc953280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:20.530616 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07e5a783-f773-435e-a381-d573f9f5ca40 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e5fa2f89-68c0-4a34-b0f4-221c89c3a529" status: 200 len: 351 microversion: 2.1 time: 0.067553 Oct 28 18:24:20.531375 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2736/4503] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 18:24:20 2022] GET /compute/v2.1/os-volumes/e5fa2f89-68c0-4a34-b0f4-221c89c3a529 => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:24:20.546969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-401adeb9-3de1-4513-b706-e0262a5896a7 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc93d8b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:20.667560 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-401adeb9-3de1-4513-b706-e0262a5896a7 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.124718 Oct 28 18:24:20.669803 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2737/4504] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 18:24:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:20.686815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-266e409f-9edd-4e1f-b3f4-15a7dbfe417b tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc969f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:20.825942 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-266e409f-9edd-4e1f-b3f4-15a7dbfe417b tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.143524 Oct 28 18:24:20.826626 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2738/4505] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 18:24:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:20.850555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5cc746f-c85c-4f52-a8bd-941b560d93ef tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc92f670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:21.010979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5cc746f-c85c-4f52-a8bd-941b560d93ef tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.169670 Oct 28 18:24:21.020972 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2739/4506] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 18:24:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:21.026100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5b2c0345-9fa6-46d4-8cea-f22135917ddf tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dca5de50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:21.195691 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5b2c0345-9fa6-46d4-8cea-f22135917ddf tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.173190 Oct 28 18:24:21.207410 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2740/4507] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 18:24:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:21.216253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67efcdf2-1809-4ba8-864f-e4450c0fd037 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc92f8b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:21.349092 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67efcdf2-1809-4ba8-864f-e4450c0fd037 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.139465 Oct 28 18:24:21.350230 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2741/4508] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 18:24:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:21.364765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1086051d-9db7-496e-8324-8d551747d6d4 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc969ca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:21.533745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1086051d-9db7-496e-8324-8d551747d6d4 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.172747 Oct 28 18:24:21.534645 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2742/4509] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:24:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:21.549302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a84725f-efc9-4120-90f4-5da3f8ede5ef tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dc9ffb80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:21.762604 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a84725f-efc9-4120-90f4-5da3f8ede5ef tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.217588 Oct 28 18:24:21.763478 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2743/4510] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Oct 28 18:24:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:21.777639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-effad831-0359-49f6-8d1b-762690d30a63 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] Calling method '.version_select at 0x7f78dca5ddc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:21.941307 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-effad831-0359-49f6-8d1b-762690d30a63 tempest-VolumesTestJSON-260256295 tempest-VolumesTestJSON-260256295-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.167295 Oct 28 18:24:21.942341 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2744/4511] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:24:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:25.608548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9df52bd-6b4a-44ca-9c9e-9fcbbadcdb09 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Action: 'create', calling method: .version_select at 0x7f78dc92f040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1048828818", "policies": ["affinity"]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:25.668532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b9df52bd-6b4a-44ca-9c9e-9fcbbadcdb09 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:25.683680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b9df52bd-6b4a-44ca-9c9e-9fcbbadcdb09 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:25.819074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b9df52bd-6b4a-44ca-9c9e-9fcbbadcdb09 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:25.853120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-b9df52bd-6b4a-44ca-9c9e-9fcbbadcdb09 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:25.917334 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b9df52bd-6b4a-44ca-9c9e-9fcbbadcdb09 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.498340 Oct 28 18:24:25.918547 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2745/4512] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 18:24:25 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:24:25.938345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45f54f30-e191-4103-b489-b6bbb35e2449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Action: 'create', calling method: .version_select at 0x7f78dc8aa0d0>, body: {"server_group": {"name": "tempest-server-group-979068474", "policies": ["affinity"]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:25.994649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-45f54f30-e191-4103-b489-b6bbb35e2449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:26.006527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-45f54f30-e191-4103-b489-b6bbb35e2449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:26.078726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:26.132911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-45f54f30-e191-4103-b489-b6bbb35e2449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:26.146303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-45f54f30-e191-4103-b489-b6bbb35e2449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:26.183095 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45f54f30-e191-4103-b489-b6bbb35e2449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.252731 Oct 28 18:24:26.185348 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2746/4513] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 18:24:25 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:26.199711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-85f15b84-3286-4493-b23c-1d6d0bb3637c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Action: 'create', calling method: .version_select at 0x7f78dc9d0790>, body: {"server_group": {"name": "tempest-server-group-979068474", "policies": ["affinity"]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:26.259341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-85f15b84-3286-4493-b23c-1d6d0bb3637c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:26.278291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-85f15b84-3286-4493-b23c-1d6d0bb3637c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:26.407464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-85f15b84-3286-4493-b23c-1d6d0bb3637c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:26.435091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-85f15b84-3286-4493-b23c-1d6d0bb3637c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:26.477766 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-85f15b84-3286-4493-b23c-1d6d0bb3637c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.281813 Oct 28 18:24:26.481440 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2747/4514] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 18:24:26 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:24:26.498546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ab25e06-0fe0-4505-a084-be4bee415304 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:26.562446 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ab25e06-0fe0-4505-a084-be4bee415304 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/8082ba40-7b63-4aaa-8804-ca4a8213e934" status: 204 len: 0 microversion: 2.1 time: 0.074469 Oct 28 18:24:26.565956 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2748/4515] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:24:26 2022] DELETE /compute/v2.1/os-server-groups/8082ba40-7b63-4aaa-8804-ca4a8213e934 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:24:26.583632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8eafbc8c-7302-44e4-9444-98388350e950 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:26.648368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8eafbc8c-7302-44e4-9444-98388350e950 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.077026 Oct 28 18:24:26.649454 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2749/4516] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:24:26 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:26.665080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dbdb4667-8f57-4da4-95c9-b0218829733a tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:26.749919 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dbdb4667-8f57-4da4-95c9-b0218829733a tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/5ef86c12-a688-47e3-827a-0e8a20d02508" status: 204 len: 0 microversion: 2.1 time: 0.087841 Oct 28 18:24:26.752948 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2750/4517] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:24:26 2022] DELETE /compute/v2.1/os-server-groups/5ef86c12-a688-47e3-827a-0e8a20d02508 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:24:26.799656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2dc23969-723a-4c55-bf96-06438bf0ad56 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:26.864235 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2dc23969-723a-4c55-bf96-06438bf0ad56 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.106419 Oct 28 18:24:26.879049 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2751/4518] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:24:26 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:26.911142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0a3e3b1-4863-40e3-a459-25a467ec635b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Action: 'create', calling method: .version_select at 0x7f78dca5d8b0>, body: {"server_group": {"name": "tempest-server-group-346306986", "policies": ["affinity"]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:27.035173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d0a3e3b1-4863-40e3-a459-25a467ec635b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:27.057677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d0a3e3b1-4863-40e3-a459-25a467ec635b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:27.248994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d0a3e3b1-4863-40e3-a459-25a467ec635b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:27.275444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d0a3e3b1-4863-40e3-a459-25a467ec635b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:27.315640 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d0a3e3b1-4863-40e3-a459-25a467ec635b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.427840 Oct 28 18:24:27.333058 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2752/4519] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 18:24:26 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:27.348396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52dd4868-4545-4472-8867-9177d677dc91 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:27.446994 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52dd4868-4545-4472-8867-9177d677dc91 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/dbc4f452-5366-4149-890e-794953f520e2" status: 204 len: 0 microversion: 2.1 time: 0.105063 Oct 28 18:24:27.453874 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2753/4520] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:24:27 2022] DELETE /compute/v2.1/os-server-groups/dbc4f452-5366-4149-890e-794953f520e2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:24:27.476777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f16285be-3cb6-49a8-9490-6119bceb5339 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:27.536892 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f16285be-3cb6-49a8-9490-6119bceb5339 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.077751 Oct 28 18:24:27.541659 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2754/4521] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:24:27 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:27.554309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73061a78-9cc6-4ffd-bfe2-ae1fd9341948 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Action: 'create', calling method: .version_select at 0x7f78dc8dab80>, body: {"server_group": {"name": "tempest-server-group-1416757471", "policies": ["anti-affinity"]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:27.574835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:27.639363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-73061a78-9cc6-4ffd-bfe2-ae1fd9341948 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:27.663074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-73061a78-9cc6-4ffd-bfe2-ae1fd9341948 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:27.810035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-73061a78-9cc6-4ffd-bfe2-ae1fd9341948 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:27.831290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-73061a78-9cc6-4ffd-bfe2-ae1fd9341948 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_groups'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:27.872979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73061a78-9cc6-4ffd-bfe2-ae1fd9341948 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.326133 Oct 28 18:24:27.891677 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2755/4522] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 18:24:27 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:27.913547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c0806b4-65e4-479a-b6f0-983c732825dc tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:28.020396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c0806b4-65e4-479a-b6f0-983c732825dc tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/259ce875-88ec-4430-b489-b5eee1674dbb" status: 204 len: 0 microversion: 2.1 time: 0.127403 Oct 28 18:24:28.025362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2756/4523] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:24:27 2022] DELETE /compute/v2.1/os-server-groups/259ce875-88ec-4430-b489-b5eee1674dbb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:24:28.031884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1d5f3474-d16f-4c8b-8629-022ee220b29b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:28.094241 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1d5f3474-d16f-4c8b-8629-022ee220b29b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.066766 Oct 28 18:24:28.101290 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2757/4524] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:24:28 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:28.182835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2061828874", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "b3e61c4a-de74-4a8a-beb5-037b08357db0"}]}, "os:scheduler_hints": {"group": "d588acd3-df28-4e1a-8fbc-bb8987ac2801"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:28.325017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] validate_networks() for [('b3e61c4a-de74-4a8a-beb5-037b08357db0', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:24:29.736453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:33.163577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:24:33.164102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:24:33.164590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:24:33.165007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:24:33.165699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:24:33.195728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:33.203163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:33.203996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:33.205208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:33.207088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:33.207852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:33.257907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:33.270814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:33.307184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:24:33.312468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:24:33.419737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120680) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 18:24:33.460710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_group_members'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:33.475427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_group_members'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:33.578989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_group_members'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:33.594441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Getting quotas for user c711a51a30a64cee9126ff687a24f22d and project cad959b0d91b4144bc3a850dcc573288. Resources: {'server_group_members'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:33.663250 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c717ad8-5e46-4999-b575-1f0ab673851d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.481235 Oct 28 18:24:33.664481 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2758/4525] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:24:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:24:33.675695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7210c55d-8c49-41b9-a934-4cfe86ff4449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:33.676572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7210c55d-8c49-41b9-a934-4cfe86ff4449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:34.009128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7210c55d-8c49-41b9-a934-4cfe86ff4449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:34.025994 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7210c55d-8c49-41b9-a934-4cfe86ff4449 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1213 microversion: 2.1 time: 0.354409 Oct 28 18:24:34.030376 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2759/4526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:33 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1213 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:35.056311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d7cd2bc-3ab5-414e-89dd-3f64c5aab1a6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:35.057918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d7cd2bc-3ab5-414e-89dd-3f64c5aab1a6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:35.266567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d7cd2bc-3ab5-414e-89dd-3f64c5aab1a6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:35.278264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d7cd2bc-3ab5-414e-89dd-3f64c5aab1a6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1213 microversion: 2.1 time: 0.225236 Oct 28 18:24:35.281852 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2760/4527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:35 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:36.308771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:36.310308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:36.349085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:36.352739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:36.353806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:36.357675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:36.358880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:36.361723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:36.676661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:36.709557 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a419fe0-bb7d-4383-aeea-a1006e9b32f9 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1273 microversion: 2.1 time: 0.404435 Oct 28 18:24:36.725132 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2761/4528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:36 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1273 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:37.760563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:37.761835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:37.791387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:37.796814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:37.798419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:37.806157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:37.815119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:37.822208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:38.384715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:38.397033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3390ebcc-4fd4-489a-8d4d-593865b9100b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1271 microversion: 2.1 time: 0.649976 Oct 28 18:24:38.403768 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2762/4529] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:37 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1271 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:39.432201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:39.432849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:39.443575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:39.444213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:39.444668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:39.445407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:39.454452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:39.455139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:39.645842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:39.654493 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75d69a92-04e2-41c1-adc7-5eea5208bed0 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1271 microversion: 2.1 time: 0.229634 Oct 28 18:24:39.655923 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2763/4530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:39 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:40.684403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:40.686830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:40.706792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:40.713617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:40.714427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:40.715320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:40.716433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:40.721391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:41.079079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:41.090883 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9bad543b-3870-43b5-b661-60c87d2d8e7d tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 0.415772 Oct 28 18:24:41.095645 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2764/4531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:40 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:42.126431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:42.130263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:42.169046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:42.169742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:42.170295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:42.172985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:42.173816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:42.180151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:42.540803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:42.572323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d00e19a7-cbcf-424d-a458-f1b9fb7fa1f1 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 0.453274 Oct 28 18:24:42.576920 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2765/4532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:42 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:43.603485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:43.604651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:43.607607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:43.624406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:43.627141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:43.629230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:43.630110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:43.635913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:43.636398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:44.282316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:44.295771 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-acb9484c-1810-4ee5-b88f-2f52820b8ba2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 0.696856 Oct 28 18:24:44.296848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2766/4533] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:43 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:44.304892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c6424170-c0d6-417c-a8fe-c43fa5afce5a req-f071d3ba-6d40-49a6-9c0b-482e517177d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5972edbf-e906-4d4e-8d71-5f450280bb7e", "tag": "2dcdee03-6fdc-4864-afc1-09aa5e607a20"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:44.330963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:44.336293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c6424170-c0d6-417c-a8fe-c43fa5afce5a req-f071d3ba-6d40-49a6-9c0b-482e517177d1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:44.337068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c6424170-c0d6-417c-a8fe-c43fa5afce5a req-f071d3ba-6d40-49a6-9c0b-482e517177d1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:44.339496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c6424170-c0d6-417c-a8fe-c43fa5afce5a req-f071d3ba-6d40-49a6-9c0b-482e517177d1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:44.370808 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c6424170-c0d6-417c-a8fe-c43fa5afce5a req-f071d3ba-6d40-49a6-9c0b-482e517177d1 service nova] Creating event network-changed:2dcdee03-6fdc-4864-afc1-09aa5e607a20 for instance 5972edbf-e906-4d4e-8d71-5f450280bb7e on n-h1-862404-2 Oct 28 18:24:44.392554 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c6424170-c0d6-417c-a8fe-c43fa5afce5a req-f071d3ba-6d40-49a6-9c0b-482e517177d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089170 Oct 28 18:24:44.393736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2767/4534] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:45.322517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:45.324170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:45.342584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=58 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:45.353688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:45.358221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:45.360456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:45.362051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:45.362710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:45.363345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:46.046012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:46.066119 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-969d57fd-f680-46dc-adbc-78f5e16e644f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 0.750062 Oct 28 18:24:46.067353 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2768/4535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:45 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:47.092437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:47.093790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:47.106927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:47.114018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:47.114657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:47.120897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:47.121628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:47.122238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:47.544867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:47.554667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08f38328-4425-4205-a406-6faff51f4c10 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 0.466027 Oct 28 18:24:47.564769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2769/4536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:47 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:47.966732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:47.967251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:47.981205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:47.982018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:47.982644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:47.983581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:47.984287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:47.984721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:48.028394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69565652-d9a0-4647-a57a-6ff0efabcce8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments/a53df83e-5f91-4af1-afba-be75e8a231a9" status: 200 len: 194 microversion: 2.20 time: 0.068402 Oct 28 18:24:48.036715 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2770/4537] 10.222.0.16 () {60 vars in 1454 bytes} [Fri Oct 28 18:24:47 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments/a53df83e-5f91-4af1-afba-be75e8a231a9 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:24:48.123732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:48.125390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:48.135408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:48.136450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:48.137126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:48.137857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:48.138372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:48.138812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:48.276413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lazy-loading 'services' on Instance uuid 24fe0daa-955e-40da-b95e-c00125d1f92a {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:24:48.423024 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7cac50da-0307-4815-827b-b6c5548cec6a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments/a53df83e-5f91-4af1-afba-be75e8a231a9" status: 202 len: 0 microversion: 2.20 time: 0.303468 Oct 28 18:24:48.424617 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2771/4538] 10.222.0.16 () {60 vars in 1457 bytes} [Fri Oct 28 18:24:48 2022] DELETE /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments/a53df83e-5f91-4af1-afba-be75e8a231a9 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:24:48.463493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:48.477403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:48.508705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:48.509233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:48.509688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:48.510958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:48.511421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:48.511879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:48.642963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e976ca0-268e-4da3-821a-c81b3db03744 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.202811 Oct 28 18:24:48.643565 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2772/4539] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:24:48 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:24:48.653614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:48.661391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:48.674355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:48.674868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:48.675314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:48.676212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:48.676537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:48.676970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:49.737200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:49.751629 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cccd06fd-6dc1-4d4c-b77b-dcce950cb430 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 1.101804 Oct 28 18:24:49.756890 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2773/4540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:48 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:49.774639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:49.780535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:49.796212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:49.797012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:49.798436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:49.804046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:49.805869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:49.809668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:49.884821 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a181fe31-f75d-495c-8664-3ab77ca43bbf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126129 Oct 28 18:24:49.885816 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2774/4541] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:24:49 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:24:50.782775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:50.784180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:50.798653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:50.801735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:50.813468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:50.814539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:50.815383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:50.817439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:51.282835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:51.296902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-58697e14-497d-4808-bad6-0302b05cb2f7 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 0.517827 Oct 28 18:24:51.309157 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2775/4542] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:50 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:51.321216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:51.323464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:51.347293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:51.347803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:51.348274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:51.349030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:51.349511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:51.349944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:51.432760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43395bec-642f-4646-aff2-0e38dd3b447c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121994 Oct 28 18:24:51.438013 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2776/4543] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:24:51 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:24:52.323276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:52.324596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:52.338769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:52.339264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:52.339718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:52.340484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:52.340949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:52.341381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:52.361681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:53.408939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:53.424488 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b8aec70-cbc3-4081-aa1f-21861952259f tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 1.100585 Oct 28 18:24:53.444438 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2777/4544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:52 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:53.452697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:53.457247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:53.468280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:53.469152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:53.469817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:53.471575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:53.473569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:53.474273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:53.520627 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67fdab6d-44b4-4f49-a62a-b607397405d4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074471 Oct 28 18:24:53.522415 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2778/4545] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:24:53 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:24:54.450934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:54.451613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:54.463940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:54.464443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:54.481050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:54.484260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:54.484976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:54.485696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:55.750264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:55.768910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef0907fa-f5f0-4463-a210-bca72c66a1a4 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 1.322246 Oct 28 18:24:55.788560 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2779/4546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:54 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:55.797029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:55.809713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:55.832487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:55.833339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:55.833952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:55.838198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:55.838871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:55.839542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:55.876303 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae0f8163-c968-4893-a797-3b9d07d6debb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086181 Oct 28 18:24:55.877539 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2780/4547] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:24:55 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:24:55.900261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ec2de8ac-69f0-4332-85e7-e682e88bc864 req-6fa7d182-899d-4811-9911-bd063effed14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5972edbf-e906-4d4e-8d71-5f450280bb7e", "name": "network-vif-plugged", "status": "completed", "tag": "2dcdee03-6fdc-4864-afc1-09aa5e607a20"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:55.932152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ec2de8ac-69f0-4332-85e7-e682e88bc864 req-6fa7d182-899d-4811-9911-bd063effed14 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:55.933273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ec2de8ac-69f0-4332-85e7-e682e88bc864 req-6fa7d182-899d-4811-9911-bd063effed14 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:55.948350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ec2de8ac-69f0-4332-85e7-e682e88bc864 req-6fa7d182-899d-4811-9911-bd063effed14 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:55.975988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ec2de8ac-69f0-4332-85e7-e682e88bc864 req-6fa7d182-899d-4811-9911-bd063effed14 service nova] Creating event network-vif-plugged:2dcdee03-6fdc-4864-afc1-09aa5e607a20 for instance 5972edbf-e906-4d4e-8d71-5f450280bb7e on n-h1-862404-2 Oct 28 18:24:55.991222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ec2de8ac-69f0-4332-85e7-e682e88bc864 req-6fa7d182-899d-4811-9911-bd063effed14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110189 Oct 28 18:24:55.993055 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2781/4548] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:56.795789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:56.797697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:56.810147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:56.813136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:56.816982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:56.818907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:56.820155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:56.826787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:57.523494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:57.544181 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d68dcda0-e081-4532-a0fa-88a3b60138c8 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 0.744974 Oct 28 18:24:57.562423 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2782/4549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:56 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:57.571425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:57.573749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:57.607324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:57.607742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:57.616461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:57.617249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:57.617914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:57.618522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:57.715286 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ccd74170-0105-48eb-9c59-a4dfe2e10cc0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151640 Oct 28 18:24:57.715908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2783/4550] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:24:57 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:24:58.567784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:58.569319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:58.593143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:58.594799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:58.597913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:58.601947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:58.607354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:58.608850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:59.103804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:59.122564 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-70c6ae4d-a173-4dc4-95f0-56fbbac00082 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1313 microversion: 2.1 time: 0.557997 Oct 28 18:24:59.123756 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2784/4551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:58 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:59.145075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:59.152506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:59.174440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:59.175754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:59.176719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:59.178879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:59.179614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:59.180586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:59.254980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d9a91b6-6667-4645-819a-768333ea5207 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.129914 Oct 28 18:24:59.259843 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2785/4552] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:24:59 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:59.414770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:59.415275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:59.424304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:59.425344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:59.426296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:59.427747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:59.429077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:59.429686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:59.483369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:24:59.746032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40ae6db9-f494-4b06-bdbc-20bca5a31371 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 204 len: 0 microversion: 2.20 time: 0.334929 Oct 28 18:24:59.747907 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2786/4553] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:24:59 2022] DELETE /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 18:24:59.766250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:59.782558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:24:59.804579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:59.805350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:59.805759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:59.806857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:59.807458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:59.808281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:00.328951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:00.345357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:00.347423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:00.349979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ed528bd-f94e-4adf-863d-e145b1f5e8cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 0.597022 Oct 28 18:25:00.351059 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2787/4554] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:24:59 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:25:00.359618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:00.374485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:00.382159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:00.383313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:00.383313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:00.383948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:00.399095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:00.399681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:00.751475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:00.773541 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71cb1585-247a-4d31-b402-4d61ed852bf6 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1499 microversion: 2.1 time: 0.410115 Oct 28 18:25:00.775373 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2788/4555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:00 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1499 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:00.799640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d9b43f7-d47c-416d-bee0-ed3c7a871524 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:00.831502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.server_groups [None req-2d9b43f7-d47c-416d-bee0-ed3c7a871524 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Querying cell 43f74929-bc21-41df-9120-e6be09c18015(cell1) for 1 instances {{(pid=120680) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 18:25:00.836594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9b43f7-d47c-416d-bee0-ed3c7a871524 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:00.837967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9b43f7-d47c-416d-bee0-ed3c7a871524 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:00.838424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9b43f7-d47c-416d-bee0-ed3c7a871524 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:00.923661 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d9b43f7-d47c-416d-bee0-ed3c7a871524 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/d588acd3-df28-4e1a-8fbc-bb8987ac2801" status: 200 len: 222 microversion: 2.1 time: 0.127984 Oct 28 18:25:00.927758 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2789/4556] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:25:00 2022] GET /compute/v2.1/os-server-groups/d588acd3-df28-4e1a-8fbc-bb8987ac2801 => generated 222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:25:00.941597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:00.942372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:00.950014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:00.950818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:00.951459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:00.952568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:00.953227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:00.956169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:01.007654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:25:01.175006 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba852ab6-8dad-4190-afcc-df63e556ec6e tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 204 len: 0 microversion: 2.1 time: 0.242557 Oct 28 18:25:01.176216 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2790/4557] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:25:00 2022] DELETE /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:25:01.185767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:01.188266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:01.205809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:01.209749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:01.214766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:01.215971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:01.216634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:01.217335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:01.269863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:02.048354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c711a51a30a64cee9126ff687a24f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad959b0d91b4144bc3a850dcc573288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:02.064077 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c6f6fb3-e58a-4749-8174-4f5ca4b985f3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 200 len: 1505 microversion: 2.1 time: 0.880929 Oct 28 18:25:02.065581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2791/4558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:01 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 1505 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:25:02.078404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:02.079432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:02.107279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:02.108189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:02.108837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:02.111036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:02.112602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:02.113221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:03.277589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:03.288974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:03.300852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:03.303587 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6766c5e-97d8-4e5e-ab3c-df7553ecec8f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 200 len: 1724 microversion: 2.20 time: 1.235924 Oct 28 18:25:03.304494 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2792/4559] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:02 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 1724 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:03.845018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-609337391", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "c111dc6a-f24a-480e-9634-5d2ea70008c8"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:03.951356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] validate_networks() for [('c111dc6a-f24a-480e-9634-5d2ea70008c8', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:25:07.117179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:25:07.117790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:25:07.118066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:25:07.118479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:25:07.120138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:25:07.136715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:07.138544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:07.140363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:07.141516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:07.144854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:07.145479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:07.215393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Getting quotas for project e6541a8f30604036833c4fb3d009746f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:25:07.233992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Getting quotas for user e155c697ee064ce69d0832ff0ab9ae89 and project e6541a8f30604036833c4fb3d009746f. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:25:07.252815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:25:07.258215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:25:07.363507 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da839c15-b7ed-43dc-9783-6c44da66e9f8 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.056865 Oct 28 18:25:07.366677 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2793/4560] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:25:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4061 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:25:07.383226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:07.383929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:07.419018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:07.419271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:07.419723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:07.435477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:07.436279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:07.436956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:07.465488 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] HTTP exception thrown: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Request method failure captured: Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e HTTP/1.1 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5ZgJLlm1X4ePoNO8hANbAS2T7VhnbZat0IsAvx5BJkyCLIUJXW3CscMGguwYLOjtENbz47waQ49_91ehr_2cavG8PirwbY48SmRus2D2jEGzsxliLYyLVXeVHiTbj7GKqy6E4Bl9ENAp87R5TcDielb3Xn99mxw0zXawrmCp4RTBg Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad959b0d91b4144bc3a850dcc573288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c711a51a30a64cee9126ff687a24f22d Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '5972edbf-e906-4d4e-8d71-5f450280bb7e'} Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:07.473276 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Returning 404 to user: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:07.480187 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7535e4ea-067c-4e02-ac44-36af6342cd86 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 404 len: 111 microversion: 2.1 time: 0.105713 Oct 28 18:25:07.481178 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2794/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:07 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:25:07.487457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:07.488146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:07.511400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:07.512198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:07.512823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:07.513717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:07.514341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:07.514939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:07.541664 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] HTTP exception thrown: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Request method failure captured: Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a HTTP/1.1 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB2ZIg3o-yYBAHJBu0IvHdlxTtZ6ygNYrbMnFgtxT0folhpkyZrI4zbglgVNotxT4tthKGZiORLyQ1Tn810GIlRZCyKT_mInKgzo3n1lo_GWyUO5mCwGHejDxc9G3_Axe0LkGrmWa42LCVzMk3BXE9Arj9RUIBesk_JuTdM7bpNvfI8 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e9840a126cf845f49cd9c80b8cc61c8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d438d70603114d2e8e9e6bbf9fb96991 Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '24fe0daa-955e-40da-b95e-c00125d1f92a'} Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.552396 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Returning 404 to user: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:07.561587 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ba87b4f-04bd-4f89-9fbb-d49c2a0bf913 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 404 len: 111 microversion: 2.20 time: 0.071682 Oct 28 18:25:07.572154 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2795/4562] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:07 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:25:07.587646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-58640e26-1420-4da4-93f7-7aacde0fb2a1 req-bdfc9272-ff55-467b-8358-0958ac9101fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fe0daa-955e-40da-b95e-c00125d1f92a", "name": "network-vif-deleted", "tag": "e8004f4a-7b2a-405e-b161-4d9d7552bdde"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:07.620686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-58640e26-1420-4da4-93f7-7aacde0fb2a1 req-bdfc9272-ff55-467b-8358-0958ac9101fe service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:07.621184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-58640e26-1420-4da4-93f7-7aacde0fb2a1 req-bdfc9272-ff55-467b-8358-0958ac9101fe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:07.621639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-58640e26-1420-4da4-93f7-7aacde0fb2a1 req-bdfc9272-ff55-467b-8358-0958ac9101fe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:07.681669 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-58640e26-1420-4da4-93f7-7aacde0fb2a1 req-bdfc9272-ff55-467b-8358-0958ac9101fe service nova] Creating event network-vif-deleted:e8004f4a-7b2a-405e-b161-4d9d7552bdde for instance 24fe0daa-955e-40da-b95e-c00125d1f92a on n-h2-862404-2 Oct 28 18:25:07.695861 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-58640e26-1420-4da4-93f7-7aacde0fb2a1 req-bdfc9272-ff55-467b-8358-0958ac9101fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120632 Oct 28 18:25:07.704775 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2796/4563] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:07.715775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ec88100-27b6-4e46-8017-d25c79196197 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:07.716509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5ec88100-27b6-4e46-8017-d25c79196197 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:07.916182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ec88100-27b6-4e46-8017-d25c79196197 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:07.931973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ec88100-27b6-4e46-8017-d25c79196197 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:07.935220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ec88100-27b6-4e46-8017-d25c79196197 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:07.941359 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ec88100-27b6-4e46-8017-d25c79196197 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1261 microversion: 2.26 time: 0.235400 Oct 28 18:25:07.943288 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2797/4564] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:07 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:07.952379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61f4073c-5690-4b65-9245-d94f1ee1a1f2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.001585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.server_groups [None req-61f4073c-5690-4b65-9245-d94f1ee1a1f2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Querying cell 43f74929-bc21-41df-9120-e6be09c18015(cell1) for 1 instances {{(pid=120680) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 18:25:08.004848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f4073c-5690-4b65-9245-d94f1ee1a1f2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:08.009153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f4073c-5690-4b65-9245-d94f1ee1a1f2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:08.009899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f4073c-5690-4b65-9245-d94f1ee1a1f2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:08.037031 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61f4073c-5690-4b65-9245-d94f1ee1a1f2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.087372 Oct 28 18:25:08.048622 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2798/4565] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:25:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:08.085364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f55025b-b268-45ac-a94c-dc035f65a4f8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '.version_select at 0x7f78dc8aa4c0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.131427 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8f55025b-b268-45ac-a94c-dc035f65a4f8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414937885" status: 204 len: 0 microversion: 2.20 time: 0.081251 Oct 28 18:25:08.135441 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2799/4566] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 18:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414937885 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:25:08.138700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1006c508-9d2e-466c-a439-1b4b5b108b9c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.156800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:08.186796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.server_groups [None req-1006c508-9d2e-466c-a439-1b4b5b108b9c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Querying cell 43f74929-bc21-41df-9120-e6be09c18015(cell1) for 1 instances {{(pid=120680) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 18:25:08.189766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1006c508-9d2e-466c-a439-1b4b5b108b9c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:08.190293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1006c508-9d2e-466c-a439-1b4b5b108b9c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:08.190750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1006c508-9d2e-466c-a439-1b4b5b108b9c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:08.223703 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1006c508-9d2e-466c-a439-1b4b5b108b9c tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/d588acd3-df28-4e1a-8fbc-bb8987ac2801" status: 200 len: 184 microversion: 2.1 time: 0.089562 Oct 28 18:25:08.228301 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2800/4567] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:25:08 2022] GET /compute/v2.1/os-server-groups/d588acd3-df28-4e1a-8fbc-bb8987ac2801 => generated 184 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:08.244407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.246092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:08.260389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:08.262226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:08.262903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:08.264024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:08.264687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:08.265502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:08.287242 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] HTTP exception thrown: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Request method failure captured: Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e HTTP/1.1 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5ZgJLlm1X4ePoNO8hANbAS2T7VhnbZat0IsAvx5BJkyCLIUJXW3CscMGguwYLOjtENbz47waQ49_91ehr_2cavG8PirwbY48SmRus2D2jEGzsxliLYyLVXeVHiTbj7GKqy6E4Bl9ENAp87R5TcDielb3Xn99mxw0zXawrmCp4RTBg Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad959b0d91b4144bc3a850dcc573288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c711a51a30a64cee9126ff687a24f22d Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '5972edbf-e906-4d4e-8d71-5f450280bb7e'} Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:25:08.289949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.293951 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.296008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Returning 404 to user: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:08.297115 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22fe5084-4f2a-46e0-ae32-cf10a951f6be tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 404 len: 111 microversion: 2.1 time: 0.061177 Oct 28 18:25:08.298170 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2801/4568] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:25:08 2022] DELETE /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:25:08.310472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.311543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] [instance: 5972edbf-e906-4d4e-8d71-5f450280bb7e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:08.320474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:08.321289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:08.322011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:08.322939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:08.323919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:08.324514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:08.342139 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] HTTP exception thrown: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Request method failure captured: Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e HTTP/1.1 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5ZgJLlm1X4ePoNO8hANbAS2T7VhnbZat0IsAvx5BJkyCLIUJXW3CscMGguwYLOjtENbz47waQ49_91ehr_2cavG8PirwbY48SmRus2D2jEGzsxliLYyLVXeVHiTbj7GKqy6E4Bl9ENAp87R5TcDielb3Xn99mxw0zXawrmCp4RTBg Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad959b0d91b4144bc3a850dcc573288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c711a51a30a64cee9126ff687a24f22d Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '5972edbf-e906-4d4e-8d71-5f450280bb7e'} Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.344029 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Returning 404 to user: Instance 5972edbf-e906-4d4e-8d71-5f450280bb7e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:08.353213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-014a9544-ae86-418d-87c3-c4404582aaf3 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e" status: 404 len: 111 microversion: 2.1 time: 0.045779 Oct 28 18:25:08.356261 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2802/4569] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:08 2022] GET /compute/v2.1/servers/5972edbf-e906-4d4e-8d71-5f450280bb7e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:25:08.366196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5028047c-1be0-43bb-8302-373b96a6ba26 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.384315 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5028047c-1be0-43bb-8302-373b96a6ba26 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] HTTP exception thrown: Instance group 259ce875-88ec-4430-b489-b5eee1674dbb could not be found. Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5028047c-1be0-43bb-8302-373b96a6ba26 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Request method failure captured: Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-server-groups/259ce875-88ec-4430-b489-b5eee1674dbb HTTP/1.1 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5ZgJLlm1X4ePoNO8hANbAS2T7VhnbZat0IsAvx5BJkyCLIUJXW3CscMGguwYLOjtENbz47waQ49_91ehr_2cavG8PirwbY48SmRus2D2jEGzsxliLYyLVXeVHiTbj7GKqy6E4Bl9ENAp87R5TcDielb3Xn99mxw0zXawrmCp4RTBg Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad959b0d91b4144bc3a850dcc573288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c711a51a30a64cee9126ff687a24f22d Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance group 259ce875-88ec-4430-b489-b5eee1674dbb could not be found. Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '259ce875-88ec-4430-b489-b5eee1674dbb'} Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 259ce875-88ec-4430-b489-b5eee1674dbb could not be found. Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 259ce875-88ec-4430-b489-b5eee1674dbb could not be found. Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.392442 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.400498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.400498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.400498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:08.400498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:08.400498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 259ce875-88ec-4430-b489-b5eee1674dbb could not be found. Oct 28 18:25:08.400498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.403008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5028047c-1be0-43bb-8302-373b96a6ba26 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Returning 404 to user: Instance group 259ce875-88ec-4430-b489-b5eee1674dbb could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:08.405544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5028047c-1be0-43bb-8302-373b96a6ba26 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/259ce875-88ec-4430-b489-b5eee1674dbb" status: 404 len: 117 microversion: 2.1 time: 0.047810 Oct 28 18:25:08.407495 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2803/4570] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:25:08 2022] DELETE /compute/v2.1/os-server-groups/259ce875-88ec-4430-b489-b5eee1674dbb => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:25:08.417190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6515d057-f6a4-46a2-914e-09c16426c0b2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.431752 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6515d057-f6a4-46a2-914e-09c16426c0b2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] HTTP exception thrown: Instance group dbc4f452-5366-4149-890e-794953f520e2 could not be found. Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6515d057-f6a4-46a2-914e-09c16426c0b2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Request method failure captured: Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-server-groups/dbc4f452-5366-4149-890e-794953f520e2 HTTP/1.1 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5ZgJLlm1X4ePoNO8hANbAS2T7VhnbZat0IsAvx5BJkyCLIUJXW3CscMGguwYLOjtENbz47waQ49_91ehr_2cavG8PirwbY48SmRus2D2jEGzsxliLYyLVXeVHiTbj7GKqy6E4Bl9ENAp87R5TcDielb3Xn99mxw0zXawrmCp4RTBg Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad959b0d91b4144bc3a850dcc573288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c711a51a30a64cee9126ff687a24f22d Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance group dbc4f452-5366-4149-890e-794953f520e2 could not be found. Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'dbc4f452-5366-4149-890e-794953f520e2'} Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group dbc4f452-5366-4149-890e-794953f520e2 could not be found. Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group dbc4f452-5366-4149-890e-794953f520e2 could not be found. Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.434428 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.438214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.438214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.438214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:08.438214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:08.438214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group dbc4f452-5366-4149-890e-794953f520e2 could not be found. Oct 28 18:25:08.438214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.438214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6515d057-f6a4-46a2-914e-09c16426c0b2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Returning 404 to user: Instance group dbc4f452-5366-4149-890e-794953f520e2 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:08.438214 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6515d057-f6a4-46a2-914e-09c16426c0b2 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/dbc4f452-5366-4149-890e-794953f520e2" status: 404 len: 117 microversion: 2.1 time: 0.026488 Oct 28 18:25:08.438865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2804/4571] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:25:08 2022] DELETE /compute/v2.1/os-server-groups/dbc4f452-5366-4149-890e-794953f520e2 => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:25:08.453002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcb1d419-8e53-4fe5-86f5-3f69ccd56267 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.484396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-bcb1d419-8e53-4fe5-86f5-3f69ccd56267 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] HTTP exception thrown: Instance group 5ef86c12-a688-47e3-827a-0e8a20d02508 could not be found. Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcb1d419-8e53-4fe5-86f5-3f69ccd56267 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Request method failure captured: Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-server-groups/5ef86c12-a688-47e3-827a-0e8a20d02508 HTTP/1.1 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5ZgJLlm1X4ePoNO8hANbAS2T7VhnbZat0IsAvx5BJkyCLIUJXW3CscMGguwYLOjtENbz47waQ49_91ehr_2cavG8PirwbY48SmRus2D2jEGzsxliLYyLVXeVHiTbj7GKqy6E4Bl9ENAp87R5TcDielb3Xn99mxw0zXawrmCp4RTBg Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad959b0d91b4144bc3a850dcc573288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c711a51a30a64cee9126ff687a24f22d Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance group 5ef86c12-a688-47e3-827a-0e8a20d02508 could not be found. Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '5ef86c12-a688-47e3-827a-0e8a20d02508'} Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5ef86c12-a688-47e3-827a-0e8a20d02508 could not be found. Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5ef86c12-a688-47e3-827a-0e8a20d02508 could not be found. Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.490073 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5ef86c12-a688-47e3-827a-0e8a20d02508 could not be found. Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcb1d419-8e53-4fe5-86f5-3f69ccd56267 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Returning 404 to user: Instance group 5ef86c12-a688-47e3-827a-0e8a20d02508 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bcb1d419-8e53-4fe5-86f5-3f69ccd56267 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/5ef86c12-a688-47e3-827a-0e8a20d02508" status: 404 len: 117 microversion: 2.1 time: 0.047748 Oct 28 18:25:08.497907 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2805/4572] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:25:08 2022] DELETE /compute/v2.1/os-server-groups/5ef86c12-a688-47e3-827a-0e8a20d02508 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:25:08.510225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c748c78a-a351-4bdd-a169-e5a167980737 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.547511 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c748c78a-a351-4bdd-a169-e5a167980737 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] HTTP exception thrown: Instance group 8082ba40-7b63-4aaa-8804-ca4a8213e934 could not be found. Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c748c78a-a351-4bdd-a169-e5a167980737 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Request method failure captured: Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-server-groups/8082ba40-7b63-4aaa-8804-ca4a8213e934 HTTP/1.1 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5ZgJLlm1X4ePoNO8hANbAS2T7VhnbZat0IsAvx5BJkyCLIUJXW3CscMGguwYLOjtENbz47waQ49_91ehr_2cavG8PirwbY48SmRus2D2jEGzsxliLYyLVXeVHiTbj7GKqy6E4Bl9ENAp87R5TcDielb3Xn99mxw0zXawrmCp4RTBg Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad959b0d91b4144bc3a850dcc573288", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad959b0d91b4144bc3a850dcc573288"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cad959b0d91b4144bc3a850dcc573288 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerGroupTestJSON-19650954 Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c711a51a30a64cee9126ff687a24f22d Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerGroupTestJSON-19650954-project Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance group 8082ba40-7b63-4aaa-8804-ca4a8213e934 could not be found. Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8082ba40-7b63-4aaa-8804-ca4a8213e934'} Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8082ba40-7b63-4aaa-8804-ca4a8213e934 could not be found. Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8082ba40-7b63-4aaa-8804-ca4a8213e934 could not be found. Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.551999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:08.556418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:08.556418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:08.556418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:08.556418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:08.556418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8082ba40-7b63-4aaa-8804-ca4a8213e934 could not be found. Oct 28 18:25:08.556418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:08.556418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c748c78a-a351-4bdd-a169-e5a167980737 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Returning 404 to user: Instance group 8082ba40-7b63-4aaa-8804-ca4a8213e934 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:08.561309 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c748c78a-a351-4bdd-a169-e5a167980737 tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/8082ba40-7b63-4aaa-8804-ca4a8213e934" status: 404 len: 117 microversion: 2.1 time: 0.062861 Oct 28 18:25:08.564219 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2806/4573] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:25:08 2022] DELETE /compute/v2.1/os-server-groups/8082ba40-7b63-4aaa-8804-ca4a8213e934 => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:25:08.604068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7d13e8b8-b6df-44de-a510-5e18a1d6659b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.706612 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7d13e8b8-b6df-44de-a510-5e18a1d6659b tempest-ServerGroupTestJSON-19650954 tempest-ServerGroupTestJSON-19650954-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d588acd3-df28-4e1a-8fbc-bb8987ac2801" status: 204 len: 0 microversion: 2.1 time: 0.135620 Oct 28 18:25:08.714912 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2807/4574] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 18:25:08 2022] DELETE /compute/v2.1/os-server-groups/d588acd3-df28-4e1a-8fbc-bb8987ac2801 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:25:08.980885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:08.981762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:09.003238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:09.006321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:09.009107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:09.010323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:09.010832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:09.012665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:09.570803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:09.584003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:09.592987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:09.592987 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a593247-3827-4948-8a80-c93d862af2f5 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1313 microversion: 2.26 time: 0.625284 Oct 28 18:25:09.610276 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2808/4575] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:08 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:09.766773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-01a17d4c-44be-47eb-93ad-feef31e9f50e req-0736489f-d2fc-4ee8-99d0-ba8de05a3367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5972edbf-e906-4d4e-8d71-5f450280bb7e", "name": "network-vif-deleted", "tag": "2dcdee03-6fdc-4864-afc1-09aa5e607a20"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:09.788650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01a17d4c-44be-47eb-93ad-feef31e9f50e req-0736489f-d2fc-4ee8-99d0-ba8de05a3367 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:09.789195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01a17d4c-44be-47eb-93ad-feef31e9f50e req-0736489f-d2fc-4ee8-99d0-ba8de05a3367 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:09.791262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01a17d4c-44be-47eb-93ad-feef31e9f50e req-0736489f-d2fc-4ee8-99d0-ba8de05a3367 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:09.820013 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-01a17d4c-44be-47eb-93ad-feef31e9f50e req-0736489f-d2fc-4ee8-99d0-ba8de05a3367 service nova] Creating event network-vif-deleted:2dcdee03-6fdc-4864-afc1-09aa5e607a20 for instance 5972edbf-e906-4d4e-8d71-5f450280bb7e on n-h1-862404-2 Oct 28 18:25:09.831796 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-01a17d4c-44be-47eb-93ad-feef31e9f50e req-0736489f-d2fc-4ee8-99d0-ba8de05a3367 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067586 Oct 28 18:25:09.832893 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2809/4576] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:25:10.621204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:10.621939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:10.648112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:10.650838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:10.654156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:10.656969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:10.658764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:10.660441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:10.871450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:10.920306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:10.932044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:10.941820 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-602a2f7e-8db1-41b1-82cd-fd19c7901a68 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1319 microversion: 2.26 time: 0.324200 Oct 28 18:25:10.947483 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2810/4577] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:10 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:11.104467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-375ca1de-4a19-4a43-9827-6e2859130a99 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'create', calling method: .version_select at 0x7f78dcab8ee0>, body: {"keypair": {"name": "tempest-keypair-350526011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuDIyzKzzGhSorYRgJtnKg2HZAEeHaoRDD+jAtslLMHuX890il3L1AUKTBYNRkAM9/UzdGKpWqYS2S1q5cCZlcwl+UaXJS/oIUIemhIJWPHuXxRkcp794QOfcE90D81Ow=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:11.128232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-375ca1de-4a19-4a43-9827-6e2859130a99 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Getting quotas for project e9840a126cf845f49cd9c80b8cc61c8c. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:25:11.147779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-375ca1de-4a19-4a43-9827-6e2859130a99 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Getting quotas for user d438d70603114d2e8e9e6bbf9fb96991 and project e9840a126cf845f49cd9c80b8cc61c8c. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:25:11.193652 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-375ca1de-4a19-4a43-9827-6e2859130a99 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.094823 Oct 28 18:25:11.205026 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2811/4578] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 18:25:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 18:25:11.977466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:11.978155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:11.993677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:11.994172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:11.994613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:11.995327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:11.995781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:11.996411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:12.525169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:12.555166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:12.560486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:12.563519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8aa749c5-b56b-4910-80d4-a8c2190301fd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 0.591457 Oct 28 18:25:12.573472 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2812/4579] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:11 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:13.604715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:13.605339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:13.613228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:13.613729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:13.614341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:13.614917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:13.615373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:13.615999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:14.638203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:14.648861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:14.650717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:14.652222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-885c3ba2-a2e7-4dbe-8cd0-5dfe4d885a76 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 1.051545 Oct 28 18:25:14.653101 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2813/4580] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:13 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:25:15.679253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:15.680290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:15.688665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:15.689407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:15.690526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:15.691325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:15.691864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:15.692312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:16.368206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:16.382862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:16.386228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:16.389597 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c72152b7-b185-4524-978d-da923f591685 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 0.713806 Oct 28 18:25:16.392284 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2814/4581] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:15 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:16.414279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a491c77b-1ca2-4afd-9a8d-6a9a2b8d9e0c req-e97f672a-560f-40bf-8ed0-b23021c7a73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "189b1c46-9056-4a1f-a7a2-9fd4ee517768", "tag": "b4ac92da-01f9-47d3-96af-32c9b2b0e7d9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:16.437852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a491c77b-1ca2-4afd-9a8d-6a9a2b8d9e0c req-e97f672a-560f-40bf-8ed0-b23021c7a73a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:16.438566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a491c77b-1ca2-4afd-9a8d-6a9a2b8d9e0c req-e97f672a-560f-40bf-8ed0-b23021c7a73a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:16.439306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a491c77b-1ca2-4afd-9a8d-6a9a2b8d9e0c req-e97f672a-560f-40bf-8ed0-b23021c7a73a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:16.468637 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a491c77b-1ca2-4afd-9a8d-6a9a2b8d9e0c req-e97f672a-560f-40bf-8ed0-b23021c7a73a service nova] Creating event network-changed:b4ac92da-01f9-47d3-96af-32c9b2b0e7d9 for instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 on n-h1-862404-2 Oct 28 18:25:16.477416 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a491c77b-1ca2-4afd-9a8d-6a9a2b8d9e0c req-e97f672a-560f-40bf-8ed0-b23021c7a73a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082519 Oct 28 18:25:16.479184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2815/4582] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:17.418293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:17.425883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:17.427199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:17.444826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:17.445443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:17.450602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:17.451748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:17.455169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:17.456001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:18.086720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:18.096754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:18.101956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:18.105659 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d9f832df-b99f-433d-87a7-1542646aea24 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 0.689967 Oct 28 18:25:18.108557 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2816/4583] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:17 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:25:18.114772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1036027466", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7cf7d39-4823-4157-a645-af8e2ff314bd"}], "security_groups": [{"name": "tempest-securitygroup--678231484"}], "key_name": "tempest-keypair-350526011", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:18.350797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] validate_networks() for [('a7cf7d39-4823-4157-a645-af8e2ff314bd', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:25:19.337133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:25:19.337640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:25:19.338169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:25:19.338791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:25:19.339417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:25:19.350401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:19.350896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:19.351498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:19.352647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:19.353111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:19.353710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:19.376128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Getting quotas for project e9840a126cf845f49cd9c80b8cc61c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:25:19.383482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Getting quotas for user d438d70603114d2e8e9e6bbf9fb96991 and project e9840a126cf845f49cd9c80b8cc61c8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:25:19.398497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:25:19.401390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:25:19.468105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e95e376a-2500-43f1-a2ce-357f825ac650 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.358101 Oct 28 18:25:19.476177 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2817/4584] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 18:25:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 18:25:19.499095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:19.500263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:19.510639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:19.511399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:19.512055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:19.513488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:19.514288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:19.514875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:19.969393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:19.983711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:19.987895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:19.990973 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-208eecfa-06f3-461d-8c00-880af11f314f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 0.512218 Oct 28 18:25:19.992040 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2818/4585] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:19 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:19.998213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f036b0ee-80ef-42d2-a21d-cb029c8fd23a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:19.999242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f036b0ee-80ef-42d2-a21d-cb029c8fd23a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:20.172959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f036b0ee-80ef-42d2-a21d-cb029c8fd23a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:20.187109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f036b0ee-80ef-42d2-a21d-cb029c8fd23a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:20.206187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f036b0ee-80ef-42d2-a21d-cb029c8fd23a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:20.216831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f036b0ee-80ef-42d2-a21d-cb029c8fd23a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1281 microversion: 2.20 time: 0.223401 Oct 28 18:25:20.217457 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2819/4586] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:19 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:21.021946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:21.022586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:21.042015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:21.042517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:21.046120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:21.047711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:21.050139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:21.050612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:21.675730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:21.685392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:21.691605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:21.696219 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03889c99-2bd4-4a25-b5be-ab8214072444 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 0.678924 Oct 28 18:25:21.696818 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2820/4587] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:21 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:21.723266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:21.729401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:21.757619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:21.759379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:21.764320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:21.765344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:21.778797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:21.785477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:21.935950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:21.947342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:21.949744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:21.951756 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80206531-2369-4b56-9cfe-0e6f2bd2b1f5 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1339 microversion: 2.20 time: 0.250812 Oct 28 18:25:21.952956 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2821/4588] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:21 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:22.721935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:22.722594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:22.736840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:22.738115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:22.739211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:22.742258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:22.744677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:22.746457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:23.164404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:23.186320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:23.188245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:23.189786 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2fbb22e9-2827-4465-91cc-8bdc0f0b61c6 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 0.472094 Oct 28 18:25:23.190847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2822/4589] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:22 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:23.203505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:23.204449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:23.220768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:23.227201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:23.227943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:23.229199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:23.229907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:23.232308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:23.439598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:23.453273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:23.455264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:23.458317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a760c6c-52d3-44ac-8942-d910cfd80b2c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1339 microversion: 2.20 time: 0.264742 Oct 28 18:25:23.459346 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2823/4590] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:23 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:24.220908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:24.222212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:24.229523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:24.230212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:24.230818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:24.231670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:24.232153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:24.232754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:24.254327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:24.607459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:24.619096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:24.620680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:24.622476 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91edc4e5-0067-4343-a401-af1cf564274f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 0.406360 Oct 28 18:25:24.634029 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2824/4591] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:24 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:25:24.641311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2431e321-f520-4cb3-8ec1-1364dc2c81eb req-31bed4fc-0a34-425c-bd9a-a7902795969d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189b1c46-9056-4a1f-a7a2-9fd4ee517768", "name": "network-vif-plugged", "status": "completed", "tag": "b4ac92da-01f9-47d3-96af-32c9b2b0e7d9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:24.652338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2431e321-f520-4cb3-8ec1-1364dc2c81eb req-31bed4fc-0a34-425c-bd9a-a7902795969d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:24.652827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2431e321-f520-4cb3-8ec1-1364dc2c81eb req-31bed4fc-0a34-425c-bd9a-a7902795969d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:24.653260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2431e321-f520-4cb3-8ec1-1364dc2c81eb req-31bed4fc-0a34-425c-bd9a-a7902795969d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:24.665971 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2431e321-f520-4cb3-8ec1-1364dc2c81eb req-31bed4fc-0a34-425c-bd9a-a7902795969d service nova] Creating event network-vif-plugged:b4ac92da-01f9-47d3-96af-32c9b2b0e7d9 for instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 on n-h1-862404-2 Oct 28 18:25:24.678715 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2431e321-f520-4cb3-8ec1-1364dc2c81eb req-31bed4fc-0a34-425c-bd9a-a7902795969d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041916 Oct 28 18:25:24.679362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2825/4592] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:24.686010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:24.687161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:24.696863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:24.697390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:24.697836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:24.698569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:24.699035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:24.700279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:24.791768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:24.809012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:24.810758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:24.812751 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-09efd9c3-5fa5-40bd-8887-fdb8f1b5415d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1339 microversion: 2.20 time: 0.131878 Oct 28 18:25:24.828814 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2826/4593] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:24 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1339 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:25.651091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:25.652533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:25.671546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:25.674232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:25.674916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:25.675873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:25.677790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:25.678810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:26.157070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:26.187401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:26.190661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:26.191911 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4bffed70-2513-4530-8c8d-a5cc0a9e045d tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1361 microversion: 2.26 time: 0.547391 Oct 28 18:25:26.193156 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2827/4594] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:25 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1361 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:26.204380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:26.210469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:26.226473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:26.226991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:26.227460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:26.228213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:26.230124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:26.230585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:26.624776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:26.643190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:26.651985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:26.653919 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-addce539-ee28-4547-8fb3-e4379d796e62 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.453546 Oct 28 18:25:26.659370 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2828/4595] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:26 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:27.227454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:27.228188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:27.250576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:27.251740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:27.254225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:27.256548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:27.257063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:27.260102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:27.578362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:27.590639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:27.601433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:27.605321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31cfa09d-564c-495e-a7f8-a2a63dfe376a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1545 microversion: 2.26 time: 0.380839 Oct 28 18:25:27.607089 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2829/4596] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:27 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1545 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:25:27.639308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd675700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:27.670843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:27.671436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:27.671787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:27.677098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:27.693290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:27.696261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:27.697191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:27.699084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:27.702264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:27.702917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:27.774120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:27.775640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:27.784927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:27.852599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:27.853526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:27.854267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:27.947946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:27.972406 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-53cd7aea-9e03-486c-9a05-432aa6d453fe tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-2003945571" status: 201 len: 0 microversion: 2.26 time: 0.338019 Oct 28 18:25:27.980063 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2830/4597] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 18:25:27 2022] PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-2003945571 => generated 0 bytes in 346 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 28 18:25:27.985915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:27.987027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:28.002970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:28.006337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.007377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.014750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.016276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.019187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.019937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.518081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:28.530358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:28.531875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:28.536317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea3bd317-3883-419c-a7ec-0e11dd344b6c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.554333 Oct 28 18:25:28.539539 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2831/4598] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:27 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:28.544878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5a4610c5-bb6c-4662-a432-fd911ebb49a3 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dc9d0670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:28.562390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a4610c5-bb6c-4662-a432-fd911ebb49a3 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.575325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a4610c5-bb6c-4662-a432-fd911ebb49a3 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.575886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a4610c5-bb6c-4662-a432-fd911ebb49a3 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.599375 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5a4610c5-bb6c-4662-a432-fd911ebb49a3 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-2003945571" status: 204 len: 0 microversion: 2.26 time: 0.057219 Oct 28 18:25:28.602216 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2832/4599] 10.222.0.16 () {60 vars in 1361 bytes} [Fri Oct 28 18:25:28 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-2003945571 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:25:28.616294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78de077160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:28.626424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.627964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.635378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.636306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:28.649856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.651533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.652471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.653640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.654506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.655181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.687582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.689224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.690192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.717978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:28.753619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e5f5ff11-e27d-40f9-a1a2-12d989aa853a tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 204 len: 0 microversion: 2.26 time: 0.143923 Oct 28 18:25:28.754543 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2833/4600] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 18:25:28 2022] DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:25:28.768434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dbe8c07a-4054-45fb-87ef-202a349a3536 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78de077e50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:28.780715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbe8c07a-4054-45fb-87ef-202a349a3536 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.781467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbe8c07a-4054-45fb-87ef-202a349a3536 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.782100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dbe8c07a-4054-45fb-87ef-202a349a3536 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.796551 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dbe8c07a-4054-45fb-87ef-202a349a3536 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 200 len: 12 microversion: 2.26 time: 0.035136 Oct 28 18:25:28.798635 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2834/4601] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 18:25:28 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:25:28.811699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dc8aa040>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:28.833255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.834091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.836010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.838543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:28.845500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.846786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.847407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.848947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.849621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.850399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.890008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.890759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.891371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.905767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:28.907177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:28.907999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:28.952123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:28.986735 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-11b9ec16-efa4-48b7-87ac-2d2396bdbcfd tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-1782825683" status: 201 len: 0 microversion: 2.26 time: 0.180354 Oct 28 18:25:28.987432 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2835/4602] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 18:25:28 2022] PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-1782825683 => generated 0 bytes in 182 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 18:25:29.000269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e2360ac-833f-483c-ab33-5e5f2a7b65fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dc9d0820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:29.011284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e2360ac-833f-483c-ab33-5e5f2a7b65fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.012072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e2360ac-833f-483c-ab33-5e5f2a7b65fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.012705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e2360ac-833f-483c-ab33-5e5f2a7b65fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.044359 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e2360ac-833f-483c-ab33-5e5f2a7b65fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 200 len: 36 microversion: 2.26 time: 0.049095 Oct 28 18:25:29.054855 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2836/4603] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 18:25:28 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 36 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:29.080781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd555820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:29.097461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.098037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.099233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.099995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:29.107350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.108607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.109265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.110155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.110808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.111445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.150397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.150953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.151486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.186201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:29.206451 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0fad9a4e-7e2e-4b4b-96a5-6921a64309bf tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-1782825683" status: 204 len: 0 microversion: 2.26 time: 0.131152 Oct 28 18:25:29.208687 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2837/4604] 10.222.0.16 () {60 vars in 1364 bytes} [Fri Oct 28 18:25:29 2022] DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-1782825683 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:25:29.220019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d349f3e-9245-4dce-8ccb-296a4ff2ff09 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd6788b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:29.237720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d349f3e-9245-4dce-8ccb-296a4ff2ff09 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.238252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d349f3e-9245-4dce-8ccb-296a4ff2ff09 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.238712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d349f3e-9245-4dce-8ccb-296a4ff2ff09 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.253481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:29.257858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d349f3e-9245-4dce-8ccb-296a4ff2ff09 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 200 len: 12 microversion: 2.26 time: 0.044112 Oct 28 18:25:29.265816 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2838/4605] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 18:25:29 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 12 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:29.277297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dc8aab80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:29.308941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.309501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.309954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.310505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:29.323507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.324066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.324514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.325307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.325923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.326365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.365976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:29.370665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.370665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.370665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.387673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:29.407623 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5b8c9f95-a426-4eee-a713-5fd4c669650f tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 204 len: 0 microversion: 2.26 time: 0.134874 Oct 28 18:25:29.408465 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2839/4606] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 18:25:29 2022] DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:25:29.419728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dc8aa430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:29.432151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.432767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.433290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.434493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:29.440875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.441492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.442114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.443853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.444389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.444902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.477573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.478184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.478757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.492010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.493551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.494163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.540030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:29.568202 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72b959c4-0ba4-42e6-a96e-62367f4277d1 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-693452019" status: 201 len: 0 microversion: 2.26 time: 0.151863 Oct 28 18:25:29.574742 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2840/4607] 10.222.0.16 () {62 vars in 1377 bytes} [Fri Oct 28 18:25:29 2022] PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-693452019 => generated 0 bytes in 158 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 28 18:25:29.584635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:29.586011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:29.603680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.605142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.624071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.624872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:29.625979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:29.627141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:29.982413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:29.995902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:29.997865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:29.999075 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf558b95-86bc-496f-87b9-aac07a005fa6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.425677 Oct 28 18:25:29.999652 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2841/4608] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:29 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:30.011022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd555280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:30.027912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.028630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.029255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.029933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:30.037238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.042325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.043112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.044925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.045790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.046349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.116447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.117750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.118428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.134810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.135470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.136045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.184975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:30.197581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=20 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:30.238263 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-511c66f5-e327-4f0c-aa4d-ee044a15e818 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-1349705653" status: 201 len: 0 microversion: 2.26 time: 0.232973 Oct 28 18:25:30.244046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2842/4609] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 18:25:30 2022] PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-1349705653 => generated 0 bytes in 239 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 18:25:30.259006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5aedab4a-f264-4795-a11d-7b5d0f965554 req-0d0781e6-9faa-4fc7-bf62-304ccb35eb6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671f07d0-7909-448b-8511-d1f763e4dd16", "tag": "62aa338b-fc02-4b9d-a878-dbe37a9d413f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:30.278644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5aedab4a-f264-4795-a11d-7b5d0f965554 req-0d0781e6-9faa-4fc7-bf62-304ccb35eb6f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.278980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5aedab4a-f264-4795-a11d-7b5d0f965554 req-0d0781e6-9faa-4fc7-bf62-304ccb35eb6f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.279416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5aedab4a-f264-4795-a11d-7b5d0f965554 req-0d0781e6-9faa-4fc7-bf62-304ccb35eb6f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.293715 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5aedab4a-f264-4795-a11d-7b5d0f965554 req-0d0781e6-9faa-4fc7-bf62-304ccb35eb6f service nova] Creating event network-changed:62aa338b-fc02-4b9d-a878-dbe37a9d413f for instance 671f07d0-7909-448b-8511-d1f763e4dd16 on n-h2-862404-2 Oct 28 18:25:30.299569 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5aedab4a-f264-4795-a11d-7b5d0f965554 req-0d0781e6-9faa-4fc7-bf62-304ccb35eb6f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053788 Oct 28 18:25:30.300574 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2843/4610] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:30.307736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd50a1f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:30.324554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.325167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.325615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.328105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:30.341221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.341747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.342251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.342894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.343352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.343784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.395759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.396371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.398211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.433283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:30.454146 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a4cf894a-9a7f-4721-906d-9e44f4b7ef6b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 204 len: 0 microversion: 2.26 time: 0.152033 Oct 28 18:25:30.455435 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2844/4611] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 18:25:30 2022] DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:25:30.465433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c9c5e1e-dd8d-4917-8a01-ee1fe98d86ef tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd555b80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:30.495758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9c5e1e-dd8d-4917-8a01-ee1fe98d86ef tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.496490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9c5e1e-dd8d-4917-8a01-ee1fe98d86ef tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.497116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c9c5e1e-dd8d-4917-8a01-ee1fe98d86ef tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.509443 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c9c5e1e-dd8d-4917-8a01-ee1fe98d86ef tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 200 len: 12 microversion: 2.26 time: 0.048604 Oct 28 18:25:30.510669 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2845/4612] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 18:25:30 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:25:30.527646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd675af0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:30.543970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.549886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.550573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.551079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:30.577699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.578219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.580428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.580575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.580988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.581422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.626754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.627339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.627716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.646177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:30.664216 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6364c46-549c-4393-a942-e3dc8299f77c tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 204 len: 0 microversion: 2.26 time: 0.145287 Oct 28 18:25:30.665235 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2846/4613] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 18:25:30 2022] DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:25:30.675770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dcab8820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:30.686335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.686831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.687270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.687752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:30.695248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.696335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.696931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.697817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.698625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.699646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.735918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.736675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.737333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.750903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.751652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.752323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.800338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:30.830564 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7647acbc-3a61-4cbc-9c0f-05f491342383 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-1765554136" status: 201 len: 0 microversion: 2.26 time: 0.157621 Oct 28 18:25:30.836844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2847/4614] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 18:25:30 2022] PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-1765554136 => generated 0 bytes in 161 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 28 18:25:30.842614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd665820>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:30.860519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.861373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.861528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.863259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:30.875381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.876193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.877021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.880327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.881047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.881686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.916010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.917113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.917113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.929590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:30.930355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:30.930683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:30.939255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:30.972451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:31.001127 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a827a2d-252d-439d-a7fc-e257f1536054 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-85884927" status: 201 len: 0 microversion: 2.26 time: 0.162730 Oct 28 18:25:31.007542 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2848/4615] 10.222.0.16 () {62 vars in 1374 bytes} [Fri Oct 28 18:25:30 2022] PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags/tempest-tag-85884927 => generated 0 bytes in 170 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 28 18:25:31.013676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Action: 'update_all', calling method: .version_select at 0x7f78dd73bd30>, body: {"tags": ["tempest-tag-886351622", "tempest-tag-2145464530"]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:31.027540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.028409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.029037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.029723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:31.036442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.037386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.038153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.039099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.039886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.040674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.080794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.081379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.081840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.122142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:31.157501 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-871c767d-82a6-4dae-ac70-6e60e1016b66 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 200 len: 61 microversion: 2.26 time: 0.148497 Oct 28 18:25:31.158539 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2849/4616] 10.222.0.16 () {62 vars in 1312 bytes} [Fri Oct 28 18:25:31 2022] PUT /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 61 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:31.167206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:31.167847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:31.178441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.178959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.179573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.180718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.181230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.181627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.560148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:31.580027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:31.582340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:31.588076 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a435b6b-4354-4b5e-b628-75dfe9dfe5b9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.428264 Oct 28 18:25:31.589118 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2850/4617] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:31 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:31.607310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-11429c8a-2d09-402f-a44e-bbcfee4dea26 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78de192430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:31.621618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11429c8a-2d09-402f-a44e-bbcfee4dea26 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.622923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11429c8a-2d09-402f-a44e-bbcfee4dea26 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.623374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11429c8a-2d09-402f-a44e-bbcfee4dea26 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.637243 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-11429c8a-2d09-402f-a44e-bbcfee4dea26 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 200 len: 61 microversion: 2.26 time: 0.046865 Oct 28 18:25:31.641215 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2851/4618] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 18:25:31 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 61 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:31.653002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '.version_select at 0x7f78dd6658b0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:31.687035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.687918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.688629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.689137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:31.697087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.697589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.698193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.700490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.700985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.701540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.738119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.739611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.740557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.772142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lazy-loading 'flavor' on Instance uuid 189b1c46-9056-4a1f-a7a2-9fd4ee517768 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:31.794070 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e403c01-900e-4827-a4fc-e3f1fa9631f4 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags" status: 204 len: 0 microversion: 2.26 time: 0.148978 Oct 28 18:25:31.795405 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2852/4619] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 18:25:31 2022] DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768/tags => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:25:31.807562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:31.808456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:31.817771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.818171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.818705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.819425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.819909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.820334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.854857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:25:31.973414 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad3bd0f2-5d2c-47ff-8e26-1db805ec19fb tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 204 len: 0 microversion: 2.26 time: 0.169948 Oct 28 18:25:31.975291 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2853/4620] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:25:31 2022] DELETE /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 18:25:31.985218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:31.986415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:31.995455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.996384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.997044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:31.997989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:31.998833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:31.999493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:32.374087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:32.384621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:32.386432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:32.387750 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a19eb09b-2b7b-4014-8b8b-492c4094ff46 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1551 microversion: 2.26 time: 0.407806 Oct 28 18:25:32.388550 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2854/4621] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:31 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1551 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:32.619013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:32.619644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:32.627877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:32.628778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:32.628778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:32.631050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:32.631623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:32.632232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:33.341529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:33.354916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:33.356491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:33.357849 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-515ad0ae-bf74-4229-9601-ec227a7a9bd2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.744053 Oct 28 18:25:33.372173 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2855/4622] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:32 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:33.417073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:33.417743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:33.425089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:33.425678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:33.426193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:33.427032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:33.427566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:33.428334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:34.012067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:34.031574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:34.044921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:34.050906 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-949dc225-72fb-471e-ba2d-acb48ad55e64 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1551 microversion: 2.26 time: 0.638598 Oct 28 18:25:34.054990 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2856/4623] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:33 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1551 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:25:34.340044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8241d8cc-6ec7-4ec7-b813-c05d6ae5c4c7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'create', calling method: .version_select at 0x7f78dd542af0>, body: {"keypair": {"name": "tempest-keypair-165590215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbcgj+b61VTMnBfwYq60Luu/tw+l9Q7oX2gfDzbrZhi3/ja1NZ3z9Q8C5dxouwGc1aNYvOt3sYlEro4+zzkqxR3hoJaV2R1P0kuQELvv+N1G+A7hJWo7rxoKY7t4Slkww=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:34.358020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-8241d8cc-6ec7-4ec7-b813-c05d6ae5c4c7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for project 089f168818394b139c87b28362e23ece. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:25:34.364528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-8241d8cc-6ec7-4ec7-b813-c05d6ae5c4c7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for user 4666e4ac2e124ed9bf3579707986cb43 and project 089f168818394b139c87b28362e23ece. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:25:34.395993 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8241d8cc-6ec7-4ec7-b813-c05d6ae5c4c7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.232537 Oct 28 18:25:34.397511 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2857/4624] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:25:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:34.403653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:34.404563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:34.412273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:34.414050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:34.414707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:34.415655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:34.416344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:34.417797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:34.948142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:34.960636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:34.962089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:34.963247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-14027979-6c9d-4769-91a1-14c6547e46cd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.564475 Oct 28 18:25:34.968590 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2858/4625] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:34 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:35.085801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:35.086391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:35.098710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:35.115605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:35.117153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:35.119296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:35.137097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:35.153908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:35.356513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:35.377399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:35.383020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e155c697ee064ce69d0832ff0ab9ae89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6541a8f30604036833c4fb3d009746f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:35.385704 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c82f2c5f-7cee-4160-99d6-8fb5b490300b tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 200 len: 1509 microversion: 2.26 time: 0.304099 Oct 28 18:25:35.387866 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2859/4626] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:35 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 1509 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:35.398629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8e9bf80f-86b8-4065-a3df-0d2f262409c6 req-3aaa0332-b7db-4c34-b286-d63cf4eebf34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "189b1c46-9056-4a1f-a7a2-9fd4ee517768", "name": "network-vif-deleted", "tag": "b4ac92da-01f9-47d3-96af-32c9b2b0e7d9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:35.422884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8e9bf80f-86b8-4065-a3df-0d2f262409c6 req-3aaa0332-b7db-4c34-b286-d63cf4eebf34 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:35.425238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8e9bf80f-86b8-4065-a3df-0d2f262409c6 req-3aaa0332-b7db-4c34-b286-d63cf4eebf34 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:35.425693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8e9bf80f-86b8-4065-a3df-0d2f262409c6 req-3aaa0332-b7db-4c34-b286-d63cf4eebf34 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:35.456728 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8e9bf80f-86b8-4065-a3df-0d2f262409c6 req-3aaa0332-b7db-4c34-b286-d63cf4eebf34 service nova] Creating event network-vif-deleted:b4ac92da-01f9-47d3-96af-32c9b2b0e7d9 for instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 on n-h1-862404-2 Oct 28 18:25:35.466845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8e9bf80f-86b8-4065-a3df-0d2f262409c6 req-3aaa0332-b7db-4c34-b286-d63cf4eebf34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076870 Oct 28 18:25:35.471705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2860/4627] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:35.997889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:35.998601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:36.005307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:36.014476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:36.014979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:36.016579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:36.017337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:36.017801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:36.018232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:36.874903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:36.890566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:36.893043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:36.899925 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3c63e14-6ceb-4297-bbf3-ae9210109228 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.905688 Oct 28 18:25:36.908629 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2861/4628] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:35 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:25:36.928195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:36.929253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] [instance: 189b1c46-9056-4a1f-a7a2-9fd4ee517768] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:36.938468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:36.939553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:36.941235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:36.943455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:36.944221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:36.944923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:36.973981 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] HTTP exception thrown: Instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 could not be found. Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Request method failure captured: Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 HTTP/1.1 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB5-Cr_486VnfPdYwxGoFT1N1nH3PuUyZckJywDfJE-byljhxW9zbpfxnzOC-bgJpcBqNUVXs5HFAvQvdz9wRNOs5uzoZboyubGczlyoqb-7oVmeHM65enrFLsTpaBnsZHy08olmY9qks1ii0I46MZawcwEhCYeXSxBp3pZPrfMNajE Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.26 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e6541a8f30604036833c4fb3d009746f Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerTagsTestJSON-66074305 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6541a8f30604036833c4fb3d009746f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e6541a8f30604036833c4fb3d009746f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e6541a8f30604036833c4fb3d009746f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e6541a8f30604036833c4fb3d009746f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerTagsTestJSON-66074305 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e6541a8f30604036833c4fb3d009746f Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerTagsTestJSON-66074305 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerTagsTestJSON-66074305-project Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e155c697ee064ce69d0832ff0ab9ae89 Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerTagsTestJSON-66074305-project Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 could not be found. Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '189b1c46-9056-4a1f-a7a2-9fd4ee517768'} Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 could not be found. Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 could not be found. Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:36.975877 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:36.980202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:36.980202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:36.980202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:36.980202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:36.980202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:36.980202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 could not be found. Oct 28 18:25:36.980202 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:25:36.982340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] Returning 404 to user: Instance 189b1c46-9056-4a1f-a7a2-9fd4ee517768 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:36.983457 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c6b4cc1-f72d-4b55-a273-20a863bab770 tempest-ServerTagsTestJSON-66074305 tempest-ServerTagsTestJSON-66074305-project] 10.222.0.16 "GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768" status: 404 len: 111 microversion: 2.26 time: 0.073525 Oct 28 18:25:36.984649 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2862/4629] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:36 2022] GET /compute/v2.1/servers/189b1c46-9056-4a1f-a7a2-9fd4ee517768 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:25:37.937255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:37.939169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:37.947985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:37.948483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:37.957157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:37.958710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:37.960828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:37.972289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:38.449494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:38.462246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:38.464267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:38.465847 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba8b66be-5634-4f1b-ab55-034056fbb35d tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.534253 Oct 28 18:25:38.466647 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2863/4630] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:37 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:39.496236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:39.505763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:39.526834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:39.527732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:39.529166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:39.530178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:39.530757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:39.531295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:39.592858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=93,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:40.039460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:40.086322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:40.094878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:40.097764 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87fcece1-2760-469d-804d-cabe1fe3c936 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1406 microversion: 2.20 time: 0.606357 Oct 28 18:25:40.110322 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2864/4631] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:39 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1406 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:40.149486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f2771adb-5a12-4aff-b0a5-d3240b3245bf req-dec3fffe-0586-46fc-b7cb-11acc82fe953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671f07d0-7909-448b-8511-d1f763e4dd16", "name": "network-vif-plugged", "status": "completed", "tag": "62aa338b-fc02-4b9d-a878-dbe37a9d413f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:40.196686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2771adb-5a12-4aff-b0a5-d3240b3245bf req-dec3fffe-0586-46fc-b7cb-11acc82fe953 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:40.198709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2771adb-5a12-4aff-b0a5-d3240b3245bf req-dec3fffe-0586-46fc-b7cb-11acc82fe953 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:40.201201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f2771adb-5a12-4aff-b0a5-d3240b3245bf req-dec3fffe-0586-46fc-b7cb-11acc82fe953 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:40.240968 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f2771adb-5a12-4aff-b0a5-d3240b3245bf req-dec3fffe-0586-46fc-b7cb-11acc82fe953 service nova] Creating event network-vif-plugged:62aa338b-fc02-4b9d-a878-dbe37a9d413f for instance 671f07d0-7909-448b-8511-d1f763e4dd16 on n-h2-862404-2 Oct 28 18:25:40.261023 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f2771adb-5a12-4aff-b0a5-d3240b3245bf req-dec3fffe-0586-46fc-b7cb-11acc82fe953 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141453 Oct 28 18:25:40.266988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2865/4632] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:41.000313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1704658263", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "731b8166-5ac1-4b7a-b324-9ea8c5b344b1"}], "security_groups": [{"name": "tempest-securitygroup--1472946434"}], "key_name": "tempest-keypair-165590215", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:41.369367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] validate_networks() for [('731b8166-5ac1-4b7a-b324-9ea8c5b344b1', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:25:43.202234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:25:43.202901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:25:43.203136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:25:43.203556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:25:43.204127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:25:43.220827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:43.221338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:43.221861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:43.229431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:43.229956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:43.230411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:43.290978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:25:43.303481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for user 4666e4ac2e124ed9bf3579707986cb43 and project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:25:43.353609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:25:43.356231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:25:43.507444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4b6e323-eb4c-4654-81e3-984e6d104532 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.528691 Oct 28 18:25:43.511221 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2866/4633] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:25:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:25:43.530636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:43.533009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:43.591045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:43.599719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:43.600324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:43.602931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:43.603530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:43.604106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:44.034641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:44.055343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:44.059123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:44.065071 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e976779-f784-4c06-9e48-6e988d5c0233 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1599 microversion: 2.20 time: 0.551463 Oct 28 18:25:44.072544 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2867/4634] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:25:43 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1599 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:25:44.805869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1015998191", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "462fb4c7-b3f8-42a2-8b4d-622368b72e71"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:44.950887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] validate_networks() for [('462fb4c7-b3f8-42a2-8b4d-622368b72e71', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:25:46.343526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:25:46.344585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:25:46.345372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:25:46.346273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:25:46.346847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:25:46.365218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:46.365725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:46.367349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:46.368366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:46.369987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:46.371932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:46.415333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Getting quotas for project 25d095e53a0947459f9181d974314a1a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:25:46.434512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Getting quotas for user fad202807ba744848541cb5770d68453 and project 25d095e53a0947459f9181d974314a1a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:25:46.476173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:25:46.483044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:25:46.577841 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef2f5a25-63f4-48ae-b35c-83788ff39371 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.503868 Oct 28 18:25:46.579195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2868/4635] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:25:46.585304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:46.586266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:46.593496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:46.594882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:46.595778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:46.596760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:46.597454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:46.598132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:46.753956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:46.771346 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f082318b-7963-4814-84ae-a1bc96698aa6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1296 microversion: 2.1 time: 0.186258 Oct 28 18:25:46.772689 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2869/4636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:46 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1296 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:46.778875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:46.779599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:46.798575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:46.799805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:46.803509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:46.805228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:46.805930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:46.806571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:47.003830 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cee6d36a-95bc-4329-bff9-38fb793eb6da tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.229744 Oct 28 18:25:47.012374 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2870/4637] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 18:25:46 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:25:47.021738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cea51e8c-693f-4212-aad2-7c3ed93051b0 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:47.022422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cea51e8c-693f-4212-aad2-7c3ed93051b0 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:47.150743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cea51e8c-693f-4212-aad2-7c3ed93051b0 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:47.163805 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cea51e8c-693f-4212-aad2-7c3ed93051b0 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1216 microversion: 2.1 time: 0.157984 Oct 28 18:25:47.167234 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2871/4638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:47 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:47.800826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:47.802631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:47.814702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:47.820555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:47.821323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:47.826385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:47.827135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:47.827765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:48.220954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:48.245673 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-957ead0f-0bca-4586-9b7b-803ee607b0d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1296 microversion: 2.1 time: 0.449560 Oct 28 18:25:48.263390 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2872/4639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:47 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1296 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:48.269047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:48.270669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:48.285223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:48.286804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:48.287428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:48.288508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:48.289814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:48.290432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:48.610271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:48.628697 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-226622b7-cd16-4a3b-aabe-6193bcab8556 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1268 microversion: 2.1 time: 0.355943 Oct 28 18:25:48.629538 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2873/4640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:48 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1268 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:49.268878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:49.270634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:49.292470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:49.293676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:49.294952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:49.297521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:49.300191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:49.300964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:50.532511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:50.542205 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d677af70-1e8b-4e93-bbde-12aeefbca7aa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 1.277174 Oct 28 18:25:50.542817 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2874/4641] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:49 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:25:50.572312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:50.572954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:50.596729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:50.597669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:50.599028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:50.600133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:50.601595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:50.602789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:51.361951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:51.380407 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc71fb82-a418-449f-bfdc-d59fcf4e02df tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 0.817222 Oct 28 18:25:51.402969 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2875/4642] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:50 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:51.846842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3bf077de-7f75-41c7-852d-31391a8a891b req-1499cd01-c752-413b-ad3e-c13dd38b41d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671f07d0-7909-448b-8511-d1f763e4dd16", "tag": "62aa338b-fc02-4b9d-a878-dbe37a9d413f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:51.861663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3bf077de-7f75-41c7-852d-31391a8a891b req-1499cd01-c752-413b-ad3e-c13dd38b41d9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:51.870700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3bf077de-7f75-41c7-852d-31391a8a891b req-1499cd01-c752-413b-ad3e-c13dd38b41d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:51.872356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3bf077de-7f75-41c7-852d-31391a8a891b req-1499cd01-c752-413b-ad3e-c13dd38b41d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:51.899317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3bf077de-7f75-41c7-852d-31391a8a891b req-1499cd01-c752-413b-ad3e-c13dd38b41d9 service nova] Creating event network-changed:62aa338b-fc02-4b9d-a878-dbe37a9d413f for instance 671f07d0-7909-448b-8511-d1f763e4dd16 on n-h2-862404-2 Oct 28 18:25:51.906665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3bf077de-7f75-41c7-852d-31391a8a891b req-1499cd01-c752-413b-ad3e-c13dd38b41d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.501928 Oct 28 18:25:51.908093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2876/4643] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:51.919648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:51.920748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:51.931844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:51.932895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:51.933547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:51.935382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:51.936558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:51.937677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:52.882608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:52.893582 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59a2f279-e874-4fac-8b5d-2576324ebad1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.982439 Oct 28 18:25:52.894581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2877/4644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:51 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:52.916243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:52.920647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:52.925128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:52.927130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:52.928701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:52.931791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:52.932555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:52.933473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:53.509830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:53.525618 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a356e308-ed04-4bf6-9ba8-f3f7565445cf tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 0.629105 Oct 28 18:25:53.526324 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2878/4645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:52 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:53.882727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b7c5e687-c1d9-41e5-b041-a7e7e5bd7507 req-d9f9c7b8-5e96-483d-948d-cb123d6ad1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11f439f-37e5-418a-a7aa-3ca9c705796c", "tag": "a12a9ce9-d2b7-4d1f-8d19-920bcd9bdf4b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:53.900941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b7c5e687-c1d9-41e5-b041-a7e7e5bd7507 req-d9f9c7b8-5e96-483d-948d-cb123d6ad1de service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:53.903318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b7c5e687-c1d9-41e5-b041-a7e7e5bd7507 req-d9f9c7b8-5e96-483d-948d-cb123d6ad1de service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:53.909034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b7c5e687-c1d9-41e5-b041-a7e7e5bd7507 req-d9f9c7b8-5e96-483d-948d-cb123d6ad1de service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:53.940218 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b7c5e687-c1d9-41e5-b041-a7e7e5bd7507 req-d9f9c7b8-5e96-483d-948d-cb123d6ad1de service nova] Creating event network-changed:a12a9ce9-d2b7-4d1f-8d19-920bcd9bdf4b for instance f11f439f-37e5-418a-a7aa-3ca9c705796c on n-h1-862404-2 Oct 28 18:25:53.948066 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b7c5e687-c1d9-41e5-b041-a7e7e5bd7507 req-d9f9c7b8-5e96-483d-948d-cb123d6ad1de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070131 Oct 28 18:25:53.949477 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2879/4646] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:53.966636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:53.968146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:53.981563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:53.982445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:53.982831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:53.984078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:53.984540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:53.985304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:54.572929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:54.581077 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aeaae838-8817-41ad-8351-520d9157aa3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.630175 Oct 28 18:25:54.581694 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2880/4647] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:53 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:54.606339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:54.606980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:54.634185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:54.634698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:54.635151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:54.635926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:54.636410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:54.636934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:55.232708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:55.241263 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3429db26-a96e-4122-9239-0941e56ff36d tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 0.639883 Oct 28 18:25:55.244109 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2881/4648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:54 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:55.605622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:55.606421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:55.617062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:55.617809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:55.619117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:55.620212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:55.620996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:55.621887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:56.202877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:56.221345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1c422698-21b3-4557-a90a-8c2a61ed12b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.614722 Oct 28 18:25:56.222788 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2882/4649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:55 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:56.235104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1f2c6568-48bd-4071-b459-c8d0ae750f22 req-0f69cb99-9276-4a7b-bf37-449c4dd55604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:56.285664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f2c6568-48bd-4071-b459-c8d0ae750f22 req-0f69cb99-9276-4a7b-bf37-449c4dd55604 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:56.286461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f2c6568-48bd-4071-b459-c8d0ae750f22 req-0f69cb99-9276-4a7b-bf37-449c4dd55604 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:56.287240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f2c6568-48bd-4071-b459-c8d0ae750f22 req-0f69cb99-9276-4a7b-bf37-449c4dd55604 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:56.323100 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1f2c6568-48bd-4071-b459-c8d0ae750f22 req-0f69cb99-9276-4a7b-bf37-449c4dd55604 service nova] Creating event network-changed:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:25:56.351713 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1f2c6568-48bd-4071-b459-c8d0ae750f22 req-0f69cb99-9276-4a7b-bf37-449c4dd55604 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122005 Oct 28 18:25:56.355129 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2883/4650] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:56.372426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:56.373477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:56.384157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:56.385013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:56.385566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:56.386385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:56.387321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:56.387885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:56.393143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:57.163075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=18 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:57.313963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:57.347475 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-005b40a6-0719-424c-a394-68b98e21004c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 0.990186 Oct 28 18:25:57.348516 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2884/4651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:56 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:57.365024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:57.375787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:57.385886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:57.388524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:57.391982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:57.392994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:57.396434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:57.397045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:58.178436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:58.187332 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59055e10-a1d3-41b5-bc70-b44ab8bed4ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.836577 Oct 28 18:25:58.187968 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2885/4652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:57 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:58.378885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:58.379752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:58.385738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:58.386477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:58.387113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:58.388033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:58.388659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:58.389260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:58.393782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:59.084714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:59.093221 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba49d4e2-8f4a-43ab-84a8-d3600c087d33 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 0.718161 Oct 28 18:25:59.107835 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2886/4653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:58 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:25:59.214572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:59.215210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:25:59.228657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:59.231231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:59.232022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:59.234331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:59.234801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:59.237160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:59.823729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:59.838221 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05ac2eed-7770-47ca-bae9-28ed2de20a03 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.628565 Oct 28 18:25:59.839696 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2887/4654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:59 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:00.120437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:00.121631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:00.143029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:00.143953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:00.149061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:00.150137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:00.154312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:00.164285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:00.719935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:00.740034 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5847c13-95d8-4502-b413-03cfb5da0d0b tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 0.623430 Oct 28 18:26:00.740875 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2888/4655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:00 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:00.865619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:00.866297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:00.884230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:00.885063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:00.885535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:00.886309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:00.886775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:00.887381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:01.398374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:01.417801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55bd29dc-381f-41ec-8bd6-eef77021f8f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.556087 Oct 28 18:26:01.421988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2889/4656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:00 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:01.762901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:01.763867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:01.781455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:01.782350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:01.783054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:01.784083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:01.784800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:01.792648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:03.107015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:03.124646 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e45720c-df0c-4782-86d0-aa1e2702d040 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 1.362356 Oct 28 18:26:03.125852 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2890/4657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:01 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:03.143317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:03.145358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:03.164199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:03.166827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:03.167459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:03.169517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:03.171407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:03.172679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:04.003907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:04.017648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f56bf79-c5cf-4571-9575-302e3d837be2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.888437 Oct 28 18:26:04.018624 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2891/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:03 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:04.026076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5cc2bb98-ffc9-4686-ae48-b9b5ccd7d0ce req-774f2f24-2db6-49a3-bbd5-e6bf28bb1fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11f439f-37e5-418a-a7aa-3ca9c705796c", "name": "network-vif-plugged", "status": "completed", "tag": "a12a9ce9-d2b7-4d1f-8d19-920bcd9bdf4b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:04.088252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cc2bb98-ffc9-4686-ae48-b9b5ccd7d0ce req-774f2f24-2db6-49a3-bbd5-e6bf28bb1fe1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:04.088708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cc2bb98-ffc9-4686-ae48-b9b5ccd7d0ce req-774f2f24-2db6-49a3-bbd5-e6bf28bb1fe1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:04.090554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cc2bb98-ffc9-4686-ae48-b9b5ccd7d0ce req-774f2f24-2db6-49a3-bbd5-e6bf28bb1fe1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:04.122159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5cc2bb98-ffc9-4686-ae48-b9b5ccd7d0ce req-774f2f24-2db6-49a3-bbd5-e6bf28bb1fe1 service nova] Creating event network-vif-plugged:a12a9ce9-d2b7-4d1f-8d19-920bcd9bdf4b for instance f11f439f-37e5-418a-a7aa-3ca9c705796c on n-h1-862404-2 Oct 28 18:26:04.142233 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5cc2bb98-ffc9-4686-ae48-b9b5ccd7d0ce req-774f2f24-2db6-49a3-bbd5-e6bf28bb1fe1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118725 Oct 28 18:26:04.158431 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2892/4659] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:04.164858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:04.165859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:04.175381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:04.176805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:04.177448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:04.178458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:04.179091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:04.179690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:04.880808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:04.892033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ffcd84d-3f36-4290-9f4e-b47cd420181c tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 0.732687 Oct 28 18:26:04.892635 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2893/4660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:04 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:05.041949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:05.043251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:05.049888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:05.051849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:05.052536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:05.053487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:05.054171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:05.054756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:05.667025 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:26:05.667578 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:26:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:26:05.669996 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:26:05.670117 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:26:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:26:05.821727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:05.862048 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-caad05e5-9052-4b51-9c4f-515bbb662124 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.823073 Oct 28 18:26:05.874727 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2894/4661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:05 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:05.919638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:05.923885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:05.931690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:05.933841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:05.934726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:05.935389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:05.936665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:05.937352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:05.938141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:06.242998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:06.268204 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87b9cbef-2455-4226-9e2e-5b90a49842cc tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1316 microversion: 2.1 time: 0.354301 Oct 28 18:26:06.268204 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2895/4662] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:05 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:06.307573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b15d4c8d-7132-49a8-90d2-b61019a8ff71 req-ca273882-34cf-4b0a-995e-d9b7108e013d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "name": "network-vif-plugged", "status": "completed", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:06.330468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b15d4c8d-7132-49a8-90d2-b61019a8ff71 req-ca273882-34cf-4b0a-995e-d9b7108e013d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:06.330961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b15d4c8d-7132-49a8-90d2-b61019a8ff71 req-ca273882-34cf-4b0a-995e-d9b7108e013d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:06.332363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b15d4c8d-7132-49a8-90d2-b61019a8ff71 req-ca273882-34cf-4b0a-995e-d9b7108e013d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:06.369947 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b15d4c8d-7132-49a8-90d2-b61019a8ff71 req-ca273882-34cf-4b0a-995e-d9b7108e013d service nova] Creating event network-vif-plugged:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:26:06.391273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b15d4c8d-7132-49a8-90d2-b61019a8ff71 req-ca273882-34cf-4b0a-995e-d9b7108e013d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088729 Oct 28 18:26:06.395517 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2896/4663] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:06.906352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:06.907794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:06.920686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:06.921186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:06.921621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:06.926630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:06.927128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:06.927571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:07.257731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:07.269234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d1d7be86-c202-4e1f-bea1-ab493dcad224 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1364 microversion: 2.1 time: 0.368162 Oct 28 18:26:07.273075 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2897/4664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:06 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:07.293775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:07.294401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:07.304423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:07.304921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:07.305366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:07.306075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:07.306534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:07.312072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:07.974882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:07.996354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9fee0f7b-93aa-42cf-92c6-8033c696f36e tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1504 microversion: 2.1 time: 0.707066 Oct 28 18:26:08.009542 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2898/4665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:07 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1504 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:08.029417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:08.029927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:08.037576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.037996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.038447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.039389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.039960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.040403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.147062 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7d5d1dc-0e0c-4fa0-bac4-a81892a2e0db tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.120918 Oct 28 18:26:08.147062 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2899/4666] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 18:26:08 2022] DELETE /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c/os-server-password => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:26:08.159093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:08.159647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:08.166409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.166977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.167447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.168344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.168717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.169196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.199658 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1a3929c7-922f-47ec-aaa5-7f08bbddc8af tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.046496 Oct 28 18:26:08.205131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2900/4667] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 18:26:08 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c/os-server-password => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:26:08.219159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:08.219684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:08.237770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.239533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.240159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.241053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.241750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.252149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.322746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:26:08.394920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:08.439732 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb1d0176-4cd1-48c9-b2f5-460cded42e04 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 204 len: 0 microversion: 2.1 time: 0.226011 Oct 28 18:26:08.441096 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2901/4668] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:26:08 2022] DELETE /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:26:08.452268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:08.454049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:08.465094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.465920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.466871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.468758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.469241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.469688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.705663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:08.715525 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26319863-85ea-407b-8917-1a6035c4dde9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1552 microversion: 2.1 time: 0.270462 Oct 28 18:26:08.728476 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2902/4669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:08 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1552 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:08.740897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:08.741757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:08.756850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.759626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.760328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:08.761809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:08.763546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:08.764239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:09.104236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:09.112202 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f17b5b6b-b81e-4a91-a2fb-981f61bdd843 tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1510 microversion: 2.1 time: 0.382316 Oct 28 18:26:09.112802 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2903/4670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:08 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:09.761570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f136b77-182f-4932-8a8b-cb5e640c3679 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: .version_select at 0x7f78dd5eab80>, body: {"keypair": {"name": "tempest-keypair-1230540329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsDoPseTbEZW+oGT4wQcCZ83L+T03Nz1xoYjlWrU/VFNQM/jzJonDXezj07l5OsnqBc8JWN5e0NbjODssZyZ8sotwZHHHBG673SZkjoa3m8kZ++vmYXYXPkjPCwB4gEcg=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:09.802099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0f136b77-182f-4932-8a8b-cb5e640c3679 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:26:09.824233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0f136b77-182f-4932-8a8b-cb5e640c3679 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for user e0cc266e44dd4f76a95a428bb3676b99 and project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:26:09.883169 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f136b77-182f-4932-8a8b-cb5e640c3679 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.760975 Oct 28 18:26:09.884388 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2904/4671] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:26:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:09.894791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:09.896137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:09.903053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:09.908225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:09.908904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:09.913989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:09.914710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:09.915320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:10.225031 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-19fe11ad-f08a-404e-9a84-3ae1fc354a8a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.335858 Oct 28 18:26:10.226576 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2905/4672] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:26:09 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/os-interface => generated 285 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:10.241777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:10.242783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:10.264647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:10.265156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:10.265608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:10.281352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:10.281887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:10.283358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:11.090168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:11.106344 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2485de7a-9ef2-49b2-8456-217a8efa6b5f tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1510 microversion: 2.1 time: 0.878407 Oct 28 18:26:11.106937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2906/4673] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:10 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1510 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:11.947155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f12665b5-795d-413e-9017-65b5ee52411a req-33b66cd5-de39-438a-9232-a037df7767cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11f439f-37e5-418a-a7aa-3ca9c705796c", "name": "network-vif-deleted", "tag": "a12a9ce9-d2b7-4d1f-8d19-920bcd9bdf4b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:11.965646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f12665b5-795d-413e-9017-65b5ee52411a req-33b66cd5-de39-438a-9232-a037df7767cf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:11.966242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f12665b5-795d-413e-9017-65b5ee52411a req-33b66cd5-de39-438a-9232-a037df7767cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:11.966834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f12665b5-795d-413e-9017-65b5ee52411a req-33b66cd5-de39-438a-9232-a037df7767cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:12.000118 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f12665b5-795d-413e-9017-65b5ee52411a req-33b66cd5-de39-438a-9232-a037df7767cf service nova] Creating event network-vif-deleted:a12a9ce9-d2b7-4d1f-8d19-920bcd9bdf4b for instance f11f439f-37e5-418a-a7aa-3ca9c705796c on n-h1-862404-2 Oct 28 18:26:12.008753 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f12665b5-795d-413e-9017-65b5ee52411a req-33b66cd5-de39-438a-9232-a037df7767cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065431 Oct 28 18:26:12.010202 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2907/4674] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:26:12.135634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:12.137452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:12.159071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:12.160391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:12.161257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:12.162828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:12.186141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:12.187236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:12.365574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:12.369480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:12.371508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:12.373179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lazy-loading 'fault' on Instance uuid f11f439f-37e5-418a-a7aa-3ca9c705796c {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:26:12.751331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fad202807ba744848541cb5770d68453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d095e53a0947459f9181d974314a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:12.773671 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3215a914-0687-4aa5-8be2-92ab5212ecca tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 200 len: 1306 microversion: 2.1 time: 0.638299 Oct 28 18:26:12.774519 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2908/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:12 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 1306 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:13.798494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:13.799700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] [instance: f11f439f-37e5-418a-a7aa-3ca9c705796c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:13.814003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:13.814643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:13.815633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:13.818049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:13.818743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:13.820987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:13.861249 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] HTTP exception thrown: Instance f11f439f-37e5-418a-a7aa-3ca9c705796c could not be found. Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Request method failure captured: Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c HTTP/1.1 Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB6mhsUx6sWZEUxLeS9i4y3SwoHOI-agxn5Usg9YPymLTVqRC0ulkGr3Fg9B92X1Tk6fCfeXOnCx0eOqML8yNVpyOUI5a4Z29cMUcuNCb_P7Ka6aQ0VaQUnYdZGvwKvrR_CNnG0XYP6MaZWWJ7S-l63wUan0QHwuczM0MUrdbELUtqI Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 25d095e53a0947459f9181d974314a1a Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerPasswordTestJSON-1647704043 Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25d095e53a0947459f9181d974314a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/25d095e53a0947459f9181d974314a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_25d095e53a0947459f9181d974314a1a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/25d095e53a0947459f9181d974314a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerPasswordTestJSON-1647704043 Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 25d095e53a0947459f9181d974314a1a Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1647704043 Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerPasswordTestJSON-1647704043-project Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: fad202807ba744848541cb5770d68453 Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerPasswordTestJSON-1647704043-project Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f11f439f-37e5-418a-a7aa-3ca9c705796c could not be found. Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f11f439f-37e5-418a-a7aa-3ca9c705796c'} Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11f439f-37e5-418a-a7aa-3ca9c705796c could not be found. Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11f439f-37e5-418a-a7aa-3ca9c705796c could not be found. Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:26:13.866002 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:26:13.870756 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:26:13.870756 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:26:13.870756 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:26:13.870756 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:26:13.870756 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:26:13.870756 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11f439f-37e5-418a-a7aa-3ca9c705796c could not be found. Oct 28 18:26:13.870756 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:26:13.872544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] Returning 404 to user: Instance f11f439f-37e5-418a-a7aa-3ca9c705796c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:26:13.874916 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cfceb517-c811-455b-ad2e-23008471aafe tempest-ServerPasswordTestJSON-1647704043 tempest-ServerPasswordTestJSON-1647704043-project] 10.222.0.16 "GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c" status: 404 len: 111 microversion: 2.1 time: 0.080563 Oct 28 18:26:13.879092 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2909/4676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:13 2022] GET /compute/v2.1/servers/f11f439f-37e5-418a-a7aa-3ca9c705796c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:26:14.595142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-171720488", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bcacda4-5a33-4117-a044-45aafb3b3d46"}], "security_groups": [{"name": "tempest-securitygroup--2033270127"}], "key_name": "tempest-keypair-1230540329", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:15.158399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] validate_networks() for [('0bcacda4-5a33-4117-a044-45aafb3b3d46', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:26:16.952322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:26:16.953636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:26:16.954119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:26:16.954604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:26:16.955165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:26:16.976848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:16.979537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:16.981097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:16.983761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:16.984859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:16.988943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:17.036194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:26:17.057078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for user e0cc266e44dd4f76a95a428bb3676b99 and project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:26:17.111109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:26:17.122761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:26:17.256910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fdb2c8df-d3f5-48a6-8f42-8024d516ee83 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.666426 Oct 28 18:26:17.260580 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2910/4677] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:26:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:26:17.273320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9905edb7-5bca-4d21-bed4-5f3a8a87cfa1 req-48d3f5c3-79ea-4c60-bfea-68aa368bcea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:17.320953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9905edb7-5bca-4d21-bed4-5f3a8a87cfa1 req-48d3f5c3-79ea-4c60-bfea-68aa368bcea1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:17.321929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9905edb7-5bca-4d21-bed4-5f3a8a87cfa1 req-48d3f5c3-79ea-4c60-bfea-68aa368bcea1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:17.322592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9905edb7-5bca-4d21-bed4-5f3a8a87cfa1 req-48d3f5c3-79ea-4c60-bfea-68aa368bcea1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:17.350935 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9905edb7-5bca-4d21-bed4-5f3a8a87cfa1 req-48d3f5c3-79ea-4c60-bfea-68aa368bcea1 service nova] Creating event network-changed:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:26:17.361450 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9905edb7-5bca-4d21-bed4-5f3a8a87cfa1 req-48d3f5c3-79ea-4c60-bfea-68aa368bcea1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099288 Oct 28 18:26:17.362466 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2911/4678] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:17.371288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4fd82d6f-7cac-41c4-8bae-e881ca0896cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:17.381686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4fd82d6f-7cac-41c4-8bae-e881ca0896cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:17.762097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fd82d6f-7cac-41c4-8bae-e881ca0896cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:17.782345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4fd82d6f-7cac-41c4-8bae-e881ca0896cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1241 microversion: 2.1 time: 0.415406 Oct 28 18:26:17.792836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2912/4679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:17 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1241 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:18.832032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:18.834780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:18.853202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:18.854143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:18.854807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:18.855784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:18.856658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:18.857304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:19.481145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:19.524273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ecfccad-ab9e-4a83-ba32-af66914d3b45 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1293 microversion: 2.1 time: 0.707486 Oct 28 18:26:19.529552 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2913/4680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:18 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1293 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:20.559600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:20.572651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:20.607528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:20.608766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:20.613901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:20.614773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:20.622031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:20.622756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:20.869652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:20.885529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-275d7d85-e6e6-4257-afa3-e83be9d290cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1299 microversion: 2.1 time: 0.328553 Oct 28 18:26:20.888286 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2914/4681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:20 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1299 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:21.104888 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:26:21.106241 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:26:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:26:21.913033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:21.913672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:21.934696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:21.935457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:21.936092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:21.937021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:21.937638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:21.938219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:22.091121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:22.155259 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c3b95175-1493-435d-aca8-68f169b91bd8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1299 microversion: 2.1 time: 0.203825 Oct 28 18:26:22.164609 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2915/4682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:21 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:23.188196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:23.189533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:23.204757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:23.205438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:23.206050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:23.206803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:23.207261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:23.207689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:23.726277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:23.740152 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8c57e2d-a0aa-4a71-b3dd-4e66a1a2c2e9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.555807 Oct 28 18:26:23.755734 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2916/4683] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:23 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:24.251380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:24.252389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:24.265643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:24.267104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:24.267759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:24.268770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:24.270257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:24.272568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:24.314126 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b305b08-e0c5-49b9-ac2a-af7195dd9b25 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/ips" status: 200 len: 153 microversion: 2.20 time: 0.557024 Oct 28 18:26:24.324549 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2917/4684] 10.222.0.16 () {60 vars in 1289 bytes} [Fri Oct 28 18:26:23 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/ips => generated 153 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:26:24.767065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:24.767695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:24.782147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:24.782654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:24.783272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:24.784030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:24.784684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:24.785294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:25.459538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:25.475114 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50bb521e-520f-4f88-b34f-d599b9710304 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.711866 Oct 28 18:26:25.482552 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2918/4685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:24 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:26.506992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:26.507686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:26.515807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:26.516330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:26.516961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:26.517923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:26.518554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:26.519376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:26.868865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:26.886216 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a639b911-7efa-485f-bb6b-bcf32782a237 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.384071 Oct 28 18:26:26.886841 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2919/4686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:26 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:27.324635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e0fe6d69-2fb0-4e38-a38c-587839c6c5fe req-a056534b-eadc-4f60-b9c0-9dbfcd687061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2297cd3-4ac6-4228-906b-ff4e283c5e23", "tag": "28fba93f-c96c-48b4-bc39-ee3b831b64a3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:27.407003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:27.411222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0fe6d69-2fb0-4e38-a38c-587839c6c5fe req-a056534b-eadc-4f60-b9c0-9dbfcd687061 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:27.412536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0fe6d69-2fb0-4e38-a38c-587839c6c5fe req-a056534b-eadc-4f60-b9c0-9dbfcd687061 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:27.413240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0fe6d69-2fb0-4e38-a38c-587839c6c5fe req-a056534b-eadc-4f60-b9c0-9dbfcd687061 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:27.440613 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e0fe6d69-2fb0-4e38-a38c-587839c6c5fe req-a056534b-eadc-4f60-b9c0-9dbfcd687061 service nova] Creating event network-changed:28fba93f-c96c-48b4-bc39-ee3b831b64a3 for instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 on n-h2-862404-2 Oct 28 18:26:27.451806 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e0fe6d69-2fb0-4e38-a38c-587839c6c5fe req-a056534b-eadc-4f60-b9c0-9dbfcd687061 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132406 Oct 28 18:26:27.453422 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2920/4687] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:27.801972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:27.812781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:27.813606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:27.836573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:27.840448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:27.841714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:27.842759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:27.844908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:27.845641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:27.974425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lazy-loading 'flavor' on Instance uuid 671f07d0-7909-448b-8511-d1f763e4dd16 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:26:28.195862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:28.437145 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a42484e-9759-47e9-b84e-41fcdcd3d933 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/action" status: 202 len: 0 microversion: 2.20 time: 0.636234 Oct 28 18:26:28.451580 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2921/4688] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:26:27 2022] POST /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:26:28.493929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:28.494674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:28.516702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:28.517214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:28.517658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:28.518377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:28.518872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:28.523409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:29.027115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:29.049783 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6812ad21-c358-4b21-8d12-f03724432098 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.593766 Oct 28 18:26:29.053253 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2922/4689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:28 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:29.068391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:29.077369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:29.098407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:29.105509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:29.107272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:29.109068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:29.112483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:29.113713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:29.414918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:29.431166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:29.434645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:29.437014 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6975309-9205-41ee-bd2b-2662ac1d8a42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1724 microversion: 2.20 time: 0.381569 Oct 28 18:26:29.437777 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2923/4690] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:29 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:30.079301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:30.080538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:30.094828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:30.096074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:30.099354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:30.101005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:30.102142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:30.103466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:30.444686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:30.456553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79fb1a8c-f302-4416-91a1-556c365a83e0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.380840 Oct 28 18:26:30.457078 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2924/4691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:30 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:30.489618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:30.490246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:30.506773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:30.507283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:30.507723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:30.512311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:30.512795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:30.513487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:30.976004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:30.986467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:30.990820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:30.994467 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0580cc7a-08af-4ae8-a366-e6825df36108 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1724 microversion: 2.20 time: 0.518393 Oct 28 18:26:30.997051 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2925/4692] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:30 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1724 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:31.485400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:31.485400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:31.490660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:31.491159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:31.505838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:31.506782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:31.523660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:31.523660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:31.978339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:31.997026 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72d36e4a-2179-47db-949f-e32cd9de03a8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.519930 Oct 28 18:26:32.000137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2926/4693] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:31 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:32.028392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:32.029187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:32.035393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:32.046814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:32.052771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:32.053235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:32.054001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:32.054466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:32.058943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:33.248115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:33.264937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:33.267239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:33.270334 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2c45502-29af-454e-baed-e722b41c98de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1724 microversion: 2.20 time: 1.246016 Oct 28 18:26:33.272634 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2927/4694] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:32 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1724 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:33.279407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:33.280493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:33.288687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:33.289798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:33.290549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:33.291443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:33.292176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:33.292770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:34.053172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:34.099585 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34667b57-01dd-410e-83aa-a4d1d51b5f28 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.819781 Oct 28 18:26:34.104025 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2928/4695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:33 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:34.303910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:34.305578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:34.330911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:34.334284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:34.336667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:34.340524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:34.343883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:34.346799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:35.174726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:35.190230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:35.193271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:35.197377 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eaeb23c9-38b8-4511-9f77-9bdb02608d20 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1724 microversion: 2.20 time: 0.900354 Oct 28 18:26:35.222245 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2929/4696] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:34 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1724 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:35.235800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:35.240169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:35.260624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:35.262112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:35.262741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:35.267112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:35.267864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:35.268511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:35.959352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:35.985010 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-16126839-c601-49fe-857b-c7bd2a8c431e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.760174 Oct 28 18:26:35.988678 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2930/4697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:35 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:36.232456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:36.233112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:36.287677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:36.288509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:36.290000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:36.294794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:36.296965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:36.298596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:36.927708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:36.950766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:36.952303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:36.953547 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed64c4b2-63bc-4a20-b51d-53f2088190b8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1724 microversion: 2.20 time: 0.726910 Oct 28 18:26:36.954120 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2931/4698] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:36 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1724 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:36.979760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8a319c30-a761-43a4-9a7b-c38a826ce864 req-6ed4e422-2c8a-4845-b271-dcd32c4997c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2297cd3-4ac6-4228-906b-ff4e283c5e23", "name": "network-vif-plugged", "status": "completed", "tag": "28fba93f-c96c-48b4-bc39-ee3b831b64a3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:37.011721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8a319c30-a761-43a4-9a7b-c38a826ce864 req-6ed4e422-2c8a-4845-b271-dcd32c4997c5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:37.012411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8a319c30-a761-43a4-9a7b-c38a826ce864 req-6ed4e422-2c8a-4845-b271-dcd32c4997c5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:37.012923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8a319c30-a761-43a4-9a7b-c38a826ce864 req-6ed4e422-2c8a-4845-b271-dcd32c4997c5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:37.033365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8a319c30-a761-43a4-9a7b-c38a826ce864 req-6ed4e422-2c8a-4845-b271-dcd32c4997c5 service nova] Creating event network-vif-plugged:28fba93f-c96c-48b4-bc39-ee3b831b64a3 for instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 on n-h2-862404-2 Oct 28 18:26:37.039805 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8a319c30-a761-43a4-9a7b-c38a826ce864 req-6ed4e422-2c8a-4845-b271-dcd32c4997c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084161 Oct 28 18:26:37.041412 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2932/4699] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:37.047296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:37.053951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:37.069548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:37.070443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:37.071119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:37.074928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:37.088039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:37.092935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:37.439651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:37.454079 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08665fb0-3529-49e5-bb0b-96ca6c2d5b10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.408937 Oct 28 18:26:37.470095 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2933/4700] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:37 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:37.985331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:37.985963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:37.997898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:38.002421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:38.003656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:38.004684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:38.011293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:38.012125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:38.467837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:38.484140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:38.486006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:38.487532 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-435aad2e-b621-4790-b38b-fe287e81b319 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1724 microversion: 2.20 time: 0.506959 Oct 28 18:26:38.488864 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2934/4701] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:37 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1724 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:38.494391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:38.495232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:38.507305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:38.508191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:38.508854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:38.509826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:38.510400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:38.510931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:38.802389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:38.819519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3eab3a63-c4ae-4e41-a59c-7df11147dc1a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1367 microversion: 2.1 time: 0.325704 Oct 28 18:26:38.821091 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2935/4702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:38 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:39.517178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:39.519159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:39.529862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:39.534035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:39.536564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:39.537549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:39.540259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:39.540948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:40.040230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:40.054665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:40.056181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:40.057418 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56a84e17-073d-4c47-a4e2-3a079605d3c4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1745 microversion: 2.20 time: 0.544436 Oct 28 18:26:40.061112 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2936/4703] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:39 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1745 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:40.078827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:40.082193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:40.103974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:40.104769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:40.105377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:40.106283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:40.109406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:40.110054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:40.666245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:40.752634 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-712bf76e-cffb-46da-9c5d-198993626b08 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1556 microversion: 2.1 time: 0.690087 Oct 28 18:26:40.757048 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2937/4704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:40 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1556 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:40.811183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:40.812344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:40.835494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:40.841808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:40.842646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:40.843645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:40.844661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:40.849935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:41.020845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b656aa4a-cd09-449e-9fe2-9f9aac9ed115 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.219715 Oct 28 18:26:41.021589 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2938/4705] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:26:40 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:41.091191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:41.092372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:41.102392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:41.111315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:41.112064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:41.113104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:41.113802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:41.115235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:41.149859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:42.203135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:42.213321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:42.222030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:42.228410 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7fcc371c-19ff-41fa-8cc8-f6a91bcd1d50 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1745 microversion: 2.20 time: 1.137942 Oct 28 18:26:42.230055 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2939/4706] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:41 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1745 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:26:43.262779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:43.264353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:43.293709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:43.296204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:43.297582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:43.301619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:43.302567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:43.303169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:44.958445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:45.004042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:45.013167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:45.022430 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 1.760527 Oct 28 18:26:45.026333 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2940/4707] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:43 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:45.029163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:45.031647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ed5c6de-6c1e-4dd7-9727-52db8639bbc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004314 Oct 28 18:26:45.032521 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2941/4708] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 18:26:45 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 18:26:45.943795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-656b775a-07e5-4fd1-bd0c-ac3ace44571d req-6f5b097c-f075-4b5c-bced-6ebc27f407cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2297cd3-4ac6-4228-906b-ff4e283c5e23", "tag": "28fba93f-c96c-48b4-bc39-ee3b831b64a3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:45.961271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-656b775a-07e5-4fd1-bd0c-ac3ace44571d req-6f5b097c-f075-4b5c-bced-6ebc27f407cf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:45.969126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-656b775a-07e5-4fd1-bd0c-ac3ace44571d req-6f5b097c-f075-4b5c-bced-6ebc27f407cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:45.969850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-656b775a-07e5-4fd1-bd0c-ac3ace44571d req-6f5b097c-f075-4b5c-bced-6ebc27f407cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:46.025032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-656b775a-07e5-4fd1-bd0c-ac3ace44571d req-6f5b097c-f075-4b5c-bced-6ebc27f407cf service nova] Creating event network-changed:28fba93f-c96c-48b4-bc39-ee3b831b64a3 for instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 on n-h2-862404-2 Oct 28 18:26:46.055142 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-656b775a-07e5-4fd1-bd0c-ac3ace44571d req-6f5b097c-f075-4b5c-bced-6ebc27f407cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116224 Oct 28 18:26:46.063929 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2942/4709] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:26:46.110122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:46.110852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:46.160811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:46.161321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:46.161768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:46.162497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:46.162959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:46.163394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:47.459333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:47.470901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:47.487442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:47.488921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c11a985-aac5-435a-8a58-3234c1dc8e29 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 1.424105 Oct 28 18:26:47.504174 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2943/4710] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:46 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:48.524989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:48.526358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:48.543296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:48.548870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:48.549653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:48.553719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:48.555401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:48.560377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:49.253636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:49.286453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:49.296474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:49.306956 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7c777a1-3297-46ff-9df6-5e922fbe92c1 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.782306 Oct 28 18:26:49.311443 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2944/4711] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:48 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:26:49.329319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1e28f8cd-77dc-4719-8a70-cb35be8ee646 req-85c50116-328e-4815-8970-484d6f13776c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671f07d0-7909-448b-8511-d1f763e4dd16", "name": "network-vif-plugged", "status": "completed", "tag": "62aa338b-fc02-4b9d-a878-dbe37a9d413f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:49.373678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1e28f8cd-77dc-4719-8a70-cb35be8ee646 req-85c50116-328e-4815-8970-484d6f13776c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:49.375321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1e28f8cd-77dc-4719-8a70-cb35be8ee646 req-85c50116-328e-4815-8970-484d6f13776c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:49.379575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1e28f8cd-77dc-4719-8a70-cb35be8ee646 req-85c50116-328e-4815-8970-484d6f13776c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:49.480183 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1e28f8cd-77dc-4719-8a70-cb35be8ee646 req-85c50116-328e-4815-8970-484d6f13776c service nova] Creating event network-vif-plugged:62aa338b-fc02-4b9d-a878-dbe37a9d413f for instance 671f07d0-7909-448b-8511-d1f763e4dd16 on n-h2-862404-2 Oct 28 18:26:49.510721 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1e28f8cd-77dc-4719-8a70-cb35be8ee646 req-85c50116-328e-4815-8970-484d6f13776c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193989 Oct 28 18:26:49.517953 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2945/4712] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:50.341674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:50.342680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:50.358905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:50.359431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:50.362380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:50.363403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:50.365416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:50.367189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:51.411404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:51.426357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:51.433373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:51.436995 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6e16f93-cd74-4753-8107-abf96e94323f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 1.099480 Oct 28 18:26:51.443063 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2946/4713] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:50 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:52.469806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:52.470586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:52.485866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:52.486397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:52.486872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:52.503762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:52.504769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:52.507487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:54.006448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:54.027172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:54.030337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:54.047929 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a54e17b-cc56-42ec-87f1-4e89b614aae9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 1.577326 Oct 28 18:26:54.048675 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2947/4714] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:52 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:55.082528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:55.083162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:55.100175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:55.101131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:55.102650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:55.104860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:55.105793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:55.107148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:55.465298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:55.480021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:55.485455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:55.488545 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56a6337c-7eaa-4700-a2fd-4e899737407b tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.413533 Oct 28 18:26:55.493419 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2948/4715] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:55 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:56.534771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:56.536176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:56.546759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:56.547398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:56.548672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:56.549410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:56.550298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:56.553604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:56.990587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:57.007744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:57.013953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:57.020980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a7bb384d-65c7-462b-8ea7-eb0688b3a867 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.495188 Oct 28 18:26:57.021693 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2949/4716] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:56 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:26:58.048044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:58.048807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:58.069011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:58.071171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:58.071746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:58.078370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:58.080420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:58.081341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:58.606869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:58.624406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:58.640748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:58.640983 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44f882f1-c059-43ea-8618-26cddc46af4c tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.597559 Oct 28 18:26:58.641652 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2950/4717] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:58 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:26:59.670580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:59.671237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:26:59.685075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:59.685579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:59.686024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:59.686756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:59.687221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:59.687998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:00.034282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:00.048085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:00.051312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:00.055001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9b6b9097-7532-4bee-b05f-59d46f4ac1ae tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.388344 Oct 28 18:27:00.078396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2951/4718] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:26:59 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:01.123733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:01.129415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:01.160819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:01.162529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:01.162982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:01.164393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:01.168264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:01.168982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:01.540037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:01.554932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:01.556885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:01.559044 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9b45c522-a8e5-41b1-93f4-8f28aa8819cf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.457545 Oct 28 18:27:01.569266 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2952/4719] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:01 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:02.617356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-686ff7d0-91d9-448d-8097-ac259878a6a5 tempest-ExtensionsTest-1385233884 tempest-ExtensionsTest-1385233884-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:02.630068 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-686ff7d0-91d9-448d-8097-ac259878a6a5 tempest-ExtensionsTest-1385233884 tempest-ExtensionsTest-1385233884-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.349298 Oct 28 18:27:02.634024 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2953/4720] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 18:27:02 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:27:02.649760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:02.656115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:02.675615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=50 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:02.679668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:02.683242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:02.683754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:02.686945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:02.692836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:02.693359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:03.317744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:03.455356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:03.460880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:03.464718 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4fa5f87f-6cfc-4e52-9558-223f1aada4cc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.828664 Oct 28 18:27:03.466237 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2954/4721] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:02 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:03.480938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2eca85f8-aa2c-4de1-89bf-5249fb7cb9ef tempest-ExtensionsTest-1385233884 tempest-ExtensionsTest-1385233884-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:03.483541 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2eca85f8-aa2c-4de1-89bf-5249fb7cb9ef tempest-ExtensionsTest-1385233884 tempest-ExtensionsTest-1385233884-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.016128 Oct 28 18:27:03.488577 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2955/4722] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 18:27:03 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:27:04.500487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:04.501541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:04.521702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:04.523396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:04.527875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:04.532658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:04.533247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:04.534625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:05.509975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:05.530709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:05.534301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:05.536549 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4297926f-2927-4056-82f2-5ce59d0dc721 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 1.041478 Oct 28 18:27:05.538004 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2956/4723] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:04 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:06.571939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:06.573415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:06.600239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:06.601101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:06.602705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:06.605009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:06.606082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:06.608081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:07.506662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:07.520460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:07.526964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:07.528751 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0cd6d57-a797-491e-9427-ee29cc0ade0e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.965945 Oct 28 18:27:07.529563 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2957/4724] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:06 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:08.562441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:08.564190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:08.577941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:08.579103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:08.580218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:08.581944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:08.585436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:08.586083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:09.324594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:09.344781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:09.349315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:09.350565 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da08eac4-936c-40d8-a2de-2fb59f1593d6 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.792462 Oct 28 18:27:09.351380 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2958/4725] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:08 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:10.382964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:10.383757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:10.398136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:10.398638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:10.399083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:10.399802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:10.408160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:10.409153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:10.979734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:10.989181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:10.990650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:11.000873 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64bf3965-1993-4452-91a7-578627d19835 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.622333 Oct 28 18:27:11.002060 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2959/4726] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:10 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:12.031160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:12.031956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:12.042086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:12.045777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:12.047109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:12.048843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:12.052463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:12.052941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:12.087001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:12.630351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:12.661070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:12.663303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:12.667199 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60f04ee0-3e2c-4be8-adf1-b0ed7bf33f9f tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.640495 Oct 28 18:27:12.673505 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2960/4727] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:12 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:13.701049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:13.702361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:13.718312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:13.719120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:13.719739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:13.720670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:13.721606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:13.722499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:14.151918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:14.166408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:14.168326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:14.172272 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-834018dc-504d-49e2-9af4-24b7b9048d7e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.475129 Oct 28 18:27:14.180631 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2961/4728] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:13 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:15.207590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:15.220769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:15.243733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:15.252353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:15.253119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:15.254196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:15.254834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:15.255440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:16.764133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:16.774211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:16.782420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:16.789566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b539031b-3167-43d5-91fc-718bb2b7e5ac tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 1.586451 Oct 28 18:27:16.792997 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2962/4729] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:15 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:17.025071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:17.027699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:17.079189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:17.079686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:17.088353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:17.089344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:17.090476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:17.092345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:17.630369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:17.638088 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d971c8b-7b0f-41a2-8352-0e5fd0cbfbd9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.616962 Oct 28 18:27:17.638698 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2963/4730] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:17 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:17.669460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:17.684594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:17.692039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:17.692802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:17.693602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:17.694516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:17.695149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:17.696037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:18.014579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:18.023398 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1dfda1b2-ffb4-4740-a9d1-045004ef4f8c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.358107 Oct 28 18:27:18.040627 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2964/4731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:17 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:18.067838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:18.068464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:18.102631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:18.103144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:18.103597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:18.104357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:18.108911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:18.110561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:18.534592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:18.548997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:18.553819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:18.556659 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78d106fb-1565-4f23-8650-89094a8bebc9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1740 microversion: 2.20 time: 0.508628 Oct 28 18:27:18.559020 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2965/4732] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:18 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1740 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:18.569977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:18.570856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:18.593976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:18.594874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:18.599619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:18.600712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:18.601605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:18.602260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:18.899755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:18.915592 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-770cd271-fd8e-400a-9c6c-a9816dd3a64d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.353470 Oct 28 18:27:18.922177 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2966/4733] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:18 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:18.948281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1042539958"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:18.951091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:18.961842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:18.962598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:18.963227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:18.986432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:18.988922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:18.988922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:19.729888 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0e64f9b-7151-442c-b47c-d8b5afd0da35 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.782839 Oct 28 18:27:19.735564 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2967/4734] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:27:18 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 18:27:19.757361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:19.758110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:19.778935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:19.787506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:19.792840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:19.793824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:19.794874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:19.795472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:20.636671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:20.649947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:20.656205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:20.660777 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f16c82ea-5538-4ece-b8df-af032c8991a8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1722 microversion: 2.20 time: 0.919299 Oct 28 18:27:20.708974 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2968/4735] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:19 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1722 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:20.729904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:20.738402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:20.759173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:20.763288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:20.765048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:20.766161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:20.790571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:20.791324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:20.862539 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8b767add-00f3-480d-a8f1-32e946176f68 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/ips" status: 200 len: 148 microversion: 2.1 time: 0.152200 Oct 28 18:27:20.863445 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2969/4736] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:27:20 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/ips => generated 148 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:27:21.474966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c637822-a58b-4dea-b44a-0e5187c2ca2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'create', calling method: .version_select at 0x7f78de21b670>, body: {"keypair": {"name": "tempest-keypair-1497725991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH9HiL11nGEHbsPTWHPkdQ0Ak+rTG90rUTQKjW96wET12yi994bGwuf2QgL0FVzOYITfVB1iCtCdt6Vb4FILTE4pSzrOY8dCo3vdw8xuQ5jewKC1X9TJ6odUTLEFGC87g=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:21.575048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9c637822-a58b-4dea-b44a-0e5187c2ca2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Getting quotas for project 4d262ef5fd724b1faee11c815b7f1b65. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:27:21.593829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9c637822-a58b-4dea-b44a-0e5187c2ca2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Getting quotas for user 830f18fef1d1434697a2c552ade4b793 and project 4d262ef5fd724b1faee11c815b7f1b65. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:27:21.645416 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c637822-a58b-4dea-b44a-0e5187c2ca2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.684010 Oct 28 18:27:21.646844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2970/4737] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:27:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:27:21.693802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:21.694898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:21.721642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:21.722453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:21.723088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:21.724458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:21.725376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:21.726760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:22.623276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:22.639528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:22.648538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:22.650080 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a0e6403b-f8b1-4931-b779-c43d52c47b92 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1722 microversion: 2.20 time: 0.961559 Oct 28 18:27:22.654911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2971/4738] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:21 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1722 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:22.976122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-feae0cfe-e5e5-415b-85dc-83b9011ee9f0 req-a8a01f6e-7eb6-4204-9735-243b9aeb2242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671f07d0-7909-448b-8511-d1f763e4dd16", "name": "network-vif-unplugged", "status": "completed", "tag": "62aa338b-fc02-4b9d-a878-dbe37a9d413f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:23.043898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-feae0cfe-e5e5-415b-85dc-83b9011ee9f0 req-a8a01f6e-7eb6-4204-9735-243b9aeb2242 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:23.044269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-feae0cfe-e5e5-415b-85dc-83b9011ee9f0 req-a8a01f6e-7eb6-4204-9735-243b9aeb2242 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:23.046552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-feae0cfe-e5e5-415b-85dc-83b9011ee9f0 req-a8a01f6e-7eb6-4204-9735-243b9aeb2242 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:23.105208 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-feae0cfe-e5e5-415b-85dc-83b9011ee9f0 req-a8a01f6e-7eb6-4204-9735-243b9aeb2242 service nova] Creating event network-vif-unplugged:62aa338b-fc02-4b9d-a878-dbe37a9d413f for instance 671f07d0-7909-448b-8511-d1f763e4dd16 on n-h2-862404-2 Oct 28 18:27:23.121079 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-feae0cfe-e5e5-415b-85dc-83b9011ee9f0 req-a8a01f6e-7eb6-4204-9735-243b9aeb2242 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149223 Oct 28 18:27:23.124511 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2972/4739] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:27:23.711602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:23.711602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:23.743323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:23.743857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:23.749347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:23.751782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:23.753043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:23.760763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:24.834353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:24.854203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:24.855754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:24.857044 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-384723bf-4e37-4e67-811b-7188821dabf7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1725 microversion: 2.20 time: 1.158576 Oct 28 18:27:24.867069 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2973/4740] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:23 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1725 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:24.886553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbb90888-c708-41e5-86b6-085633a7737b"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:24.903015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:24.920112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:24.920354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:24.920803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:24.928680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:24.933213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:24.937349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:25.693345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:25.700332 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6d58c59-2315-4ecb-9b3b-4ea3c63d90fb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.818221 Oct 28 18:27:25.702688 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2974/4741] 10.222.0.16 () {62 vars in 1364 bytes} [Fri Oct 28 18:27:24 2022] POST /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/os-volume_attachments => generated 188 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:27:25.710121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1339422120", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6abc3248-9953-4ca1-b9c8-297ec8cf13bc"}], "security_groups": [{"name": "tempest-securitygroup--1604348756"}], "key_name": "tempest-keypair-1497725991", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:25.920659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] validate_networks() for [('6abc3248-9953-4ca1-b9c8-297ec8cf13bc', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:27:26.974641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:27:26.981307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:27:26.981906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:27:26.982426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:27:26.982855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:27:26.998351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:26.998847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:26.999487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:27.000439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:27.001083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:27.001688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:27.046997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Getting quotas for project 4d262ef5fd724b1faee11c815b7f1b65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:27:27.063527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Getting quotas for user 830f18fef1d1434697a2c552ade4b793 and project 4d262ef5fd724b1faee11c815b7f1b65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:27:27.100540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:27:27.103698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:27:27.223179 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d5c53f9-1b60-4528-a344-5cf05c3b19eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.518373 Oct 28 18:27:27.225808 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2975/4742] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:27:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:27:27.243746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e4c0a49-940f-4d2b-819d-b208182f6257"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:27.246950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:27.266982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:27.268362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:27.269342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:27.270326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:27.271774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:27.276299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:27.789874 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f50cbed6-5a63-4f07-9bd4-f37727059fc3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561856 Oct 28 18:27:27.791036 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2976/4743] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:27:27 2022] POST /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:27:27.800365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:27.801684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:27.810344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:27.811577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:27.812865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:27.814088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:27.814835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:27.815435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:28.529936 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f678aa74-7ff7-40d0-a798-c54cf326ccd7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/os-volume_attachments/cbb90888-c708-41e5-86b6-085633a7737b" status: 202 len: 0 microversion: 2.20 time: 0.735910 Oct 28 18:27:28.536320 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2977/4744] 10.222.0.16 () {60 vars in 1457 bytes} [Fri Oct 28 18:27:27 2022] DELETE /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/os-volume_attachments/cbb90888-c708-41e5-86b6-085633a7737b => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:27:28.567684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:28.570609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:28.593454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:28.594424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:28.598038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:28.601236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:28.602184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:28.602853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:28.868895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:28.881535 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db4e9184-234f-4dc9-8da3-525a215121aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1242 microversion: 2.1 time: 0.339727 Oct 28 18:27:28.886591 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2978/4745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:28 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1242 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:28.896619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:28.901043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:28.913110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:28.913956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:28.914616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:28.917288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:28.919277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:28.919958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:29.000944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120680) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 28 18:27:29.195710 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39a38584-86b1-4e8f-ba9d-db121e651a03 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "POST /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/action" status: 202 len: 0 microversion: 2.20 time: 0.307669 Oct 28 18:27:29.200396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2979/4746] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 18:27:28 2022] POST /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:27:29.211193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:29.219405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:29.248755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:29.254520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:29.255254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:29.258838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:29.259556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:29.262236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:29.848625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:29.871167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:29.873837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:29.875264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82d68f23-a20c-49ec-863e-18889b44c637 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1673 microversion: 2.20 time: 0.668047 Oct 28 18:27:29.888874 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2980/4747] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:29 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1673 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:29.974723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:29.977942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:30.010054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:30.016249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:30.017186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:30.022643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:30.025417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:30.026688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:30.197023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:30.206680 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7138860f-70d9-4bdd-85ad-b0a0e2aae79e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1308 microversion: 2.1 time: 0.295224 Oct 28 18:27:30.217298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2981/4748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:29 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:30.903802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:30.905067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:30.923358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:30.927167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:30.928330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:30.933127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:30.935420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:30.935780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:31.392126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:31.404527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:31.406966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:31.408721 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8ab17fb-a839-4467-b530-4a57bf8901de tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1673 microversion: 2.20 time: 0.509984 Oct 28 18:27:31.409917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2982/4749] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:30 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1673 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:31.420831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-40acc212-3eaf-4528-b55c-a3dfc1529247 req-d6a6fc6e-96ec-46cf-8013-950df4f2f117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "name": "network-vif-plugged", "status": "completed", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:31.462900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40acc212-3eaf-4528-b55c-a3dfc1529247 req-d6a6fc6e-96ec-46cf-8013-950df4f2f117 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:31.463795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40acc212-3eaf-4528-b55c-a3dfc1529247 req-d6a6fc6e-96ec-46cf-8013-950df4f2f117 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:31.467326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40acc212-3eaf-4528-b55c-a3dfc1529247 req-d6a6fc6e-96ec-46cf-8013-950df4f2f117 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:31.522062 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-40acc212-3eaf-4528-b55c-a3dfc1529247 req-d6a6fc6e-96ec-46cf-8013-950df4f2f117 service nova] Creating event network-vif-plugged:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:27:31.548280 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-40acc212-3eaf-4528-b55c-a3dfc1529247 req-d6a6fc6e-96ec-46cf-8013-950df4f2f117 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133495 Oct 28 18:27:31.553988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2983/4750] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:27:31.582508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:31.584634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:31.608248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:31.615495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:31.618858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:31.622509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:31.623275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:31.626570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:31.995842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:32.013465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b312a2d-1fc9-45c5-aa96-5703cce32318 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1296 microversion: 2.1 time: 0.455449 Oct 28 18:27:32.029327 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2984/4751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:31 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1296 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:32.440518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:32.441368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:32.473205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:32.478923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:32.480834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:32.482393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:32.485919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:32.487584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:32.842641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:32.857794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:32.862226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:32.871952 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91893120-f82a-449c-8eba-7f790acdd889 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.436670 Oct 28 18:27:32.872936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2985/4752] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:32 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:33.045775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:33.047246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:33.052378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:33.067536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:33.068700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:33.069393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:33.070365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:33.071066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:33.072463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:33.394139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:33.409738 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8f763dc3-69c7-4807-abe5-2260cee52fa1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.368859 Oct 28 18:27:33.427201 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2986/4753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:33 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:27:33.904444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:33.907857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:33.938190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:33.941382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:33.960684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:33.974284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:33.977251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:33.977809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:34.546516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:34.551029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:UPDATE=8,nova_cell1:SELECT=88,nova_cell1:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:34.556806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:34.570060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:34.588467 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87a0b5f9-ba0c-4955-a70a-18c9af5c4522 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.684610 Oct 28 18:27:34.589135 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2987/4754] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:33 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:34.631266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:34.646611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:34.691960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:34.692443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:34.692904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:34.693643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:34.694116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:34.695012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:35.088835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:35.099209 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3540bc0-7942-4b6e-af62-c622ca69494c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.501395 Oct 28 18:27:35.100171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2988/4755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:34 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:35.619137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:35.620845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:35.628319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:35.629126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:35.629948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:35.631139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:35.631785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:35.632572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:36.054124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:36.074205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:36.076213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:36.077667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35c5fedc-f039-4d9a-b09e-8d5ff83e1f35 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.462756 Oct 28 18:27:36.103023 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2989/4756] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:35 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:36.126632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:36.128987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:36.161071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:36.161713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:36.164041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:36.164821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:36.165297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:36.165735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:36.622615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:36.631032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0f16f47-ab54-42ea-91a2-6e0e28a04172 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.508240 Oct 28 18:27:36.649866 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2990/4757] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:36 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:36.677231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-def5442b-1192-4fd8-9582-dd66c11c918c req-db0ad1b9-b1a3-4d32-b84c-e41f177427b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9f698-5ba3-475b-ba38-5a97256e8c9a", "tag": "b0ee2a93-a3f4-4fb0-b883-eef9ab10b963"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:36.696695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-def5442b-1192-4fd8-9582-dd66c11c918c req-db0ad1b9-b1a3-4d32-b84c-e41f177427b4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:36.697193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-def5442b-1192-4fd8-9582-dd66c11c918c req-db0ad1b9-b1a3-4d32-b84c-e41f177427b4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:36.699189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-def5442b-1192-4fd8-9582-dd66c11c918c req-db0ad1b9-b1a3-4d32-b84c-e41f177427b4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:36.737739 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-def5442b-1192-4fd8-9582-dd66c11c918c req-db0ad1b9-b1a3-4d32-b84c-e41f177427b4 service nova] Creating event network-changed:b0ee2a93-a3f4-4fb0-b883-eef9ab10b963 for instance cca9f698-5ba3-475b-ba38-5a97256e8c9a on n-h1-862404-2 Oct 28 18:27:36.759294 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-def5442b-1192-4fd8-9582-dd66c11c918c req-db0ad1b9-b1a3-4d32-b84c-e41f177427b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107432 Oct 28 18:27:36.761920 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2991/4758] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:27:37.104217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:37.107502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:37.113859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:37.119342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:37.148524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:37.149554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:37.160788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:37.163704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:37.168770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:37.171297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:37.704244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:37.719134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:37.725137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:37.728376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-252e1f00-f325-4c61-9e1f-e8aae9033b5a tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.625258 Oct 28 18:27:37.747318 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2992/4759] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:37 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:37.765874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:37.769114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:37.796696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:37.806572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:37.807779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:37.813791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:37.815723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:37.817310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:38.190521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:38.198893 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-463fc2b0-943e-41b0-8489-a622e9466ce7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.449991 Oct 28 18:27:38.199496 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2993/4760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:37 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:38.765451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:38.766276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:38.781251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:38.781757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:38.782206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:38.782932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:38.796847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:38.797321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:39.576584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:39.589939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:39.598490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:39.599749 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31b589fc-c808-4f70-bf96-cb9536c8eed7 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.838984 Oct 28 18:27:39.602295 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2994/4761] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:38 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:39.622252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:39.631337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:39.651638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:39.656517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:39.657323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:39.663256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:39.665628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:39.668638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:40.170116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:40.190876 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e3877a9-59ac-44bf-947f-0cfee414a8c6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.582885 Oct 28 18:27:40.200490 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2995/4762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:39 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:40.629549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:40.630457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:40.654371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:40.657854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:40.659162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:40.664753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:40.666426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:40.667343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:41.323423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:41.335409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:41.344341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:41.347540 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d53b2f1-581d-41d8-b0cd-46211743f8d2 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.722393 Oct 28 18:27:41.370331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2996/4763] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:40 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:41.375940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:41.378828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:41.421256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:41.423271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:41.424513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:41.426584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:41.428294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:41.430071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:42.000081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:42.012212 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5b9e516f-4f8a-463d-8f10-9dd23624df01 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.640320 Oct 28 18:27:42.013137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2997/4764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:41 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:42.379167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:42.379918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:42.408559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:42.409138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:42.409629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:42.410579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:42.411077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:42.411507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:43.084092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:43.105346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:43.117194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:43.123508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9547306b-afcf-46f0-86d8-7534bde288f0 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.748315 Oct 28 18:27:43.148774 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2998/4765] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:42 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:43.155706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:43.166538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:43.200062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:43.201010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:43.202652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:43.203593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:43.208273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:43.209632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:43.864511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:43.896407 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8e0d718-2621-48a6-9767-f9cc377ba40e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.727504 Oct 28 18:27:43.900364 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2999/4766] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:43 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:44.169427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:44.170338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:44.210586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:44.211605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:44.214940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:44.215942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:44.216559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:44.219581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:44.895456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:44.918315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:44.923064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:44.932724 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b17ed23-8d7b-4d86-b339-d4a8438e2adc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.777255 Oct 28 18:27:44.933643 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3000/4767] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:44 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:44.955937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:44.956580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:44.982652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:44.983507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:44.990706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:44.992818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:44.994204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:44.997538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:45.440848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:45.450082 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-88bb93e3-41a5-4f61-b856-fbff494d9ca1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.514517 Oct 28 18:27:45.456259 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3001/4768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:44 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:45.936053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-84a7dd1e-7d8c-4b08-b9f4-74753ed31e52 req-be0ffdd5-341c-4f84-a90c-b5d7866a0332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9f698-5ba3-475b-ba38-5a97256e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "b0ee2a93-a3f4-4fb0-b883-eef9ab10b963"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:45.986049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-84a7dd1e-7d8c-4b08-b9f4-74753ed31e52 req-be0ffdd5-341c-4f84-a90c-b5d7866a0332 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:45.989364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-84a7dd1e-7d8c-4b08-b9f4-74753ed31e52 req-be0ffdd5-341c-4f84-a90c-b5d7866a0332 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:45.993986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-84a7dd1e-7d8c-4b08-b9f4-74753ed31e52 req-be0ffdd5-341c-4f84-a90c-b5d7866a0332 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:46.077709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-84a7dd1e-7d8c-4b08-b9f4-74753ed31e52 req-be0ffdd5-341c-4f84-a90c-b5d7866a0332 service nova] Creating event network-vif-plugged:b0ee2a93-a3f4-4fb0-b883-eef9ab10b963 for instance cca9f698-5ba3-475b-ba38-5a97256e8c9a on n-h1-862404-2 Oct 28 18:27:46.095245 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-84a7dd1e-7d8c-4b08-b9f4-74753ed31e52 req-be0ffdd5-341c-4f84-a90c-b5d7866a0332 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162912 Oct 28 18:27:46.106958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3002/4769] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:27:46.130258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:46.131041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:46.175121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:46.175612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:46.176042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:46.196230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:46.196230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:46.196230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:46.663289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:46.685559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:46.695163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:46.701575 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bdce29ee-0ce5-4059-b209-a35ea05351b3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.593309 Oct 28 18:27:46.705520 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3003/4770] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:46 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:46.728724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:46.729643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:46.763915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:46.764469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:46.764929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:46.765836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:46.783622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:46.785395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:47.273370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:47.289368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33a96975-13e1-419b-a38f-94032f0e3ba0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1364 microversion: 2.1 time: 0.579128 Oct 28 18:27:47.295643 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3004/4771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:46 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1364 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:47.732628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:47.733531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:47.749729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:47.750509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:47.751141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:47.752365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:47.753016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:47.755069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:48.226597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:48.230812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:48.244530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:48.247565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:48.261725 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-737c1b20-1095-481a-9a98-30d0b4341cdd tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.533088 Oct 28 18:27:48.262987 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3005/4772] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:47 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:48.321396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:48.322833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:48.333768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:48.334550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:48.336355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:48.337287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:48.340278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:48.341202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:48.807979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:48.827412 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ea19a2c-8fc8-4f7c-ac28-590a325717a1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1551 microversion: 2.1 time: 0.506996 Oct 28 18:27:48.828113 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3006/4773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:48 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1551 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:27:48.854657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:48.862948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:48.879491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:48.880041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:48.880489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:48.881220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:48.881688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:48.882172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:49.080106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-484b6003-91a7-4a49-8fa2-9393965394b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229604 Oct 28 18:27:49.081634 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3007/4774] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:27:48 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:27:49.301971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:49.302756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:49.337425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:49.340329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:49.343757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:49.344903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:49.346122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:49.348226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:49.808712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:49.830742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:49.832934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:49.836708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2b05fe8-c57d-4717-928c-e1bcb7d010f9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.539313 Oct 28 18:27:49.841609 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3008/4775] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:49 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:50.874773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:50.875457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:50.935469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:50.945846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:50.946318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:50.950409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:50.953589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:50.954422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:51.599662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:51.612933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:51.622882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:51.632764 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-955f7cc5-be16-431f-b859-78555b255ebf tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.761428 Oct 28 18:27:51.633685 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3009/4776] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:50 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:51.654615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91029807-388f-47bc-b4bc-b9309a8a8236 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: .version_select at 0x7f78de0eed30>, body: {"keypair": {"name": "tempest-keypair-2085445572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtfd7tHzH+yezru+MRGsLyc2MkgqD1fgzWNorNdVzgxtFPo8NaEHkdRUtG1VqSw8kemeoK8//eOFy8UtCOAojfn7rqJNbZZf/ElCH4v+CLl8LSefQj0CmjN5ES46rxQUA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:51.687015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-91029807-388f-47bc-b4bc-b9309a8a8236 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:27:51.693981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-91029807-388f-47bc-b4bc-b9309a8a8236 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for user e0cc266e44dd4f76a95a428bb3676b99 and project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:27:51.758150 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91029807-388f-47bc-b4bc-b9309a8a8236 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121933 Oct 28 18:27:51.761292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3010/4777] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:27:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:27:52.671320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:52.675683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:52.714851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:52.716001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:52.718011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:52.719218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:52.725236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:52.727109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:53.142917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:53.163924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:53.168171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:53.171582 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d1fb0769-acf0-44be-bb6f-cd0353959dd9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.507929 Oct 28 18:27:53.174705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3011/4778] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:52 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:53.182333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-01cfa302-6c5c-412a-b1fd-710f9c7e8df8 req-261d1b7d-c1c6-45a4-8aa6-de915c053943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9f698-5ba3-475b-ba38-5a97256e8c9a", "tag": "b0ee2a93-a3f4-4fb0-b883-eef9ab10b963"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:53.207852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01cfa302-6c5c-412a-b1fd-710f9c7e8df8 req-261d1b7d-c1c6-45a4-8aa6-de915c053943 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:53.211287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01cfa302-6c5c-412a-b1fd-710f9c7e8df8 req-261d1b7d-c1c6-45a4-8aa6-de915c053943 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:53.212674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01cfa302-6c5c-412a-b1fd-710f9c7e8df8 req-261d1b7d-c1c6-45a4-8aa6-de915c053943 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:53.246026 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-01cfa302-6c5c-412a-b1fd-710f9c7e8df8 req-261d1b7d-c1c6-45a4-8aa6-de915c053943 service nova] Creating event network-changed:b0ee2a93-a3f4-4fb0-b883-eef9ab10b963 for instance cca9f698-5ba3-475b-ba38-5a97256e8c9a on n-h1-862404-2 Oct 28 18:27:53.283316 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-01cfa302-6c5c-412a-b1fd-710f9c7e8df8 req-261d1b7d-c1c6-45a4-8aa6-de915c053943 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106941 Oct 28 18:27:53.290246 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3012/4779] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:27:54.207192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:54.208138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:54.240919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:54.243727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:54.247668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:54.250326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:54.257536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:54.258126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:54.662936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:54.675051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:54.677471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:54.683857 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6655d8a-6c23-4198-ae61-d21e3b8c3b91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.484849 Oct 28 18:27:54.701706 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3013/4780] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:54 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:27:55.710892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:55.711563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:55.732962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:55.738418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:55.739558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:55.742287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:55.745515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:55.748690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:57.107782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:57.117984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:57.128023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:57.129700 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a5bb853-0ec2-41b8-916e-ab44c0cadc42 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 1.422954 Oct 28 18:27:57.131497 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3014/4781] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:55 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:58.065542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:58.066535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:58.097845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:58.098359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:58.098896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:58.103929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:58.104433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:58.119945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:58.493038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:58.500774 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3e274f2-d03b-4b40-bf9c-5e066f66b0c5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.442139 Oct 28 18:27:58.505058 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3015/4782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:27:58 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:27:58.528857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:58.530235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:27:58.564656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:58.569388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:58.570165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:58.573311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:58.575722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:58.576550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:59.083835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:59.093720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:59.103219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:27:59.114713 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ebb12b4f-7d2f-40d7-8d5e-6871d6cd1aad tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.603082 Oct 28 18:27:59.126324 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3016/4783] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:27:58 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:27:59.155366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1948138268", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bcacda4-5a33-4117-a044-45aafb3b3d46"}], "security_groups": [{"name": "tempest-securitygroup--2026979047"}], "key_name": "tempest-keypair-2085445572", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:27:59.491880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] validate_networks() for [('0bcacda4-5a33-4117-a044-45aafb3b3d46', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:28:00.313050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:28:00.315564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:28:00.316513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:28:00.317123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:28:00.317942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:28:00.334769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:00.335517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:00.336839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:00.338499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:00.340339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:00.346181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:00.437270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:28:00.445923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for user e0cc266e44dd4f76a95a428bb3676b99 and project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:28:00.492964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:28:00.508952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:28:00.653507 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86d29d32-e3af-4d5b-b372-39a36d1231a9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.518323 Oct 28 18:28:00.655161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3017/4784] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:27:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:28:00.675589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:00.680024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:00.697998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:00.702098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:00.702749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:00.703637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:00.705666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:00.706350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:01.343241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:01.365152 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-604ccae6-eab0-42dd-a6af-8ca959286944 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.706142 Oct 28 18:28:01.368098 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3018/4785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:00 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:01.402003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:01.404006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:01.413986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:01.414943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:01.415905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:01.417528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:01.418265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:01.419327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:02.144614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:02.189996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:02.194392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:02.196126 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97fb46b2-4514-4bc7-a309-373c93a502fa tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.825105 Oct 28 18:28:02.213757 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3019/4786] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:01 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:02.236729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:02.243768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:02.265479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:02.268414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:02.271123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:02.275707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:02.276539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:02.277899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:02.532396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:02.557290 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d05fb547-13e1-4c9e-a1f9-f051def18b16 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1238 microversion: 2.1 time: 0.334870 Oct 28 18:28:02.579087 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3020/4787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:02 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1238 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:02.589320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-443292404"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:02.601318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:02.616060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:02.619797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:02.620541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:02.621584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:02.622868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:02.623537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:03.415508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-74589622-31f8-490b-b17b-ea910e075464 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.834144 Oct 28 18:28:03.423917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3021/4788] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:28:02 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 18:28:03.451978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:03.455640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:03.467232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:03.493903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:03.495199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:03.496417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:03.502444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:03.503065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:03.503604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:03.888384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:03.898993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:03.900798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:03.902227 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76f1f846-3fa8-40d9-87b6-3b31ea301d59 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.471185 Oct 28 18:28:03.903306 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3022/4789] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:03 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:03.912626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4bfc0ab9-5041-4aa2-81fc-8d230688ded4 req-82901fd7-10cd-40df-bdc0-6ef53738da4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "name": "network-vif-unplugged", "status": "completed", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:03.937635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4bfc0ab9-5041-4aa2-81fc-8d230688ded4 req-82901fd7-10cd-40df-bdc0-6ef53738da4a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:03.938322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4bfc0ab9-5041-4aa2-81fc-8d230688ded4 req-82901fd7-10cd-40df-bdc0-6ef53738da4a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:03.938946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4bfc0ab9-5041-4aa2-81fc-8d230688ded4 req-82901fd7-10cd-40df-bdc0-6ef53738da4a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:04.003150 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4bfc0ab9-5041-4aa2-81fc-8d230688ded4 req-82901fd7-10cd-40df-bdc0-6ef53738da4a service nova] Creating event network-vif-unplugged:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:28:04.026677 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4bfc0ab9-5041-4aa2-81fc-8d230688ded4 req-82901fd7-10cd-40df-bdc0-6ef53738da4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116947 Oct 28 18:28:04.034530 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3023/4790] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:04.043914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:04.076083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:04.095389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:04.096539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:04.098374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:04.099417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:04.100201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:04.102833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:04.162602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:04.254120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:04.276973 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-beb0bf0b-b231-49b9-a566-98c6ad74be90 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1300 microversion: 2.1 time: 0.234357 Oct 28 18:28:04.277945 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3024/4791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:04 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:04.937416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:04.942553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:04.976363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:04.977240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:04.977881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:04.979258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:04.980384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:05.019545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:05.327258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:05.337092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:05.340819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:05.346151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2983981c-de67-47a4-8fc1-2a0a92d9e8c8 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.414617 Oct 28 18:28:05.347640 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3025/4792] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:04 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:05.356066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:05.356953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:05.369677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:05.370353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:05.373877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:05.374850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:05.389798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:05.390247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:05.784942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:05.797993 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c3775b2-ffe6-4e64-9bc1-d1aa21880012 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1368 microversion: 2.1 time: 0.444814 Oct 28 18:28:05.802109 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3026/4793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:05 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:06.379654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:06.380512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:06.398852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:06.399496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:06.401060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:06.401901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:06.404210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:06.404815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:07.646951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:07.661460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:07.671625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:07.673290 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-659bee9c-850f-43de-849b-2c5b1b343770 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 1.298660 Oct 28 18:28:07.674227 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3027/4794] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:06 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:07.685102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:07.685831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:07.727388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:07.728025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:07.728487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:07.729236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:07.731439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:07.733847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:08.031247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:08.042553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34a723b9-e964-4db0-939c-e7767d5e97e4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1368 microversion: 2.1 time: 0.366880 Oct 28 18:28:08.058311 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3028/4795] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:07 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:08.069155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e997b13b-2c3e-4eba-afbd-3634dcedcf50 req-c71f021b-8bfb-4ce8-b34f-33d139273163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "196979b7-42a0-44ee-a9b8-33099e5937af", "tag": "ddca39ab-ecdc-4e3f-98f5-5992c696a6b3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:08.086268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e997b13b-2c3e-4eba-afbd-3634dcedcf50 req-c71f021b-8bfb-4ce8-b34f-33d139273163 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:08.087135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e997b13b-2c3e-4eba-afbd-3634dcedcf50 req-c71f021b-8bfb-4ce8-b34f-33d139273163 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:08.087791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e997b13b-2c3e-4eba-afbd-3634dcedcf50 req-c71f021b-8bfb-4ce8-b34f-33d139273163 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:08.103956 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e997b13b-2c3e-4eba-afbd-3634dcedcf50 req-c71f021b-8bfb-4ce8-b34f-33d139273163 service nova] Creating event network-changed:ddca39ab-ecdc-4e3f-98f5-5992c696a6b3 for instance 196979b7-42a0-44ee-a9b8-33099e5937af on n-h1-862404-2 Oct 28 18:28:08.110190 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e997b13b-2c3e-4eba-afbd-3634dcedcf50 req-c71f021b-8bfb-4ce8-b34f-33d139273163 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050474 Oct 28 18:28:08.111863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3029/4796] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:08.223906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-968d4efc-6d10-4bf8-809c-ab3c2b9c655f req-4c172e50-012e-4f3b-88b4-63bc0ba66d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671f07d0-7909-448b-8511-d1f763e4dd16", "name": "network-vif-plugged", "status": "completed", "tag": "62aa338b-fc02-4b9d-a878-dbe37a9d413f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:08.247936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-968d4efc-6d10-4bf8-809c-ab3c2b9c655f req-4c172e50-012e-4f3b-88b4-63bc0ba66d69 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:08.248860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-968d4efc-6d10-4bf8-809c-ab3c2b9c655f req-4c172e50-012e-4f3b-88b4-63bc0ba66d69 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:08.249464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-968d4efc-6d10-4bf8-809c-ab3c2b9c655f req-4c172e50-012e-4f3b-88b4-63bc0ba66d69 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:08.272489 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-968d4efc-6d10-4bf8-809c-ab3c2b9c655f req-4c172e50-012e-4f3b-88b4-63bc0ba66d69 service nova] Creating event network-vif-plugged:62aa338b-fc02-4b9d-a878-dbe37a9d413f for instance 671f07d0-7909-448b-8511-d1f763e4dd16 on n-h2-862404-2 Oct 28 18:28:08.284762 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-968d4efc-6d10-4bf8-809c-ab3c2b9c655f req-4c172e50-012e-4f3b-88b4-63bc0ba66d69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067696 Oct 28 18:28:08.285390 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3030/4797] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:28:08.712390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:08.713106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:08.729591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:08.738844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:08.739871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:08.741517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:08.744425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:08.745043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:09.045413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:09.078081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:09.081697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:09.083503 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf56ca2e-4941-42bf-8253-deb1fd5531bc tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.375859 Oct 28 18:28:09.084852 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3031/4798] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:08 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:09.090995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:09.092580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:09.115717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:09.117371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:09.118020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:09.126672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:09.130499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:09.138770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:09.468829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:09.489971 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4f2c33c-b306-43a3-a607-1280120c6a2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1368 microversion: 2.1 time: 0.403283 Oct 28 18:28:09.490808 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3032/4799] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:09 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1368 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:10.116371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:10.117948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:10.125919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:10.127109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:10.131240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:10.132082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:10.132802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:10.133414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:10.372599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:10.385535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:10.395126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:10.398365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdc8e40b-cf86-4afc-bade-5b66b25f4d81 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.288624 Oct 28 18:28:10.400224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3033/4800] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:10 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:10.427394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-81fba955-a524-4b5e-80bb-54c6d66e064a req-86884aba-fe99-4c48-b884-3a45ea14cf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "name": "network-vif-plugged", "status": "completed", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:10.442430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:10.447701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81fba955-a524-4b5e-80bb-54c6d66e064a req-86884aba-fe99-4c48-b884-3a45ea14cf3e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:10.450593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81fba955-a524-4b5e-80bb-54c6d66e064a req-86884aba-fe99-4c48-b884-3a45ea14cf3e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:10.451988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81fba955-a524-4b5e-80bb-54c6d66e064a req-86884aba-fe99-4c48-b884-3a45ea14cf3e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:10.478449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:10.483930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-81fba955-a524-4b5e-80bb-54c6d66e064a req-86884aba-fe99-4c48-b884-3a45ea14cf3e service nova] Creating event network-vif-plugged:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:28:10.496563 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-81fba955-a524-4b5e-80bb-54c6d66e064a req-86884aba-fe99-4c48-b884-3a45ea14cf3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090497 Oct 28 18:28:10.499396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3034/4801] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:10.515065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:10.518079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:10.529531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:10.530662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:10.533351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:10.535309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:10.536132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:10.536768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:10.831991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:10.856164 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4845794d-0806-488c-8099-9dc417a16113 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1368 microversion: 2.1 time: 0.344064 Oct 28 18:28:10.856983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3035/4802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:10 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1368 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:11.429958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:11.430581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:11.450835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:11.451646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:11.452056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:11.453799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:11.454309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:11.454869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:11.980752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:11.993728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:11.998994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:12.003994 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-667b342d-d43f-4932-9ea3-c150f1067d91 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1731 microversion: 2.20 time: 0.578271 Oct 28 18:28:12.005172 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3036/4803] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:11 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1731 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:28:12.018505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:12.019375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:12.044194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:12.044947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:12.045698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:12.046720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:12.048946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:12.049865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:12.408480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:12.421784 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f709c4aa-15e7-4f20-92d0-47701d6cbb6b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1368 microversion: 2.1 time: 0.415303 Oct 28 18:28:12.422490 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3037/4804] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:12 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1368 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:13.041076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:13.041828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:13.068358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:13.073019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:13.073743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:13.075961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:13.077314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:13.080670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:13.317448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:13.326072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:13.327559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:13.328781 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea312ba8-5db2-47ac-8ed5-d06b6e458473 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1718 microversion: 2.20 time: 0.293604 Oct 28 18:28:13.329400 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3038/4805] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:13 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1718 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:13.448253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:13.448941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:13.461346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:13.461834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:13.462310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:13.471118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:13.473883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:13.474352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:13.805882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:13.820959 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5ff9bed-5f4f-4e85-9d36-bf92a0e7296e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1368 microversion: 2.1 time: 0.377143 Oct 28 18:28:13.822545 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3039/4806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:13 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1368 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:13.833353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d1428fb6-4a54-4807-b048-fa4f61280113 req-d45b6405-bb11-409c-abb9-2a39143606e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "196979b7-42a0-44ee-a9b8-33099e5937af", "name": "network-vif-plugged", "status": "completed", "tag": "ddca39ab-ecdc-4e3f-98f5-5992c696a6b3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:13.855230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d1428fb6-4a54-4807-b048-fa4f61280113 req-d45b6405-bb11-409c-abb9-2a39143606e6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:13.858323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d1428fb6-4a54-4807-b048-fa4f61280113 req-d45b6405-bb11-409c-abb9-2a39143606e6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:13.859926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d1428fb6-4a54-4807-b048-fa4f61280113 req-d45b6405-bb11-409c-abb9-2a39143606e6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:13.882856 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d1428fb6-4a54-4807-b048-fa4f61280113 req-d45b6405-bb11-409c-abb9-2a39143606e6 service nova] Creating event network-vif-plugged:ddca39ab-ecdc-4e3f-98f5-5992c696a6b3 for instance 196979b7-42a0-44ee-a9b8-33099e5937af on n-h1-862404-2 Oct 28 18:28:13.891768 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d1428fb6-4a54-4807-b048-fa4f61280113 req-d45b6405-bb11-409c-abb9-2a39143606e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065798 Oct 28 18:28:13.896958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3040/4807] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:14.854730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:14.858017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:14.884162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:14.885080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:14.885796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:14.886840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:14.888296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:14.889006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:15.097805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:15.107324 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d518748d-0448-40c1-8312-53a124bceb94 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1368 microversion: 2.1 time: 0.258990 Oct 28 18:28:15.108512 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3041/4808] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:14 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:16.132623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:16.133977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:16.151077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:16.151695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:16.152355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:16.153196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:16.153885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:16.154669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:16.413364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:16.430430 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2caafb8-3cfe-43b1-9568-6b0033eeb600 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1557 microversion: 2.1 time: 0.302039 Oct 28 18:28:16.431609 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3042/4809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:16 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1557 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:16.467527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:16.468357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:16.477388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:16.478148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:16.478832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:16.479865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:16.480680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:16.481492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:16.641387 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39ad4f0f-617e-473b-b784-4af73fc19e3a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190739 Oct 28 18:28:16.642937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3043/4810] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:28:16 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:28:19.645926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0c4e30a9-030a-4a78-a203-5e04ace38e0a req-aee3918c-f2d9-4243-82dd-485e32cd8b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "196979b7-42a0-44ee-a9b8-33099e5937af", "tag": "ddca39ab-ecdc-4e3f-98f5-5992c696a6b3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:19.668791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0c4e30a9-030a-4a78-a203-5e04ace38e0a req-aee3918c-f2d9-4243-82dd-485e32cd8b8c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:19.669272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0c4e30a9-030a-4a78-a203-5e04ace38e0a req-aee3918c-f2d9-4243-82dd-485e32cd8b8c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:19.674229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0c4e30a9-030a-4a78-a203-5e04ace38e0a req-aee3918c-f2d9-4243-82dd-485e32cd8b8c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:19.682769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:19.730661 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0c4e30a9-030a-4a78-a203-5e04ace38e0a req-aee3918c-f2d9-4243-82dd-485e32cd8b8c service nova] Creating event network-changed:ddca39ab-ecdc-4e3f-98f5-5992c696a6b3 for instance 196979b7-42a0-44ee-a9b8-33099e5937af on n-h1-862404-2 Oct 28 18:28:19.746251 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0c4e30a9-030a-4a78-a203-5e04ace38e0a req-aee3918c-f2d9-4243-82dd-485e32cd8b8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105823 Oct 28 18:28:19.747428 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3044/4811] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:27.031624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1156492711", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "ed8bebbd-a002-488d-a8ce-9806b9a6907e"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:35.273393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] validate_networks() for [('ed8bebbd-a002-488d-a8ce-9806b9a6907e', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:28:35.785758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:28:35.786243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:28:35.786736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:28:35.787256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:28:35.787698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:28:35.790472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=48 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:35.805579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:35.806036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:35.806495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:35.807364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:35.807866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:35.808323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:35.826707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Getting quotas for project c28ead94884144e886dcec198860b961. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:28:35.834437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Getting quotas for user c636558f6e8f47a3b128bd795a56cac9 and project c28ead94884144e886dcec198860b961. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:28:35.850362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:28:35.852996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:28:35.913186 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-868518ac-fc00-4232-834f-48fb9b3db452 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.140957 Oct 28 18:28:35.915300 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3045/4812] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:28:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 9144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:28:35.924038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:35.927999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:35.951956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:35.952676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:35.953121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:35.955790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:35.957134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:35.958483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:36.177260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:36.189276 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0a5c0b5-9295-4354-8fd9-59a3ae13a32d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.271632 Oct 28 18:28:36.196684 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3046/4813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:35 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:36.206600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-15e3320d-4b9a-4a31-9ba4-7d5ae44f769e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:36.207226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-15e3320d-4b9a-4a31-9ba4-7d5ae44f769e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:36.270557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-15e3320d-4b9a-4a31-9ba4-7d5ae44f769e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:36.284816 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-15e3320d-4b9a-4a31-9ba4-7d5ae44f769e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1214 microversion: 2.1 time: 0.086526 Oct 28 18:28:36.286266 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3047/4814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:36 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:36.690988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-226461008", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "ec2bf803-5ee0-42e8-af96-37d8e7899a02"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:36.809229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] validate_networks() for [('ec2bf803-5ee0-42e8-af96-37d8e7899a02', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:28:37.246380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:28:37.247021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:28:37.247665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:28:37.248272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:28:37.248822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:28:37.260039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:37.260907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:37.261458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:37.262277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:37.262848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:37.263402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:37.283147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Getting quotas for project dad644e20fe3442bb7b487829a18e35a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:28:37.288966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Getting quotas for user aa928cab270e439b9030f07ed4899554 and project dad644e20fe3442bb7b487829a18e35a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:28:37.304167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:28:37.306651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:28:37.374409 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35e08dcc-36da-4de0-885c-551e3f933f6c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689208 Oct 28 18:28:37.375778 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3048/4815] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:28:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:28:37.381231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:37.383039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:37.391626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:37.392592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:37.393212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:37.394151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:37.394834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:37.395462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:37.604743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:37.624537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e751dc5d-3568-427a-b04f-4e38cd3ade26 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.247271 Oct 28 18:28:37.625395 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3049/4816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:37 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:37.632021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:37.632938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:37.640104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:37.640975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:37.642701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:37.643666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:37.644566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:37.645228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:37.736151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:37.744464 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b6198a6-461e-45f6-8293-cab64161131e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1272 microversion: 2.1 time: 0.116728 Oct 28 18:28:37.756065 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3050/4817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:37 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:37.762207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-46de2410-d1cd-409d-8fee-2c442e2c556b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:37.763020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-46de2410-d1cd-409d-8fee-2c442e2c556b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:37.839024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-46de2410-d1cd-409d-8fee-2c442e2c556b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:37.848924 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-46de2410-d1cd-409d-8fee-2c442e2c556b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1218 microversion: 2.1 time: 0.089741 Oct 28 18:28:37.849919 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3051/4818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:37 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:37.855506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1862232766"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:37.858381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:37.868923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:37.869975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:37.870631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:37.872084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:37.872711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:37.873364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:38.130485 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3c2c2b1-15a3-464e-8898-b1291342c354 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.278836 Oct 28 18:28:38.131995 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3052/4819] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:28:37 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 18:28:38.143520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:38.145334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:38.153843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:38.154817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:38.156219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:38.157641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:38.158268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:38.158803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:38.358629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:38.370277 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99d44f10-eef1-499f-817f-314c1e021613 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.233749 Oct 28 18:28:38.386567 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3053/4820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:38 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:38.771192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:38.778465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:38.796102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:38.796616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:38.797123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:38.799913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:38.800406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:38.800847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:38.970236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:38.979718 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0200045c-c2cf-47f1-8a7a-d326b51ab9f9 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.215226 Oct 28 18:28:38.981169 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3054/4821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:38 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:38.986796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:38.987922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:38.995209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:38.997408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:38.998885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:38.999834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:39.001177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:39.001803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:39.090338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:39.100171 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-115fcb90-7dcd-4f9d-b6c2-c331a02040c5 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1270 microversion: 2.1 time: 0.117492 Oct 28 18:28:39.101118 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3055/4822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:38 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:39.399949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:39.401292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:39.415063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:39.415887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:39.416588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:39.420183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:39.420901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:39.421517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:39.752909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:39.792476 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-23c11c74-23b0-45f6-9931-caf3563de302 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.397814 Oct 28 18:28:39.793537 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3056/4823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:39 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:39.817925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0d70401a-3f7f-4493-9238-9b93416110db req-75d0f903-0668-4d78-a54a-dfda6212f2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "name": "network-vif-unplugged", "status": "completed", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:39.857291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d70401a-3f7f-4493-9238-9b93416110db req-75d0f903-0668-4d78-a54a-dfda6212f2a7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:39.858570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d70401a-3f7f-4493-9238-9b93416110db req-75d0f903-0668-4d78-a54a-dfda6212f2a7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:39.859241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d70401a-3f7f-4493-9238-9b93416110db req-75d0f903-0668-4d78-a54a-dfda6212f2a7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:39.877983 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0d70401a-3f7f-4493-9238-9b93416110db req-75d0f903-0668-4d78-a54a-dfda6212f2a7 service nova] Creating event network-vif-unplugged:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:28:39.888476 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0d70401a-3f7f-4493-9238-9b93416110db req-75d0f903-0668-4d78-a54a-dfda6212f2a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082004 Oct 28 18:28:39.890195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3057/4824] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:39.898619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9ee936ee-2341-4052-a363-136f2c286686 req-8ee3ce5d-6772-4f04-890b-63a9bd725221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade342e6-bfcf-4e42-91e7-20efc080ba35", "tag": "30307a3a-b3d6-4c59-a62c-3ee1137a1c34"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:39.915405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9ee936ee-2341-4052-a363-136f2c286686 req-8ee3ce5d-6772-4f04-890b-63a9bd725221 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:39.916384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9ee936ee-2341-4052-a363-136f2c286686 req-8ee3ce5d-6772-4f04-890b-63a9bd725221 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:39.917383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9ee936ee-2341-4052-a363-136f2c286686 req-8ee3ce5d-6772-4f04-890b-63a9bd725221 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:39.933896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9ee936ee-2341-4052-a363-136f2c286686 req-8ee3ce5d-6772-4f04-890b-63a9bd725221 service nova] Creating event network-changed:30307a3a-b3d6-4c59-a62c-3ee1137a1c34 for instance ade342e6-bfcf-4e42-91e7-20efc080ba35 on n-h2-862404-2 Oct 28 18:28:39.940120 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9ee936ee-2341-4052-a363-136f2c286686 req-8ee3ce5d-6772-4f04-890b-63a9bd725221 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046900 Oct 28 18:28:39.941601 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3058/4825] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:40.009385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:40.010131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:40.018288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:40.018778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:40.019352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:40.020090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:40.020547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:40.020975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:40.284667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:40.296177 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f13a16e9-208f-46d5-9c47-2b1d96df4bf1 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.289539 Oct 28 18:28:40.308274 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3059/4826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:40 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:40.319589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:40.320245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:40.327470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:40.328036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:40.329516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:40.330890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:40.332432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:40.333018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:40.575024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:40.584253 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e18c040-889c-443b-ab3e-4526226f3be8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1318 microversion: 2.1 time: 0.274684 Oct 28 18:28:40.585093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3060/4827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:40 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:40.820662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:40.821809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:40.829643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:40.830392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:40.831003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:40.832285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:40.833032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:40.833391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:40.991080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:40.999996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-14719f8d-dd73-46e0-9ada-347e934407fb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.183236 Oct 28 18:28:41.001782 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3061/4828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:40 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:41.323927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:41.324632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:41.333569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:41.334071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:41.334519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:41.335234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:41.335696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:41.336150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:41.502786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:41.513336 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-971fb508-43d3-40ed-a64d-b843a5a5cf8f tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.193204 Oct 28 18:28:41.530438 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3062/4829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:41 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:41.612591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:41.614028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:41.624100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:41.627087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:41.627792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:41.629031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:41.632995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:41.633764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:42.096609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:42.110310 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce979838-d75d-4579-8f80-12f0cefe692b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1318 microversion: 2.1 time: 0.502707 Oct 28 18:28:42.111008 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3063/4830] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:41 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:42.137575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:42.138115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:42.159315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:42.161306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:42.163180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:42.164835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:42.166763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:42.168512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:42.792276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:42.800298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:42.807252 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d83800f3-66da-4700-afce-68a0e06ae407 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1689 microversion: 2.1 time: 0.677550 Oct 28 18:28:42.808172 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3064/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:42 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1689 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:42.817120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:42.819059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:42.832290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:42.833748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:42.840613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:42.841636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:42.842216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:42.843215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:43.132098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:43.145107 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-415af5b2-3892-4bec-a272-116aceb7373d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.335603 Oct 28 18:28:43.145727 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3065/4832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:42 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:43.150950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:43.151862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:43.158485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:43.159261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:43.160098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:43.161146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:43.161608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:43.162036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:43.378524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:43.386891 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d4565c0c-c7e3-4a7a-b702-5be41949c0c6 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1318 microversion: 2.1 time: 0.240039 Oct 28 18:28:43.404107 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3066/4833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:43 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:43.474601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f7b077ce-0504-4727-886c-1c89d5da34b0 req-e1bc4ddd-d10a-402c-b9eb-72f13c28abea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1291cee3-3f73-48f9-82ec-decaee6028e4", "tag": "f330ef4c-ef5f-4ef4-9d24-004d74034d44"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:43.490108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f7b077ce-0504-4727-886c-1c89d5da34b0 req-e1bc4ddd-d10a-402c-b9eb-72f13c28abea service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:43.490771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f7b077ce-0504-4727-886c-1c89d5da34b0 req-e1bc4ddd-d10a-402c-b9eb-72f13c28abea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:43.491319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f7b077ce-0504-4727-886c-1c89d5da34b0 req-e1bc4ddd-d10a-402c-b9eb-72f13c28abea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:43.519368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f7b077ce-0504-4727-886c-1c89d5da34b0 req-e1bc4ddd-d10a-402c-b9eb-72f13c28abea service nova] Creating event network-changed:f330ef4c-ef5f-4ef4-9d24-004d74034d44 for instance 1291cee3-3f73-48f9-82ec-decaee6028e4 on n-h2-862404-2 Oct 28 18:28:43.525635 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f7b077ce-0504-4727-886c-1c89d5da34b0 req-e1bc4ddd-d10a-402c-b9eb-72f13c28abea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055095 Oct 28 18:28:43.526619 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3067/4834] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:28:43.838360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:43.839234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:43.850120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:43.850855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:43.851457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:43.853280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:43.854331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:43.854791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:44.122816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:44.136782 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d956530d-ea5c-4b8c-b2e0-b4824b395108 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1689 microversion: 2.1 time: 0.306475 Oct 28 18:28:44.138180 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3068/4835] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:43 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1689 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:44.183066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:44.185303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:44.203988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:44.206713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:44.208159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:44.208932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:44.209404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:44.210187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:44.393153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:44.402477 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5d850a4-a27a-4e44-b721-6c087ddaf62a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.233518 Oct 28 18:28:44.403718 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3069/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:44 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:44.422041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:44.423794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:44.433932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:44.434434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:44.434878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:44.435594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:44.436087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:44.436516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:44.613947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:44.623206 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-89fa8045-dfd8-450a-adcd-a9e275190fa8 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1318 microversion: 2.1 time: 0.204980 Oct 28 18:28:44.639524 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3070/4837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:44 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:45.169003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:45.170265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:45.178531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:45.179348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:45.180040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:45.181143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:45.181800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:45.182562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:45.545577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:45.578090 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a0445e3a-de8a-40d0-b608-3fc49afeb01f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1689 microversion: 2.1 time: 0.417829 Oct 28 18:28:45.591930 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3071/4838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:45 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1689 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:45.610876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:45.612814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:45.623596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:45.642523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:45.643649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:45.645737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:45.646769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:45.650514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.095612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:46.109706 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8413f10b-8f23-4881-bbbe-d8421e4a3ac5 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.516164 Oct 28 18:28:46.113790 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3072/4839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:45 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:46.124968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:46.126822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:46.155456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.156138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.156705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.158042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.158505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.159509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.416712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:46.429823 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-83ebbfcb-f389-4b4c-b9f5-48898d77e9fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1318 microversion: 2.1 time: 0.310124 Oct 28 18:28:46.430940 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3073/4840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:46 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:46.437250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-25d9061c-6df4-4d1c-bc5c-6e6af50412d1 req-cc94a3ac-bcd2-4ac4-bd04-a6331dbe86da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "name": "network-vif-plugged", "status": "completed", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:46.461715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25d9061c-6df4-4d1c-bc5c-6e6af50412d1 req-cc94a3ac-bcd2-4ac4-bd04-a6331dbe86da service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.462649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25d9061c-6df4-4d1c-bc5c-6e6af50412d1 req-cc94a3ac-bcd2-4ac4-bd04-a6331dbe86da service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.463325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-25d9061c-6df4-4d1c-bc5c-6e6af50412d1 req-cc94a3ac-bcd2-4ac4-bd04-a6331dbe86da service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.478126 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-25d9061c-6df4-4d1c-bc5c-6e6af50412d1 req-cc94a3ac-bcd2-4ac4-bd04-a6331dbe86da service nova] Creating event network-vif-plugged:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:28:46.486774 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-25d9061c-6df4-4d1c-bc5c-6e6af50412d1 req-cc94a3ac-bcd2-4ac4-bd04-a6331dbe86da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051220 Oct 28 18:28:46.488084 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3074/4841] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:46.500985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:46.504408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:46.512632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.513472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.514143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.515071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.515744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.517103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.560573 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38460334-d7c6-4b27-84ae-50ad177e2710 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070553 Oct 28 18:28:46.561431 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3075/4842] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 18:28:46 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:46.626027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:46.627007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:46.634900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.635493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.636808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.638237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.638870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.639474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.824181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:46.854284 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-190db22b-a5ab-4604-b761-93e994821fa2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1689 microversion: 2.1 time: 0.239528 Oct 28 18:28:46.854891 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3076/4843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:46 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1689 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:46.866096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:46.870034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:46.881784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.882230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.883122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.884361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:46.885011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:46.885445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:46.930296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:28:47.042580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:47.055428 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7fc2250-d5d6-4e4c-9e61-c0ebcbdb0dc3 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 204 len: 0 microversion: 2.20 time: 0.194814 Oct 28 18:28:47.057260 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3077/4844] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:28:46 2022] DELETE /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:28:47.068726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:47.069474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:47.076467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:47.076975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:47.077567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:47.078297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:47.079632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:47.080803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:47.235547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:47.249023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:47.249023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:47.249298 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-584b514f-fa44-4b5e-b7f8-13c31d4b0c64 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1724 microversion: 2.20 time: 0.186988 Oct 28 18:28:47.252298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3078/4845] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:47 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 18:28:47.258240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:47.259029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:47.266245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:47.267074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:47.267736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:47.268934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:47.274162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:47.274676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:47.275224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:47.421838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:47.431187 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf82a551-85af-476c-aebe-38acb8d4ee9a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.177431 Oct 28 18:28:47.431899 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3079/4846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:47 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:47.454641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:47.455297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:47.461739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:47.462224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:47.462663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:47.463354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:47.463810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:47.464252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:47.618547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:47.627564 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd448914-2595-4208-9f4d-5fdd95cd6770 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1318 microversion: 2.1 time: 0.177100 Oct 28 18:28:47.640473 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3080/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:47 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:47.879731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:47.880553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:47.883961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=16 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:47.890073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:47.890976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:47.893410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:47.895788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:47.896548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:47.898177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:47.909527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:48.115954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:48.124951 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0bf8514-71f8-4443-8509-3e811e9921ad tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1689 microversion: 2.1 time: 0.250795 Oct 28 18:28:48.126646 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3081/4848] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:47 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:48.283557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:48.284601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:48.293620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:48.294540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:48.296400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:48.298674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:48.299491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:48.300349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:48.505327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:48.519943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:48.521526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:48.522744 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d856062-a17b-47cd-afe6-e084fe8d4e11 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1724 microversion: 2.20 time: 0.247792 Oct 28 18:28:48.523327 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3082/4849] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:48 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:48.538983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:48.540000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:48.548671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:48.549686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:48.550221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:48.551176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:48.552354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:48.553771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:48.789684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:48.798072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d0b10ce-d367-43a9-82be-a67dec1bb759 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.273672 Oct 28 18:28:48.803082 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3083/4850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:48 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:48.813620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d1766d52-4135-4fbb-bbc1-d6c6717bcafe req-71aa9170-ff71-46df-af81-0d5c4bfff432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade342e6-bfcf-4e42-91e7-20efc080ba35", "name": "network-vif-plugged", "status": "completed", "tag": "30307a3a-b3d6-4c59-a62c-3ee1137a1c34"}, {"server_uuid": "1291cee3-3f73-48f9-82ec-decaee6028e4", "name": "network-vif-plugged", "status": "completed", "tag": "f330ef4c-ef5f-4ef4-9d24-004d74034d44"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:48.825730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d1766d52-4135-4fbb-bbc1-d6c6717bcafe req-71aa9170-ff71-46df-af81-0d5c4bfff432 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:48.826226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d1766d52-4135-4fbb-bbc1-d6c6717bcafe req-71aa9170-ff71-46df-af81-0d5c4bfff432 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:48.826672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d1766d52-4135-4fbb-bbc1-d6c6717bcafe req-71aa9170-ff71-46df-af81-0d5c4bfff432 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:48.842552 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d1766d52-4135-4fbb-bbc1-d6c6717bcafe req-71aa9170-ff71-46df-af81-0d5c4bfff432 service nova] Creating event network-vif-plugged:30307a3a-b3d6-4c59-a62c-3ee1137a1c34 for instance ade342e6-bfcf-4e42-91e7-20efc080ba35 on n-h2-862404-2 Oct 28 18:28:48.843219 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d1766d52-4135-4fbb-bbc1-d6c6717bcafe req-71aa9170-ff71-46df-af81-0d5c4bfff432 service nova] Creating event network-vif-plugged:f330ef4c-ef5f-4ef4-9d24-004d74034d44 for instance 1291cee3-3f73-48f9-82ec-decaee6028e4 on n-h2-862404-2 Oct 28 18:28:48.853636 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d1766d52-4135-4fbb-bbc1-d6c6717bcafe req-71aa9170-ff71-46df-af81-0d5c4bfff432 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052758 Oct 28 18:28:48.854595 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3084/4851] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:48.864381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:48.865303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:48.887624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:48.888172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:48.888624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:48.889349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:48.896655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:48.897163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:49.284903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:49.295535 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-66138cd1-acfb-4071-a2a5-75eb1a4ae758 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1318 microversion: 2.1 time: 0.439613 Oct 28 18:28:49.296159 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3085/4852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:48 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:49.319570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:49.320957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:49.327527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:49.328331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:49.329599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:49.330410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:49.330871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:49.331305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:49.560348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:49.570666 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd4f290d-c673-453b-af2a-f9818adb7f79 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1689 microversion: 2.1 time: 0.260549 Oct 28 18:28:49.571298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3086/4853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:49 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1689 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:49.587101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:49.588223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:49.599429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:49.600134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:49.600572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:49.601275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:49.601731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:49.602154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:49.720269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:49.733895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:49.736562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:49.739262 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6337fad5-bb1c-4dac-af85-1fd6db006975 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1657 microversion: 2.20 time: 0.164419 Oct 28 18:28:49.740254 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3087/4854] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:49 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1657 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:49.824980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:49.826008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:49.836668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:49.837517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:49.838145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:49.839244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:49.840403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:49.840849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:50.097660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:50.121646 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30c02d08-51ac-47a9-b308-15e02783bc06 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1314 microversion: 2.1 time: 0.292340 Oct 28 18:28:50.137088 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3088/4855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:49 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:50.145835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b0c4cc8b-0ccb-4a66-869f-eac11ac73ab2 req-15f9336f-f76f-498f-b556-bca4f38e7013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671f07d0-7909-448b-8511-d1f763e4dd16", "name": "network-vif-deleted", "tag": "62aa338b-fc02-4b9d-a878-dbe37a9d413f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:28:50.156120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b0c4cc8b-0ccb-4a66-869f-eac11ac73ab2 req-15f9336f-f76f-498f-b556-bca4f38e7013 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:50.156370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b0c4cc8b-0ccb-4a66-869f-eac11ac73ab2 req-15f9336f-f76f-498f-b556-bca4f38e7013 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:50.156869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b0c4cc8b-0ccb-4a66-869f-eac11ac73ab2 req-15f9336f-f76f-498f-b556-bca4f38e7013 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:50.169622 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b0c4cc8b-0ccb-4a66-869f-eac11ac73ab2 req-15f9336f-f76f-498f-b556-bca4f38e7013 service nova] Creating event network-vif-deleted:62aa338b-fc02-4b9d-a878-dbe37a9d413f for instance 671f07d0-7909-448b-8511-d1f763e4dd16 on n-h2-862404-2 Oct 28 18:28:50.178855 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b0c4cc8b-0ccb-4a66-869f-eac11ac73ab2 req-15f9336f-f76f-498f-b556-bca4f38e7013 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039941 Oct 28 18:28:50.180656 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3089/4856] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:28:50.324338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:50.325445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:50.339511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:50.340046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:50.340502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:50.341231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:50.341698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:50.342162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:50.627437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:50.655499 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-62ff1dc2-7b2b-4cb0-84cc-8198022a77a0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1318 microversion: 2.1 time: 0.336103 Oct 28 18:28:50.657092 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3090/4857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:50 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:50.676431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:50.677411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:50.708635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:50.709291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:50.709807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:50.711179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:50.712196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:50.714472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:50.914929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:50.925476 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07207b72-b629-4ba3-9693-b77284b0fdf5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.263723 Oct 28 18:28:50.945203 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3091/4858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:50 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:50.951362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:50.952245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:50.960088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:50.960826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:50.961672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:50.963232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:50.964089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:50.965050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:51.007214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:51.008009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:51.008702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:51.009534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lazy-loading 'fault' on Instance uuid 671f07d0-7909-448b-8511-d1f763e4dd16 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:28:51.079312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:51.087246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:51.088731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd438d70603114d2e8e9e6bbf9fb96991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9840a126cf845f49cd9c80b8cc61c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:51.089919 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13feab40-86d0-496c-9871-90302da8102e tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 200 len: 1371 microversion: 2.20 time: 0.142883 Oct 28 18:28:51.090553 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3092/4859] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:50 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 18:28:51.151358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:51.152014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:51.163379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:51.164563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:51.166802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:51.170959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:51.172711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:51.174445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:51.474409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:51.492607 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6112e88-f727-41dd-a1ba-d701abee6f60 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1499 microversion: 2.1 time: 0.345845 Oct 28 18:28:51.509100 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3093/4860] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:51 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1499 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:51.682563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:51.683983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:51.697003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:51.699095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:51.701704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:51.704313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:51.707105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:51.708077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:52.028933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:52.044155 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5447da80-9571-4fa6-be00-4a84c31f1124 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1507 microversion: 2.1 time: 0.365211 Oct 28 18:28:52.060376 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3094/4861] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:51 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:52.129664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:52.130211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:52.169813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:52.170322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:52.170765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:52.171487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:52.172030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:52.172476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:52.539754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:52.551743 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69d87efe-f536-447b-90b1-3d20d2c9daba tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.489933 Oct 28 18:28:52.552463 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3095/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:52 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:52.575578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:52.576439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:52.592710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:52.593229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:52.593680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:52.595936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:52.596441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:52.596886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:52.635025 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] HTTP exception thrown: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Request method failure captured: Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 HTTP/1.1 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB2ZIg3o-yYBAHJBu0IvHdlxTtZ6ygNYrbMnFgtxT0folhpkyZrI4zbglgVNotxT4tthKGZiORLyQ1Tn810GIlRZCyKT_mInKgzo3n1lo_GWyUO5mCwGHejDxc9G3_Axe0LkGrmWa42LCVzMk3BXE9Arj9RUIBesk_JuTdM7bpNvfI8 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e9840a126cf845f49cd9c80b8cc61c8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d438d70603114d2e8e9e6bbf9fb96991 Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '671f07d0-7909-448b-8511-d1f763e4dd16'} Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:52.638130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:52.643513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Returning 404 to user: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:28:52.644218 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95c9614d-f1e1-4a07-ab2b-b83ec86a53a9 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 404 len: 111 microversion: 2.20 time: 0.090040 Oct 28 18:28:52.650150 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3096/4863] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:52 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:28:52.663194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-044e71fd-90a6-4735-8bd9-e2dedb1bcd70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '.version_select at 0x7f78dca1c940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:52.697463 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-044e71fd-90a6-4735-8bd9-e2dedb1bcd70 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350526011" status: 204 len: 0 microversion: 2.20 time: 0.044565 Oct 28 18:28:52.701613 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3097/4864] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Oct 28 18:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350526011 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 18:28:53.581413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:53.583367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:53.623145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:53.623755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:53.624887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:53.627677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:53.628295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:53.629154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:53.945376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:53.963435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c1d3b52a-6ea5-468e-80af-ef7fc249f82e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.391312 Oct 28 18:28:53.984720 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3098/4865] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:53 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:54.988672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:54.990391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:55.002672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:55.004444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:55.007526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:55.011455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:55.012590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:55.013921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:55.439710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:55.488978 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5755d32b-b11d-4b7d-9b9b-7c86c71303ca tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.503930 Oct 28 18:28:55.489970 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3099/4866] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:54 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:56.514666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:56.516649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:56.530360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:56.531158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:56.532359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:56.534300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:56.535622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:56.544732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:56.589765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:28:56.979961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:56.994686 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bfd30071-c810-462a-bc8a-02ebf2a4cb2d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.483723 Oct 28 18:28:56.995874 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3100/4867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:56 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:57.065748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:57.066719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:57.083437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:57.084268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:57.084857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:57.088701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:57.089715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:57.090473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:57.144916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:28:57.350337 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e11dd8ef-7048-4878-bede-9cb89d1257aa tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 204 len: 0 microversion: 2.1 time: 0.290181 Oct 28 18:28:57.350946 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3101/4868] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:28:57 2022] DELETE /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:28:57.378348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:57.380727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:57.398892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:57.399327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:57.400820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:57.404193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:57.405056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:57.405697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:57.717557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:57.734989 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fade94cb-6d61-4a38-b0dc-72300b62a89e tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1505 microversion: 2.1 time: 0.376978 Oct 28 18:28:57.737422 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3102/4869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:57 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:58.023479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:58.025052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:58.036323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:58.045645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:58.046462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:58.048233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:58.049080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:58.049764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:58.413136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:58.421331 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e0d6d91-8174-4383-b5c7-881ead953281 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.401948 Oct 28 18:28:58.423963 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3103/4870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:58 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:28:58.765164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:58.766370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:58.783310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:58.784121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:58.784741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:58.789153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:58.789838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:58.790456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:59.481126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:59.490357 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-711331af-a0b9-4113-b1d3-d95a0f00f41d tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1505 microversion: 2.1 time: 0.728934 Oct 28 18:28:59.510521 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3104/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:58 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1505 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:59.515664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:59.516346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:59.548641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:59.549159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:59.549611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:59.550343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:59.550994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:59.551592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:59.578102 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] HTTP exception thrown: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Request method failure captured: Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 HTTP/1.1 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB2ZIg3o-yYBAHJBu0IvHdlxTtZ6ygNYrbMnFgtxT0folhpkyZrI4zbglgVNotxT4tthKGZiORLyQ1Tn810GIlRZCyKT_mInKgzo3n1lo_GWyUO5mCwGHejDxc9G3_Axe0LkGrmWa42LCVzMk3BXE9Arj9RUIBesk_JuTdM7bpNvfI8 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e9840a126cf845f49cd9c80b8cc61c8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d438d70603114d2e8e9e6bbf9fb96991 Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '671f07d0-7909-448b-8511-d1f763e4dd16'} Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:28:59.586902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:28:59.592623 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:28:59.595024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Returning 404 to user: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:28:59.596125 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d1a520c1-3d7a-4cac-a230-ec5b11a0d470 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 404 len: 111 microversion: 2.20 time: 0.084522 Oct 28 18:28:59.596875 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3105/4872] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:28:59 2022] DELETE /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:28:59.601793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:28:59.616786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:28:59.623348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:59.624240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:59.624882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:59.625852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:28:59.626538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:28:59.627181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:28:59.948395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:28:59.958395 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce5ddc98-0ce9-441a-9d9b-c478c138971e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.360030 Oct 28 18:28:59.985144 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3106/4873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:28:59 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:28:59.997237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:00.002794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 671f07d0-7909-448b-8511-d1f763e4dd16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:00.032488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:00.034140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:00.035095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:00.036146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:00.037608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:00.041273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:00.092931 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] HTTP exception thrown: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Request method failure captured: Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 HTTP/1.1 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB2ZIg3o-yYBAHJBu0IvHdlxTtZ6ygNYrbMnFgtxT0folhpkyZrI4zbglgVNotxT4tthKGZiORLyQ1Tn810GIlRZCyKT_mInKgzo3n1lo_GWyUO5mCwGHejDxc9G3_Axe0LkGrmWa42LCVzMk3BXE9Arj9RUIBesk_JuTdM7bpNvfI8 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e9840a126cf845f49cd9c80b8cc61c8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d438d70603114d2e8e9e6bbf9fb96991 Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '671f07d0-7909-448b-8511-d1f763e4dd16'} Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:00.095647 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Returning 404 to user: Instance 671f07d0-7909-448b-8511-d1f763e4dd16 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc7acde3-5d59-4844-b5f6-1856370241bb tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16" status: 404 len: 111 microversion: 2.20 time: 0.111172 Oct 28 18:29:00.106121 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3107/4874] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:28:59 2022] GET /compute/v2.1/servers/671f07d0-7909-448b-8511-d1f763e4dd16 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:29:00.191664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a35963ae-a999-4985-918b-25ea142a4c0f req-d0555e0d-25b7-4faa-888a-1010622f0952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade342e6-bfcf-4e42-91e7-20efc080ba35", "name": "network-vif-deleted", "tag": "30307a3a-b3d6-4c59-a62c-3ee1137a1c34"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:00.226100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a35963ae-a999-4985-918b-25ea142a4c0f req-d0555e0d-25b7-4faa-888a-1010622f0952 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:00.228954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a35963ae-a999-4985-918b-25ea142a4c0f req-d0555e0d-25b7-4faa-888a-1010622f0952 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:00.231486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a35963ae-a999-4985-918b-25ea142a4c0f req-d0555e0d-25b7-4faa-888a-1010622f0952 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:00.266369 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a35963ae-a999-4985-918b-25ea142a4c0f req-d0555e0d-25b7-4faa-888a-1010622f0952 service nova] Creating event network-vif-deleted:30307a3a-b3d6-4c59-a62c-3ee1137a1c34 for instance ade342e6-bfcf-4e42-91e7-20efc080ba35 on n-h2-862404-2 Oct 28 18:29:00.281502 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a35963ae-a999-4985-918b-25ea142a4c0f req-d0555e0d-25b7-4faa-888a-1010622f0952 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093233 Oct 28 18:29:00.287750 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3108/4875] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:00.518873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:00.519601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:00.535028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:00.535545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:00.536034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:00.541332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:00.542002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:00.542464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:00.650787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:00.651338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:00.651793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:00.662121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lazy-loading 'fault' on Instance uuid ade342e6-bfcf-4e42-91e7-20efc080ba35 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:29:01.506807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c636558f6e8f47a3b128bd795a56cac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28ead94884144e886dcec198860b961', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:01.516074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f87aa75f-948c-4f05-940a-72668e9ecd49 tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 200 len: 1304 microversion: 2.1 time: 1.001522 Oct 28 18:29:01.518993 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3109/4876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:00 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 1304 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:01.527429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:01.540603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:01.569345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:01.575669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:01.577380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:01.583327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:01.585539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:01.586436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:01.991904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:02.002222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f506d733-fba5-43a8-8426-d002bb9a225c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.480254 Oct 28 18:29:02.017100 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3110/4877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:01 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:02.542375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:02.542992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] [instance: ade342e6-bfcf-4e42-91e7-20efc080ba35] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:02.558597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:02.559114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:02.559566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:02.560323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:02.560792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:02.561228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:02.630159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] HTTP exception thrown: Instance ade342e6-bfcf-4e42-91e7-20efc080ba35 could not be found. Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Request method failure captured: Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 HTTP/1.1 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB9H6wA5T2TrfkIjId6jG8r7ZFHxG1VPTSvOTL0HeuIJrikE_Q78QTK8flhKzttUPluSlEZoyexvmLvdEUOwAayC6gTIMKvAYZwRXcQV1e-lxU4ZDuq6UzyHIwtrb0ITvfyDKrNVYVNPb5vxJq8iLGt8GCinzzsdJ65s00MaROqnP8w Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c28ead94884144e886dcec198860b961 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesActionsTest-1552490044 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c28ead94884144e886dcec198860b961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c28ead94884144e886dcec198860b961"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c28ead94884144e886dcec198860b961", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c28ead94884144e886dcec198860b961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesActionsTest-1552490044 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c28ead94884144e886dcec198860b961 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesActionsTest-1552490044 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesActionsTest-1552490044-project Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c636558f6e8f47a3b128bd795a56cac9 Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesActionsTest-1552490044-project Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance ade342e6-bfcf-4e42-91e7-20efc080ba35 could not be found. Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'ade342e6-bfcf-4e42-91e7-20efc080ba35'} Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade342e6-bfcf-4e42-91e7-20efc080ba35 could not be found. Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade342e6-bfcf-4e42-91e7-20efc080ba35 could not be found. Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:02.637348 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade342e6-bfcf-4e42-91e7-20efc080ba35 could not be found. Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] Returning 404 to user: Instance ade342e6-bfcf-4e42-91e7-20efc080ba35 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bebde4dc-2b0a-4b0b-9970-1de80c2f2a7a tempest-VolumesActionsTest-1552490044 tempest-VolumesActionsTest-1552490044-project] 10.222.0.16 "GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35" status: 404 len: 111 microversion: 2.1 time: 0.100758 Oct 28 18:29:02.642910 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3111/4878] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:02 2022] GET /compute/v2.1/servers/ade342e6-bfcf-4e42-91e7-20efc080ba35 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:29:03.042501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:03.044742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:03.066120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:03.075156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:03.077552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:03.081423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:03.085863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:03.091121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:03.455596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:03.474831 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c027a651-316a-4806-9a08-3ceba389147d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.436078 Oct 28 18:29:03.476803 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3112/4879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:03 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:04.505991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:04.507307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:04.528826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:04.533994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:04.537052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:04.538009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:04.540960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:04.543809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:05.167690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:05.177285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3bd773df-cdcc-4d3f-8a9a-c072ce4fb36d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.677471 Oct 28 18:29:05.178347 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3113/4880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:04 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:06.207159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:06.208577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:06.244372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:06.250527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:06.251246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:06.254227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:06.256450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:06.256989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:06.629597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:06.640542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72524973-f2a9-42bc-ab58-649f09c00073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.438277 Oct 28 18:29:06.649600 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3114/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:06 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:07.511846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:07.512563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:07.530545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:07.538609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:07.541044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:07.541992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:07.542927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:07.548307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:07.723387 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80164136-7482-4479-bd50-a2dba72bd4b0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/ips" status: 200 len: 147 microversion: 2.1 time: 0.215872 Oct 28 18:29:07.744629 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3115/4882] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:29:07 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/ips => generated 147 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:29:07.757626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:07.758552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:07.775083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:07.775863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:07.776494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:07.777397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:07.778060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:07.778658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:08.085793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:08.102546 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c020230f-2e60-4965-8646-0349316dff71 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.356366 Oct 28 18:29:08.103700 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3116/4883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:07 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:09.132172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:09.138930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:09.162383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:09.163292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:09.163948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:09.164883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:09.165786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:09.166645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:09.760435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:09.769974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71bb3cdb-15ea-4e62-92af-0745b369622a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.642178 Oct 28 18:29:09.778633 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3117/4884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:09 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:09.792282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:09.803521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:09.827536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:09.842257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:09.843285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:09.844579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:09.845269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:09.845951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:09.909429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:09.917185 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] HTTP exception thrown: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Request method failure captured: Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a HTTP/1.1 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB2ZIg3o-yYBAHJBu0IvHdlxTtZ6ygNYrbMnFgtxT0folhpkyZrI4zbglgVNotxT4tthKGZiORLyQ1Tn810GIlRZCyKT_mInKgzo3n1lo_GWyUO5mCwGHejDxc9G3_Axe0LkGrmWa42LCVzMk3BXE9Arj9RUIBesk_JuTdM7bpNvfI8 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e9840a126cf845f49cd9c80b8cc61c8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d438d70603114d2e8e9e6bbf9fb96991 Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '24fe0daa-955e-40da-b95e-c00125d1f92a'} Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:29:09.928746 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:09.933532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:09.944353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Returning 404 to user: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:29:09.945778 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d4dfcb51-6e11-4e81-93f7-7782bfa162a4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 404 len: 111 microversion: 2.20 time: 0.162127 Oct 28 18:29:09.951506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3118/4885] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 18:29:09 2022] DELETE /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:29:09.968664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:09.980533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] [instance: 24fe0daa-955e-40da-b95e-c00125d1f92a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:09.993473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:09.994498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:09.995430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:09.996909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:09.997599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:09.999479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:10.073170 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] HTTP exception thrown: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Request method failure captured: Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a HTTP/1.1 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB2ZIg3o-yYBAHJBu0IvHdlxTtZ6ygNYrbMnFgtxT0folhpkyZrI4zbglgVNotxT4tthKGZiORLyQ1Tn810GIlRZCyKT_mInKgzo3n1lo_GWyUO5mCwGHejDxc9G3_Axe0LkGrmWa42LCVzMk3BXE9Arj9RUIBesk_JuTdM7bpNvfI8 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e9840a126cf845f49cd9c80b8cc61c8c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e9840a126cf845f49cd9c80b8cc61c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e9840a126cf845f49cd9c80b8cc61c8c Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-80540812 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: d438d70603114d2e8e9e6bbf9fb96991 Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-80540812-project Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '24fe0daa-955e-40da-b95e-c00125d1f92a'} Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:10.075074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] Returning 404 to user: Instance 24fe0daa-955e-40da-b95e-c00125d1f92a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-328638e7-3f28-4d84-afa7-1e85da1c82f4 tempest-AttachVolumeShelveTestJSON-80540812 tempest-AttachVolumeShelveTestJSON-80540812-project] 10.222.0.16 "GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a" status: 404 len: 111 microversion: 2.20 time: 0.123613 Oct 28 18:29:10.081071 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3119/4886] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 18:29:09 2022] GET /compute/v2.1/servers/24fe0daa-955e-40da-b95e-c00125d1f92a => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:29:10.802871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:10.804272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:10.815595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:10.818610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:10.820720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:10.829376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:10.830166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:10.830815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:11.133415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:11.143321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aff6361f-288a-4770-8fab-4d8149fc3e22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.344200 Oct 28 18:29:11.149990 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3120/4887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:10 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:12.178780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:12.179440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:12.189025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:12.221924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:12.222972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:12.223611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:12.225025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:12.225664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:12.229178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:12.804169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:12.816597 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b219f6d-8cd7-410e-8007-cbadcfb7a1ac tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.648302 Oct 28 18:29:12.820381 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3121/4888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:12 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:13.844906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:13.845614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:13.884175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:13.884687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:13.885138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:13.895796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:13.896332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:13.896800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:14.239185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:14.253223 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa86c79c-65ac-4cd7-b568-9ca8499a5b2c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.408659 Oct 28 18:29:14.253983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3122/4889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:13 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:14.900830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1f5df33-3a38-4c2d-b835-f6708d6529e9"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:14.905372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:14.950566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:14.951349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:14.953956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:14.955343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:14.959494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:14.961055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:15.666313 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6df50255-cfd1-4eed-90c1-12aae4146c0d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770064 Oct 28 18:29:15.673137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3123/4890] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:29:14 2022] POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:29:15.692672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:15.695236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:15.718923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:15.721103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:15.721756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:15.724238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:15.726525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:15.727483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:16.186671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:16.207188 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8f5bd31-9d83-4f2f-8854-aa40e98dc209 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.527214 Oct 28 18:29:16.208247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3124/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:15 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:17.232659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:17.233351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:17.264591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:17.268255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:17.269676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:17.271655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:17.274073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:17.275773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:17.843913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:17.889290 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a311438-06e3-4ca0-a83c-170ade56bf87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.659869 Oct 28 18:29:17.913647 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3125/4892] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:17 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:18.928665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:18.930777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:18.939458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:18.959796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:18.964337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:18.969516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:18.970028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:18.970483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:19.561285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:19.596611 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e542e588-9a00-48fb-80af-fd565ae9d4c2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.671708 Oct 28 18:29:19.615636 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3126/4893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:18 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:20.627142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:20.627709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:20.635773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:20.636308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:20.636754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:20.637970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:20.638437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:20.638874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:21.300510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:21.335603 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ca0ab58-1701-4e30-9b7c-b720d060b375 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1684 microversion: 2.1 time: 0.713515 Oct 28 18:29:21.338650 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3127/4894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:20 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1684 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:22.366961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:22.367663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:22.377891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:22.391095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:22.395416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:22.396708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:22.397359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:22.397802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:22.806353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:22.834432 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8787cd0c-3e63-40a2-b028-a926eeb175d3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.471208 Oct 28 18:29:22.849022 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3128/4895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:22 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:23.360752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:23.361245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:23.378857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:23.380676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:23.381159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:23.381891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:23.385548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:23.386862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:23.707330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:23.717203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c52868d9-e12d-4c5a-8836-a60fb8738530 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.361350 Oct 28 18:29:23.718365 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3129/4896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:23 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:25.696301 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:29:25.697485 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:29:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:29:25.698748 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:29:25.699060 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:29:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:29:26.674841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f3b0a530-d8b1-4d18-9a0c-7032fc0e4fd0 req-5d82aa6f-0e00-4d1f-a07d-3e23d5e1ddfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "name": "network-vif-unplugged", "status": "completed", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:26.713536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f3b0a530-d8b1-4d18-9a0c-7032fc0e4fd0 req-5d82aa6f-0e00-4d1f-a07d-3e23d5e1ddfd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:26.724639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f3b0a530-d8b1-4d18-9a0c-7032fc0e4fd0 req-5d82aa6f-0e00-4d1f-a07d-3e23d5e1ddfd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:26.728179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f3b0a530-d8b1-4d18-9a0c-7032fc0e4fd0 req-5d82aa6f-0e00-4d1f-a07d-3e23d5e1ddfd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:26.766469 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f3b0a530-d8b1-4d18-9a0c-7032fc0e4fd0 req-5d82aa6f-0e00-4d1f-a07d-3e23d5e1ddfd service nova] Creating event network-vif-unplugged:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:29:26.772347 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f3b0a530-d8b1-4d18-9a0c-7032fc0e4fd0 req-5d82aa6f-0e00-4d1f-a07d-3e23d5e1ddfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.731636 Oct 28 18:29:26.773854 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3130/4897] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:29:26.801058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:26.802450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:26.818056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:26.819867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:26.823246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:26.825867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:26.829105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:26.830163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:27.147531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:27.161214 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-390b5439-5f38-41ec-a0c8-42a107b62223 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.380539 Oct 28 18:29:27.170064 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3131/4898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:26 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:27.192793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:27.195199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:27.207324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:27.207865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:27.209119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:27.226146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:27.227953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:27.229903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:27.536676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:27.546246 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55fd87c5-9b24-4553-8155-15387be1ef0b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.358111 Oct 28 18:29:27.547507 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3132/4899] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:27 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:27.577444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:27.580177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:27.591466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:27.596206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:27.596764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:27.597805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:27.598286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:27.602317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:27.982328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:28.001057 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29dac3cb-206c-4ef7-8ff1-9c57783109e6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.434320 Oct 28 18:29:28.001957 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3133/4900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:27 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:28.030156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:28.033519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:28.050147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:28.052249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:28.053141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:28.055309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:28.057649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:28.058772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:28.197152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:28.244301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1af5c3da-20df-40c4-acf2-a11071beef73 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.219096 Oct 28 18:29:28.245199 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3134/4901] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:29:28 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:29:28.255435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:28.261857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:28.283301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:28.284028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:28.284702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:28.286645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:28.288131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:28.288824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:28.686713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:28.698211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5cd28223-a2e8-4197-b978-f76b1ebed579 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1673 microversion: 2.1 time: 0.446931 Oct 28 18:29:28.708289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3135/4902] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:28 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1673 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:29.732947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:29.733608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:29.746418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:29.748047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:29.748502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:29.751395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:29.751913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:29.752352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:30.150129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:30.159714 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-357a4f16-013d-40b7-8d5c-db7dc579907f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1673 microversion: 2.1 time: 0.430509 Oct 28 18:29:30.161596 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3136/4903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:29 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1673 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:31.187609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:31.189046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:31.200357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:31.203200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:31.203703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:31.204616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:31.205257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:31.205904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:31.482130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:31.498325 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1511562b-0569-42ca-9b71-c6d742dbe56a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.313834 Oct 28 18:29:31.502385 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3137/4904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:31 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:31.529977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:31.533533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:31.551582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:31.552330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:31.553189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:31.565021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:31.566587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:31.567211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:31.635869 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8ab89c4-3a26-4ef5-b6b7-ddfe74e4e347 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 200 len: 324 microversion: 2.1 time: 0.109790 Oct 28 18:29:31.637408 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3138/4905] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:29:31 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 324 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:31.651865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:31.654132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:31.695195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:31.695879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:31.696870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:31.698016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:31.710334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:31.712248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:32.233515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:32.250767 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87e2af4b-f317-4c31-82c4-b89fc33e7790 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.606330 Oct 28 18:29:32.251543 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3139/4906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:31 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:32.281761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:32.282397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:32.314539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:32.320653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:32.321122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:32.321879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:32.322350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:32.322847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:32.651245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:32.665667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29426a32-a45a-4de2-a60e-4d6b9b79a9fc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.382895 Oct 28 18:29:32.665667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3140/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:32 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:32.688393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:32.689023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:32.696600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:32.697345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:32.697992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:32.698887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:32.699524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:32.700155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:32.999676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:33.013561 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d7bfde5-a82c-49fa-8748-75ba77869681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.329751 Oct 28 18:29:33.014468 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3141/4908] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:32 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:33.038013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:33.038978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:33.045807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:33.046576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:33.047808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:33.048788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:33.049423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:33.050103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:33.271976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:33.282093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-364e2070-d52b-41c5-b247-b8df6cdcb085 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.248116 Oct 28 18:29:33.292104 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3142/4909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:33 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:33.470165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1331625629", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "731b8166-5ac1-4b7a-b324-9ea8c5b344b1"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:33.625287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] validate_networks() for [('731b8166-5ac1-4b7a-b324-9ea8c5b344b1', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:29:34.768400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:29:34.769121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:29:34.769316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:29:34.769742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:29:34.770233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:29:34.798970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:34.799476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:34.799966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:34.800741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:34.801210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:34.801646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:34.839045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:29:34.847648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for user 4666e4ac2e124ed9bf3579707986cb43 and project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:29:34.900255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:29:34.909418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:29:34.979254 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba223a39-74f0-472e-abde-4071e2b5a358 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513469 Oct 28 18:29:34.980544 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3143/4910] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:29:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:29:34.998242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5886f650-fea0-4d0b-b663-4e3e007a5bb3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:34.999219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5886f650-fea0-4d0b-b663-4e3e007a5bb3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:35.228641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5886f650-fea0-4d0b-b663-4e3e007a5bb3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:35.240200 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5886f650-fea0-4d0b-b663-4e3e007a5bb3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1215 microversion: 2.1 time: 0.248770 Oct 28 18:29:35.242942 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3144/4911] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:34 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:36.007067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9342d08-b140-4294-83f8-8bebec6d330f tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:36.063585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9342d08-b140-4294-83f8-8bebec6d330f tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:36.064732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9342d08-b140-4294-83f8-8bebec6d330f tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:36.066181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9342d08-b140-4294-83f8-8bebec6d330f tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:36.151725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9342d08-b140-4294-83f8-8bebec6d330f tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:29:36.219041 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9342d08-b140-4294-83f8-8bebec6d330f tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.216592 Oct 28 18:29:36.220163 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3145/4912] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:29:35 2022] POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:29:36.229523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:36.232218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:36.245124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:36.246007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:36.247400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:36.251254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:36.252006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:36.253846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:36.633087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:36.660095 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdffce81-d0a2-4f2a-a11a-605e950fb06d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.433502 Oct 28 18:29:36.665616 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3146/4913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:36 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:36.676650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:36.680843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:36.709208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:36.715596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:36.716392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:36.720792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:36.725709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:36.727343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:36.868916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:36.881879 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c678cdf2-2d00-4763-b813-393d007a764d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1211 microversion: 2.1 time: 0.214895 Oct 28 18:29:36.884124 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3147/4914] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:36 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1211 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:36.897162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:36.898682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:36.915280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:36.931636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:36.933487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:36.935181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:36.936545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:36.939024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:36.980882 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b16680a6-f0ec-4125-b207-c2b154a214ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af/ips" status: 200 len: 148 microversion: 2.1 time: 0.094238 Oct 28 18:29:36.989296 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3148/4915] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:29:36 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af/ips => generated 148 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:36.996084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e4c0a49-940f-4d2b-819d-b208182f6257"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:37.000885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:37.008989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:37.009716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:37.009896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:37.010599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:37.011110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:37.011551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:37.160637 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Invalid volume: volume 9e4c0a49-940f-4d2b-819d-b208182f6257 is already attached to instances: d2297cd3-4ac6-4228-906b-ff4e283c5e23 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af/os-volume_attachments HTTP/1.1 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 74 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: {"volumeAttachment": {"volumeId": "9e4c0a49-940f-4d2b-819d-b208182f6257"}} Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid volume: volume 9e4c0a49-940f-4d2b-819d-b208182f6257 is already attached to instances: d2297cd3-4ac6-4228-906b-ff4e283c5e23 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '196979b7-42a0-44ee-a9b8-33099e5937af', 'body': {'volumeAttachment': {'volumeId': '9e4c0a49-940f-4d2b-819d-b208182f6257'}}} Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e4c0a49-940f-4d2b-819d-b208182f6257 is already attached to instances: d2297cd3-4ac6-4228-906b-ff4e283c5e23 Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:29:37.167299 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e4c0a49-940f-4d2b-819d-b208182f6257 is already attached to instances: d2297cd3-4ac6-4228-906b-ff4e283c5e23 Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e4c0a49-940f-4d2b-819d-b208182f6257 is already attached to instances: d2297cd3-4ac6-4228-906b-ff4e283c5e23 Oct 28 18:29:37.172905 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:37.177992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 400 to user: Invalid volume: volume 9e4c0a49-940f-4d2b-819d-b208182f6257 is already attached to instances: d2297cd3-4ac6-4228-906b-ff4e283c5e23 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:29:37.177992 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97fe0137-8669-45a0-8a89-c9fc76ce453c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.186848 Oct 28 18:29:37.188536 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3149/4916] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:29:36 2022] POST /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af/os-volume_attachments => generated 174 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:29:37.195011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:37.195722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:37.217798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:37.218444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:37.219051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:37.233678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:37.239220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:37.241262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:37.283305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:29:37.346306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:37.435318 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1df25950-9bc9-4f90-b56d-e67e69fd6c8b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 204 len: 0 microversion: 2.1 time: 0.245034 Oct 28 18:29:37.437810 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3150/4917] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:29:37 2022] DELETE /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:29:37.453099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:37.454166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:37.461905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:37.462557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:37.463236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:37.464091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:37.464651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:37.465371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:37.959543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:37.975148 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a5f8614-a63a-4f55-a7fc-dddc189ec9d8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1681 microversion: 2.1 time: 0.532043 Oct 28 18:29:37.978501 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3151/4918] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:37 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1681 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:37.997965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:37.999061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:38.014853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:38.015563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:38.019087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:38.021951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:38.023722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:38.025877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:38.598514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:38.622192 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78bc08b8-c7d9-42fb-8ecf-8f9e80a305a3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.642112 Oct 28 18:29:38.622799 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3152/4919] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:37 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:38.630630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:38.631261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:38.638113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:38.638779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:38.639366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:38.640459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:38.641094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:38.641673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:38.878914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:38.894237 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-23481dc0-aff2-465b-8f7a-a45cf3244bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1273 microversion: 2.1 time: 0.269555 Oct 28 18:29:38.896523 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3153/4920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:38 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:38.911669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb5b5ca7-ea91-4ca5-a7d5-bcdd7d48898a", "device": "/dev/sdb"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:38.939104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:38.964283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:38.964765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:38.965276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:38.974221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:38.976672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:38.978298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:39.800505 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7841127a-724f-4de3-b4d6-550bc521bfc2 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "POST /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902169 Oct 28 18:29:39.801184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3154/4921] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:29:38 2022] POST /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:39.844555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:39.845219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:39.887112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:39.887627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:39.888098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:39.905847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:39.906411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:39.913169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:40.358144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:40.367604 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-63c60734-65dd-4c94-b1c4-4467f3f2b3c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1681 microversion: 2.1 time: 0.565281 Oct 28 18:29:40.368241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3155/4922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:39 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1681 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:40.392935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:40.394947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:40.401354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:40.401851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:40.402295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:40.403013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:40.403476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:40.419377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:40.735696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:40.757193 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb70240e-19d9-427f-80cf-35dba16cd4ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.385867 Oct 28 18:29:40.758670 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3156/4923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:40 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:40.774905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:40.778654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:40.813990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:40.820323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:40.821114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:40.825030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:40.828641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:40.834873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:41.119139 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:29:41.119669 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:29:41.486395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:41.501047 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e848d99a-6e36-4cee-a302-001eb8457bb2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1315 microversion: 2.1 time: 0.740901 Oct 28 18:29:41.506314 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3157/4924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:40 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:41.519588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:41.520452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:41.533579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:41.536125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:41.538291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:41.539184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:41.540695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:41.541873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:41.738326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:41.761659 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00b52ef6-7e7a-4f50-b0cd-0462bd74c279 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 200 len: 1613 microversion: 2.1 time: 0.253839 Oct 28 18:29:41.762955 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3158/4925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:41 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 1613 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:41.788736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:41.789641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:41.819283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:41.827925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:41.828810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:41.829766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:41.830429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:41.831038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:42.486787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:42.500421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cba55ea-68b0-49b7-8697-7faa8fc420ba tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.715456 Oct 28 18:29:42.502458 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3159/4926] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:41 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:42.528404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:42.529220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:42.541791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:42.557581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:42.558088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:42.558533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:42.559259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:42.559723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:42.560190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:43.280675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:43.309412 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a232367-2147-422f-8285-919ad6a4878e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1315 microversion: 2.1 time: 0.785761 Oct 28 18:29:43.314281 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3160/4927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:42 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:43.323679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3743b257-bb7c-4595-89e0-b3cb8c1123f7 req-190a49d4-9733-48eb-81e9-c2540bea8b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2823b77-91c9-404b-b0a4-df3f3a4c2158", "tag": "5f851dac-7fa1-44b5-9e09-917b9e450294"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:43.386971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3743b257-bb7c-4595-89e0-b3cb8c1123f7 req-190a49d4-9733-48eb-81e9-c2540bea8b63 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:43.387797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3743b257-bb7c-4595-89e0-b3cb8c1123f7 req-190a49d4-9733-48eb-81e9-c2540bea8b63 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:43.391090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3743b257-bb7c-4595-89e0-b3cb8c1123f7 req-190a49d4-9733-48eb-81e9-c2540bea8b63 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:43.426783 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3743b257-bb7c-4595-89e0-b3cb8c1123f7 req-190a49d4-9733-48eb-81e9-c2540bea8b63 service nova] Creating event network-changed:5f851dac-7fa1-44b5-9e09-917b9e450294 for instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 on n-h2-862404-2 Oct 28 18:29:43.432761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3743b257-bb7c-4595-89e0-b3cb8c1123f7 req-190a49d4-9733-48eb-81e9-c2540bea8b63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114121 Oct 28 18:29:43.434303 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3161/4928] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:43.783114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cf425f7f-0795-4448-86f5-578d270382bb req-fefc343d-d160-4246-ad60-d562781ba6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "196979b7-42a0-44ee-a9b8-33099e5937af", "name": "network-vif-deleted", "tag": "ddca39ab-ecdc-4e3f-98f5-5992c696a6b3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:43.802733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf425f7f-0795-4448-86f5-578d270382bb req-fefc343d-d160-4246-ad60-d562781ba6a2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:43.803522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf425f7f-0795-4448-86f5-578d270382bb req-fefc343d-d160-4246-ad60-d562781ba6a2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:43.804458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf425f7f-0795-4448-86f5-578d270382bb req-fefc343d-d160-4246-ad60-d562781ba6a2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:43.822504 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cf425f7f-0795-4448-86f5-578d270382bb req-fefc343d-d160-4246-ad60-d562781ba6a2 service nova] Creating event network-vif-deleted:ddca39ab-ecdc-4e3f-98f5-5992c696a6b3 for instance 196979b7-42a0-44ee-a9b8-33099e5937af on n-h1-862404-2 Oct 28 18:29:43.831052 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cf425f7f-0795-4448-86f5-578d270382bb req-fefc343d-d160-4246-ad60-d562781ba6a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.394345 Oct 28 18:29:43.832598 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3162/4929] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:43.840608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:43.841855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:43.850874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:43.851952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:43.852758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:43.853974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:43.854673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:43.855502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:43.882761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af HTTP/1.1 Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '196979b7-42a0-44ee-a9b8-33099e5937af'} Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:29:43.885259 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:43.888356 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:29:43.888356 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:29:43.888356 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:29:43.888356 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:29:43.888356 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:29:43.888356 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:29:43.888356 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:29:43.894701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:29:43.897361 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6bba80cc-f7c6-4f25-963f-4833a7252cc7 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 404 len: 111 microversion: 2.1 time: 0.063012 Oct 28 18:29:43.898786 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3163/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:43 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:29:43.907573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:43.908960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:43.917552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:43.918314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:43.918833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:43.919648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:43.920224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:43.920726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:44.201537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:44.212731 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9591f75d-6f8b-4931-bc93-c9ba357bd294 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.311876 Oct 28 18:29:44.214483 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3164/4931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:43 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:44.234175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1fa67980-c1cb-408b-a04f-9ebd972b029f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '.version_select at 0x7f78dca1b550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:44.312935 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1fa67980-c1cb-408b-a04f-9ebd972b029f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085445572" status: 202 len: 0 microversion: 2.1 time: 0.093239 Oct 28 18:29:44.316980 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3165/4932] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:29:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085445572 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:29:44.355970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:44.356648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:44.379788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:44.381467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:44.381923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:44.388426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:44.389025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:44.389597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:44.834985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:45.039986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:45.051625 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ec01383-1407-4293-8259-0acb8ee0467f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1315 microversion: 2.1 time: 0.701871 Oct 28 18:29:45.053457 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3166/4933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:44 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:45.252039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:45.252764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:45.264356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:45.270948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:45.271453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:45.272383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:45.273487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:45.274138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:45.275098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:45.942277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:45.952332 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0476fd19-8027-4af8-b4df-64b3314e46c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.714811 Oct 28 18:29:45.953330 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3167/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:45 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:45.998522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:46.000831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:46.024894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:46.028932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:46.036488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:46.039690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:46.040254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:46.042428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:46.329632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lazy-loading 'services' on Instance uuid d2297cd3-4ac6-4228-906b-ff4e283c5e23 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:29:46.341808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:46.516586 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-924c4a3a-c64f-4fe3-99c3-22623b5aff2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments/9e4c0a49-940f-4d2b-819d-b208182f6257" status: 202 len: 0 microversion: 2.1 time: 0.561758 Oct 28 18:29:46.522532 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3168/4935] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:29:45 2022] DELETE /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments/9e4c0a49-940f-4d2b-819d-b208182f6257 => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:29:46.544138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:46.550418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:46.594300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:46.594839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:46.595294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:46.596257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:46.596874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:46.597722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:47.820592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:47.835966 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0002d613-558c-448c-8169-07038090cace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1315 microversion: 2.1 time: 1.311668 Oct 28 18:29:47.836736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3169/4936] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:46 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:47.867588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:47.873075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:47.898441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:47.904682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:47.905689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:47.914326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:47.914848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:47.915294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:48.063230 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a76e9c65-4f01-42a3-97b6-b451377d1213 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224586 Oct 28 18:29:48.073203 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3170/4937] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:29:47 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:48.089024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:48.090072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:48.109146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:48.110033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:48.110713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:48.111641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:48.112355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:48.113129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:48.408398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:48.420050 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-efa5f17f-3504-46e3-8a47-692432b08811 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.345211 Oct 28 18:29:48.424307 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3171/4938] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:48 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:48.755773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f3dac6b8-2f46-47f7-b93b-07e8776856dc req-6fd9d97e-a809-49eb-b8c6-cb53e364731e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2823b77-91c9-404b-b0a4-df3f3a4c2158", "name": "network-vif-plugged", "status": "completed", "tag": "5f851dac-7fa1-44b5-9e09-917b9e450294"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:48.789492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f3dac6b8-2f46-47f7-b93b-07e8776856dc req-6fd9d97e-a809-49eb-b8c6-cb53e364731e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:48.789996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f3dac6b8-2f46-47f7-b93b-07e8776856dc req-6fd9d97e-a809-49eb-b8c6-cb53e364731e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:48.790443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f3dac6b8-2f46-47f7-b93b-07e8776856dc req-6fd9d97e-a809-49eb-b8c6-cb53e364731e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:48.826408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f3dac6b8-2f46-47f7-b93b-07e8776856dc req-6fd9d97e-a809-49eb-b8c6-cb53e364731e service nova] Creating event network-vif-plugged:5f851dac-7fa1-44b5-9e09-917b9e450294 for instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 on n-h2-862404-2 Oct 28 18:29:48.836814 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f3dac6b8-2f46-47f7-b93b-07e8776856dc req-6fd9d97e-a809-49eb-b8c6-cb53e364731e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084659 Oct 28 18:29:48.837986 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3172/4939] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:29:48.866070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:48.867721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:48.875321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:48.876216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:48.876872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:48.877801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:48.878472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:48.879127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:49.239247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:49.252384 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aec4c512-f3ff-4465-86ee-61195fa35a83 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1315 microversion: 2.1 time: 0.390330 Oct 28 18:29:49.260262 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3173/4940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:48 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:49.267385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:49.275264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:49.290380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:49.292912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:49.293711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:49.296997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:49.297743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:49.298420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:49.379528 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d11ac19-3253-4178-b001-b62fa65ca772 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117581 Oct 28 18:29:49.393265 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3174/4941] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:29:49 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:49.444113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:49.444934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:49.453670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:49.456027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:49.456630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:49.457512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:49.466287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:49.466958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:49.691723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:49.700267 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7354a266-5917-4325-9df0-82be262cfc6c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.260068 Oct 28 18:29:49.700865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3175/4942] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:49 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:50.276518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:50.277844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:50.295595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:50.296187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:50.296638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:50.300228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:50.301612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:50.306998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:50.616508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:50.632443 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6cc4f345-133c-469a-b23a-798f0755bb36 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1315 microversion: 2.1 time: 0.358710 Oct 28 18:29:50.633667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3176/4943] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:50 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:50.659008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:50.680592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:50.727726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:50.728455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:50.728986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:50.730067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:50.730491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:50.731002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:50.802387 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b7817015-2e76-4af4-81fa-b5f74bcab2b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152493 Oct 28 18:29:50.811141 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3177/4944] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:29:50 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:50.821485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:50.824647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:50.836428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:50.840692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:50.841152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:50.841909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:50.842375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:50.849938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:51.095224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:51.124544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b19d73c-d55e-4398-8aa2-fcd306e3a37e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.310745 Oct 28 18:29:51.125180 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3178/4945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:50 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:51.658081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:51.658780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:51.666844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:51.667753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:51.668257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:51.669036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:51.669579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:51.670216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:51.872702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:51.882843 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed9e7a6f-a0fd-4475-bd2b-5dd2f6a315b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1502 microversion: 2.1 time: 0.229175 Oct 28 18:29:51.901922 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3179/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:51 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:51.903157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:51.906265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:51.912542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:51.913040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:51.913482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:51.914191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:51.915011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:51.915613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:51.949027 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e038c785-6659-4559-9b5b-ed43f95c05f8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049891 Oct 28 18:29:51.950131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3180/4947] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:29:51 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:51.955380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa8f7a88-66af-4e23-b05c-c18f7cd9793f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:51.962929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa8f7a88-66af-4e23-b05c-c18f7cd9793f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:51.963681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa8f7a88-66af-4e23-b05c-c18f7cd9793f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:51.964160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa8f7a88-66af-4e23-b05c-c18f7cd9793f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:51.991526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa8f7a88-66af-4e23-b05c-c18f7cd9793f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:29:52.061035 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa8f7a88-66af-4e23-b05c-c18f7cd9793f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158/action" status: 202 len: 0 microversion: 2.1 time: 0.109260 Oct 28 18:29:52.066936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3181/4948] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:29:51 2022] POST /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:29:52.096615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:52.098077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:52.113050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:52.113647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:52.114167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:52.114953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:52.116086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:52.116635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:52.331444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:52.342329 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb4e6633-712e-4a11-bd44-e74d4bec0c55 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.269587 Oct 28 18:29:52.345320 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3182/4949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:52 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:52.351292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:52.352654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:52.368428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:52.369141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:52.370198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:52.371039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:52.371683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:52.372236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:52.557346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:52.570584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a8f7bcb-7c82-4382-9b14-8dcf71668897 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.224043 Oct 28 18:29:52.571338 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3183/4950] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:52 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:52.962910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:52.965644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:52.977010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:52.977812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:52.978726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:52.979948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:52.980493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:52.980934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:53.032011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:53.036232 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c361684e-71c4-4f50-9a3e-a3a54cd381c6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077899 Oct 28 18:29:53.036997 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3184/4951] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:29:52 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:29:53.376350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:53.377367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:53.390944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:53.392348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:53.393269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:53.399869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:53.401090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:53.404081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:53.603571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:53.616416 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e65a2afc-07c1-4b83-b68e-1c10ba7ee2ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.249253 Oct 28 18:29:53.633314 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3185/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:53 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:53.638223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:53.638849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:53.645547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:53.646051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:53.646568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:53.647202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:53.647667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:53.648126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:53.827801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:53.840393 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c663d73a-8c95-48ee-9122-6a0c8ee39631 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.205884 Oct 28 18:29:53.841960 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3186/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:53 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:54.051336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:54.054438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:54.082436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:54.085351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:54.085942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:54.086828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:54.091250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:54.091880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:54.174408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f7ea3dd4-0cd3-4c4e-8bc2-c115a79d533b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128354 Oct 28 18:29:54.175024 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3187/4954] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:29:54 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:29:54.392652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:54.393484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:54.402283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:54.403118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:54.403859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:54.404892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:54.405625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:54.406395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:54.442622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:29:54.600800 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24012b35-8d53-41d4-9e65-06f69adeaaef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 204 len: 0 microversion: 2.1 time: 0.213891 Oct 28 18:29:54.607411 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3188/4955] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:29:54 2022] DELETE /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:29:54.615800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:54.616753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:54.624979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:54.625621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:54.625845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:54.626684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:54.627153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:54.628156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:54.875210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:54.892814 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1d0dc93d-2ffe-4ed9-8b79-d631677c305b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1680 microversion: 2.1 time: 0.279084 Oct 28 18:29:54.911248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3189/4956] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:54 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1680 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:54.918035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:54.918898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:54.926616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:54.927304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:54.928545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:54.929474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:54.930195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:54.931464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:55.131703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:55.145001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b69e363-7714-493d-b662-29b12fe1d245 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.232105 Oct 28 18:29:55.145973 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3190/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:54 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:55.152044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:55.153520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:55.163728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:55.164952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:55.166097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:55.170166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:55.171039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:55.171797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:55.471258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:55.484178 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-370658e8-9a16-4832-b03f-f0ed0b6916ab tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1726 microversion: 2.1 time: 0.335789 Oct 28 18:29:55.485414 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3191/4958] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:55 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1726 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:55.924659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:55.925280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:55.931780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:55.932291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:55.932727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:55.933417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:55.933892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:55.934315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:56.300394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:56.310884 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-deb1fcc0-088d-4327-a6e3-a4accc786fb2 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1680 microversion: 2.1 time: 0.388001 Oct 28 18:29:56.325520 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3192/4959] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:55 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1680 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:29:56.334380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:56.335016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:56.352408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:56.358691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:56.359836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:56.360746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:56.361361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:56.366997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:56.610830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:56.619638 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-451969a0-c022-406a-9bd2-e4120a1d45d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.289100 Oct 28 18:29:56.628298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3193/4960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:56 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:56.637704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:56.643668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:56.672703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:56.674160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:56.674924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:56.676336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:56.677013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:56.677664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:57.196005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:57.235201 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f55453e-180d-4cc4-aafc-7fbd42763d2e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1703 microversion: 2.1 time: 0.600408 Oct 28 18:29:57.237790 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3194/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:56 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1703 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:57.287400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e26bcdf-c9ad-4aa4-83a5-aaaa28d78fff tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:29:57.301734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e26bcdf-c9ad-4aa4-83a5-aaaa28d78fff tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:57.302913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e26bcdf-c9ad-4aa4-83a5-aaaa28d78fff tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:57.303586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e26bcdf-c9ad-4aa4-83a5-aaaa28d78fff tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:57.342931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2e26bcdf-c9ad-4aa4-83a5-aaaa28d78fff tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Going to try to start instance {{(pid=120680) start /opt/stack/nova/nova/compute/api.py:2787}} Oct 28 18:29:57.401565 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e26bcdf-c9ad-4aa4-83a5-aaaa28d78fff tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.130083 Oct 28 18:29:57.423958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3195/4962] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:29:57 2022] POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:29:57.438153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:57.439236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:57.447647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:57.448514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:57.449159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:57.450057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:57.451391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:57.452803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:57.797703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:57.812000 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c297b9b-8fca-4116-aff7-48b6ca7dc210 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1680 microversion: 2.1 time: 0.385348 Oct 28 18:29:57.826119 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3196/4963] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:57 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1680 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:57.839145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:57.840057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:57.849207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:57.850066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:57.850844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:57.851787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:57.852460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:57.853075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:58.223562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:58.233850 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69859926-72c8-4651-9d34-a5676f9c5af9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1712 microversion: 2.1 time: 0.401447 Oct 28 18:29:58.241654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3197/4964] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:57 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1712 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:58.246737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:58.248701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:58.264120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:58.270964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:58.271487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:58.272274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:58.275976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:58.276442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:59.168225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:59.172442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:29:59.184529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7722368a-1e1d-4818-b428-5eb0aa490d60 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.941559 Oct 28 18:29:59.185140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3198/4965] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:58 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:59.225511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:59.226189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:59.275100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:59.281549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:59.306425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:59.310684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:59.315522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:59.322085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:59.589320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:29:59.604233 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2efd1efa-e563-419b-89b5-560ca87de849 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 200 len: 1612 microversion: 2.1 time: 0.396543 Oct 28 18:29:59.605908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3199/4966] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:59 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 1612 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:29:59.630290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:29:59.631234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:29:59.640420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:59.641317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:59.641917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:29:59.643056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:29:59.643770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:29:59.644685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:00.088503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:00.110755 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-375d96d4-2cfd-478e-aaab-5fd7809d6ee7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1712 microversion: 2.1 time: 0.499023 Oct 28 18:30:00.112821 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3200/4967] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:29:59 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1712 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:00.127220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5ff98b1d-ef23-45cc-a377-ce53901a28d8 req-9c5f7db0-2df7-4a0c-b5a9-d0c7756969cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2297cd3-4ac6-4228-906b-ff4e283c5e23", "name": "network-vif-deleted", "tag": "28fba93f-c96c-48b4-bc39-ee3b831b64a3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:00.180536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5ff98b1d-ef23-45cc-a377-ce53901a28d8 req-9c5f7db0-2df7-4a0c-b5a9-d0c7756969cc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:00.183683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5ff98b1d-ef23-45cc-a377-ce53901a28d8 req-9c5f7db0-2df7-4a0c-b5a9-d0c7756969cc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:00.184268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5ff98b1d-ef23-45cc-a377-ce53901a28d8 req-9c5f7db0-2df7-4a0c-b5a9-d0c7756969cc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:00.238234 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5ff98b1d-ef23-45cc-a377-ce53901a28d8 req-9c5f7db0-2df7-4a0c-b5a9-d0c7756969cc service nova] Creating event network-vif-deleted:28fba93f-c96c-48b4-bc39-ee3b831b64a3 for instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 on n-h2-862404-2 Oct 28 18:30:00.278215 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5ff98b1d-ef23-45cc-a377-ce53901a28d8 req-9c5f7db0-2df7-4a0c-b5a9-d0c7756969cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158179 Oct 28 18:30:00.291921 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3201/4968] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:30:00.318194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:00.322662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:00.350034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:00.365994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:00.366958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:00.370749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:00.371656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:00.372311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:00.762039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:00.778177 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65363e22-9cc1-4473-a355-32aa810a11ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.481033 Oct 28 18:30:00.779987 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3202/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:00 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:00.789940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:00.793773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:00.806175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:00.809167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:00.814366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:00.815318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:00.816081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:00.817214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:00.834396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 HTTP/1.1 Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'd2297cd3-4ac6-4228-906b-ff4e283c5e23'} Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:30:00.836473 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:00.840315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:00.840315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:30:00.840315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:30:00.840315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:30:00.840315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:30:00.840315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:30:00.840315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:00.841574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:30:00.842868 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b160a7b-bf33-4587-9b3a-517f94d181af tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 404 len: 111 microversion: 2.1 time: 0.060669 Oct 28 18:30:00.843599 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3203/4970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:00 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:30:00.860108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2d16514-4e5b-4aa4-9178-23314ef421ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '.version_select at 0x7f78dc836c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:00.905243 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2d16514-4e5b-4aa4-9178-23314ef421ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230540329" status: 202 len: 0 microversion: 2.1 time: 0.056284 Oct 28 18:30:00.906295 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3204/4971] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:30:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230540329 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:30:01.151957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:01.152598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:01.165266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:01.167750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:01.168284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:01.168730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:01.169480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:01.176086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:01.177047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:01.695673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:01.708542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5f7e170-fc64-431a-b7a2-ed088bfb6e47 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1716 microversion: 2.1 time: 0.562521 Oct 28 18:30:01.727803 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3205/4972] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:01 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1716 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:01.809486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:01.817861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:01.839858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:01.841863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:01.843109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:01.844213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:01.850741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:01.851901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:02.452931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:02.464363 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af81816c-02bf-4791-956f-699d20176327 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.661288 Oct 28 18:30:02.465262 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3206/4973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:01 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:02.475036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3394228b-5cbf-4834-9a61-d32f60bdbb5b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: .version_select at 0x7f78dca1c820>, body: {"keypair": {"name": "tempest-keypair-175094355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD+HilUPo3+wxSZpsc2wEXEb4oYG8SAioKj8mApxHboZrqqDFL3P8DKBKvaLEjL9VTCVxXr23b9ZbUJJ9Sw1HGFk3ct5yS/9OUCSs2RWzUoUDMFIPu74EHzVKBn0epGQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:02.507496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3394228b-5cbf-4834-9a61-d32f60bdbb5b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:30:02.522706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3394228b-5cbf-4834-9a61-d32f60bdbb5b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for user e0cc266e44dd4f76a95a428bb3676b99 and project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:30:02.585979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3394228b-5cbf-4834-9a61-d32f60bdbb5b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119482 Oct 28 18:30:02.588157 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3207/4974] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:30:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:30:03.492526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:03.493873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:03.505904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:03.510319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:03.511625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:03.514914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:03.516421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:03.518236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:04.002150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:04.014030 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a877744a-f8b4-4b04-9edf-c03f9749f1a0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.525669 Oct 28 18:30:04.015385 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3208/4975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:03 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:05.041424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:05.042040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:05.065957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:05.066459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:05.068561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:05.069499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:05.069787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:05.076172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:05.371877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:05.381832 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb7a7e39-b0a4-4454-b4e1-d9b84386a5ef tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.346338 Oct 28 18:30:05.382445 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3209/4976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:05 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:06.406496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:06.407751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:06.420598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:06.422608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:06.423914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:06.426533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:06.427177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:06.428236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:06.622359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:06.633694 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-58809582-b22c-4a44-9f34-4d780c11cef6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.231342 Oct 28 18:30:06.649674 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3210/4977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:06 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:06.661050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-365461905", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bcacda4-5a33-4117-a044-45aafb3b3d46"}], "security_groups": [{"name": "tempest-securitygroup--1429784635"}], "key_name": "tempest-keypair-175094355", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:06.807108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] validate_networks() for [('0bcacda4-5a33-4117-a044-45aafb3b3d46', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:30:07.408346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:30:07.409439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:30:07.410064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:30:07.410632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:30:07.411202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:30:07.424906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:07.425597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:07.426192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:07.427091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:07.428401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:07.428993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:07.452132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:30:07.458307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for user e0cc266e44dd4f76a95a428bb3676b99 and project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:30:07.517470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:30:07.520447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:30:07.590065 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d35c72e-3c34-4fed-b372-7a47e6aeb68a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.938725 Oct 28 18:30:07.590989 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3211/4978] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:30:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:30:07.612001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8e99832-f351-4b6d-83df-5e2e3933366c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:07.612872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8e99832-f351-4b6d-83df-5e2e3933366c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:07.727388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8e99832-f351-4b6d-83df-5e2e3933366c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:07.737860 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8e99832-f351-4b6d-83df-5e2e3933366c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1240 microversion: 2.1 time: 0.132560 Oct 28 18:30:07.756632 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3212/4979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:07 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1240 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:07.758991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:07.766327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:07.779203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:07.782947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:07.783574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:07.785516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:07.786860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:07.787448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:08.104587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:08.113863 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9075464f-8ba9-45b8-89da-231da6104861 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.366514 Oct 28 18:30:08.127515 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3213/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:07 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:08.766293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:08.766973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:08.783659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:08.785286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:08.786795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:08.788737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:08.790951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:08.791565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:08.909970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:08.939149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa019fd5-e997-40a7-bd97-5f18501d2065 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1236 microversion: 2.1 time: 0.178951 Oct 28 18:30:08.942519 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3214/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:08 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1236 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:09.150965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:09.151593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:09.168741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:09.169240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:09.169691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:09.171034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:09.171682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:09.196471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:09.435610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:09.449039 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdd3597e-e885-401f-9049-4f44bbaed75c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.302273 Oct 28 18:30:09.450392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3215/4982] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:09 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:09.972111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:09.974557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:09.993303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:09.999868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:10.006012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:10.011455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:10.015697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:10.017467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:10.202388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:10.210921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c2d551e4-efdf-406f-96ae-53e6ff5094f3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1298 microversion: 2.1 time: 0.246667 Oct 28 18:30:10.211541 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3216/4983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:09 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1298 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:10.474475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:10.475340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:10.490033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:10.490815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:10.491431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:10.492599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:10.493211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:10.493991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:10.768433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:10.781386 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3350f0b4-9f5a-4d60-902f-fbb4f6b4743f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.308984 Oct 28 18:30:10.798582 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3217/4984] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:10 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:11.235996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:11.236682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:11.253977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:11.254485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:11.254939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:11.257262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:11.257741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:11.258182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:11.588514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:11.600409 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a9cc4ec-5226-4680-b2e0-be80928301c0 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.369243 Oct 28 18:30:11.602631 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3218/4985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:11 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:11.808543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:11.809379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:11.823851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:11.825614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:11.826234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:11.830705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:11.834069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:11.834738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:12.199948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:12.212608 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d857c87-dc64-444c-8abd-cb76ec06955e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.410046 Oct 28 18:30:12.214898 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3219/4986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:11 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:12.629160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:12.631368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:12.644879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:12.647035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:12.648751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:12.650092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:12.653216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:12.653919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:12.710846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:13.040281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:13.085011 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-834ae945-9d5a-4086-a688-c1e13ead46d4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.461126 Oct 28 18:30:13.130324 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3220/4987] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:12 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:13.174199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-af467780-7bbb-4c30-b07f-437d09c9e16a req-11c5d659-6190-4d9d-aeab-b1e7246a0d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6730fd-e15f-480a-a249-28b7c59a53d7", "tag": "1b7c3921-ca9c-44e9-9976-24e98348e89d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:13.234171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af467780-7bbb-4c30-b07f-437d09c9e16a req-11c5d659-6190-4d9d-aeab-b1e7246a0d9b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:13.238880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af467780-7bbb-4c30-b07f-437d09c9e16a req-11c5d659-6190-4d9d-aeab-b1e7246a0d9b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:13.242393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af467780-7bbb-4c30-b07f-437d09c9e16a req-11c5d659-6190-4d9d-aeab-b1e7246a0d9b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:13.309541 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-af467780-7bbb-4c30-b07f-437d09c9e16a req-11c5d659-6190-4d9d-aeab-b1e7246a0d9b service nova] Creating event network-changed:1b7c3921-ca9c-44e9-9976-24e98348e89d for instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 on n-h1-862404-2 Oct 28 18:30:13.329640 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-af467780-7bbb-4c30-b07f-437d09c9e16a req-11c5d659-6190-4d9d-aeab-b1e7246a0d9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195175 Oct 28 18:30:13.337228 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3221/4988] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:30:13.361016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:13.363325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:13.382449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:13.383355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:13.384091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:13.386982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:13.390416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:13.391170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:13.724220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:13.734996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3dae21b3-f9ce-4591-aa1a-8ea2da7e889f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.393695 Oct 28 18:30:13.754254 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3222/4989] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:13 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:14.135116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:14.135999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:14.142874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:14.144250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:14.145105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:14.146208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:14.147182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:14.147879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:14.470836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:14.480498 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8fa2a9b0-85f1-4e37-8648-a5ec29fe3bd1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.349783 Oct 28 18:30:14.481899 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3223/4990] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:14 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:14.758917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:14.759555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:14.772736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:14.773603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:14.775836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:14.776763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:14.782557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:14.783290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:15.414440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:15.424642 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed30280d-1bde-4128-aaeb-45a8f09e64e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.669902 Oct 28 18:30:15.426089 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3224/4991] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:14 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:15.506459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:15.508119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:15.525708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:15.526058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:15.526870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:15.528854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:15.530120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:15.530714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:15.774460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:15.793324 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-655c4d42-7255-4cfe-a143-1108f32c90a3 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.290209 Oct 28 18:30:15.812247 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3225/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:15 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:16.454968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:16.455610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:16.470762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:16.471402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:16.476331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:16.477402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:16.478024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:16.478466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:16.721384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:16.734575 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b917bf6-d7cb-42eb-b1f9-1a4634db377e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.284202 Oct 28 18:30:16.747909 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3226/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:16 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:16.822907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:16.823512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:16.865416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:16.866332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:16.867756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:16.868764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:16.869930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:16.873125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:17.225530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:17.235022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-501f35c2-844c-40bb-ade0-03191de0c6b6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.415915 Oct 28 18:30:17.236255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3227/4994] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:16 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:17.760988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:17.761612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:17.763900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:17.764714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:17.770031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:17.770528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:17.770971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:17.771707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:17.772450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:17.772885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:17.963469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:17.973012 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb45461c-eb60-4ca2-b58f-4a7410ad7900 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.215489 Oct 28 18:30:17.974310 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3228/4995] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:17 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:18.264143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:18.265077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:18.279519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:18.288900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:18.289371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:18.290151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:18.290585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:18.292755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:18.623529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:18.636252 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4216bc60-1c34-4c5f-b2d7-20376a7b200e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.378040 Oct 28 18:30:18.637045 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3229/4996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:18 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:19.002143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:19.002756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:19.016978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:19.018478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:19.019641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:19.022559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:19.023253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:19.023915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:19.290160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:19.305714 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ef97532-85cf-4d5b-905b-d4feb8561141 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.307571 Oct 28 18:30:19.306541 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3230/4997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:18 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:19.663319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:19.664383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:19.670957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:19.671579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:19.672134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:19.672928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:19.673496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:19.674013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:19.883481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:19.897084 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-acfbe586-b960-4e01-864e-e0ce8338bd2b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.237765 Oct 28 18:30:19.899388 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3231/4998] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:19 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:20.333894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:20.334540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:20.358317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:20.361696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:20.362868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:20.365942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:20.366663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:20.376069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:20.683083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:20.714060 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ab32283-b71d-4f04-8cf4-87dbf95e22dc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.386688 Oct 28 18:30:20.721274 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3232/4999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:20 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:20.846062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-dd16215a-2d78-4c95-a192-d6a2e3136ef4 req-a7550a7c-8a29-463d-8a46-f5b0fce764d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6730fd-e15f-480a-a249-28b7c59a53d7", "name": "network-vif-plugged", "status": "completed", "tag": "1b7c3921-ca9c-44e9-9976-24e98348e89d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:20.888155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dd16215a-2d78-4c95-a192-d6a2e3136ef4 req-a7550a7c-8a29-463d-8a46-f5b0fce764d9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:20.888647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dd16215a-2d78-4c95-a192-d6a2e3136ef4 req-a7550a7c-8a29-463d-8a46-f5b0fce764d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:20.891306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dd16215a-2d78-4c95-a192-d6a2e3136ef4 req-a7550a7c-8a29-463d-8a46-f5b0fce764d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:20.911989 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-dd16215a-2d78-4c95-a192-d6a2e3136ef4 req-a7550a7c-8a29-463d-8a46-f5b0fce764d9 service nova] Creating event network-vif-plugged:1b7c3921-ca9c-44e9-9976-24e98348e89d for instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 on n-h1-862404-2 Oct 28 18:30:20.940529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-dd16215a-2d78-4c95-a192-d6a2e3136ef4 req-a7550a7c-8a29-463d-8a46-f5b0fce764d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112274 Oct 28 18:30:20.947572 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3233/5000] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:30:20.990044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:20.991327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:21.015910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:21.019737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:21.022058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:21.027466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:21.028833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:21.029530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:21.359757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:21.377031 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34f56a76-b14e-47d0-a348-f7aefdab7f60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.421966 Oct 28 18:30:21.377570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3234/5001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:20 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:21.746918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:21.747900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:21.757954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:21.758656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:21.759880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:21.760762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:21.761809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:21.762701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:21.925120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:21.941837 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e40904a6-468e-49c7-a59f-b8d190775bdc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1512 microversion: 2.1 time: 0.199872 Oct 28 18:30:21.955838 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3235/5002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:21 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:22.088690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:22.089194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:22.100930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:22.101837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:22.102429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:22.103283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:22.104101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:22.104922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:22.206826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lazy-loading 'services' on Instance uuid 1291cee3-3f73-48f9-82ec-decaee6028e4 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:30:22.313089 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb6f7de5-7dd4-4dd5-9f73-fcd9fc38a183 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4/os-volume_attachments/eb5b5ca7-ea91-4ca5-a7d5-bcdd7d48898a" status: 202 len: 0 microversion: 2.1 time: 0.228230 Oct 28 18:30:22.313788 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3236/5003] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:30:22 2022] DELETE /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4/os-volume_attachments/eb5b5ca7-ea91-4ca5-a7d5-bcdd7d48898a => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:30:22.402790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:22.413185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:22.443328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:22.443984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:22.444432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:22.445199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:22.445645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:22.449358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:22.667588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:22.672745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:22.679927 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b47208af-a64c-437f-b843-0545216ad920 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1366 microversion: 2.1 time: 0.282265 Oct 28 18:30:22.696036 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3237/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:22 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:22.967004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:22.967651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:22.983405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:22.984052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:22.984873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:22.985861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:22.986508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:22.987385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:23.289300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:23.300005 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-600cbf79-3adc-40bb-bcd9-aa547326d6be tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1489 microversion: 2.1 time: 0.337450 Oct 28 18:30:23.306301 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3238/5005] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:22 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1489 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:23.323365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:23.327051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:23.340034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:23.340771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:23.341418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:23.342399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:23.343269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:23.343957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:23.420840 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-23e30e9a-ff2e-4199-92f0-642925583f5f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 200 len: 173 microversion: 2.1 time: 0.100505 Oct 28 18:30:23.421911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3239/5006] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:23 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 173 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:30:23.438717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:23.439697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:23.449998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:23.451728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:23.452497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:23.453367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:23.453974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:23.454571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:23.646311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:23.656259 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7dc118d7-341c-43d9-946d-ef51bef2c963 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.223115 Oct 28 18:30:23.657613 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3240/5007] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:23 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:23.685093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:23.685708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:23.691967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:23.693862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:23.694508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:23.707936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:23.709401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:23.710088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:23.710682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:23.881937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:23.893749 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e18a867-68bc-457d-b27f-3506c0c7cc53 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.212600 Oct 28 18:30:23.894661 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3241/5008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:23 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:23.899387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:23.900314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:23.906811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:23.907312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:23.908883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:23.909609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:23.910315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:23.910756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:24.076613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:24.091732 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5eeca046-fb2c-4fc8-a8af-572685976b72 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1555 microversion: 2.1 time: 0.195952 Oct 28 18:30:24.107975 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3242/5009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:23 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:24.112362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:24.112997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:24.119315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:24.119911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:24.120372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:24.121064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:24.121526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:24.121952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:24.283516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:24.292937 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-57c7b0ab-5902-47c3-a1b5-23631b2d2803 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.199073 Oct 28 18:30:24.293865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3243/5010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:24 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:24.300566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:24.301222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:24.307793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:24.308417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:24.308922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:24.310134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:24.310134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:24.310529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:24.411600 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b221c232-d2d3-4867-97fa-d650d954877e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116489 Oct 28 18:30:24.412240 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3244/5011] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:30:24 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:30:24.417106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:24.417772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:24.432544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:24.433125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:24.434284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:24.435032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:24.435497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:24.437874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:24.754665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:24.769149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a1786ec-8f42-4213-8fcd-1af303ab41da tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.355825 Oct 28 18:30:24.769752 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3245/5012] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:24 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:25.000207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2113054406", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "731b8166-5ac1-4b7a-b324-9ea8c5b344b1"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:25.123502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] validate_networks() for [('731b8166-5ac1-4b7a-b324-9ea8c5b344b1', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:30:26.015057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:30:26.016238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:30:26.016959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:30:26.017574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:30:26.018308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:30:26.048547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:26.049718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:26.050346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:26.051264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:26.052422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:26.053041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:26.110460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:30:26.128671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for user 4666e4ac2e124ed9bf3579707986cb43 and project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:30:26.163335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:30:26.165753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:30:26.266514 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bed99a1b-831e-41ba-ad5d-0e451279fd7f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276243 Oct 28 18:30:26.271641 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3246/5013] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:30:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:30:26.279337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdeda363-be94-447b-9be1-cb4d0205fdbd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:26.280821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdeda363-be94-447b-9be1-cb4d0205fdbd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:26.409172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdeda363-be94-447b-9be1-cb4d0205fdbd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:26.426366 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdeda363-be94-447b-9be1-cb4d0205fdbd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1215 microversion: 2.1 time: 0.147957 Oct 28 18:30:26.432171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3247/5014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:26 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:26.802145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ffba2fc8-13ea-4284-b09c-7e36f32557b4 req-0b3ad4f1-bb96-4029-b54f-70fc63ac9b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6730fd-e15f-480a-a249-28b7c59a53d7", "tag": "1b7c3921-ca9c-44e9-9976-24e98348e89d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:26.834530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ffba2fc8-13ea-4284-b09c-7e36f32557b4 req-0b3ad4f1-bb96-4029-b54f-70fc63ac9b7f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:26.838190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ffba2fc8-13ea-4284-b09c-7e36f32557b4 req-0b3ad4f1-bb96-4029-b54f-70fc63ac9b7f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:26.842596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ffba2fc8-13ea-4284-b09c-7e36f32557b4 req-0b3ad4f1-bb96-4029-b54f-70fc63ac9b7f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:26.889339 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ffba2fc8-13ea-4284-b09c-7e36f32557b4 req-0b3ad4f1-bb96-4029-b54f-70fc63ac9b7f service nova] Creating event network-changed:1b7c3921-ca9c-44e9-9976-24e98348e89d for instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 on n-h1-862404-2 Oct 28 18:30:26.916844 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ffba2fc8-13ea-4284-b09c-7e36f32557b4 req-0b3ad4f1-bb96-4029-b54f-70fc63ac9b7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117860 Oct 28 18:30:26.918419 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3248/5015] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:30:27.451873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:27.453705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:27.468188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:27.469250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:27.471291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:27.473522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:27.474266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:27.475595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:27.652359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:27.676657 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a84f2c81-cba4-41dc-89b9-955349e75447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1211 microversion: 2.1 time: 0.229960 Oct 28 18:30:27.693463 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3249/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:27 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1211 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:28.712446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:28.713843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:28.732012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:28.737280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:28.738064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:28.739232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:28.741375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:28.742108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:29.009463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:29.026436 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc5a12b6-b8d9-4570-9090-bf81f7f14d3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1275 microversion: 2.1 time: 0.320104 Oct 28 18:30:29.030861 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3250/5017] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:28 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1275 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:30.061474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:30.077649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:30.120559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:30.121117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:30.121576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:30.145003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:30.145645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:30.146156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:30.411074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:30.428046 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-095de2ad-0193-4568-8542-6255e8cafe07 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1273 microversion: 2.1 time: 0.367070 Oct 28 18:30:30.428046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3251/5018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:30 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1273 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:31.446218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:31.449885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:31.483030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:31.487499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:31.488490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:31.491780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:31.512901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:31.517279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:32.087634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:32.112106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9323c950-0511-414d-93bc-684404873e51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1315 microversion: 2.1 time: 0.669392 Oct 28 18:30:32.113921 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3252/5019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:31 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:33.145992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:33.147485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:33.174298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:33.175145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:33.176753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:33.179089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:33.184495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:33.185269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:33.569383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:33.585404 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6676b7f1-e70e-4957-8f5c-c83712819c6c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1315 microversion: 2.1 time: 0.448706 Oct 28 18:30:33.587837 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3253/5020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:33 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:33.600738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7164029c-0ed1-49fa-9598-0f4d42476c59 req-8214b968-14eb-4220-bd74-dd683c4b9aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78d005ca-c602-45a1-88b0-104243706a04", "tag": "b69145d4-ebfc-44da-b866-5e1cd042e0d3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:33.635288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7164029c-0ed1-49fa-9598-0f4d42476c59 req-8214b968-14eb-4220-bd74-dd683c4b9aaf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:33.636933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7164029c-0ed1-49fa-9598-0f4d42476c59 req-8214b968-14eb-4220-bd74-dd683c4b9aaf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:33.638706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7164029c-0ed1-49fa-9598-0f4d42476c59 req-8214b968-14eb-4220-bd74-dd683c4b9aaf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:33.661538 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7164029c-0ed1-49fa-9598-0f4d42476c59 req-8214b968-14eb-4220-bd74-dd683c4b9aaf service nova] Creating event network-changed:b69145d4-ebfc-44da-b866-5e1cd042e0d3 for instance 78d005ca-c602-45a1-88b0-104243706a04 on n-h2-862404-2 Oct 28 18:30:33.667538 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7164029c-0ed1-49fa-9598-0f4d42476c59 req-8214b968-14eb-4220-bd74-dd683c4b9aaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076927 Oct 28 18:30:33.668766 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3254/5021] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:30:33.925533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:33.926375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:33.934326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:33.946125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:33.946787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:33.947704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:33.948350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:33.949240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:33.990358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:30:34.142362 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-17771ea4-c479-4007-a692-31f46bb9b5bf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 204 len: 0 microversion: 2.1 time: 0.219941 Oct 28 18:30:34.145468 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3255/5022] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:30:33 2022] DELETE /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:30:34.164332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:34.165923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:34.181677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:34.183184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:34.183644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:34.187319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:34.187726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:34.188201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:34.231173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:34.444327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:34.485150 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71d22a59-d76b-4322-b621-5ee6ae5eebbb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1513 microversion: 2.1 time: 0.334078 Oct 28 18:30:34.486006 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3256/5023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:34 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:34.612322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:34.613258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:34.625455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:34.626299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:34.626930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:34.627904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:34.629795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:34.630410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:35.318476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:35.330512 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3e2ca99-1614-444d-8880-540ca8ae02ed tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1315 microversion: 2.1 time: 0.722422 Oct 28 18:30:35.345104 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3257/5024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:34 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:35.516331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:35.517385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:35.528776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:35.530669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:35.531150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:35.533113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:35.533928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:35.534477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:35.822427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:35.837725 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a7a4c1c1-ea1c-4f11-9c58-61d9e22a16fb tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1513 microversion: 2.1 time: 0.327761 Oct 28 18:30:35.843204 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3258/5025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:35 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:36.359850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:36.361263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:36.367291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:36.375359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:36.376456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:36.377844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:36.378595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:36.379060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:36.379495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:36.428422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:36.898308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:36.916215 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a59f8d0b-9507-47b4-8916-48ded348d0cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1315 microversion: 2.1 time: 0.561537 Oct 28 18:30:36.921132 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3259/5026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:36 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:36.933545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:36.934311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:36.952953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:36.958427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:36.959390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:36.977498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:36.978052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:36.981255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:38.482070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:38.507645 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b1a5564-6a2c-4370-832c-60eb3e00e598 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1513 microversion: 2.1 time: 1.585195 Oct 28 18:30:38.508316 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3260/5027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:36 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1513 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:38.522842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:38.523856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:38.531754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:38.532546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:38.533148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:38.534019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:38.534629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:38.535214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:39.312856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:39.325306 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e692ed33-a36a-4384-8271-d775cf516970 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1315 microversion: 2.1 time: 0.803802 Oct 28 18:30:39.329627 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3261/5028] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:38 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:39.351000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b5304c3a-544e-4bba-9187-23c859c853af req-de6fe1cb-8a9c-4637-8176-3c0163eaed17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d005ca-c602-45a1-88b0-104243706a04", "name": "network-vif-plugged", "status": "completed", "tag": "b69145d4-ebfc-44da-b866-5e1cd042e0d3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:39.385368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b5304c3a-544e-4bba-9187-23c859c853af req-de6fe1cb-8a9c-4637-8176-3c0163eaed17 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:39.387491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b5304c3a-544e-4bba-9187-23c859c853af req-de6fe1cb-8a9c-4637-8176-3c0163eaed17 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:39.388047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b5304c3a-544e-4bba-9187-23c859c853af req-de6fe1cb-8a9c-4637-8176-3c0163eaed17 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:39.421117 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b5304c3a-544e-4bba-9187-23c859c853af req-de6fe1cb-8a9c-4637-8176-3c0163eaed17 service nova] Creating event network-vif-plugged:b69145d4-ebfc-44da-b866-5e1cd042e0d3 for instance 78d005ca-c602-45a1-88b0-104243706a04 on n-h2-862404-2 Oct 28 18:30:39.428326 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b5304c3a-544e-4bba-9187-23c859c853af req-de6fe1cb-8a9c-4637-8176-3c0163eaed17 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096456 Oct 28 18:30:39.429151 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3262/5029] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:30:39.540587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:39.541984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:39.571295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:39.571295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:39.571295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:39.574008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:39.579969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:39.580661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:40.340739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:40.356369 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-188687e9-9d58-4fd5-82c2-f9191c1f007b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1513 microversion: 2.1 time: 0.825056 Oct 28 18:30:40.380657 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3263/5030] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:39 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1513 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:40.395804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b711703f-4267-4b27-a86a-1fa4f8e57399 req-cd299a7b-4290-4ed3-b398-f2196cc193f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1291cee3-3f73-48f9-82ec-decaee6028e4", "name": "network-vif-deleted", "tag": "f330ef4c-ef5f-4ef4-9d24-004d74034d44"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:40.410297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b711703f-4267-4b27-a86a-1fa4f8e57399 req-cd299a7b-4290-4ed3-b398-f2196cc193f0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:40.411075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b711703f-4267-4b27-a86a-1fa4f8e57399 req-cd299a7b-4290-4ed3-b398-f2196cc193f0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:40.411736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b711703f-4267-4b27-a86a-1fa4f8e57399 req-cd299a7b-4290-4ed3-b398-f2196cc193f0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:40.452318 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b711703f-4267-4b27-a86a-1fa4f8e57399 req-cd299a7b-4290-4ed3-b398-f2196cc193f0 service nova] Creating event network-vif-deleted:f330ef4c-ef5f-4ef4-9d24-004d74034d44 for instance 1291cee3-3f73-48f9-82ec-decaee6028e4 on n-h2-862404-2 Oct 28 18:30:40.458042 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b711703f-4267-4b27-a86a-1fa4f8e57399 req-cd299a7b-4290-4ed3-b398-f2196cc193f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075800 Oct 28 18:30:40.462926 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3264/5031] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:30:40.469927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:40.470846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:40.524096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:40.524763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:40.526262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:40.528743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:40.534815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:40.535472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:41.415137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:41.464693 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-989efdcc-af29-42f2-97d1-5e8725e7db29 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1315 microversion: 2.1 time: 0.994088 Oct 28 18:30:41.508738 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3265/5032] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:40 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1315 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:41.540263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:41.540896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:41.567962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:41.573373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:41.577034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:41.580593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:41.586784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:41.588282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:41.695410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:41.695943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:41.696387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:41.703110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lazy-loading 'fault' on Instance uuid 1291cee3-3f73-48f9-82ec-decaee6028e4 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:30:41.881814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:41.894952 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90842dff-07bb-4d7e-adf1-56dfa5bf25bd tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 200 len: 1308 microversion: 2.1 time: 0.379416 Oct 28 18:30:41.924675 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3266/5033] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:41 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:42.513398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:42.514284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:42.538988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:42.549319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:42.550112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:42.550933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:42.551433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:42.552013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:42.863627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:42.874544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60a29fd0-fcf3-4e90-a671-715016e76e87 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1503 microversion: 2.1 time: 0.364956 Oct 28 18:30:42.880029 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3267/5034] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:42 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:42.910359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:42.914463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:42.925520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:42.926529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:42.927038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:42.928175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:42.928791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:42.929322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:42.995082 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-299fcfdd-e40b-4008-a2e3-014a54d5e1e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.090952 Oct 28 18:30:43.001693 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3268/5035] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:42 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:30:43.008980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:43.009950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: 1291cee3-3f73-48f9-82ec-decaee6028e4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:43.025530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:43.026317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:43.027106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:43.028983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:43.030128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:43.030719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:43.087864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] HTTP exception thrown: Instance 1291cee3-3f73-48f9-82ec-decaee6028e4 could not be found. Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Request method failure captured: Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 HTTP/1.1 Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7StRxqavQgFBj2SUqZtAZ21vu1hobctJHxlWgYUryZMfKzj3yi3POiSfsMQCltSGJ4AsUHL3cxzLR8SkfVrKhjU5AupI4Q7oIbFYXWaWZWzDTEvL37dTOP5dbYivPnoW7LIZ7B6ZLEuH43rv-GSY720cUMOoRXGxfdm9DNs5s7H8g Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: dad644e20fe3442bb7b487829a18e35a Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1854731093 Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad644e20fe3442bb7b487829a18e35a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad644e20fe3442bb7b487829a18e35a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad644e20fe3442bb7b487829a18e35a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad644e20fe3442bb7b487829a18e35a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotTestJSON-1854731093 Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: dad644e20fe3442bb7b487829a18e35a Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1854731093 Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotTestJSON-1854731093-project Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aa928cab270e439b9030f07ed4899554 Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotTestJSON-1854731093-project Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 1291cee3-3f73-48f9-82ec-decaee6028e4 could not be found. Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '1291cee3-3f73-48f9-82ec-decaee6028e4'} Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1291cee3-3f73-48f9-82ec-decaee6028e4 could not be found. Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1291cee3-3f73-48f9-82ec-decaee6028e4 could not be found. Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:30:43.089658 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1291cee3-3f73-48f9-82ec-decaee6028e4 could not be found. Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Returning 404 to user: Instance 1291cee3-3f73-48f9-82ec-decaee6028e4 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d57e94e5-74c0-4b9e-bd4e-85fccbc80a83 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4" status: 404 len: 111 microversion: 2.1 time: 0.086981 Oct 28 18:30:43.095851 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3269/5036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:43 2022] GET /compute/v2.1/servers/1291cee3-3f73-48f9-82ec-decaee6028e4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:30:44.008686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:44.011759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:44.026443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:44.028846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:44.030431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:44.031325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:44.031801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:44.032268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:44.083217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a36cc03-dd4a-4db7-bc49-47c4fd721681 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.078550 Oct 28 18:30:44.087177 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3270/5037] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:44 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:30:45.096513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:45.100679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:45.114385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:45.114943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:45.115387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:45.116414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:45.119209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:45.120003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:45.180508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b15dd0f-8102-405c-86a0-3816e26b5072 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.088729 Oct 28 18:30:45.185994 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3271/5038] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:45 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:30:46.193448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:46.196488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:46.204820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:46.205309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:46.205748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:46.206477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:46.207103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:46.207533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:46.247314 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5abf668-06ec-4b01-8f31-e211387dd0e9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.058152 Oct 28 18:30:46.251410 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3272/5039] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:46 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:30:47.261628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:47.264932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:47.283186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:47.283727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:47.284333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:47.285350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:47.286178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:47.286883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:47.385435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-142d96c7-ff43-4197-9c47-ac01e4e302b3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.129727 Oct 28 18:30:47.386148 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3273/5040] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:47 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:30:48.400276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:48.402742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:48.414947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:48.420788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:48.421583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:48.422475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:48.422952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:48.423394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:48.486382 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22ed18dd-506f-42c8-b032-4a8bdb82b100 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.091265 Oct 28 18:30:48.487059 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3274/5041] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:48 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:30:49.499964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:49.502306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:49.517528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:49.532597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:49.533146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:49.533933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:49.534413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:49.539038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:49.596167 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1e98ef35-28ab-4506-bc0a-f44cece9b985 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.100315 Oct 28 18:30:49.598127 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3275/5042] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:49 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:30:50.611107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:50.616313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:50.632093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:50.632986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:50.633593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:50.634526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:50.635139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:50.635781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:50.702012 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e82c8fcd-04fc-456d-871c-8f8f646771ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.096623 Oct 28 18:30:50.703261 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3276/5043] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:50 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:30:51.718068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:51.721969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:51.742008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:51.744543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:51.744996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:51.748115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:51.753646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:51.754447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:51.795781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:51.824542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f7a7cb44-7927-4719-a33a-fd34b0bb2947 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.114454 Oct 28 18:30:51.828644 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3277/5044] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:51 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:30:51.883501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1146198422", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "ec2bf803-5ee0-42e8-af96-37d8e7899a02"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:51.969830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] validate_networks() for [('ec2bf803-5ee0-42e8-af96-37d8e7899a02', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:30:52.520255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:30:52.520686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:30:52.521160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:30:52.521570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:30:52.522037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:30:52.527297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:52.535874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:52.538301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:52.538301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:52.538301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:52.538301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:52.539647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:52.562439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Getting quotas for project dad644e20fe3442bb7b487829a18e35a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:30:52.568310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Getting quotas for user aa928cab270e439b9030f07ed4899554 and project dad644e20fe3442bb7b487829a18e35a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:30:52.586778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:30:52.589962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:30:52.658239 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bcfef61b-ddce-4d32-8d09-a09e415f7d51 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789762 Oct 28 18:30:52.662759 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3278/5045] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:30:52.679654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b0d012a-26d2-4b9a-b222-155697236823 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:52.680354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b0d012a-26d2-4b9a-b222-155697236823 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:52.748535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b0d012a-26d2-4b9a-b222-155697236823 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:52.768189 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b0d012a-26d2-4b9a-b222-155697236823 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1219 microversion: 2.1 time: 0.096962 Oct 28 18:30:52.779840 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3279/5046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:52 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:52.836804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:52.839159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:52.850487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:52.850994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:52.851442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:52.852681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:52.856609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:52.857646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:52.917272 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-231f29dc-a8b0-43b4-9f6f-610b9e82194b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 14 microversion: 2.1 time: 0.084523 Oct 28 18:30:52.918849 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3280/5047] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:52 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:30:53.793940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:53.795417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:53.817243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:53.818065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:53.818682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:53.819555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:53.820208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:53.820785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:53.933006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:53.942910 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7af9d1e5-9995-4b14-938e-64bd7dd99b5c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1271 microversion: 2.1 time: 0.153025 Oct 28 18:30:53.959324 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3281/5048] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:53 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:53.960124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:53.962465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:53.977460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:53.977580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:53.985816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:53.986983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:53.987660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:53.989813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:54.100678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4627f0c2-22a8-4e27-bae9-6bfb542f9d10 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action" status: 200 len: 8207 microversion: 2.1 time: 0.151555 Oct 28 18:30:54.104073 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3282/5049] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:53 2022] POST /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04/action => generated 8207 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:54.115611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:54.116566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:54.125373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:54.126240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:54.126834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:54.127716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:54.128379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:54.128836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:54.417476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:54.428226 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d48c911-bd4b-4c9c-9215-8d37f515526a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.317235 Oct 28 18:30:54.444238 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3283/5050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:54 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:54.467004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:54.468025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:54.477742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:54.479647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:54.481874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:54.484891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:54.489837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:54.492177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:54.825982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:54.848667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51d36ee4-c9e9-40b0-9bed-e142b0ecd283 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.383852 Oct 28 18:30:54.850964 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3284/5051] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:54 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:54.881506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:54.883128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:54.927388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:54.928676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:54.932376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:54.936266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:54.937353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:54.938312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:55.254374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:55.265914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aad33c63-f2ba-4b11-8f09-0f52e46d6399 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.389656 Oct 28 18:30:55.283070 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3285/5052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:54 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:55.288175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:55.288810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:55.296607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:55.297522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:55.298133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:55.299046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:55.299655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:55.300516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:55.439533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:55.467165 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c680cde8-70a6-4491-b1fc-fcf86b73e96b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1277 microversion: 2.1 time: 0.182093 Oct 28 18:30:55.483787 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3286/5053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:55 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:55.501474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:55.502781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:55.519672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:55.531287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:55.532383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:55.534442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:55.536652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:55.537345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:55.883802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:55.895473 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c755ed0-f72d-44e1-9514-f2c0b8bfdb68 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.410367 Oct 28 18:30:55.898046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3287/5054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:55 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:55.936520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:55.937366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:55.961137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:55.962159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:55.963630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:55.965128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:55.967095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:55.967670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:56.073915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Locking {{(pid=120680) lock /opt/stack/nova/nova/compute/api.py:4847}} Oct 28 18:30:56.191652 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90ccf353-84d2-45be-87b6-b3dd2d23d073 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.261750 Oct 28 18:30:56.195720 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3288/5055] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:55 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:30:56.203575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:56.204427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:56.221687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:56.222208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:56.225983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:56.226780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:56.228515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:56.228940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:56.584351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:56.605193 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc7e83ed-e26c-4576-8c9d-994faf15fa3e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.408194 Oct 28 18:30:56.616249 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3289/5056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:56 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:30:56.643324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:56.645044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:56.672405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:56.673138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:56.675012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:56.676465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:56.678792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:56.679444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:56.944796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:56.972247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca1b93dc-c791-4d4d-9d55-580d6b7e23ee tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1319 microversion: 2.1 time: 0.349911 Oct 28 18:30:57.000520 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3290/5057] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:56 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:57.015670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80bdb8c1-d603-43c1-b8ca-dcfd19cbe190 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:57.039965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bdb8c1-d603-43c1-b8ca-dcfd19cbe190 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:57.042100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bdb8c1-d603-43c1-b8ca-dcfd19cbe190 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:57.046719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bdb8c1-d603-43c1-b8ca-dcfd19cbe190 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:57.098929 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-80bdb8c1-d603-43c1-b8ca-dcfd19cbe190 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] HTTP exception thrown: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b is locked Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80bdb8c1-d603-43c1-b8ca-dcfd19cbe190 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Request method failure captured: Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action HTTP/1.1 Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 15 Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB6dBWom9PfWWrVlOz28i6q1JTEGnX4a38Ezyy2-BWbQb5KwjqAEGZhlqT-dGZLI01HlbriOiZH66pzf1EE7Oqt23aDgyc2ihZ8cz7p9s5jamZRMIVgJ2IOvuBCLLTbe22MQa4HNHPydsiT3bq4yFq5y-NIEqeiWcA3tE3JGICcOyfc Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 089f168818394b139c87b28362e23ece Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089f168818394b139c87b28362e23ece", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089f168818394b139c87b28362e23ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 089f168818394b139c87b28362e23ece Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4666e4ac2e124ed9bf3579707986cb43 Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: {"os-stop": {}} Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b is locked Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4bb7b4b4-62b3-4f08-92a2-69c78746a21b', 'body': {'os-stop': {}}} Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b is locked Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b is locked Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b is locked Oct 28 18:30:57.101440 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:30:57.107760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80bdb8c1-d603-43c1-b8ca-dcfd19cbe190 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Returning 409 to user: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b is locked {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:30:57.109039 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80bdb8c1-d603-43c1-b8ca-dcfd19cbe190 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 409 len: 107 microversion: 2.1 time: 0.107438 Oct 28 18:30:57.110129 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3291/5058] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:57 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 107 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:30:57.117699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:57.118793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:57.126849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:57.127620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:57.128634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:57.129575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:57.130233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:57.130859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:57.306826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lazy-loading 'services' on Instance uuid cca9f698-5ba3-475b-ba38-5a97256e8c9a {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:30:57.497991 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44e085cf-b8c4-479a-aab5-4fa3fc4d24b9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/os-volume_attachments/a1f5df33-3a38-4c2d-b835-f6708d6529e9" status: 202 len: 0 microversion: 2.1 time: 0.384325 Oct 28 18:30:57.498954 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3292/5059] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:30:57 2022] DELETE /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/os-volume_attachments/a1f5df33-3a38-4c2d-b835-f6708d6529e9 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:30:57.511537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:57.530443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:57.549285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:57.550063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:57.552230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:57.558680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:57.559640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:57.560417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:57.648614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:30:57.656797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Unlocking {{(pid=120680) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 28 18:30:57.786708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-74bd34e2-4947-481f-b40c-4a00a26b72df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.279178 Oct 28 18:30:57.787616 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3293/5060] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:57 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:30:57.807536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ebab1d42-ec2d-447c-ba67-980d944eaba1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:30:57.825376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebab1d42-ec2d-447c-ba67-980d944eaba1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:57.827312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebab1d42-ec2d-447c-ba67-980d944eaba1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:57.831974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebab1d42-ec2d-447c-ba67-980d944eaba1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:57.907703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ebab1d42-ec2d-447c-ba67-980d944eaba1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:30:58.015171 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ebab1d42-ec2d-447c-ba67-980d944eaba1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.218666 Oct 28 18:30:58.017967 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3294/5061] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:30:57 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:30:58.031403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:58.033474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:58.049520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:58.049928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:58.052362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:58.053882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:58.055572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:58.073609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:58.581268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:58.594826 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-041c3699-82f5-4f13-afac-4d5ccc1d0b77 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1319 microversion: 2.1 time: 0.574917 Oct 28 18:30:58.607847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3295/5062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:58 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:58.607847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:30:58.607847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:30:58.625635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:58.625635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:58.626720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:58.627622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:30:58.646181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:30:58.646884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:30:59.544863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:30:59.559337 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-efa0c62a-3b7d-482e-a57c-ed3ee074fcc7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.956637 Oct 28 18:30:59.563027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3296/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:30:58 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:30:59.990147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-624e8e51-1f13-4564-ab80-ea4aafd5ea00 req-f8234f51-2aec-406b-91cb-7d5419ebdc63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a57983-20f6-4f5d-aa70-98ac6294a35e", "tag": "5a73de1f-baf0-4cbc-982c-654b6240a08c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:00.021158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-624e8e51-1f13-4564-ab80-ea4aafd5ea00 req-f8234f51-2aec-406b-91cb-7d5419ebdc63 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:00.028333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-624e8e51-1f13-4564-ab80-ea4aafd5ea00 req-f8234f51-2aec-406b-91cb-7d5419ebdc63 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:00.029104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-624e8e51-1f13-4564-ab80-ea4aafd5ea00 req-f8234f51-2aec-406b-91cb-7d5419ebdc63 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:00.065420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-624e8e51-1f13-4564-ab80-ea4aafd5ea00 req-f8234f51-2aec-406b-91cb-7d5419ebdc63 service nova] Creating event network-changed:5a73de1f-baf0-4cbc-982c-654b6240a08c for instance c2a57983-20f6-4f5d-aa70-98ac6294a35e on n-h2-862404-2 Oct 28 18:31:00.080270 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-624e8e51-1f13-4564-ab80-ea4aafd5ea00 req-f8234f51-2aec-406b-91cb-7d5419ebdc63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.515432 Oct 28 18:31:00.083605 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3297/5064] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:31:00.105573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:00.106529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:00.128567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:00.129727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:00.130329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:00.131573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:00.132271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:00.133413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:00.368625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:00.380108 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7277118c-b51c-4889-a376-cd67b3703290 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1319 microversion: 2.1 time: 0.288401 Oct 28 18:31:00.381255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3298/5065] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:00 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:00.590587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:00.598323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:00.615456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:00.616716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:00.617755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:00.618626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:00.619236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:00.619809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:00.952836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:00.964099 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bcf7ad78-31eb-4b10-8e3a-d98277782a06 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.377386 Oct 28 18:31:00.964829 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3299/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:00 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:01.407641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:01.408525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:01.459700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:01.462088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:01.464071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:01.465311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:01.467432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:01.468471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:01.932296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:01.959551 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-573ab368-c041-4df0-8cee-2d5da283b01a tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1319 microversion: 2.1 time: 0.554996 Oct 28 18:31:01.962396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3300/5067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:01 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:01.994162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:01.997578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:02.022501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:02.028176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:02.029882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:02.031258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:02.032128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:02.032773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:02.551364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:02.630991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:02.644126 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91d40203-8654-4574-aa74-2c701f4e57ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.656452 Oct 28 18:31:02.645210 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3301/5068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:01 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:02.986508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:02.987798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:03.005178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:03.007521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:03.012580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:03.013865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:03.015057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:03.015684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:03.016368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:03.337868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:03.348264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05c63e7c-0d24-4405-b358-0ef749c622f4 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1319 microversion: 2.1 time: 0.365746 Oct 28 18:31:03.354002 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3302/5069] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:02 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:03.671393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:03.672544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:03.685980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:03.690425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:03.691320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:03.692334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:03.692951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:03.694314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:04.012476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:04.031962 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9901c6c8-d982-40ee-861c-4934b5699657 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.363596 Oct 28 18:31:04.033367 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3303/5070] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:03 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:04.377305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:04.378400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:04.385049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:04.385770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:04.386558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:04.387432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:04.388792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:04.389384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:04.699703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:04.720040 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-100ee418-11b5-4e38-a697-14a69a447b5f tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1319 microversion: 2.1 time: 0.342814 Oct 28 18:31:04.723965 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3304/5071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:04 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:05.023135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-336f8194-3742-4fd6-907b-03a2d7cbdeca req-4fbd035d-3abd-48dd-9441-8d58f44a76e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a57983-20f6-4f5d-aa70-98ac6294a35e", "name": "network-vif-plugged", "status": "completed", "tag": "5a73de1f-baf0-4cbc-982c-654b6240a08c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:05.045308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-336f8194-3742-4fd6-907b-03a2d7cbdeca req-4fbd035d-3abd-48dd-9441-8d58f44a76e3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:05.045427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-336f8194-3742-4fd6-907b-03a2d7cbdeca req-4fbd035d-3abd-48dd-9441-8d58f44a76e3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:05.046111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-336f8194-3742-4fd6-907b-03a2d7cbdeca req-4fbd035d-3abd-48dd-9441-8d58f44a76e3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:05.065065 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-336f8194-3742-4fd6-907b-03a2d7cbdeca req-4fbd035d-3abd-48dd-9441-8d58f44a76e3 service nova] Creating event network-vif-plugged:5a73de1f-baf0-4cbc-982c-654b6240a08c for instance c2a57983-20f6-4f5d-aa70-98ac6294a35e on n-h2-862404-2 Oct 28 18:31:05.071458 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-336f8194-3742-4fd6-907b-03a2d7cbdeca req-4fbd035d-3abd-48dd-9441-8d58f44a76e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052855 Oct 28 18:31:05.072788 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3305/5072] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:31:05.079596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:05.080751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:05.090599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:05.092004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:05.092983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:05.094797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:05.096232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:05.097516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:05.299179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:05.309469 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01161dcc-3703-4ffa-b9fa-93b9ce86407a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.234979 Oct 28 18:31:05.311862 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3306/5073] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:05 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:05.518116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1211445f-a0d3-439b-968d-333f174231ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:05.524868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1211445f-a0d3-439b-968d-333f174231ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:05.525595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1211445f-a0d3-439b-968d-333f174231ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:05.526230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1211445f-a0d3-439b-968d-333f174231ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:05.885897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1211445f-a0d3-439b-968d-333f174231ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:31:05.924430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:05.956818 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1211445f-a0d3-439b-968d-333f174231ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.442780 Oct 28 18:31:05.958102 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3307/5074] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:31:05 2022] POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:31:05.967565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:05.968854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:05.976211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:05.977876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:05.978828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:05.979661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:05.980164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:05.980658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:06.170097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:06.180891 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4cb819e6-2b75-4330-850d-cdff84ee959b tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1319 microversion: 2.1 time: 0.220076 Oct 28 18:31:06.196405 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3308/5075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:05 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:06.196405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:06.196953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:06.208779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:06.209461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:06.210392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:06.211248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:06.211876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:06.212410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:06.395963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:06.406647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b4096b5-a946-41da-8308-1451a09da940 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1680 microversion: 2.1 time: 0.221501 Oct 28 18:31:06.407703 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3309/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:06 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:06.413607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:06.414423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:06.423484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:06.424239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:06.424852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:06.425724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:06.426335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:06.426927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:06.679845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:06.689821 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d693a86c-85ac-4aca-84d5-6ab16558489f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.279971 Oct 28 18:31:06.690802 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3310/5077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:06 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:07.210473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:07.211102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:07.218998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:07.219982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:07.220608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:07.221488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:07.222254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:07.222829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:07.409592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:07.423222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71bb02f3-824d-4569-a1d4-706a456929fa tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1509 microversion: 2.1 time: 0.216335 Oct 28 18:31:07.436598 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3311/5078] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:07 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:07.448526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:07.449181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:07.456921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:07.457568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:07.458904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:07.459790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:07.460418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:07.461460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:07.667079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:07.679287 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35a00c67-e971-4888-964f-26416fb85661 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1680 microversion: 2.1 time: 0.241356 Oct 28 18:31:07.691846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3312/5079] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:07 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1680 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:07.691846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b089e34-e16e-4797-8f9a-894d1cf914a6", "device": "/dev/sdb"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:07.691846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:07.695280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:07.695912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:07.696460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:07.697278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:07.697835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:07.698507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:08.009958 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-11c397b8-1d4f-42a1-93c3-70854e888b82 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "POST /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327348 Oct 28 18:31:08.010720 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3313/5080] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:31:07 2022] POST /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:31:08.017845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:08.018573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:08.027797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:08.029032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:08.029851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:08.031115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:08.033163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:08.033163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:08.284048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:08.295971 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60f5f6ca-eb73-455e-b492-d3e4b37313df tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.283506 Oct 28 18:31:08.296512 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3314/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:08 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:08.709951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:08.710660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:08.719298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:08.720352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:08.732213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:08.738296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:08.740776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:08.741467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:09.355780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:09.365127 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-220610d0-4a80-44f9-af55-b165270af1a8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1680 microversion: 2.1 time: 0.660948 Oct 28 18:31:09.369464 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3315/5082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:08 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1680 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:09.381220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:09.384879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:09.396464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:09.397182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:09.397770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:09.398654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:09.399303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:09.399901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:09.720865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:09.729821 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ab07440-f596-48b4-94d3-794f4b502b51 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1658 microversion: 2.1 time: 0.359072 Oct 28 18:31:09.738292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3316/5083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:09 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1658 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:09.764186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92dbf472-cd11-4588-aa4a-b35084e4c7ff tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:09.774775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92dbf472-cd11-4588-aa4a-b35084e4c7ff tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:09.780369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92dbf472-cd11-4588-aa4a-b35084e4c7ff tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:09.780985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92dbf472-cd11-4588-aa4a-b35084e4c7ff tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:09.836004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92dbf472-cd11-4588-aa4a-b35084e4c7ff tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Going to try to start instance {{(pid=120680) start /opt/stack/nova/nova/compute/api.py:2787}} Oct 28 18:31:09.926026 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92dbf472-cd11-4588-aa4a-b35084e4c7ff tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.166380 Oct 28 18:31:09.928941 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3317/5084] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:31:09 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:31:09.949128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:09.951664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:09.967757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:09.970452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:09.970911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:09.971654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:09.974346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:09.974800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:10.568991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:10.585844 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6da68f70-fb44-4b02-9cf7-80a564526a3c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1667 microversion: 2.1 time: 0.652710 Oct 28 18:31:10.596140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3318/5085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:09 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1667 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:10.612522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:10.613148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:10.664172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:10.664689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:10.665147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:10.665885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:10.666354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:10.687343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:11.154792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:11.165812 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81f55f77-7109-4356-bd5a-8cd9074bba39 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1680 microversion: 2.1 time: 0.568120 Oct 28 18:31:11.167102 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3319/5086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:10 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1680 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:11.623617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:11.625783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:11.636503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:11.636999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:11.637442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:11.638847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:11.640496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:11.640989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:11.843421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:11.869209 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39caed9a-7371-4db5-92a3-b0f54c1c6542 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1667 microversion: 2.1 time: 0.247143 Oct 28 18:31:11.871128 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3320/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:11 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1667 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:12.191048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:12.191940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:12.197876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:12.199661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:12.201160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:12.202214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:12.203294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:12.203903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:12.204446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:12.517324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:12.521262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:12.528816 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72f870e7-888b-4694-95ab-658b8db4437e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1680 microversion: 2.1 time: 0.340768 Oct 28 18:31:12.529738 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3321/5088] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:12 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1680 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:12.900310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:12.911209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:12.940946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:12.945664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:12.946802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:12.949996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:12.951371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:12.952296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:13.271872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:13.293152 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b79baa0-10aa-432e-a424-334dcbfa4536 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.385960 Oct 28 18:31:13.293152 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3322/5089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:12 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:13.315487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:13.317477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:13.334350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:13.335159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:13.336106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:13.337439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:13.338345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:13.339072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:13.583229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:13.611111 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5072097e-bef0-4146-a37d-776d3bd0002a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.302339 Oct 28 18:31:13.613162 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3323/5090] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:13 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:13.628210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:13.632960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:13.657392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:13.657745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:13.658350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:13.661920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:13.662833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:13.667380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:13.876338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:13.887921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1eaba38a-0ed3-4840-9b3d-64a5a91cde81 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1680 microversion: 2.1 time: 0.272993 Oct 28 18:31:13.888531 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3324/5091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:13 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1680 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:13.894788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:13.895329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:13.905042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:13.905646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:13.905981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:13.906704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:13.907159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:13.907937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:13.967474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Unlocking {{(pid=120680) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 28 18:31:14.032420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13f93a47-a2a9-4c2d-82b0-f429ce375447 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.142746 Oct 28 18:31:14.033090 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3325/5092] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:31:13 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:31:14.044797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:14.045441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:14.054976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:14.055483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:14.072987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:14.078725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:14.079515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:14.080224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:14.260399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:14.280670 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-688ed3b4-48d6-4d3e-9be7-8d2d111d37d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.241444 Oct 28 18:31:14.282459 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3326/5093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:14 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:14.307864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:14.308521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:14.318687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:14.319371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:14.319922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:14.320908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:14.321636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:14.322299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:14.568409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:14.582317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b25db24b-3003-4f83-9b00-112fd9a9fc6f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.279713 Oct 28 18:31:14.583529 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3327/5094] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:14 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:14.607884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:14.608891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:14.620445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:14.621195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:14.621742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:14.624485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:14.625327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:14.625864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:14.883462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:14.915520 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34188175-38d7-465f-96b0-c82f3d0f7e8b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.309490 Oct 28 18:31:14.921460 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3328/5095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:14 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:14.957060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:14.961389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:14.975050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:14.975484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:14.975958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:14.976680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:14.977139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:14.977573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:15.212245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:15.223679 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3212d49f-3f0d-4d20-b003-d77aa02cd4df tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1680 microversion: 2.1 time: 0.300502 Oct 28 18:31:15.224460 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3329/5096] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:14 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1680 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:15.248603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:15.249605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:15.257018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:15.258107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:15.259040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:15.260311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:15.261375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:15.262365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:15.359399 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6727d08c-8f09-4d4d-bbe0-b4c0c0e85494 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.133536 Oct 28 18:31:15.360524 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3330/5097] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:31:15 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:31:15.369476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:15.370254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:15.378718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:15.379370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:15.380020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:15.380831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:15.381478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:15.382064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:15.570239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:15.582471 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d3d76b8-2857-4280-971b-a3017e19ebd7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1676 microversion: 2.1 time: 0.217897 Oct 28 18:31:15.583383 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3331/5098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:15 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:16.253177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:16.253810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:16.266534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:16.267052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:16.267509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:16.276744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:16.277449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:16.278048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:16.549565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:16.561763 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe355893-556b-415e-933e-601d75ebbb92 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1680 microversion: 2.1 time: 0.312283 Oct 28 18:31:16.562898 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3332/5099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:16 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1680 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:16.608775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:16.609640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:16.622297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:16.624052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:16.625916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:16.628664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:16.629642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:16.630348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:16.852214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:16.862516 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d1d8331-e245-4529-a43f-d26642aba982 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1656 microversion: 2.1 time: 0.259299 Oct 28 18:31:16.876171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3333/5100] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:16 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1656 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:16.890094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:16.890571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:16.897624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:16.898139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:16.898762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:16.899959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:16.901323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:16.902754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:16.990247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:17.070459 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04a726ec-75dd-4373-b4a3-24b00c89edde tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.184824 Oct 28 18:31:17.073838 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3334/5101] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:31:16 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:31:17.089119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:17.089793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:17.103436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:17.109196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:17.109772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:17.110543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:17.112113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:17.112566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:17.392164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:17.422145 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c35c94f-1765-47a3-8ee3-296e3cedc9f8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1663 microversion: 2.1 time: 0.345261 Oct 28 18:31:17.426607 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3335/5102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:17 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1663 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:17.585732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:17.586915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:17.593831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:17.594746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:17.595466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:17.596504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:17.597115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:17.599091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:17.768745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:17.778456 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f561e8be-740a-41ea-9926-b005a9455134 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1657 microversion: 2.1 time: 0.196726 Oct 28 18:31:17.792624 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3336/5103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:17 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1657 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:17.803347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-54e54d39-56ee-45c2-bb68-5352060484d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:17.811136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e54d39-56ee-45c2-bb68-5352060484d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:17.811646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e54d39-56ee-45c2-bb68-5352060484d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:17.812231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e54d39-56ee-45c2-bb68-5352060484d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:17.838379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-54e54d39-56ee-45c2-bb68-5352060484d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Going to try to start instance {{(pid=120680) start /opt/stack/nova/nova/compute/api.py:2787}} Oct 28 18:31:17.889438 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-54e54d39-56ee-45c2-bb68-5352060484d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.090063 Oct 28 18:31:17.891997 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3337/5104] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:31:17 2022] POST /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:31:17.939603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:17.941618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:17.956927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:17.960623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:17.964546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:17.964546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:17.964546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:17.964546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:18.295565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:18.305725 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79c813e6-8b2c-414a-8d0f-fcab8ca3e33b tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1666 microversion: 2.1 time: 0.411095 Oct 28 18:31:18.308184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3338/5105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:17 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1666 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:18.450315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:18.453367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:18.461992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:18.462745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:18.463183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:18.464077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:18.465180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:18.466825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:18.758514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:18.770063 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36ecbc78-21b0-4fc5-90d4-853aff0540cb tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.327115 Oct 28 18:31:18.799328 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3339/5106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:18 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:18.807345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:18.808575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:18.841242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:18.846055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:18.846659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:18.847621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:18.848525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:18.858772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:19.076075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:19.085978 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fc88301f-cd31-4f83-b767-fbda27e6d6a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.285211 Oct 28 18:31:19.100729 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3340/5107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:18 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:19.118340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:19.118983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:19.133681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:19.134537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:19.135212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:19.136641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:19.138287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:19.139168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:19.487775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:19.499736 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07cb9268-9aba-4073-a117-892911af798a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.388257 Oct 28 18:31:19.500622 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3341/5108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:19 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:19.505578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:19.506513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:19.515683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:19.516339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:19.517018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:19.518011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:19.518665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:19.519362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:19.701902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:19.711914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07a33035-cce8-437b-b668-2cb487cf3860 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1670 microversion: 2.1 time: 0.210062 Oct 28 18:31:19.720850 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3342/5109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:19 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:19.732883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:19.733516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:19.748018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:19.748454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:19.748899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:19.749617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:19.750079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:19.750578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:19.930849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:19.940244 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a183b8b-9224-4c07-9dde-8e6e941db97f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.218267 Oct 28 18:31:19.948829 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3343/5110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:19 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:19.964840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:19.965466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:19.973350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:19.973845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:19.974288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:19.974989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:19.975448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:19.975908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:20.144951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:20.154071 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdcfdab5-bec4-47d3-8490-4474cad7f49c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.192918 Oct 28 18:31:20.154855 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3344/5111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:19 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:20.189044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:20.190388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:20.200569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:20.202315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:20.202315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:20.203573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:20.205416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:20.206389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:20.448260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:20.458136 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-417810f5-f897-4578-93d8-9eb965ec8de0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.276493 Oct 28 18:31:20.459864 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3345/5112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:20 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:39.487785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=49 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:39.489767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:39.909717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:39.910228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:39.920450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:39.923891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:39.924737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:39.927101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:39.930061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:39.931378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:39.990345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c58c0eed-176e-447b-9ce5-142288eb4e7a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/ips" status: 200 len: 148 microversion: 2.1 time: 0.510112 Oct 28 18:31:39.990943 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3346/5113] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:31:39 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/ips => generated 148 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:31:41.321590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:41.322259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:41.338785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:41.339293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:41.339847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:41.341233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:41.341976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:41.342417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:41.527291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lazy-loading 'services' on Instance uuid c2a57983-20f6-4f5d-aa70-98ac6294a35e {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:31:41.688998 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd2fabd2-eb16-4345-9f84-c79cfa75b5ba tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e/os-volume_attachments/7b089e34-e16e-4797-8f9a-894d1cf914a6" status: 202 len: 0 microversion: 2.1 time: 0.371687 Oct 28 18:31:41.691025 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3347/5114] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:31:41 2022] DELETE /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e/os-volume_attachments/7b089e34-e16e-4797-8f9a-894d1cf914a6 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:31:43.026520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95974a1e-297c-4413-b084-158d3003039a"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:43.030470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:43.039232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:43.040048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:43.053435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:43.055053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:43.055053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:43.055391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:43.645480 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-baf505ce-6ffb-4873-b2fc-d3afc695cd8e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623694 Oct 28 18:31:43.646718 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3348/5115] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:31:43 2022] POST /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:31:49.421118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:49.421802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:49.439347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:49.442441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:49.443253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:49.447970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:49.448649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:49.449316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:49.535687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:31:49.724857 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-584f1b91-f476-4148-bc68-0fc4fa54862c tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 204 len: 0 microversion: 2.1 time: 0.315534 Oct 28 18:31:49.727979 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3349/5116] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:31:49 2022] DELETE /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:31:49.749387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:49.765186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:49.781208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:49.781911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:49.782540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:49.785715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:49.786351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:49.786951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:50.125640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:50.135187 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c75e6a50-71ec-497f-8015-631be016f578 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1515 microversion: 2.1 time: 0.400794 Oct 28 18:31:50.139675 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3350/5117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:49 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1515 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:31:51.165282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:51.165923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:51.178242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:51.178757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:51.181984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:51.185330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:51.185824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:51.186721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:51.503560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:51.518711 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-178be45a-9b90-444c-83c1-c56c15992233 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1515 microversion: 2.1 time: 0.358984 Oct 28 18:31:51.519515 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3351/5118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:51 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:52.475120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-59f3c8a8-3d4e-4abf-83b3-9290c4e22cf7 req-4656bde6-35d1-4813-ba93-f131085049d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a57983-20f6-4f5d-aa70-98ac6294a35e", "name": "network-vif-deleted", "tag": "5a73de1f-baf0-4cbc-982c-654b6240a08c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:52.495851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-59f3c8a8-3d4e-4abf-83b3-9290c4e22cf7 req-4656bde6-35d1-4813-ba93-f131085049d8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:52.499561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-59f3c8a8-3d4e-4abf-83b3-9290c4e22cf7 req-4656bde6-35d1-4813-ba93-f131085049d8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:52.500582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-59f3c8a8-3d4e-4abf-83b3-9290c4e22cf7 req-4656bde6-35d1-4813-ba93-f131085049d8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:52.528384 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-59f3c8a8-3d4e-4abf-83b3-9290c4e22cf7 req-4656bde6-35d1-4813-ba93-f131085049d8 service nova] Creating event network-vif-deleted:5a73de1f-baf0-4cbc-982c-654b6240a08c for instance c2a57983-20f6-4f5d-aa70-98ac6294a35e on n-h2-862404-2 Oct 28 18:31:52.534090 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-59f3c8a8-3d4e-4abf-83b3-9290c4e22cf7 req-4656bde6-35d1-4813-ba93-f131085049d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063941 Oct 28 18:31:52.535847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3352/5119] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:31:52.547843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:52.548959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:52.555775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:52.556307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:52.556930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:52.557651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:52.558114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:52.558852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:52.645126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa928cab270e439b9030f07ed4899554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad644e20fe3442bb7b487829a18e35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:52.655335 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aee4fdb0-cbe9-4764-82fa-9f999b6309f0 tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 200 len: 1304 microversion: 2.1 time: 0.112488 Oct 28 18:31:52.658591 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3353/5120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:52 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:53.679808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:53.680690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] [instance: c2a57983-20f6-4f5d-aa70-98ac6294a35e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:31:53.689698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:53.690296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:53.690839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:53.691634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:53.692192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:53.692733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:53.721171 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] HTTP exception thrown: Instance c2a57983-20f6-4f5d-aa70-98ac6294a35e could not be found. Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Request method failure captured: Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e HTTP/1.1 Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7StRxqavQgFBj2SUqZtAZ21vu1hobctJHxlWgYUryZMfKzj3yi3POiSfsMQCltSGJ4AsUHL3cxzLR8SkfVrKhjU5AupI4Q7oIbFYXWaWZWzDTEvL37dTOP5dbYivPnoW7LIZ7B6ZLEuH43rv-GSY720cUMOoRXGxfdm9DNs5s7H8g Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: dad644e20fe3442bb7b487829a18e35a Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1854731093 Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad644e20fe3442bb7b487829a18e35a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dad644e20fe3442bb7b487829a18e35a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dad644e20fe3442bb7b487829a18e35a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dad644e20fe3442bb7b487829a18e35a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotTestJSON-1854731093 Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: dad644e20fe3442bb7b487829a18e35a Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1854731093 Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotTestJSON-1854731093-project Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aa928cab270e439b9030f07ed4899554 Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotTestJSON-1854731093-project Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance c2a57983-20f6-4f5d-aa70-98ac6294a35e could not be found. Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'c2a57983-20f6-4f5d-aa70-98ac6294a35e'} Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a57983-20f6-4f5d-aa70-98ac6294a35e could not be found. Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a57983-20f6-4f5d-aa70-98ac6294a35e could not be found. Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:31:53.724576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a57983-20f6-4f5d-aa70-98ac6294a35e could not be found. Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] Returning 404 to user: Instance c2a57983-20f6-4f5d-aa70-98ac6294a35e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:31:53.729306 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e9754e06-fbce-44db-9b15-50f99c0979cf tempest-VolumesSnapshotTestJSON-1854731093 tempest-VolumesSnapshotTestJSON-1854731093-project] 10.222.0.16 "GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e" status: 404 len: 111 microversion: 2.1 time: 0.051195 Oct 28 18:31:53.734091 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3354/5121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:53 2022] GET /compute/v2.1/servers/c2a57983-20f6-4f5d-aa70-98ac6294a35e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:32:02.506027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95974a1e-297c-4413-b084-158d3003039a"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:02.509590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:02.540141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:02.540652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:02.541104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:02.541943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:02.542300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:02.547351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:02.816836 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Invalid volume: volume 95974a1e-297c-4413-b084-158d3003039a is already attached to instances: 6d6730fd-e15f-480a-a249-28b7c59a53d7 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments HTTP/1.1 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 74 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: {"volumeAttachment": {"volumeId": "95974a1e-297c-4413-b084-158d3003039a"}} Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid volume: volume 95974a1e-297c-4413-b084-158d3003039a is already attached to instances: 6d6730fd-e15f-480a-a249-28b7c59a53d7 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '6d6730fd-e15f-480a-a249-28b7c59a53d7', 'body': {'volumeAttachment': {'volumeId': '95974a1e-297c-4413-b084-158d3003039a'}}} Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 95974a1e-297c-4413-b084-158d3003039a is already attached to instances: 6d6730fd-e15f-480a-a249-28b7c59a53d7 Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:32:02.824400 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 95974a1e-297c-4413-b084-158d3003039a is already attached to instances: 6d6730fd-e15f-480a-a249-28b7c59a53d7 Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 95974a1e-297c-4413-b084-158d3003039a is already attached to instances: 6d6730fd-e15f-480a-a249-28b7c59a53d7 Oct 28 18:32:02.829896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:02.832702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 400 to user: Invalid volume: volume 95974a1e-297c-4413-b084-158d3003039a is already attached to instances: 6d6730fd-e15f-480a-a249-28b7c59a53d7 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:32:02.834176 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c37311b-f246-4cc2-a481-ed1a1312f776 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.333061 Oct 28 18:32:02.835026 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3355/5122] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:32:02 2022] POST /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 174 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:32:02.982764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:02.983596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:02.996725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:02.997668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:02.998352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:02.999247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:02.999921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:03.000560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:03.275055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lazy-loading 'services' on Instance uuid 6d6730fd-e15f-480a-a249-28b7c59a53d7 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:32:03.498330 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2700f84-26a8-4fdc-96a6-5c40c3c13a78 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments/95974a1e-297c-4413-b084-158d3003039a" status: 202 len: 0 microversion: 2.1 time: 0.519678 Oct 28 18:32:03.499376 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3356/5123] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:32:02 2022] DELETE /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments/95974a1e-297c-4413-b084-158d3003039a => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:32:03.512029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:03.520359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:03.575835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:03.576497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:03.577918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:03.580459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:03.581225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:03.584153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:03.718187 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08eaa618-c52b-432f-90e9-4b4d394b0203 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210466 Oct 28 18:32:03.724422 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3357/5124] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:03 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:04.734854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:04.739077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:04.759772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:04.760542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:04.761211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:04.762230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:04.763878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:04.764574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:04.893461 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-93535b28-f3b3-4fa6-bec0-d0ed05f3c852 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163713 Oct 28 18:32:04.894769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3358/5125] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:04 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:05.907128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:05.909382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:05.930799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:05.934777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:05.935461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:05.941213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:05.952672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:05.953386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:06.085650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:06.092250 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-abc687ef-b389-49cd-99d0-e06a56700b1c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189144 Oct 28 18:32:06.096117 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3359/5126] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:05 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:07.105399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:07.108661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:07.140057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:07.140576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:07.142313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:07.143318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:07.144535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:07.146054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:07.217275 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-747f7123-dad3-469f-b8dd-32b9d5dfbc60 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116189 Oct 28 18:32:07.220683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3360/5127] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:07 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:08.231938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:08.246633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:08.278114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:08.283878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:08.288435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:08.289612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:08.295523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:08.296470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:08.415542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-505aa2a2-1d14-4fdd-9e11-97398dc32675 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185854 Oct 28 18:32:08.421862 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3361/5128] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:08 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:09.266519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:09.269203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:09.315071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:09.321892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:09.323760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:09.327673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:09.330131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:09.330962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:09.506570 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ecb3bb1f-f2b0-48e2-9145-b17e44c32b48 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.244814 Oct 28 18:32:09.510911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3362/5129] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:32:09 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:32:09.525171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:09.532691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:09.544708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:09.550622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:09.552551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:09.557337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:09.559028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:09.564113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:09.564890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:09.688146 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f5c1ddc-f098-47b0-925c-ede602387505 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172993 Oct 28 18:32:09.707751 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3363/5130] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:09 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:09.707751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:09.708058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:09.739689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:09.740232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:09.740904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:09.744131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:09.744878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:09.745809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.419798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:10.438421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ddb02e2-f354-4592-b38d-4f8f799ec680 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1673 microversion: 2.1 time: 0.738295 Oct 28 18:32:10.455841 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3364/5131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:09 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1673 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:10.719418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:10.721775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:10.735112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.735620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.736285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.737098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.737507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.737937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.811983 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2da971b5-2e5f-40e7-b37f-0f5e6fdcc2d6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097151 Oct 28 18:32:10.815117 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3365/5132] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:10 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:11.468837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:11.469523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:11.495677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.496986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.497426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.498160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.498626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.499063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.759663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:11.770137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec81e058-2bd2-4d52-adaa-615f9c5d3196 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1678 microversion: 2.1 time: 0.305103 Oct 28 18:32:11.774730 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3366/5133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:11 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1678 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:11.853355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:11.856610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:11.887574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.890560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.891196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.891993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.892436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.896201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.982044 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed8a5c5a-bb5d-4edd-81d4-d9c7c430f875 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143453 Oct 28 18:32:11.988061 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3367/5134] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:11 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:12.799189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:12.799923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:12.815000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:12.815662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:12.818159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:12.819928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:12.820691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:12.822442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:13.288389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:13.299588 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-de552503-11d1-4f6e-ab87-7fcfe376b907 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.504228 Oct 28 18:32:13.301974 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3368/5135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:12 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:13.320157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:13.325111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:13.338101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:13.338737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:13.340442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:13.343639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:13.344297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:13.344813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:13.430842 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac013f45-5b3c-4b00-a557-d43808fb18ef tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124022 Oct 28 18:32:13.431877 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3369/5136] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:13 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:14.444219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:14.446938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:14.466115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:14.466788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:14.468682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:14.471007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:14.472551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:14.474387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:14.565267 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e07fd811-54da-4181-bbe1-12b174e259c4 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125622 Oct 28 18:32:14.567928 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3370/5137] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:14 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:32:14.676916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:14.677724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:14.689707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:14.690384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:14.691004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:14.691896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:14.692505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:14.693084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:14.791522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:32:15.049010 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65903044-a7f8-4864-8bcd-785fc0161a7e tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 204 len: 0 microversion: 2.1 time: 0.372921 Oct 28 18:32:15.064968 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3371/5138] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:32:14 2022] DELETE /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:32:15.070998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:15.072231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:15.097954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:15.099123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:15.099787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:15.100753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:15.109985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:15.111655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:15.326127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:15.334487 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01a8ecf6-1527-4f7b-9bdc-c387cfd12340 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1679 microversion: 2.1 time: 0.267875 Oct 28 18:32:15.336359 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3372/5139] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:15 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1679 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:16.361448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:16.362137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:16.380404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:16.380910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:16.381360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:16.382091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:16.382558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:16.382996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:16.675607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:16.682558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:16.687492 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-178d80a5-16ae-4767-9710-af3a043eee1b tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1679 microversion: 2.1 time: 0.330604 Oct 28 18:32:16.691712 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3373/5140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:16 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1679 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:17.722041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:17.728997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:17.750141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:17.750645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:17.751093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:17.751833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:17.762587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:17.764434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:18.846767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:18.865470 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a915c1d-62fe-47cb-946b-9b0109ebe423 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1679 microversion: 2.1 time: 1.142951 Oct 28 18:32:18.866398 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3374/5141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:17 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1679 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:18.889229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:18.892525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:18.904429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:18.909145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:18.909794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:18.910717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:18.911342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:18.911937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:19.005317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-742cadfd-05de-4ce3-ad70-f5fda3405ea9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134313 Oct 28 18:32:19.011718 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3375/5142] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:32:18 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:32:19.171658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:19.172285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:19.185770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:19.186330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:19.195406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:19.196255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:19.196754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:19.197201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:19.309750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:32:19.643365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84adddd2-7e60-4afd-8674-415d99b5b629 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 204 len: 0 microversion: 2.1 time: 0.474841 Oct 28 18:32:19.644880 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3376/5143] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:32:19 2022] DELETE /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:32:19.664186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:19.666070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:19.719323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:19.725663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:19.726634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:19.730167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:19.730920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:19.733346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:20.201153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:20.209782 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2774ce17-0363-4f8c-9df7-3d4a897aeca9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1676 microversion: 2.1 time: 0.560380 Oct 28 18:32:20.210384 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3377/5144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:19 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1676 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:20.245830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cdc32d45-c3d0-4fb2-8e02-2cad8fe13e30 req-10b75e44-c5a5-44e4-aa03-748bfe830f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6730fd-e15f-480a-a249-28b7c59a53d7", "name": "network-vif-deleted", "tag": "1b7c3921-ca9c-44e9-9976-24e98348e89d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:20.268065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cdc32d45-c3d0-4fb2-8e02-2cad8fe13e30 req-10b75e44-c5a5-44e4-aa03-748bfe830f0f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:20.268559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cdc32d45-c3d0-4fb2-8e02-2cad8fe13e30 req-10b75e44-c5a5-44e4-aa03-748bfe830f0f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:20.269000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cdc32d45-c3d0-4fb2-8e02-2cad8fe13e30 req-10b75e44-c5a5-44e4-aa03-748bfe830f0f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:20.296873 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cdc32d45-c3d0-4fb2-8e02-2cad8fe13e30 req-10b75e44-c5a5-44e4-aa03-748bfe830f0f service nova] Creating event network-vif-deleted:1b7c3921-ca9c-44e9-9976-24e98348e89d for instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 on n-h1-862404-2 Oct 28 18:32:20.306472 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cdc32d45-c3d0-4fb2-8e02-2cad8fe13e30 req-10b75e44-c5a5-44e4-aa03-748bfe830f0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071862 Oct 28 18:32:20.310543 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3378/5145] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:20.324986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:20.329955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:20.348213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:20.350624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:20.351232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:20.353886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:20.354528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:20.355366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:20.505788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:20.515406 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2ff70b8-91c8-46af-ad37-f37a3a4db04c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 200 len: 1325 microversion: 2.1 time: 0.203334 Oct 28 18:32:20.521277 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3379/5146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:20 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 1325 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:21.789688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:21.790994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:21.800744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:21.801529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:21.802320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:21.803316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:21.804127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:21.804853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:22.230923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:22.281734 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8fb9d41-c630-4adc-bc21-d9f1dc1160d4 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1676 microversion: 2.1 time: 1.043399 Oct 28 18:32:22.284999 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3380/5147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:21 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1676 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:22.306546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:22.307591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:22.329266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:22.330859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:22.333390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:22.335312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:22.335974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:22.339163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:22.360278 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 HTTP/1.1 Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '6d6730fd-e15f-480a-a249-28b7c59a53d7'} Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:22.362117 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cba0db9e-fcb8-443b-9f60-22646efc9bc8 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 404 len: 111 microversion: 2.1 time: 0.068581 Oct 28 18:32:22.366712 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3381/5148] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:22 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:32:22.373019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68111ed9-e527-4f1e-8d9f-d8a39e694231 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '.version_select at 0x7f78dd786430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:22.410776 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68111ed9-e527-4f1e-8d9f-d8a39e694231 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-175094355" status: 202 len: 0 microversion: 2.1 time: 0.041948 Oct 28 18:32:22.411659 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3382/5149] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-175094355 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:32:23.314815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:23.316402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:23.340631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:23.341527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:23.347151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:23.348319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:23.349355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:23.350247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:23.813878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:23.825525 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a9449244-8063-43d5-a992-89b3889e2450 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1676 microversion: 2.1 time: 0.515762 Oct 28 18:32:23.831450 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3383/5150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:23 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1676 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:24.561653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-abb52b67-f8db-4071-a659-aa0fbcbcc450 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: .version_select at 0x7f78dcaaca60>, body: {"keypair": {"name": "tempest-keypair-1886144267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmb249OT4g5c/9bUd7bJFOIDWFYwm/WJ3xwIUXCczfGMvOc9wqXeP7qDuBPDWxf4vbGKp1G6W+U+AWK2jhWGth/LvBasJnwMLuA3BQ6fx5c4v36hVV8fLtqlQvwlePOKg=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:24.580419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-abb52b67-f8db-4071-a659-aa0fbcbcc450 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:32:24.587458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-abb52b67-f8db-4071-a659-aa0fbcbcc450 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for user e0cc266e44dd4f76a95a428bb3676b99 and project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:32:24.621437 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-abb52b67-f8db-4071-a659-aa0fbcbcc450 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066092 Oct 28 18:32:24.622798 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3384/5151] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:32:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:24.646997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b015a144-e1b2-4cd1-92eb-5b28214de1aa req-c2cdb0c0-7242-451d-8598-6f4e1a5b8ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9f698-5ba3-475b-ba38-5a97256e8c9a", "name": "network-vif-deleted", "tag": "b0ee2a93-a3f4-4fb0-b883-eef9ab10b963"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:24.669622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b015a144-e1b2-4cd1-92eb-5b28214de1aa req-c2cdb0c0-7242-451d-8598-6f4e1a5b8ee6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:24.670652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b015a144-e1b2-4cd1-92eb-5b28214de1aa req-c2cdb0c0-7242-451d-8598-6f4e1a5b8ee6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:24.671312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b015a144-e1b2-4cd1-92eb-5b28214de1aa req-c2cdb0c0-7242-451d-8598-6f4e1a5b8ee6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:24.693802 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b015a144-e1b2-4cd1-92eb-5b28214de1aa req-c2cdb0c0-7242-451d-8598-6f4e1a5b8ee6 service nova] Creating event network-vif-deleted:b0ee2a93-a3f4-4fb0-b883-eef9ab10b963 for instance cca9f698-5ba3-475b-ba38-5a97256e8c9a on n-h1-862404-2 Oct 28 18:32:24.711351 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b015a144-e1b2-4cd1-92eb-5b28214de1aa req-c2cdb0c0-7242-451d-8598-6f4e1a5b8ee6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068750 Oct 28 18:32:24.715241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3385/5152] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:24.854112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:24.855807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:24.869593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:24.870409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:24.871547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:24.872671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:24.875457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:24.876134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:24.969498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:24.971386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:24.972588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:24.975154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lazy-loading 'fault' on Instance uuid cca9f698-5ba3-475b-ba38-5a97256e8c9a {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:32:25.060434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:25.073068 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef5295ee-5ef9-4c15-9e94-b811b2986594 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 200 len: 1328 microversion: 2.1 time: 0.224713 Oct 28 18:32:25.075243 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3386/5153] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:24 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 1328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:26.102563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:26.103384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:26.116894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:26.117670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:26.119750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:26.122113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:26.124168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:26.124635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:26.157999 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] HTTP exception thrown: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Request method failure captured: Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a HTTP/1.1 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB8IjUya3a2G7Fs0f9MCae4jU_YovM8f0nLdAgjDzRkQ_YcbPZ8XFvAE-a5RsBcABirCIiVqsB0w52qkaEjpDDSW2yyWnWwek18n9OEICtUDKbPeGDBGMyqqMgkB-nGRfleiUcpA7w6v0lldM5suVxZLHim_AwUu4puBteGOZDVbhuI Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d262ef5fd724b1faee11c815b7f1b65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 830f18fef1d1434697a2c552ade4b793 Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'cca9f698-5ba3-475b-ba38-5a97256e8c9a'} Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:26.162561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Returning 404 to user: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:32:26.166490 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07c32d86-9f64-4e02-b30d-b3c589eeac7c tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 404 len: 111 microversion: 2.1 time: 0.071697 Oct 28 18:32:26.167004 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3387/5154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:26 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:32:26.179800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3295c5ee-c440-4a3d-812e-e4f58e778601 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '.version_select at 0x7f78de25cc10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:26.220125 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3295c5ee-c440-4a3d-812e-e4f58e778601 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497725991" status: 202 len: 0 microversion: 2.1 time: 0.047527 Oct 28 18:32:26.224312 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3388/5155] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:32:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497725991 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:32:28.746454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1571907797", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bcacda4-5a33-4117-a044-45aafb3b3d46"}], "security_groups": [{"name": "tempest-securitygroup--1274486250"}], "key_name": "tempest-keypair-1886144267", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:29.049110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] validate_networks() for [('0bcacda4-5a33-4117-a044-45aafb3b3d46', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:32:30.097812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:32:30.098419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:32:30.099031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:32:30.100800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:32:30.101250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:32:30.119272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:30.122900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:30.124064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:30.126592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:30.128656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:30.129668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:30.171711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:32:30.190585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Getting quotas for user e0cc266e44dd4f76a95a428bb3676b99 and project 2302daf1521c4a0c8059fe6b55b81f4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:32:30.234648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:32:30.239164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:32:30.314396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2bfbef88-1d36-4d6f-8403-b8bd295677cc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.572227 Oct 28 18:32:30.324105 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3389/5156] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:32:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:32:30.335916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13af5c43-2a03-4fe5-a46d-41cb215d9eb0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'create', calling method: .version_select at 0x7f78e2472f70>, body: {"keypair": {"name": "tempest-keypair-1055293608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwSHG8jGPe/N8KoqbSAzrCGta20ufviGT/KQb3Jp4cDiRRIz2Gov6/0JtgMC4N5Kbs7RLW1lT9KbtKd9BvBEENeTo+W71X9Oq3ofLQ2FkiEu4E6IUzf/IKfLd+Rw4kuGg=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:30.354731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:30.364279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-13af5c43-2a03-4fe5-a46d-41cb215d9eb0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Getting quotas for project 4d262ef5fd724b1faee11c815b7f1b65. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:32:30.376366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-13af5c43-2a03-4fe5-a46d-41cb215d9eb0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Getting quotas for user 830f18fef1d1434697a2c552ade4b793 and project 4d262ef5fd724b1faee11c815b7f1b65. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:32:30.437119 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13af5c43-2a03-4fe5-a46d-41cb215d9eb0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108953 Oct 28 18:32:30.438454 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3390/5157] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:32:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:30.443532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d03b503f-5f06-4ec7-831c-4c221f41a33f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:30.444196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d03b503f-5f06-4ec7-831c-4c221f41a33f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:30.601768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d03b503f-5f06-4ec7-831c-4c221f41a33f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:30.630408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d03b503f-5f06-4ec7-831c-4c221f41a33f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1242 microversion: 2.1 time: 0.172932 Oct 28 18:32:30.630408 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3391/5158] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:30 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1242 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:31.643187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:31.644141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:31.666616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:31.675225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:31.682872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:31.690863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:31.694302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:31.696077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:31.866162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:31.878110 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef96f03a-fe99-4fa9-a898-84f9c182190f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1294 microversion: 2.1 time: 0.238788 Oct 28 18:32:31.884389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3392/5159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:31 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1294 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:32.938301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:32.947220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:32.965447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:32.965956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:32.966409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:32.967136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:32.967599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:32.976332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:33.720707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:33.759326 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7cf871f1-5e68-43c0-b3cd-dfe0bcdafeb6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1300 microversion: 2.1 time: 0.829397 Oct 28 18:32:33.766806 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3393/5160] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:32 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1300 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:34.835607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:34.836441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:34.858116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:34.858651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:34.859102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:34.864207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:34.864742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:34.865998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:35.585464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:35.609035 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-58dc88d1-d74e-4077-a410-9a7894cf631d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1368 microversion: 2.1 time: 0.778616 Oct 28 18:32:35.612828 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3394/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:34 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1368 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:35.627343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2093348818", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6abc3248-9953-4ca1-b9c8-297ec8cf13bc"}], "security_groups": [{"name": "tempest-securitygroup--1389683551"}], "key_name": "tempest-keypair-1055293608", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:36.031599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] validate_networks() for [('6abc3248-9953-4ca1-b9c8-297ec8cf13bc', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:32:36.037057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG neutronclient.v2_0.client [None req-3a52762c-de9d-4ab6-9ed3-8e072bc1b377 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=120679) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:32:36.039109 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a52762c-de9d-4ab6-9ed3-8e072bc1b377 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.988483 Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack [None req-3a52762c-de9d-4ab6-9ed3-8e072bc1b377 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Traceback (most recent call last): Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self.find_resource_by_id(resource, name_or_id, Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack raise exceptions.NotFound(message=not_found_message) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'tempest-securitygroup--1928229265' Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Traceback (most recent call last): Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack raise client_exc(message=error_message, Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-83521861-b5e5-4dc0-a71f-d98e53cf33be'] Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Traceback (most recent call last): Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return req.get_response(self.application) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack self._log_req(req, res, start) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack self.force_reraise() Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack raise self.value Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack res = req.get_response(self.application) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return resp(environ, start_response) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return request.get_response(self.application) Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 28 18:32:36.184932 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack response = req.get_response(self._app) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return resp(environ, start_response) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return resp(environ, start_response) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack response = self.app(environ, start_response) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return resp(environ, start_response) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return method(req=request, **action_args) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return f(*args, **kwargs) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack [Previous line repeated 10 more times] Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self._create_instance( Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack security_groups = self._check_requested_secgroups( Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return neutronv20.find_resourceid_by_name_or_id( Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return find_resource_by_name_or_id(client, resource, name_or_id, Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return client.find_resource(resource, name_or_id, project_id, Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 28 18:32:36.189236 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self._find_resource_by_name( Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 457, in _find_resource_by_name Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack data = obj_lister(**params) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1063, in list_security_groups Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self.list('security_groups', self.security_groups_path, Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack res = self.get(path, params=params) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack raise exception.Unauthorized() Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack [None req-3a52762c-de9d-4ab6-9ed3-8e072bc1b377 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] http://10.222.0.16/compute/v2.1/servers returned with HTTP 401 Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a52762c-de9d-4ab6-9ed3-8e072bc1b377 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:32:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.16) Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: CRITICAL nova [None req-3a52762c-de9d-4ab6-9ed3-8e072bc1b377 tempest-ServersTestBootFromVolume-172215972 tempest-ServersTestBootFromVolume-172215972-project] Unhandled error: OSError: write error Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova OSError: write error Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova Oct 28 18:32:36.193254 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1768/5162] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:17:35 2022] POST /compute/v2.1/servers => generated 0 bytes in 901138 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Oct 28 18:32:36.524499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5c57f3d8-cf74-4c3c-a45d-22ff13bc6770 req-58f9717c-d0d5-48a3-854f-4fbd8271f59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9cf817-aac4-44b7-a5f4-ead714699a06", "tag": "332a3a7a-886f-447d-a9c9-1c3790d6f701"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:36.548483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5c57f3d8-cf74-4c3c-a45d-22ff13bc6770 req-58f9717c-d0d5-48a3-854f-4fbd8271f59f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:36.552017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5c57f3d8-cf74-4c3c-a45d-22ff13bc6770 req-58f9717c-d0d5-48a3-854f-4fbd8271f59f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:36.552657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5c57f3d8-cf74-4c3c-a45d-22ff13bc6770 req-58f9717c-d0d5-48a3-854f-4fbd8271f59f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:36.581317 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5c57f3d8-cf74-4c3c-a45d-22ff13bc6770 req-58f9717c-d0d5-48a3-854f-4fbd8271f59f service nova] Creating event network-changed:332a3a7a-886f-447d-a9c9-1c3790d6f701 for instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 on n-h1-862404-2 Oct 28 18:32:36.610864 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5c57f3d8-cf74-4c3c-a45d-22ff13bc6770 req-58f9717c-d0d5-48a3-854f-4fbd8271f59f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091825 Oct 28 18:32:36.611484 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1769/5163] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:32:36.647830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:36.648612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:36.670146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:36.675344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:36.680101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:36.681252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:36.681942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:36.682624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:36.897774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:32:36.898712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:32:36.899408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:32:36.900076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:32:36.900762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:32:36.913596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:36.914406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:36.915076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:36.916125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:36.917767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:36.918640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:36.941151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Getting quotas for project 4d262ef5fd724b1faee11c815b7f1b65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:32:36.954677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Getting quotas for user 830f18fef1d1434697a2c552ade4b793 and project 4d262ef5fd724b1faee11c815b7f1b65. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:32:36.988044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:32:36.991496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:32:37.139200 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-702466ea-0c73-4e66-986c-5ee72a382efb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.522631 Oct 28 18:32:37.167445 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3395/5164] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:32:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:32:37.185148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:37.191493 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9e5c1da5-59ab-49c6-8f9f-bbe695c4ad48 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1368 microversion: 2.1 time: 0.549358 Oct 28 18:32:37.206341 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1770/5165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:36 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1368 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:37.210209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6aee7092-b30f-4747-91d0-17c92eb0a1eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:37.213187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6aee7092-b30f-4747-91d0-17c92eb0a1eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:37.336987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6aee7092-b30f-4747-91d0-17c92eb0a1eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:37.358574 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6aee7092-b30f-4747-91d0-17c92eb0a1eb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1238 microversion: 2.1 time: 0.182725 Oct 28 18:32:37.367699 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3396/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:37 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1238 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:38.222880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:38.224194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:38.236943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:38.237659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:38.238097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:38.238951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:38.239585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:38.240190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:38.386433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:38.387860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:38.395926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:38.396430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:38.396873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:38.400064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:38.400913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:38.402068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:38.463639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:38.476658 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fa9bbaab-9b98-4aac-88fc-20ff83ab8327 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1368 microversion: 2.1 time: 0.258958 Oct 28 18:32:38.478204 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1771/5167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:38 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:38.568681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:38.579729 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5c81314-5490-441e-9d1f-80c21bd0d17e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1290 microversion: 2.1 time: 0.198555 Oct 28 18:32:38.580357 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3397/5168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:38 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1290 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:39.506432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:39.507737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:39.516243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:39.520438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:39.521119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:39.524178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:39.524905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:39.527199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:39.613079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:39.614350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:39.624538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:39.625051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:39.625488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:39.633561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:39.634305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:39.635052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:39.714854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:39.815062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:39.826797 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a4b4d79-95dd-4c43-9b42-db0db6b3b259 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1296 microversion: 2.1 time: 0.217046 Oct 28 18:32:39.828158 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3398/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:39 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1296 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:39.929041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:39.939758 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-066f03e8-78a1-4663-8cdf-3a164c942676 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1368 microversion: 2.1 time: 0.437155 Oct 28 18:32:39.958125 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1772/5170] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:39 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1368 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:40.856058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:40.857406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:40.892633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:40.897830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:40.903720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:40.904851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:40.910260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:40.912563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:40.977285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:40.978723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:41.002925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:41.003431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:41.007136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:41.007633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:41.008118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:41.011498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:41.085370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:41.094786 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d0047e8-a7bd-4c4e-9519-dccd50bca1f7 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1296 microversion: 2.1 time: 0.244827 Oct 28 18:32:41.096823 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3399/5171] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:40 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1296 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:41.726716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:41.759391 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff275910-5ef9-4808-b20f-de0da7c8f009 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1368 microversion: 2.1 time: 0.798123 Oct 28 18:32:41.770023 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1773/5172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:40 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1368 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:42.123284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:42.124452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:42.132894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:42.133663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:42.134423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:42.136418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:42.136927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:42.137709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:42.303391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:42.314119 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f91978f4-c6b5-4a36-8ebe-25f4966903cd tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1364 microversion: 2.1 time: 0.197409 Oct 28 18:32:42.324245 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3400/5173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:42 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:42.795726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:42.796565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:42.815692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:42.827774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:42.828610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:42.829625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:42.830539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:42.831280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:43.225108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-47ec07cf-d475-47ac-bd12-cbe56ef3a4d8 req-1550c7f9-7cb1-4d1b-b174-1b0459802f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e32484-be7d-43a6-b346-745198a421e2", "tag": "966b7c3d-f1b2-48b9-b1b4-13d1e15871cf"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:43.258448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-47ec07cf-d475-47ac-bd12-cbe56ef3a4d8 req-1550c7f9-7cb1-4d1b-b174-1b0459802f71 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:43.259303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-47ec07cf-d475-47ac-bd12-cbe56ef3a4d8 req-1550c7f9-7cb1-4d1b-b174-1b0459802f71 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:43.260018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-47ec07cf-d475-47ac-bd12-cbe56ef3a4d8 req-1550c7f9-7cb1-4d1b-b174-1b0459802f71 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:43.307357 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-47ec07cf-d475-47ac-bd12-cbe56ef3a4d8 req-1550c7f9-7cb1-4d1b-b174-1b0459802f71 service nova] Creating event network-changed:966b7c3d-f1b2-48b9-b1b4-13d1e15871cf for instance 08e32484-be7d-43a6-b346-745198a421e2 on n-h2-862404-2 Oct 28 18:32:43.326559 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-47ec07cf-d475-47ac-bd12-cbe56ef3a4d8 req-1550c7f9-7cb1-4d1b-b174-1b0459802f71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106452 Oct 28 18:32:43.334101 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3401/5174] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:32:43.347619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:43.351306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:43.366372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:43.381725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:43.382756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:43.385340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:43.387324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:43.389738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:43.552138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:43.565038 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-afeacaf6-bde0-4fef-b4e8-e374e5560be6 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1368 microversion: 2.1 time: 0.773720 Oct 28 18:32:43.568656 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1774/5175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:42 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1368 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:43.983160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:44.012215 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01edd043-24cf-4841-94ea-2c7000e080ef tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1364 microversion: 2.1 time: 0.664350 Oct 28 18:32:44.016256 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3402/5176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:43 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1364 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:44.596208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:44.596832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:44.618037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:44.618930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:44.619585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:44.620565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:44.623073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:44.623688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:45.007787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:45.016827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b3ccc31b-e248-4b26-bf8f-5fd11f15f8a7 req-4d14cc54-c51e-48d0-8590-757a381921bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9cf817-aac4-44b7-a5f4-ead714699a06", "name": "network-vif-plugged", "status": "completed", "tag": "332a3a7a-886f-447d-a9c9-1c3790d6f701"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:45.017789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7dd00c86-a8a6-4bf3-bf78-47374628fd54 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1368 microversion: 2.1 time: 0.425473 Oct 28 18:32:45.019863 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1775/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:44 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:45.036605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b3ccc31b-e248-4b26-bf8f-5fd11f15f8a7 req-4d14cc54-c51e-48d0-8590-757a381921bd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:45.041027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b3ccc31b-e248-4b26-bf8f-5fd11f15f8a7 req-4d14cc54-c51e-48d0-8590-757a381921bd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:45.041768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b3ccc31b-e248-4b26-bf8f-5fd11f15f8a7 req-4d14cc54-c51e-48d0-8590-757a381921bd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:45.054570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:45.056425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:45.072162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:45.075561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:45.076901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:45.079224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:45.081057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:45.081824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:45.092932 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b3ccc31b-e248-4b26-bf8f-5fd11f15f8a7 req-4d14cc54-c51e-48d0-8590-757a381921bd service nova] Creating event network-vif-plugged:332a3a7a-886f-447d-a9c9-1c3790d6f701 for instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 on n-h1-862404-2 Oct 28 18:32:45.123583 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b3ccc31b-e248-4b26-bf8f-5fd11f15f8a7 req-4d14cc54-c51e-48d0-8590-757a381921bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096493 Oct 28 18:32:45.126248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3403/5178] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:45.478635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:45.488708 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86872a00-a980-4618-bd39-3a29834073c3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1364 microversion: 2.1 time: 0.448820 Oct 28 18:32:45.489826 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1776/5179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:45 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1364 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:46.048577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:46.050751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:46.080655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:46.081547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:46.082321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:46.083346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:46.084054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:46.085608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:46.310022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:46.333980 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ece78b5-2673-4d34-ac48-82b7a6d2a690 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1368 microversion: 2.1 time: 0.292620 Oct 28 18:32:46.334683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3404/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:46 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:46.519568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:46.521213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:46.534641 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:32:46.535086 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 (ip 10.222.0.16) !!! Oct 28 18:32:46.537761 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:32:46.540511 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 (ip 10.222.0.16) !!! Oct 28 18:32:46.543415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:46.547112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:46.547775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:46.549356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:46.552085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:46.552888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:47.237920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:47.273651 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ce5b32eb-ecf1-456b-9d79-335badc4d5ed tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1364 microversion: 2.1 time: 0.755115 Oct 28 18:32:47.274341 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1777/5181] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:46 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1364 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:47.365968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:47.367089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:47.379503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:47.396382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=24 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:47.404804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:47.405439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:47.407301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:47.408187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:47.409829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:47.411916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:47.794193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:47.809854 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8f8f14f8-db99-4ebd-873b-b89fc6a1a0c9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1558 microversion: 2.1 time: 0.455933 Oct 28 18:32:47.824764 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3405/5182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:47 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1558 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:47.837495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:47.838850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:47.847505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:47.848386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:47.849349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:47.850300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:47.850976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:47.851627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:48.118682 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4082dcb2-392d-4a42-9ea1-9f95b1db88c5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.286313 Oct 28 18:32:48.123742 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1778/5183] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:32:47 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-interface => generated 285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:48.301750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:48.302787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:48.313413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:48.322643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:48.323486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:48.324571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:48.325262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:48.325947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:49.112163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:49.140087 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-93734a0e-c0bf-404e-9727-5d4b5dcc0798 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1364 microversion: 2.1 time: 0.840235 Oct 28 18:32:49.145151 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3406/5184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:48 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1364 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:49.572328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-19dbe14f-16d8-4fa0-8414-9a5b133302c4 req-55ddd23f-791d-4c04-b36b-de74e14dd93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e32484-be7d-43a6-b346-745198a421e2", "name": "network-vif-plugged", "status": "completed", "tag": "966b7c3d-f1b2-48b9-b1b4-13d1e15871cf"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:49.596879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-19dbe14f-16d8-4fa0-8414-9a5b133302c4 req-55ddd23f-791d-4c04-b36b-de74e14dd93d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:49.600396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-19dbe14f-16d8-4fa0-8414-9a5b133302c4 req-55ddd23f-791d-4c04-b36b-de74e14dd93d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:49.601051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-19dbe14f-16d8-4fa0-8414-9a5b133302c4 req-55ddd23f-791d-4c04-b36b-de74e14dd93d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:49.640437 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-19dbe14f-16d8-4fa0-8414-9a5b133302c4 req-55ddd23f-791d-4c04-b36b-de74e14dd93d service nova] Creating event network-vif-plugged:966b7c3d-f1b2-48b9-b1b4-13d1e15871cf for instance 08e32484-be7d-43a6-b346-745198a421e2 on n-h2-862404-2 Oct 28 18:32:49.654756 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-19dbe14f-16d8-4fa0-8414-9a5b133302c4 req-55ddd23f-791d-4c04-b36b-de74e14dd93d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086851 Oct 28 18:32:49.656893 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1779/5185] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:50.172371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:50.173167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:50.185134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:50.185909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:50.189570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:50.190648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:50.191361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:50.191993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:50.451513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:50.465453 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69b95a80-5c28-442b-8719-5afeba2682c9 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1364 microversion: 2.1 time: 0.298770 Oct 28 18:32:50.484502 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3407/5186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:50 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:50.657811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c8cee2be-127c-40c6-b985-03f8b29ff0d6 req-9a3c7adb-d881-41b6-a92a-ade0eaf45861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9cf817-aac4-44b7-a5f4-ead714699a06", "tag": "332a3a7a-886f-447d-a9c9-1c3790d6f701"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:50.684427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c8cee2be-127c-40c6-b985-03f8b29ff0d6 req-9a3c7adb-d881-41b6-a92a-ade0eaf45861 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:50.685113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c8cee2be-127c-40c6-b985-03f8b29ff0d6 req-9a3c7adb-d881-41b6-a92a-ade0eaf45861 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:50.685708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c8cee2be-127c-40c6-b985-03f8b29ff0d6 req-9a3c7adb-d881-41b6-a92a-ade0eaf45861 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:50.698723 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c8cee2be-127c-40c6-b985-03f8b29ff0d6 req-9a3c7adb-d881-41b6-a92a-ade0eaf45861 service nova] Creating event network-changed:332a3a7a-886f-447d-a9c9-1c3790d6f701 for instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 on n-h1-862404-2 Oct 28 18:32:50.705082 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c8cee2be-127c-40c6-b985-03f8b29ff0d6 req-9a3c7adb-d881-41b6-a92a-ade0eaf45861 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051026 Oct 28 18:32:50.709848 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1780/5187] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:51.490997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:51.491887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:51.514500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:51.515283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:51.516338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:51.518939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:51.519590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:51.520398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:51.918495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:51.929222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-66507ced-6018-4237-9cef-319957b74d56 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1551 microversion: 2.1 time: 0.442559 Oct 28 18:32:51.943034 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3408/5188] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:51 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1551 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:51.997654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:51.998268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:52.018284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:52.018284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:52.018600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:52.024225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:52.024826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:52.025287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:52.335426 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b6000730-09d1-4c5a-91cd-941684f3d41a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.359489 Oct 28 18:32:52.336612 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1781/5189] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:32:51 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-interface => generated 285 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:53.070349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-102807885", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:53.179090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:32:53.728182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:32:53.729034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:32:53.730554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:32:53.731135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:32:53.731741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:32:53.750004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:53.751478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:53.753308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:53.754430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:53.756402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:53.758532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:53.832171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Getting quotas for project 8dd688d9bb1d45d79102626a65ee782d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:32:53.850757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Getting quotas for user e6d9ee410e4d427082abb0722d9d55a0 and project 8dd688d9bb1d45d79102626a65ee782d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:32:53.892819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:32:53.895240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:32:54.050010 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb552d1b-cba3-45fd-a75a-6bc81792fef8 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984115 Oct 28 18:32:54.050685 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3409/5190] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:32:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:32:54.064101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a17ffee2-dca6-4951-a1ac-fec43dac7283 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:54.064876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a17ffee2-dca6-4951-a1ac-fec43dac7283 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:54.250741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a17ffee2-dca6-4951-a1ac-fec43dac7283 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:54.263745 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a17ffee2-dca6-4951-a1ac-fec43dac7283 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1214 microversion: 2.1 time: 0.203150 Oct 28 18:32:54.264735 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1782/5191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:54 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:54.971693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-aa841eb7-2ae4-4cf6-804c-1823fe244c69 req-040aa8a9-9ade-4c2a-8512-5c4338459a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e32484-be7d-43a6-b346-745198a421e2", "tag": "966b7c3d-f1b2-48b9-b1b4-13d1e15871cf"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:55.006959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aa841eb7-2ae4-4cf6-804c-1823fe244c69 req-040aa8a9-9ade-4c2a-8512-5c4338459a23 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:55.007418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aa841eb7-2ae4-4cf6-804c-1823fe244c69 req-040aa8a9-9ade-4c2a-8512-5c4338459a23 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:55.010939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aa841eb7-2ae4-4cf6-804c-1823fe244c69 req-040aa8a9-9ade-4c2a-8512-5c4338459a23 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:55.038818 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-aa841eb7-2ae4-4cf6-804c-1823fe244c69 req-040aa8a9-9ade-4c2a-8512-5c4338459a23 service nova] Creating event network-changed:966b7c3d-f1b2-48b9-b1b4-13d1e15871cf for instance 08e32484-be7d-43a6-b346-745198a421e2 on n-h2-862404-2 Oct 28 18:32:55.058424 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-aa841eb7-2ae4-4cf6-804c-1823fe244c69 req-040aa8a9-9ade-4c2a-8512-5c4338459a23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091244 Oct 28 18:32:55.073041 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3410/5192] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:55.294004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:55.297277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:55.307020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:55.312752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:55.315562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:55.316708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:55.317494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:55.318180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:55.481697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:55.501849 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-57c123ab-4667-4ae1-8635-29fbbc64613f tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1210 microversion: 2.1 time: 0.213354 Oct 28 18:32:55.504470 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1783/5193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:55 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1210 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:56.534146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:56.535657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:56.555731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:56.559376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:56.561352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:56.564583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:56.568273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:56.570243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:57.480652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:57.497836 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5aff7fc3-64ea-46a7-837b-76c21d3a4e32 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1272 microversion: 2.1 time: 0.965272 Oct 28 18:32:57.499333 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3411/5194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:56 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1272 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:58.526848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:58.527623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:58.541167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:58.548044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:58.548838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:58.549816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:58.550487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:58.551142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:58.740242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:58.759014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-abc7f5db-2ffd-4dbd-a697-3d78f77da6bd tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1272 microversion: 2.1 time: 0.235426 Oct 28 18:32:58.764423 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1784/5195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:58 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:59.789446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:59.790617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:32:59.801040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:59.802992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:59.803442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:59.804187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:59.806133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:59.806599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:00.051036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:00.068380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce078995-2594-4388-b699-cae7f90c364b tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1314 microversion: 2.1 time: 0.285029 Oct 28 18:33:00.069294 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3412/5196] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:59 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:00.419542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-cab1fc27-ab70-466c-95ec-f06e89495f5d req-58c717b7-edbc-4026-9211-be1826d56c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d33434-8e4e-437a-a2b9-f7d14a27f2c7", "tag": "8c6770b1-6607-48a1-9098-d6cd65d3f542"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:00.449582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cab1fc27-ab70-466c-95ec-f06e89495f5d req-58c717b7-edbc-4026-9211-be1826d56c6c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:00.452752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cab1fc27-ab70-466c-95ec-f06e89495f5d req-58c717b7-edbc-4026-9211-be1826d56c6c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:00.455671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cab1fc27-ab70-466c-95ec-f06e89495f5d req-58c717b7-edbc-4026-9211-be1826d56c6c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:00.485448 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-cab1fc27-ab70-466c-95ec-f06e89495f5d req-58c717b7-edbc-4026-9211-be1826d56c6c service nova] Creating event network-changed:8c6770b1-6607-48a1-9098-d6cd65d3f542 for instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 on n-h1-862404-2 Oct 28 18:33:00.501100 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-cab1fc27-ab70-466c-95ec-f06e89495f5d req-58c717b7-edbc-4026-9211-be1826d56c6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090638 Oct 28 18:33:00.502343 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1785/5197] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:01.096403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:01.098618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:01.101602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:01.121088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:01.123275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:01.123740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:01.126815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:01.127375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:01.127762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:01.468543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:01.478342 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e1bf026-a7d4-43bd-881c-f01a88bb3701 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1314 microversion: 2.1 time: 0.386984 Oct 28 18:33:01.481217 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3413/5198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:01 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:02.505808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:02.506775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:02.523111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:02.523630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:02.524117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:02.525170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:02.525825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:02.527634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:02.809641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:02.831479 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a3e5dfa8-835a-4ee1-9d67-57a109936f36 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1314 microversion: 2.1 time: 0.329232 Oct 28 18:33:02.832512 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1786/5199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:02 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:03.856277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:03.857219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:03.869079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:03.871404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:03.876875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:03.878718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:03.880110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:03.882018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:03.884250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:03.884932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:04.235752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:04.245259 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-785bf7a9-c03b-4d03-8cb8-0dda3d7c2b0d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1314 microversion: 2.1 time: 0.392600 Oct 28 18:33:04.246335 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3414/5200] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:03 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:05.271779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:05.272175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:05.279527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:05.279527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=39 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:05.283946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:05.284449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:05.284890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:05.285605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:05.286070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:05.286545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:05.314816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=83 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:05.474849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:05.484595 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-26e4e516-bc75-497f-87cd-80e363a7c190 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1314 microversion: 2.1 time: 0.217859 Oct 28 18:33:05.503054 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1787/5201] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:05 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:06.519473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:06.521688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:06.536093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:06.537631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:06.538298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:06.539578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:06.540285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:06.540932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:06.835112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:06.851302 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41524d5b-473e-45e7-96e8-61a988a0d939 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1314 microversion: 2.1 time: 0.339423 Oct 28 18:33:06.854284 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3415/5202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:06 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:06.931673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8aa7c1cb-8391-46a5-946c-f5992fcec032 req-e256e501-8a1e-4d09-8f62-e6ecce31c079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d33434-8e4e-437a-a2b9-f7d14a27f2c7", "name": "network-vif-plugged", "status": "completed", "tag": "8c6770b1-6607-48a1-9098-d6cd65d3f542"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:06.944822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8aa7c1cb-8391-46a5-946c-f5992fcec032 req-e256e501-8a1e-4d09-8f62-e6ecce31c079 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:06.950414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8aa7c1cb-8391-46a5-946c-f5992fcec032 req-e256e501-8a1e-4d09-8f62-e6ecce31c079 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:06.951202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8aa7c1cb-8391-46a5-946c-f5992fcec032 req-e256e501-8a1e-4d09-8f62-e6ecce31c079 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:06.977208 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8aa7c1cb-8391-46a5-946c-f5992fcec032 req-e256e501-8a1e-4d09-8f62-e6ecce31c079 service nova] Creating event network-vif-plugged:8c6770b1-6607-48a1-9098-d6cd65d3f542 for instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 on n-h1-862404-2 Oct 28 18:33:06.985430 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8aa7c1cb-8391-46a5-946c-f5992fcec032 req-e256e501-8a1e-4d09-8f62-e6ecce31c079 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058898 Oct 28 18:33:06.988939 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1788/5203] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:07.879560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:07.880341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:07.894694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:07.897067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:07.897615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:07.899054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:07.902749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:07.904626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:08.330458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:08.342761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-400171a2-ec7a-4575-9691-9aca16e5539d tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1314 microversion: 2.1 time: 0.467587 Oct 28 18:33:08.343390 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3416/5204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:07 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:09.372542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:09.373976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:09.386741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:09.388433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:09.389349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:09.392734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:09.396018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:09.396761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:09.839430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:09.850586 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-647563ca-1ec8-4915-9668-df0f13cfc4f2 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1464 microversion: 2.1 time: 0.483952 Oct 28 18:33:09.855096 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1789/5205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:09 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1464 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:09.907891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:09.908873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:09.926490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:09.927042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:09.927541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:09.928292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:09.928799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:09.929263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:09.941034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:09.967863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:33:10.110609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af2235ac-2ee2-4009-baf9-8666141a25bc tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 204 len: 0 microversion: 2.1 time: 0.208353 Oct 28 18:33:10.111328 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3417/5206] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:33:09 2022] DELETE /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:33:10.122990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:10.124207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:10.132170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.132956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.133650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.135280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.135979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.136722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.395249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:10.406519 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e7af3e85-ebce-4dc2-afe1-2b7708698828 tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1470 microversion: 2.1 time: 0.290790 Oct 28 18:33:10.415850 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1790/5207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:10 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:33:11.435121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:11.436536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:11.458451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:11.458970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:11.459419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:11.467736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:11.475734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:11.476649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:11.786232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:11.798163 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae427f54-8aca-4baf-ac3c-fdcafa0b89ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1470 microversion: 2.1 time: 0.368213 Oct 28 18:33:11.804390 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3418/5208] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:11 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1470 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:12.469268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-aed60d52-3352-4741-9d21-57f55e391930 req-5cfa6aad-f22a-44de-8065-f8d14b66a0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d33434-8e4e-437a-a2b9-f7d14a27f2c7", "name": "network-vif-deleted", "tag": "8c6770b1-6607-48a1-9098-d6cd65d3f542"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:12.482679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aed60d52-3352-4741-9d21-57f55e391930 req-5cfa6aad-f22a-44de-8065-f8d14b66a0d9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:12.483175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aed60d52-3352-4741-9d21-57f55e391930 req-5cfa6aad-f22a-44de-8065-f8d14b66a0d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:12.483611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aed60d52-3352-4741-9d21-57f55e391930 req-5cfa6aad-f22a-44de-8065-f8d14b66a0d9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:12.498102 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-aed60d52-3352-4741-9d21-57f55e391930 req-5cfa6aad-f22a-44de-8065-f8d14b66a0d9 service nova] Creating event network-vif-deleted:8c6770b1-6607-48a1-9098-d6cd65d3f542 for instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 on n-h1-862404-2 Oct 28 18:33:12.503729 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-aed60d52-3352-4741-9d21-57f55e391930 req-5cfa6aad-f22a-44de-8065-f8d14b66a0d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038244 Oct 28 18:33:12.504715 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1791/5209] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:33:12.834926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:12.836499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:12.858369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:12.859651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:12.860615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:12.861928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:12.862593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:12.863230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:12.926275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:12.926890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:12.927420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:12.928196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lazy-loading 'fault' on Instance uuid 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:33:13.006750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d9ee410e4d427082abb0722d9d55a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd688d9bb1d45d79102626a65ee782d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:13.018072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5d6cbac-6925-4fd2-8563-80005564c5ed tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 200 len: 1304 microversion: 2.1 time: 0.193058 Oct 28 18:33:13.020245 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3419/5210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:12 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 1304 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:14.045949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:14.047359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] [instance: 07d33434-8e4e-437a-a2b9-f7d14a27f2c7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:14.060711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:14.061672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:14.062390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:14.063523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:14.064533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:14.065209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:14.104441 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] HTTP exception thrown: Instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 could not be found. Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Request method failure captured: Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 HTTP/1.1 Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCBRNbEgIe5CtzY0_Fekkhp6DAGR_MLX0g635hlvnbssagy8RU7368xoUQkEPOG-hH9QpTkCb_A_xWDJ2oZXXQdCvf8wRnBLXimDXOcol5ptpnqmsPRAV2RQa7R3gZ7oLYMpllLOvIU3liwjDmgy1_SHN2zk7RGfkJGMhWx4WsBgGSg Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 8dd688d9bb1d45d79102626a65ee782d Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesNegativeTest-2141462909 Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd688d9bb1d45d79102626a65ee782d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8dd688d9bb1d45d79102626a65ee782d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8dd688d9bb1d45d79102626a65ee782d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8dd688d9bb1d45d79102626a65ee782d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-VolumesNegativeTest-2141462909 Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 8dd688d9bb1d45d79102626a65ee782d Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesNegativeTest-2141462909 Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-VolumesNegativeTest-2141462909-project Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e6d9ee410e4d427082abb0722d9d55a0 Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-VolumesNegativeTest-2141462909-project Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 could not be found. Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '07d33434-8e4e-437a-a2b9-f7d14a27f2c7'} Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 could not be found. Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 could not be found. Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:33:14.110411 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:33:14.114552 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:14.114552 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:33:14.114552 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:33:14.114552 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:33:14.114552 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:33:14.114552 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 could not be found. Oct 28 18:33:14.114552 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:33:14.118926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] Returning 404 to user: Instance 07d33434-8e4e-437a-a2b9-f7d14a27f2c7 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:33:14.120314 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d9434fe1-f2f3-41cd-b64f-b0c1a044cd3c tempest-VolumesNegativeTest-2141462909 tempest-VolumesNegativeTest-2141462909-project] 10.222.0.16 "GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7" status: 404 len: 111 microversion: 2.1 time: 0.079895 Oct 28 18:33:14.121239 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1792/5211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:14 2022] GET /compute/v2.1/servers/07d33434-8e4e-437a-a2b9-f7d14a27f2c7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:33:16.434486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:16.436391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:16.450568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:16.451415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:16.451958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:16.452756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:16.453294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:16.453963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:16.915427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:16.969161 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c35d9daa-790c-407e-91c8-5fc5adff9dc5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.540053 Oct 28 18:33:16.973198 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3420/5212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:16 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:17.003755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:17.004547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:17.017442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:17.017973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:17.018430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:17.019170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:17.019636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:17.021078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:17.398698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:17.409123 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e1a89f9-6bb8-4a9f-bff5-7684c1c3813b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.409864 Oct 28 18:33:17.410388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1793/5213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:16 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:17.433861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:17.434496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:17.444412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:17.445078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:17.450478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:17.453706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:17.454293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:17.454746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:17.725108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:17.737222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7247c484-a09e-48d5-a6b7-5237494715d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.308633 Oct 28 18:33:17.743894 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3421/5214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:17 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:17.771888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:17.772551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:17.785030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:17.785559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:17.786010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:17.792280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:17.792802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:17.793287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:18.262704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:18.279275 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22db2e39-78f3-4eaa-8285-aa7263aae57a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.514306 Oct 28 18:33:18.279886 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1794/5215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:17 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:33:18.465317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-901302456", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "731b8166-5ac1-4b7a-b324-9ea8c5b344b1"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:18.537120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] validate_networks() for [('731b8166-5ac1-4b7a-b324-9ea8c5b344b1', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:33:19.418144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:33:19.418883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:33:19.419570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:33:19.420171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:33:19.420956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:33:19.436593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:19.437282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:19.437937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:19.441299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:19.441740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:19.442219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:19.476866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:33:19.486216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for user 4666e4ac2e124ed9bf3579707986cb43 and project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:33:19.507749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:33:19.511659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:33:19.636408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45a0effc-e0a7-4a85-8516-f91b61fec0c9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169290 Oct 28 18:33:19.639779 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3422/5216] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:33:19.650293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45f82042-8230-4413-abc1-a9c2534f2e7d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:19.652721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45f82042-8230-4413-abc1-a9c2534f2e7d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:19.949352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45f82042-8230-4413-abc1-a9c2534f2e7d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:19.958843 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45f82042-8230-4413-abc1-a9c2534f2e7d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1214 microversion: 2.1 time: 0.312201 Oct 28 18:33:19.960484 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1795/5217] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:19 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:20.686623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e470e2c0-ea32-41fb-8ac5-7cce114dc9b9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'create', calling method: .version_select at 0x7f78dd52a280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-233759918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdfeJZUYoNKzEWrWYbR9BY3pT+7YiPc+woHdoTZ4H3cr+9CpoYLgTCNQThCLq+R0PJScY+WY6hzTc4hVAUWidxqYNKfPGbAoPwxsBT/Z5CmtXIOm9xm2NWuW+ooXS0NeQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:20.715089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e470e2c0-ea32-41fb-8ac5-7cce114dc9b9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for project 946b8055a69f4f979036482e1fd37f67. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:33:20.723289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e470e2c0-ea32-41fb-8ac5-7cce114dc9b9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for user 379680f3dd0542389b53a8a4f20ae800 and project 946b8055a69f4f979036482e1fd37f67. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:33:20.764059 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e470e2c0-ea32-41fb-8ac5-7cce114dc9b9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.349586 Oct 28 18:33:20.765901 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3423/5218] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:33:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:20.988670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:20.990308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:21.013352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:21.016095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:21.018446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:21.019226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:21.021970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:21.022418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:21.300755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:21.312637 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aefe4118-fe3d-4dff-9585-107daae32964 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1266 microversion: 2.1 time: 0.329319 Oct 28 18:33:21.316934 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1796/5219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:20 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:22.343498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:22.345155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:22.365808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:22.369808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:22.374827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:22.376795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:22.377761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:22.378417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:22.560176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:22.584008 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34d8a9e0-e460-4fa6-99c3-07ad9ab2f334 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1272 microversion: 2.1 time: 0.243214 Oct 28 18:33:22.587230 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3424/5220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:22 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:23.618394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:23.619733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:23.653689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:23.654477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:23.655088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:23.656060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:23.656676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:23.657260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:24.649995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:24.669214 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2cd853e3-092f-4d7a-bed6-4fae5db0ce0e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 1.058801 Oct 28 18:33:24.670411 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1797/5221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:23 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:25.699844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:25.700567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:25.709528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:25.710128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:25.710613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:25.711386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:25.712097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:25.714331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:25.898968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:25.911629 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36d26d57-c81c-45f3-acce-25ecfc31685b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.218623 Oct 28 18:33:25.922835 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3425/5222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:25 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:26.526068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9cbba476-8759-4e51-9a7c-aba1e9dd387e req-eea809b8-41f9-4257-8b9b-39af5fc1b6fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4362b20-fe39-4f11-a4e6-0b889f750fb0", "tag": "78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:26.538158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9cbba476-8759-4e51-9a7c-aba1e9dd387e req-eea809b8-41f9-4257-8b9b-39af5fc1b6fc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:26.538885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9cbba476-8759-4e51-9a7c-aba1e9dd387e req-eea809b8-41f9-4257-8b9b-39af5fc1b6fc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:26.539475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9cbba476-8759-4e51-9a7c-aba1e9dd387e req-eea809b8-41f9-4257-8b9b-39af5fc1b6fc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:26.563065 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9cbba476-8759-4e51-9a7c-aba1e9dd387e req-eea809b8-41f9-4257-8b9b-39af5fc1b6fc service nova] Creating event network-changed:78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd for instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 on n-h1-862404-2 Oct 28 18:33:26.577084 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9cbba476-8759-4e51-9a7c-aba1e9dd387e req-eea809b8-41f9-4257-8b9b-39af5fc1b6fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055171 Oct 28 18:33:26.580072 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1798/5223] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:26.938938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:26.939492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:26.946638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:26.948183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:26.948985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:26.949906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:26.950577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:26.951378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:27.241595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:27.254553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a737a3c-fecf-40f8-a5c5-b7c028f19e12 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.320378 Oct 28 18:33:27.255140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3426/5224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:26 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:28.284964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:28.285739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:28.298144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:28.298642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:28.301762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:28.303603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:28.304108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:28.304522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:28.560308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:28.571723 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-98ec2fe4-43a8-4654-abd3-2316d8c27800 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.293062 Oct 28 18:33:28.573394 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1799/5225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:28 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:33:29.597540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:29.599219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:29.604290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:29.610402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:29.611413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:29.612063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:29.613002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:29.613632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:29.616832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:30.126346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:30.127571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:30.143119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:30.147533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:30.149222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:30.156515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:30.157786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:30.159555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:30.160258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:30.256668 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c6db9a5-3370-48c5-b516-a813570cf734 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/ips" status: 200 len: 147 microversion: 2.1 time: 0.134228 Oct 28 18:33:30.259124 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1800/5226] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:33:30 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/ips => generated 147 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:30.383803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:30.399090 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d17a27c2-e6c2-4521-8f6f-1c8f039fd5a8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.805650 Oct 28 18:33:30.419045 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3427/5227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:29 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:31.423355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:31.424026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:31.441974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.455991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.458906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.460218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.474385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.475056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:32.186209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:32.202774 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d607bf9f-8357-4985-9b91-2da5a5fc98f6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.783133 Oct 28 18:33:32.261347 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1801/5228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:31 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:33.216271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5578668c-0313-475b-80bf-c7968d60a136"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:33.218945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:33.225157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:33.226340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:33.230607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:33.231923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:33.249141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:33.250781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:33.252251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:33.253238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:33.254389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:33.254934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:33.255375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:33.256052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:33.256534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:33.257812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:33.260514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:33.261175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:33.776379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:33.802491 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a629aeab-d7f3-4b3a-a149-db1f87d50b57 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.578854 Oct 28 18:33:33.803296 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1802/5229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:33 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:33:33.831243 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-afb7c7b2-74eb-4c95-ae04-b368b2dc24bb tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623364 Oct 28 18:33:33.837402 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3428/5230] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:33:33 2022] POST /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:34.831146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:34.831887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:34.849275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:34.849877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:34.856532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:34.857409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:34.861842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:34.862566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:35.696112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:35.701406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=76 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:35.716255 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11d18434-8105-40ac-a77e-635599c5dcb8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.889466 Oct 28 18:33:35.733822 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1803/5231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:34 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:36.740590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:36.742065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:36.764928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:36.772282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:36.773129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:36.774276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:36.775027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:36.776105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:37.227849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:37.233660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1805607577", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "e37868fd-9165-4553-bebc-a17f01f864cf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-233759918", "security_groups": [{"name": "tempest-secgroup-smoke-2084183266"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:37.251053 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6648c24d-43dc-4adb-8503-dd1dd59de01b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.515889 Oct 28 18:33:37.275924 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3429/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:36 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:37.277714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=36 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:37.542191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] validate_networks() for [('e37868fd-9165-4553-bebc-a17f01f864cf', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:33:38.284420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:38.285613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:38.315098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:38.320499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:38.323174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:38.326088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:38.330663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:38.333207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:39.204354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:39.214068 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f68eb00e-3ef7-493c-945e-2cd7a1effe17 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.933981 Oct 28 18:33:39.217694 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3430/5233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:38 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:39.489797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:33:39.490917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:33:39.491564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:33:39.492213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:33:39.492792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:33:39.514959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:39.515789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:39.516460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:39.517419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:39.521598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:39.522324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:39.573409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for project 946b8055a69f4f979036482e1fd37f67. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:33:39.579763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for user 379680f3dd0542389b53a8a4f20ae800 and project 946b8055a69f4f979036482e1fd37f67. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:33:39.613685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:33:39.616610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:33:39.738482 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b2943886-030d-4ef1-88bc-c89a2a4b4ece tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.508694 Oct 28 18:33:39.753154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e64cbeca-5a9b-45c6-9db4-88aeec4b8a04 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:39.753788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e64cbeca-5a9b-45c6-9db4-88aeec4b8a04 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:39.760799 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1804/5234] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:33:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:33:40.086772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e64cbeca-5a9b-45c6-9db4-88aeec4b8a04 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:40.098765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-47a74cb0-d1f4-425c-9f97-163f3de22562 req-ebe22124-8ae6-45b0-99f9-c78c16232f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4362b20-fe39-4f11-a4e6-0b889f750fb0", "name": "network-vif-plugged", "status": "completed", "tag": "78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:40.102392 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e64cbeca-5a9b-45c6-9db4-88aeec4b8a04 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1266 microversion: 2.1 time: 0.353107 Oct 28 18:33:40.109513 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3431/5235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:39 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:40.145411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-47a74cb0-d1f4-425c-9f97-163f3de22562 req-ebe22124-8ae6-45b0-99f9-c78c16232f66 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:40.157265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-47a74cb0-d1f4-425c-9f97-163f3de22562 req-ebe22124-8ae6-45b0-99f9-c78c16232f66 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:40.157745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-47a74cb0-d1f4-425c-9f97-163f3de22562 req-ebe22124-8ae6-45b0-99f9-c78c16232f66 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:40.188633 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-47a74cb0-d1f4-425c-9f97-163f3de22562 req-ebe22124-8ae6-45b0-99f9-c78c16232f66 service nova] Creating event network-vif-plugged:78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd for instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 on n-h1-862404-2 Oct 28 18:33:40.199205 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-47a74cb0-d1f4-425c-9f97-163f3de22562 req-ebe22124-8ae6-45b0-99f9-c78c16232f66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104125 Oct 28 18:33:40.211907 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1805/5236] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:40.242462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:40.243091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:40.289087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:40.293331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:40.297217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:40.302175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:40.313952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:40.319479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:40.361021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:40.789374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:40.820717 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f40ce3f0-4fc6-4b66-b54a-1d744082d318 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.584080 Oct 28 18:33:40.825541 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3432/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:40 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:41.127166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:41.128027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:41.142356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:41.149720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:41.153961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:41.154592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:41.155206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:41.158242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:41.332022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:41.348282 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6df0a30d-afa8-4468-b7a7-0a6f0d6a1649 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1270 microversion: 2.1 time: 0.224504 Oct 28 18:33:41.351620 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1806/5238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:41 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:41.855200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:41.862073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:41.880352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:41.881143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:41.881752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:41.883015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:41.883666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:41.884698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:42.262198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:42.273224 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-503951b1-bef2-4aab-86d5-5f4bdb7b8a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1314 microversion: 2.1 time: 0.423249 Oct 28 18:33:42.274680 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3433/5239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:41 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:42.375379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:42.378195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:42.388714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:42.389187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:42.391965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:42.395893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:42.398648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:42.399447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:42.799043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:42.812551 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-46b63507-c188-4b58-ac95-fe1014fce1ae tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1318 microversion: 2.1 time: 0.440807 Oct 28 18:33:42.813745 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1807/5240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:42 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:43.297302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:43.297849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:43.324057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:43.334415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:43.335139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:43.336235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:43.336870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:43.337544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:43.845285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:43.846992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:43.882671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:43.888404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:43.888900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:43.889669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:43.895516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:43.896044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:44.287575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:44.299699 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8369b4ee-b927-4a71-a257-6a4869c467e3 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1502 microversion: 2.1 time: 1.006331 Oct 28 18:33:44.317538 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3434/5241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:43 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1502 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:44.330637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:44.331198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:44.361046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:44.361558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:44.362117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:44.362765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:44.363243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:44.363682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:44.615219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:44.626361 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7488723b-ca08-4872-9936-1b54c8a94c3a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1324 microversion: 2.1 time: 0.793769 Oct 28 18:33:44.643846 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1808/5242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:43 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1324 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:44.807329 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Removing security group 637e8d2a-226d-4f59-8c3d-bbb09731b031 from port 78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd Oct 28 18:33:45.660107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:45.660926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:45.673333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:45.674063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:45.674830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:45.675689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:45.676796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:45.677335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:46.058652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:46.078229 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-613556fb-dad1-42d4-9a33-e86f37b6c378 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.420903 Oct 28 18:33:46.079360 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1809/5243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:45 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:46.446057 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51dc0438-d930-4d8a-a395-8ac55c060e3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0/action" status: 202 len: 0 microversion: 2.1 time: 2.119707 Oct 28 18:33:46.447875 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3435/5244] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:33:44 2022] POST /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0/action => generated 0 bytes in 2122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:33:46.470496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6e7fc4fa-4666-4186-9537-f5b6e79cde1d req-301469f3-c2e1-4c92-a8a3-270d9e2b1727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4362b20-fe39-4f11-a4e6-0b889f750fb0", "tag": "78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:46.472128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:46.473444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:46.492368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:46.496095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:46.496664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:46.497503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:46.500659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6e7fc4fa-4666-4186-9537-f5b6e79cde1d req-301469f3-c2e1-4c92-a8a3-270d9e2b1727 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:46.501158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6e7fc4fa-4666-4186-9537-f5b6e79cde1d req-301469f3-c2e1-4c92-a8a3-270d9e2b1727 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:46.501594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6e7fc4fa-4666-4186-9537-f5b6e79cde1d req-301469f3-c2e1-4c92-a8a3-270d9e2b1727 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:46.502191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:46.502776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:46.554005 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6e7fc4fa-4666-4186-9537-f5b6e79cde1d req-301469f3-c2e1-4c92-a8a3-270d9e2b1727 service nova] Creating event network-changed:78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd for instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 on n-h1-862404-2 Oct 28 18:33:46.567108 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6e7fc4fa-4666-4186-9537-f5b6e79cde1d req-301469f3-c2e1-4c92-a8a3-270d9e2b1727 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104741 Oct 28 18:33:46.569753 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3436/5245] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:33:46.789485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:46.809609 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-124aebbb-00df-4c61-b236-bc4a01771bd8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1460 microversion: 2.1 time: 0.349088 Oct 28 18:33:46.811208 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1810/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:46 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1460 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:46.843388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:46.844151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:46.866385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:46.867942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:46.869732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:46.875650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:46.876221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:46.876673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:47.106690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:47.107303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:47.119656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:47.120201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:47.120650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:47.121373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:47.122423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:47.122871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:47.378081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:47.424934 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0bd10f1f-9dd4-4ccc-8c29-ba9f5a1d9aea tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.592412 Oct 28 18:33:47.426550 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3437/5247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:46 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:47.450914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:47.451581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:47.457893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:47.458397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:47.459028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:47.460011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:47.460723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:47.461379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:47.527803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:47.539537 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-928a20a7-39cd-46ea-85d0-0d7df20d2c0b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.437016 Oct 28 18:33:47.541390 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1811/5248] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:47 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:47.723189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:47.734818 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af039abe-f3f1-4b9d-a398-8b8cbfde84f4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.288201 Oct 28 18:33:47.736648 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3438/5249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:47 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:47.776353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:47.777687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:47.789834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:47.791591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:47.792233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:47.793329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:47.794057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:47.795447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:48.373227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:48.387940 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-226202cd-ee64-4b20-8267-46a8de01a576 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.629669 Oct 28 18:33:48.389146 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1812/5250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:47 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:48.419651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:48.421085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:48.428841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:48.429542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:48.430192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:48.431872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:48.432528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:48.433345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:48.570104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:48.571232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:48.588630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:48.589442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:48.590121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:48.591070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:48.592490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:48.596696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:49.554492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:49.597512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:49.662630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:49.673450 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59e25f86-68f6-4ff1-be2a-8c480a4a631f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 1.109828 Oct 28 18:33:49.674505 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1813/5251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:48 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:49.688415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f104fd7b-a915-4254-8dbd-a08fcaf90658 req-1e538ac5-5f67-49e3-82cd-d21a4e61b766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063de5e-ae3f-4d25-97a3-4ffa18bdf86d", "tag": "6aea57d1-9a26-42db-99e7-ffd76f4f0873"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:49.705855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:49.711559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f104fd7b-a915-4254-8dbd-a08fcaf90658 req-1e538ac5-5f67-49e3-82cd-d21a4e61b766 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:49.713158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f104fd7b-a915-4254-8dbd-a08fcaf90658 req-1e538ac5-5f67-49e3-82cd-d21a4e61b766 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:49.713896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f104fd7b-a915-4254-8dbd-a08fcaf90658 req-1e538ac5-5f67-49e3-82cd-d21a4e61b766 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:49.726812 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb44098b-9825-4340-afba-df5ceb7c6275 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 1.311429 Oct 28 18:33:49.730260 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3439/5252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:48 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:49.745735 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f104fd7b-a915-4254-8dbd-a08fcaf90658 req-1e538ac5-5f67-49e3-82cd-d21a4e61b766 service nova] Creating event network-changed:6aea57d1-9a26-42db-99e7-ffd76f4f0873 for instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d on n-h2-862404-2 Oct 28 18:33:49.756642 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f104fd7b-a915-4254-8dbd-a08fcaf90658 req-1e538ac5-5f67-49e3-82cd-d21a4e61b766 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077889 Oct 28 18:33:49.758179 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1814/5253] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:50.031376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1895820742", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "731b8166-5ac1-4b7a-b324-9ea8c5b344b1"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:50.102451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:50.197531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] validate_networks() for [('731b8166-5ac1-4b7a-b324-9ea8c5b344b1', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:33:50.701023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:50.702343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:50.717994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:50.718491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:50.718922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:50.745591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:50.746706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:50.747200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:51.394334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:51.404106 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43241cf0-69b6-4854-9b22-0f6a6ffd4bff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.708009 Oct 28 18:33:51.409246 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1815/5254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:50 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:51.420176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:51.440407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:51.450909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:51.452260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:51.453350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:51.454278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:51.454923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:51.455589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:51.547287 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2178311c-fd7b-4b10-bd44-9e2066e62c30 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131256 Oct 28 18:33:51.550021 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1816/5255] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:33:51 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:51.570569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:51.575794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:51.598042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:51.600565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:51.601075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:51.604783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:51.605299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:51.609203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:51.710693 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-959140dc-3e23-473f-a784-aea0b79de041 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/5578668c-0313-475b-80bf-c7968d60a136" status: 200 len: 194 microversion: 2.1 time: 0.152507 Oct 28 18:33:51.714011 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1817/5256] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Oct 28 18:33:51 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/5578668c-0313-475b-80bf-c7968d60a136 => generated 194 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:52.441492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:52.443921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:52.451670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:33:52.453506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:33:52.454006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:33:52.454490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:33:52.454917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:33:52.480192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:52.480691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:52.483152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:52.485415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:52.486031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:52.486334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:52.487145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:52.488053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:52.488988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:52.492178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:52.492853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:52.494630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:52.558650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:33:52.585898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Getting quotas for user 4666e4ac2e124ed9bf3579707986cb43 and project 089f168818394b139c87b28362e23ece. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:33:52.613539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:33:52.617093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:33:52.708924 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d696ffb-9be3-4de7-b37a-dd7b5a087bc9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.681825 Oct 28 18:33:52.713182 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3440/5257] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:33:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:33:52.724874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84056d05-04ae-4e2a-8327-f0165d2de15c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:52.728987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84056d05-04ae-4e2a-8327-f0165d2de15c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:52.915154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-84056d05-04ae-4e2a-8327-f0165d2de15c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:52.925460 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84056d05-04ae-4e2a-8327-f0165d2de15c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1215 microversion: 2.1 time: 0.204951 Oct 28 18:33:52.931864 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3441/5258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:52 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:53.471777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:53.485712 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2255e3a7-b819-45dd-a141-9be814ce31e3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 1.053508 Oct 28 18:33:53.486336 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1818/5259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:52 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:53.804703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:53.806634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:53.826223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:53.828483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:53.830904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:53.832314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:53.835476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:53.836280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:53.889830 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b802a8e2-e323-4dcd-8efa-01ad89335a31 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/ips" status: 200 len: 150 microversion: 2.1 time: 0.091144 Oct 28 18:33:53.891078 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3442/5260] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 18:33:53 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:53.954794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:53.956489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:53.972120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:53.972981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:53.975016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:53.976115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:53.978046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:53.978911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:54.315451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:54.352830 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb7d8d37-ba4d-4bef-9437-5f1dfd23c325 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1211 microversion: 2.1 time: 0.398690 Oct 28 18:33:54.354418 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1819/5261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:53 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1211 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:54.510953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:54.511759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:54.521030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:54.524411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:54.525081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:54.526069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:54.526695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:54.532478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:54.676886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c265b6a-b51c-4424-8fff-6b5a937ef752"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:54.680237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:54.696056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:54.697774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:54.699399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:54.700365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:54.703145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:54.703759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:55.120663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:55.135505 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d38c90a-822b-4dc4-9840-d873707d5d6b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.627894 Oct 28 18:33:55.140625 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3443/5262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:54 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:55.253411 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-125e145a-1d07-4918-b922-62a13da0e2ad tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "POST /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578940 Oct 28 18:33:55.258900 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1820/5263] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:33:54 2022] POST /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:33:55.382570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:55.383272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:55.392484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:55.393302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:55.394802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:55.396866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:55.397553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:55.398916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:55.564761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:55.579965 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4213d12-45f0-493a-aef6-1039300bfa93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1273 microversion: 2.1 time: 0.200148 Oct 28 18:33:55.581011 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3444/5264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:55 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:56.165770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:56.166611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:56.194243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:56.200281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:56.200896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:56.202932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:56.207454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:56.208074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:56.211548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:56.609811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:56.610527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:56.633150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:56.633970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:56.634684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:56.635522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:56.636036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:56.636471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:56.850969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:56.867348 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a4d2fce-4a11-48e0-b080-f927f87bf4e5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1273 microversion: 2.1 time: 0.257859 Oct 28 18:33:56.888967 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3445/5265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:56 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:56.941389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7079b5f-7ac9-4b41-9703-a0b9e05d07c1"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:56.944205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:56.966451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:56.969390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:56.971059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:56.971853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:56.975587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:56.976102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:56.987347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:57.011018 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f5537662-a499-4e9e-be7a-e635abef3a07 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.851198 Oct 28 18:33:57.011625 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1821/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:56 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:57.559134 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76a8381e-e6de-480c-a3a2-d82d15e30dc1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "POST /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.622512 Oct 28 18:33:57.560054 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3446/5267] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:33:56 2022] POST /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:33:57.893358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:57.894800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:57.924089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:57.924639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:57.927071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:57.928667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:57.929324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:57.932824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:58.235289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:58.244751 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1b0c944b-e2d0-44c7-9bdd-de7b26b2d531 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1273 microversion: 2.1 time: 0.355690 Oct 28 18:33:58.245350 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1822/5268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:57 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1273 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:58.266239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:58.285106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:58.294457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:58.298260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:58.298950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:58.299891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:58.302421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:58.303066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:58.363251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e142e13a-aa24-4aef-a8db-59225e6aa40a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:58.365129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e142e13a-aa24-4aef-a8db-59225e6aa40a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:58.365748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e142e13a-aa24-4aef-a8db-59225e6aa40a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:58.366304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e142e13a-aa24-4aef-a8db-59225e6aa40a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:58.367170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e142e13a-aa24-4aef-a8db-59225e6aa40a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:58.370635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e142e13a-aa24-4aef-a8db-59225e6aa40a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:58.372717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e142e13a-aa24-4aef-a8db-59225e6aa40a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:58.463553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e142e13a-aa24-4aef-a8db-59225e6aa40a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.489963 Oct 28 18:33:58.464220 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3447/5269] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 18:33:57 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:58.639622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-111164240", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "availability_zone": "nova:n-h1-862404-2", "networks": [{"uuid": "c0d3c7e5-5185-4dee-9a64-9c097a491e8f"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:58.813761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] validate_networks() for [('c0d3c7e5-5185-4dee-9a64-9c097a491e8f', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:33:58.988811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:59.008121 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-68252dbb-44b4-49b7-bed4-525d14c847c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.746357 Oct 28 18:33:59.010732 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1823/5270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:58 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:59.270199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:59.279734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:33:59.296169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:59.298621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:59.300560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:59.301596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:59.307503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:59.308682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:59.781418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:59.793472 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d2b8ea5c-eda0-4659-baba-d5864a010182 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1315 microversion: 2.1 time: 0.527436 Oct 28 18:33:59.794106 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1824/5271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:59 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:00.006925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:34:00.007720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:34:00.010182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:34:00.010889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:34:00.011338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:34:00.025957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.033292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.035239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:00.036925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.038575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:00.039205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:00.052426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.053323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:00.054842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.055350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.055910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:00.056647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.057111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.063884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:00.105206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Getting quotas for project c1f4ee93a4234d36a4b46653f4a38fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:34:00.112785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Getting quotas for user 6f830445fe8f4ffc963bff548e087d12 and project c1f4ee93a4234d36a4b46653f4a38fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:34:00.146749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:34:00.150264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:34:00.215021 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7920c7d2-d619-4efa-82a2-f1680b8aa78f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580813 Oct 28 18:34:00.223186 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3448/5272] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:33:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:34:00.229231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-701201b7-9e14-49d4-b8c4-b01495055edc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:00.230183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-701201b7-9e14-49d4-b8c4-b01495055edc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:00.393685 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-701201b7-9e14-49d4-b8c4-b01495055edc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1328 microversion: 2.1 time: 0.169069 Oct 28 18:34:00.397980 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3449/5273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:00 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:00.482389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:00.492070 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-38f36c22-2418-43d8-8bfd-a2e6f85e813f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.457320 Oct 28 18:34:00.499904 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1825/5274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:00 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:00.821926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:00.822608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:00.843621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.845512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.848221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:00.849527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.852196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.854117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.151334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:01.166030 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-09d04356-b9c3-450e-b3f8-476355d900ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1315 microversion: 2.1 time: 0.346087 Oct 28 18:34:01.166814 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3450/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:00 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:01.338969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9f43014a-6698-4a82-b36f-3bcd4973d4d4 req-2485cc17-924c-4f29-8936-4165c75cae01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba94308-6ac5-4b60-81ba-3662bd82c3f0", "tag": "5df55407-37c7-4aa2-854a-af22833eff2c"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:01.371665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9f43014a-6698-4a82-b36f-3bcd4973d4d4 req-2485cc17-924c-4f29-8936-4165c75cae01 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:01.376416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9f43014a-6698-4a82-b36f-3bcd4973d4d4 req-2485cc17-924c-4f29-8936-4165c75cae01 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:01.378573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9f43014a-6698-4a82-b36f-3bcd4973d4d4 req-2485cc17-924c-4f29-8936-4165c75cae01 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.399804 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9f43014a-6698-4a82-b36f-3bcd4973d4d4 req-2485cc17-924c-4f29-8936-4165c75cae01 service nova] Creating event network-changed:5df55407-37c7-4aa2-854a-af22833eff2c for instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 on n-h1-862404-2 Oct 28 18:34:01.416958 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9f43014a-6698-4a82-b36f-3bcd4973d4d4 req-2485cc17-924c-4f29-8936-4165c75cae01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082836 Oct 28 18:34:01.423664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:01.424831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:01.432230 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1826/5276] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:01.435359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:01.436161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:01.436844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.437798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:01.438493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:01.439171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.529770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:01.531711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:01.546059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:01.547641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:01.548697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.551098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:01.554661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:01.555364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.721155 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48de78b3-f8e4-4945-8fea-6f440b4fdb0b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1337 microversion: 2.1 time: 0.301865 Oct 28 18:34:01.735878 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3451/5277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:01 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1337 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:01.735878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-31d6b634-b48f-4ae2-aa2a-c22848e4bfb0 req-31bd9786-79c6-4309-bedb-ba2885a74466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e063de5e-ae3f-4d25-97a3-4ffa18bdf86d", "name": "network-vif-plugged", "status": "completed", "tag": "6aea57d1-9a26-42db-99e7-ffd76f4f0873"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:01.752634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-31d6b634-b48f-4ae2-aa2a-c22848e4bfb0 req-31bd9786-79c6-4309-bedb-ba2885a74466 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:01.753130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-31d6b634-b48f-4ae2-aa2a-c22848e4bfb0 req-31bd9786-79c6-4309-bedb-ba2885a74466 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:01.753615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-31d6b634-b48f-4ae2-aa2a-c22848e4bfb0 req-31bd9786-79c6-4309-bedb-ba2885a74466 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.805815 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-31d6b634-b48f-4ae2-aa2a-c22848e4bfb0 req-31bd9786-79c6-4309-bedb-ba2885a74466 service nova] Creating event network-vif-plugged:6aea57d1-9a26-42db-99e7-ffd76f4f0873 for instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d on n-h2-862404-2 Oct 28 18:34:01.827668 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-31d6b634-b48f-4ae2-aa2a-c22848e4bfb0 req-31bd9786-79c6-4309-bedb-ba2885a74466 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098188 Oct 28 18:34:01.829671 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3452/5278] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:02.191911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:02.193016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:02.205499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:02.214723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:02.219668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:02.222437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:02.223677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:02.224164 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-80092f35-354b-452f-9578-3cb188dd6bf9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.690690 Oct 28 18:34:02.225296 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1827/5279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:01 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:02.227455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:02.232482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:02.287004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:02.751521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:02.752988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:02.772577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:02.782431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:02.785434 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40676cb2-0515-48dd-a323-d72b17268e69 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1315 microversion: 2.1 time: 0.598896 Oct 28 18:34:02.787027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3453/5280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:02 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:02.788340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:02.792009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:02.793330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:02.794010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:02.794781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:03.092985 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25c3f20e-43b1-4daa-b32a-4c53984a34de tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1421 microversion: 2.1 time: 0.346092 Oct 28 18:34:03.093925 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1828/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:02 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1421 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:03.249712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:03.250350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:03.265841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:03.266358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:03.266812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:03.267745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:03.270187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:03.270655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:03.660382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:03.670321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6702115-ffa7-46a9-99a8-61a8b300079c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1392 microversion: 2.1 time: 0.424437 Oct 28 18:34:03.670858 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3454/5282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:03 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1392 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:03.812965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:03.813704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:03.837311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:03.837836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:03.838289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:03.844663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:03.846149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:03.846990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.121608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:04.122243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:04.138391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:04.142203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.142712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.143162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.156408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.157514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.158609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.326663 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4952dc5c-80b9-4a73-bce7-b2ce1b7eadbf tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1421 microversion: 2.1 time: 0.209505 Oct 28 18:34:04.331690 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3455/5283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:04 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1421 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:04.661037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:04.673466 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2bc7cb0b-6898-46aa-b017-15d5c6dddd05 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1315 microversion: 2.1 time: 0.865959 Oct 28 18:34:04.689883 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1829/5284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:03 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:04.694195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:04.694878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:04.703794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.704776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.705524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.706879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.707745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.708570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.889687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:04.900816 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-155624f9-a5ee-41d4-8a5b-647fdb03c952 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1564 microversion: 2.1 time: 0.210581 Oct 28 18:34:04.924836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3456/5285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:04 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1564 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:04.930276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:04.931641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:04.947518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.951051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.951506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.952270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.952732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.958416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:05.356078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:05.357538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:05.366470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:05.367766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:05.370003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:05.371023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:05.374084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:05.374997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:05.460005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:05.469805 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a5cee8d5-ff7f-462d-9bca-13d36b3c25b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1564 microversion: 2.1 time: 0.544000 Oct 28 18:34:05.473011 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1830/5286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:04 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1564 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:05.549098 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8b22ea4-fe05-42c1-ada4-1a6fef8abac4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1421 microversion: 2.1 time: 0.197956 Oct 28 18:34:05.550452 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3457/5287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:05 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1421 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:05.698898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:05.699575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:05.711557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:05.713090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:05.713725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:05.714653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:05.719754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:05.720502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:06.117377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:06.129490 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3e96164-c63d-4ff1-8d19-2f50a95cd562 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1315 microversion: 2.1 time: 0.432512 Oct 28 18:34:06.130404 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1831/5288] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:05 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:06.580655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:06.582363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:06.599478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:06.600520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:06.603148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:06.603984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:06.608991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:06.612428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:06.801864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f80e0291-3230-4085-8ec7-0cff58c22cc1 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1421 microversion: 2.1 time: 0.226844 Oct 28 18:34:06.810242 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3458/5289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:06 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1421 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:07.154135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:07.156639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:07.205004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:07.212609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:07.215252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:07.216068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:07.216573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:07.217005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:07.835715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:07.836291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:07.845066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:07.845897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:07.846360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:07.847113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:07.847585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:07.848058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:08.081587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:08.093199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e8fcdc06-1d40-41e4-82c3-3a9b1859434d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1315 microversion: 2.1 time: 0.943484 Oct 28 18:34:08.095213 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1832/5290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:07 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:08.189679 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5db6fa0-104b-4146-ad9f-bf331afe41c5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.357727 Oct 28 18:34:08.193300 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3459/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:07 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:09.118174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:09.118819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:09.127787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:09.140177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.141603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.145552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.147260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.148181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.153587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.218317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:09.219690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:09.240038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.245125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.253722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.256449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.258083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.259386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.751574 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9297271-28d4-4def-8aed-73ec794d0021 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.537410 Oct 28 18:34:09.754421 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3460/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:09 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:09.760339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-85fa3e88-6c66-4caa-8f01-537bc6773cc8 req-732326cd-cdd0-4b07-8cdc-00cce2486411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba94308-6ac5-4b60-81ba-3662bd82c3f0", "name": "network-vif-plugged", "status": "completed", "tag": "5df55407-37c7-4aa2-854a-af22833eff2c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:09.788723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85fa3e88-6c66-4caa-8f01-537bc6773cc8 req-732326cd-cdd0-4b07-8cdc-00cce2486411 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.789016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85fa3e88-6c66-4caa-8f01-537bc6773cc8 req-732326cd-cdd0-4b07-8cdc-00cce2486411 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.789460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-85fa3e88-6c66-4caa-8f01-537bc6773cc8 req-732326cd-cdd0-4b07-8cdc-00cce2486411 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.812974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-85fa3e88-6c66-4caa-8f01-537bc6773cc8 req-732326cd-cdd0-4b07-8cdc-00cce2486411 service nova] Creating event network-vif-plugged:5df55407-37c7-4aa2-854a-af22833eff2c for instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 on n-h1-862404-2 Oct 28 18:34:09.818670 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-85fa3e88-6c66-4caa-8f01-537bc6773cc8 req-732326cd-cdd0-4b07-8cdc-00cce2486411 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062768 Oct 28 18:34:09.823252 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3461/5293] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:09.830554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:09.831331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:09.839696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.840227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.840678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.841456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.842007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.842442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.914408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:09.922978 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c41f098-8f2b-44b6-8490-8acf6003dc80 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1315 microversion: 2.1 time: 0.809479 Oct 28 18:34:09.923607 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1833/5294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:09 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:09.942694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-49b06fb1-ed0c-44f6-bd7f-01f91235b4ec req-5ec5bd84-3929-42b3-83ae-2ed9a203c1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063de5e-ae3f-4d25-97a3-4ffa18bdf86d", "tag": "6aea57d1-9a26-42db-99e7-ffd76f4f0873"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:09.961674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-49b06fb1-ed0c-44f6-bd7f-01f91235b4ec req-5ec5bd84-3929-42b3-83ae-2ed9a203c1cc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.962809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-49b06fb1-ed0c-44f6-bd7f-01f91235b4ec req-5ec5bd84-3929-42b3-83ae-2ed9a203c1cc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.963241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-49b06fb1-ed0c-44f6-bd7f-01f91235b4ec req-5ec5bd84-3929-42b3-83ae-2ed9a203c1cc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.991627 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-49b06fb1-ed0c-44f6-bd7f-01f91235b4ec req-5ec5bd84-3929-42b3-83ae-2ed9a203c1cc service nova] Creating event network-changed:6aea57d1-9a26-42db-99e7-ffd76f4f0873 for instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d on n-h2-862404-2 Oct 28 18:34:09.999305 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-49b06fb1-ed0c-44f6-bd7f-01f91235b4ec req-5ec5bd84-3929-42b3-83ae-2ed9a203c1cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074404 Oct 28 18:34:10.000811 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1834/5295] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:10.070317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:10.214605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:10.223860 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72e382ec-dce9-4899-b282-9cab1537b120 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1564 microversion: 2.1 time: 0.399230 Oct 28 18:34:10.226917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3462/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:09 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1564 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:10.779611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:10.780610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:10.791455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:10.797036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:10.797802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:10.801413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:10.803919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:10.804542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:10.950392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:10.952141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:10.958652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=16 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:10.984379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:10.985846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:10.986674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:10.990195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:10.990934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:10.991693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:11.501416 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-406bd2b8-07ec-4390-b076-79cc49ce4900 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.727160 Oct 28 18:34:11.530540 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1835/5297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:10 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:11.535454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b3d14e6e-cf1c-4e59-9371-15396a1e0eeb req-5a4816a6-26cc-48ef-8703-97f09778c8cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dd6680-b062-425b-beb9-9d1c22608301", "tag": "61f00648-d0fe-4496-b865-0126ac5f26f2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:11.582747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b3d14e6e-cf1c-4e59-9371-15396a1e0eeb req-5a4816a6-26cc-48ef-8703-97f09778c8cf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:11.583258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b3d14e6e-cf1c-4e59-9371-15396a1e0eeb req-5a4816a6-26cc-48ef-8703-97f09778c8cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:11.583768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b3d14e6e-cf1c-4e59-9371-15396a1e0eeb req-5a4816a6-26cc-48ef-8703-97f09778c8cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:11.619671 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b3d14e6e-cf1c-4e59-9371-15396a1e0eeb req-5a4816a6-26cc-48ef-8703-97f09778c8cf service nova] Creating event network-changed:61f00648-d0fe-4496-b865-0126ac5f26f2 for instance a5dd6680-b062-425b-beb9-9d1c22608301 on n-h1-862404-2 Oct 28 18:34:11.648844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:11.660048 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0e60a01-65c5-467b-99e3-09fbcd104d44 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1315 microversion: 2.1 time: 0.715295 Oct 28 18:34:11.662553 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b3d14e6e-cf1c-4e59-9371-15396a1e0eeb req-5a4816a6-26cc-48ef-8703-97f09778c8cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130618 Oct 28 18:34:11.667214 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1836/5298] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:11.702859 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3463/5299] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:10 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:12.538326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:12.538930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:12.573031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:12.573515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:12.575748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:12.578051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:12.580387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:12.585191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:12.719941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:12.721801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:12.735790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:12.736676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:12.737340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:12.738939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:12.739664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:12.740838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:13.014160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:13.019037 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2b927437-76ba-4646-85d1-61f99d8abe19 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.484980 Oct 28 18:34:13.020681 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1837/5300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:12 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:13.024643 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6bc130d4-81a8-43c2-ba67-ac9542cfdb0d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1502 microversion: 2.1 time: 0.313105 Oct 28 18:34:13.025679 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3464/5301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:12 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:13.050715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:13.053585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:13.084544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:13.085041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:13.085482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:13.086238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:13.088542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:13.089382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:13.234132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:13.247324 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4ee971e4-9585-4b6d-a256-4535312a8417 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0/action" status: 202 len: 0 microversion: 2.1 time: 0.200835 Oct 28 18:34:13.248302 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1838/5302] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:13 2022] POST /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:34:13.258084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:13.258939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:13.265710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:13.266825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:13.267507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:13.268738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:13.270129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:13.270758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:13.461020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:13.476801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4bd68619-f897-48d2-96bf-1cd989fe0940 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1507 microversion: 2.1 time: 0.223691 Oct 28 18:34:13.477937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3465/5303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:13 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:14.046627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:14.047337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:14.064608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:14.065093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:14.065534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:14.074345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:14.076448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:14.077417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:14.341554 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb7724e0-353d-4493-b072-c414493b4528 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.302421 Oct 28 18:34:14.343124 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1839/5304] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:14 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:14.502381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:14.503647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:14.511773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:14.512360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:14.513056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:14.514074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:14.514674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:14.515297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:14.734738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:14.743894 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8403a917-978d-451a-bf07-82060938f9b6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1507 microversion: 2.1 time: 0.244580 Oct 28 18:34:14.745278 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3466/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:14 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:15.367283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:15.368647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:15.382469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.385357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.387391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.388706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.393060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.393859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.462959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:15.466996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:15.477541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.481005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.481657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.482545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.483162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.489668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.542679 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbe0ce8f-9d80-4c30-a77e-406cefa57b22 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.083564 Oct 28 18:34:15.543319 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3467/5306] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:15 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:15.685274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:15.686001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:15.689608 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-98d49ea4-ecfe-440f-a3ef-0c696ebe5ad6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.327550 Oct 28 18:34:15.708541 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1840/5307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:15 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:15.708652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.708652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.708652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.708652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.708652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.708652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.743214 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96860a63-e8a7-43bb-a111-0bb6aac44dd3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/5578668c-0313-475b-80bf-c7968d60a136" status: 200 len: 194 microversion: 2.1 time: 0.061847 Oct 28 18:34:15.744768 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3468/5308] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Oct 28 18:34:15 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/5578668c-0313-475b-80bf-c7968d60a136 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:15.755709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:15.756304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:15.766695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.767112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.767562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.768306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.768443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:15.768772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.769053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:15.769207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.782683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.783246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.783713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.784534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.785008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.785451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.943456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lazy-loading 'services' on Instance uuid 08e32484-be7d-43a6-b346-745198a421e2 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:34:16.062435 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-af2b371d-81d2-4b1a-80e0-221c964686aa tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/5578668c-0313-475b-80bf-c7968d60a136" status: 202 len: 0 microversion: 2.1 time: 0.310512 Oct 28 18:34:16.063054 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1841/5309] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:34:15 2022] DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/5578668c-0313-475b-80bf-c7968d60a136 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:34:16.087061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:16.102564 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02d64bbc-b17c-4e36-8f6c-381cf55f9504 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1487 microversion: 2.1 time: 0.337520 Oct 28 18:34:16.103389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3469/5310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:15 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1487 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:16.130728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:16.131361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:16.145177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:16.145592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:16.146038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:16.146762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:16.147225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:16.147654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:16.210418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lazy-loading 'flavor' on Instance uuid 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:34:16.565548 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3d505c3c-9e14-4352-a9a9-eafb15ee03d6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0/action" status: 202 len: 0 microversion: 2.1 time: 0.438082 Oct 28 18:34:16.566844 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1842/5311] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:16 2022] POST /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:34:16.579568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:16.580323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:16.597723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:16.598876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:16.601171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:16.602053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:16.603232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:16.605695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:16.733459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:16.734233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:16.750412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:16.750923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:16.751375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:16.752139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:16.752600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:16.753031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:16.950123 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d2d27831-a475-45bf-a71a-1b20080daf99 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.227671 Oct 28 18:34:16.950967 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1843/5312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:16 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:16.963730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:16.972431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:16.977136 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d618a79-ae87-45bd-b88c-b142916f57a6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1493 microversion: 2.1 time: 0.404973 Oct 28 18:34:16.979156 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3470/5313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:16 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1493 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:17.974967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:17.975625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:17.997002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:17.999928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:18.001181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:18.002143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:18.002284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:18.006707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:18.007427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:18.013601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:18.023400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:18.029230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:18.029833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:18.030624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:18.031119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:18.031565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:18.346627 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a57c9681-f36b-47d8-b227-329e79db0a2a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.375077 Oct 28 18:34:18.370875 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1844/5314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:17 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:18.468421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:18.481408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f016168f-b586-4f41-ad8c-ffee72b3b0c0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1514 microversion: 2.1 time: 0.484858 Oct 28 18:34:18.486705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3471/5315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:17 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1514 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:19.376307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:19.376919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:19.391356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.392125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.394122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.400468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.401314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.401949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.435339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d03b77b2-a6a3-4120-b27b-aea84607fa43 req-150fc3ad-4060-454b-a13a-bf095e652b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dd6680-b062-425b-beb9-9d1c22608301", "name": "network-vif-plugged", "status": "completed", "tag": "61f00648-d0fe-4496-b865-0126ac5f26f2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:19.475666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d03b77b2-a6a3-4120-b27b-aea84607fa43 req-150fc3ad-4060-454b-a13a-bf095e652b13 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.477776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d03b77b2-a6a3-4120-b27b-aea84607fa43 req-150fc3ad-4060-454b-a13a-bf095e652b13 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.479733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d03b77b2-a6a3-4120-b27b-aea84607fa43 req-150fc3ad-4060-454b-a13a-bf095e652b13 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.518574 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d03b77b2-a6a3-4120-b27b-aea84607fa43 req-150fc3ad-4060-454b-a13a-bf095e652b13 service nova] Creating event network-vif-plugged:61f00648-d0fe-4496-b865-0126ac5f26f2 for instance a5dd6680-b062-425b-beb9-9d1c22608301 on n-h1-862404-2 Oct 28 18:34:19.534427 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d03b77b2-a6a3-4120-b27b-aea84607fa43 req-150fc3ad-4060-454b-a13a-bf095e652b13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103624 Oct 28 18:34:19.547538 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3472/5316] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:19.557490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:19.558213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:19.567186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.568085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.568802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.569678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.570324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.571450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.607638 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c1a841d5-141c-4934-b032-b4757b09cbde tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.236084 Oct 28 18:34:19.610959 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1845/5317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:19 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:19.911492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:19.913318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:19.921982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.923356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.924031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.924977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.925663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.926421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.929061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:19.959700 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-550dc8f3-bbc7-4c5f-a52d-47202c3ce92b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1514 microversion: 2.1 time: 0.408961 Oct 28 18:34:19.960392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3473/5318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:19 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1514 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:20.060884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lazy-loading 'services' on Instance uuid 2f9cf817-aac4-44b7-a5f4-ead714699a06 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:34:20.154638 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5c6e0366-aa2c-425d-8bd4-0b3c50598f85 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments/a7079b5f-7ac9-4b41-9703-a0b9e05d07c1" status: 202 len: 0 microversion: 2.1 time: 0.246685 Oct 28 18:34:20.165943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:20.168854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:20.171352 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1846/5319] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:34:19 2022] DELETE /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments/a7079b5f-7ac9-4b41-9703-a0b9e05d07c1 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:34:20.188536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.190548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.191910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.195471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.197489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.199628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.336557 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d93d64e-8ca6-4796-9c03-deaff1ef07bc tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167315 Oct 28 18:34:20.338054 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3474/5320] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:20 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:20.639692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:20.641538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:20.659199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.660377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.668507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.669269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.669935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.670369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.872567 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fa356813-97ad-43ad-98ae-ae4425e12485 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.238564 Oct 28 18:34:20.878845 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1847/5321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:20 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:20.989390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:20.990010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:20.997328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.997819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.998479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.999389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.999870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:21.000301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:21.203351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:21.228197 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b785f194-7ea8-4a42-aacc-2082791341a5 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1514 microversion: 2.1 time: 0.242469 Oct 28 18:34:21.236082 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3475/5322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:20 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:21.352872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:21.356013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:21.365730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:21.366218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:21.369557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:21.370302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:21.372306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:21.372755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:21.441511 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1ece3118-0b34-40ac-81f5-6a93b9f5518c tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095806 Oct 28 18:34:21.444373 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1848/5323] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:21 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:21.906246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:21.906889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:21.925928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:21.928515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:21.929109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:21.929881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:21.931023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:21.931466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.246612 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b86d5e03-71ae-46a6-8cca-dc97c302554c tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1463 microversion: 2.1 time: 0.345347 Oct 28 18:34:22.247436 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3476/5324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:21 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1463 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:22.259798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:22.260453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:22.267085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:22.267571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:22.268253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.269034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:22.269497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:22.269921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.454523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:22.456757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:22.483766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:22.484304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:22.484791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.485172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:22.485648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:22.486129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:22.486562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.493401 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-75a5e199-6f83-4fe4-9a08-f424bbfff253 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1514 microversion: 2.1 time: 0.238598 Oct 28 18:34:22.494707 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1849/5325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:22 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:22.533555 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-89a018f9-581f-4932-9063-b7bac8a72b36 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083218 Oct 28 18:34:22.534433 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3477/5326] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:22 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:34:22.857181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:22.857696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:22.863949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:22.864350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:22.864849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.865562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:22.866026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:22.866494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.900415 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59dc3baa-7b15-4b0e-ba3c-e67187fc9ee6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/6c265b6a-b51c-4424-8fff-6b5a937ef752" status: 200 len: 194 microversion: 2.1 time: 0.047076 Oct 28 18:34:22.901848 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1850/5327] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Oct 28 18:34:22 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/6c265b6a-b51c-4424-8fff-6b5a937ef752 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:22.912188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:22.912720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:22.924883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:22.925638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:22.926324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.927232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:22.928216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:22.929677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.073639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lazy-loading 'services' on Instance uuid 08e32484-be7d-43a6-b346-745198a421e2 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:34:23.271097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:23.272606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:23.293867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.300821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.301635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.304016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.307691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.308539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.315502 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5287d859-77ac-4132-9702-bf87eda2ab62 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/6c265b6a-b51c-4424-8fff-6b5a937ef752" status: 202 len: 0 microversion: 2.1 time: 0.400239 Oct 28 18:34:23.316260 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3478/5328] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:34:22 2022] DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments/6c265b6a-b51c-4424-8fff-6b5a937ef752 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:34:23.377614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5c2bea0b-390c-4093-b568-951907f966dc req-f00fb067-05d3-46df-a38a-bdb06731d16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba94308-6ac5-4b60-81ba-3662bd82c3f0", "name": "network-vif-plugged", "status": "completed", "tag": "5df55407-37c7-4aa2-854a-af22833eff2c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:23.403928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c2bea0b-390c-4093-b568-951907f966dc req-f00fb067-05d3-46df-a38a-bdb06731d16e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.404701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c2bea0b-390c-4093-b568-951907f966dc req-f00fb067-05d3-46df-a38a-bdb06731d16e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.406156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5c2bea0b-390c-4093-b568-951907f966dc req-f00fb067-05d3-46df-a38a-bdb06731d16e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.422921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5c2bea0b-390c-4093-b568-951907f966dc req-f00fb067-05d3-46df-a38a-bdb06731d16e service nova] Creating event network-vif-plugged:5df55407-37c7-4aa2-854a-af22833eff2c for instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 on n-h1-862404-2 Oct 28 18:34:23.428386 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5c2bea0b-390c-4093-b568-951907f966dc req-f00fb067-05d3-46df-a38a-bdb06731d16e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056126 Oct 28 18:34:23.429732 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3479/5329] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:34:23.530521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:23.531644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:23.549088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.550821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.552516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.553287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.556032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.557919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.691420 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c74578bc-592a-4f7a-b193-d25414670827 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1648 microversion: 2.1 time: 0.423890 Oct 28 18:34:23.694755 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1851/5330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:23 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1648 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:23.711077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:23.714816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:23.729842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.730929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.733363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.738006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.738539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.738990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.767433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=94,nova_cell1:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:23.793151 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ca5a025-8ed5-4025-805a-7a26453602ad tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095938 Oct 28 18:34:23.808754 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1852/5331] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:23 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:23.815940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:23.822873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:23.830132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:23.834981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.835482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.835943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.840131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.840636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.841078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.842641 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c236a73b-86fc-43a4-a6f3-412335b65153 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.328563 Oct 28 18:34:23.845217 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3480/5332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:23 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:24.012109 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fcb1908b-43a2-4fb5-af39-dee3fd6f439b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1648 microversion: 2.1 time: 0.202012 Oct 28 18:34:24.013418 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1853/5333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:23 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1648 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:24.040362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:24.041203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:24.052618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:24.058813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:24.059282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:24.060966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:24.061453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:24.061890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:24.322707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-693a222f-65a2-493f-b682-ace0bf87b95e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1648 microversion: 2.1 time: 0.287550 Oct 28 18:34:24.323623 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3481/5334] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:24 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1648 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:24.494815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1342575752", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "availability_zone": "nova:n-h2-862404-2", "networks": [{"uuid": "c0d3c7e5-5185-4dee-9a64-9c097a491e8f"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:24.618908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] validate_networks() for [('c0d3c7e5-5185-4dee-9a64-9c097a491e8f', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:34:24.821782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:24.824806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:24.837289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:24.844266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:24.844968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:24.846010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:24.846718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:24.847376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:24.913033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f09ab3bf-1560-4df3-a44c-98a66e1f54df tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095058 Oct 28 18:34:24.918072 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3482/5335] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:24 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:34:24.927909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:24.928833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:24.938168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:24.940094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:24.940935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:24.942001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:24.942897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:24.943624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:25.162954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:25.173459 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-74b22a14-1415-4da8-adb0-636dfd93e5d1 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.251836 Oct 28 18:34:25.174464 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3483/5336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:24 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:25.455701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:34:25.456455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:34:25.457011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:34:25.457514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:34:25.458005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:34:25.471747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:25.472362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:25.473092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:25.474074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:25.475310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:25.476054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:25.509640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Getting quotas for project c1f4ee93a4234d36a4b46653f4a38fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:34:25.529080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Getting quotas for user 6f830445fe8f4ffc963bff548e087d12 and project c1f4ee93a4234d36a4b46653f4a38fa3. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:34:25.560535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:34:25.569093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:34:25.694336 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2b50813-44ec-47ae-be20-445e91fc4722 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198795 Oct 28 18:34:25.695553 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1854/5337] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:34:25.707125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01ffea4a-5335-4b73-9bea-e2a81728e979 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:25.708140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01ffea4a-5335-4b73-9bea-e2a81728e979 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:25.892256 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01ffea4a-5335-4b73-9bea-e2a81728e979 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1329 microversion: 2.1 time: 0.188944 Oct 28 18:34:25.893393 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3484/5338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:25 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1329 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:25.931973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:25.934499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:25.950062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:25.950853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:25.951513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:25.953754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:25.954314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:25.954987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:26.003297 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-38a8a796-12e9-49d3-af78-ab9ebdd26b30 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077050 Oct 28 18:34:26.004651 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1855/5339] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:25 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:26.204189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:26.204746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:26.232074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:26.234020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:26.236673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:26.239916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:26.244362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:26.245861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:26.678722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:26.693423 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc8bd5e6-e351-4da0-a93c-29b7726eee41 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.495698 Oct 28 18:34:26.696529 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3485/5340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:26 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:26.914336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:26.915736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:26.922911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:26.923401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:26.937052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:26.940847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:26.948275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:26.948913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:27.017178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:27.019520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:27.030789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:27.033586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:27.033586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:27.033586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:27.033586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:27.034109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:27.112768 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6cdadc59-9517-4e36-9e5a-2bc4f23492e7 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1416 microversion: 2.1 time: 0.201977 Oct 28 18:34:27.118093 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1856/5341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:26 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1416 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:27.145888 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d2691fc-c57b-465f-bcdc-31a78a0566ce tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132782 Oct 28 18:34:27.146894 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3486/5342] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:27 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:27.728314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:27.729845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:27.755135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:27.755642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:27.762074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:27.763110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:27.763759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:27.773766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:28.141509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:28.142143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:28.165570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:28.167993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:28.168478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:28.176650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:28.177186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:28.177637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:28.356622 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af2cddf8-2d3b-4743-af67-ea9124fa8161 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1422 microversion: 2.1 time: 0.216604 Oct 28 18:34:28.358251 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3487/5343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:28 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1422 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:28.376128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:28.381076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:28.427655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:28.428476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:28.429096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:28.430143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:28.430954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:28.431741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:28.479563 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc824dd3-bcc4-41ad-a7c1-451482e11114 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119611 Oct 28 18:34:28.480665 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3488/5344] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:28 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:28.701354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:28.714914 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1cc77bed-c09a-4b4c-9cd7-300e68a0b76e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 1.000383 Oct 28 18:34:28.716344 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1857/5345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:27 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:29.381377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:29.382167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:29.401588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.404947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.408022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.416693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.417379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.417820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.435535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:29.494003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:29.496482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:29.531653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.543235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.544061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.544993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.545612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.546210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.663787 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22921286-064a-4605-b230-0e2d325f4022 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.174501 Oct 28 18:34:29.667301 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1858/5346] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:29 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06/os-volume_attachments => generated 25 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:34:29.743606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:29.745303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:29.757714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.760774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.761554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.764366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.765185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.766859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.830302 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1c41682d-e8b9-42be-ad3e-65010a335409 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1422 microversion: 2.1 time: 0.452993 Oct 28 18:34:29.836559 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3489/5347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:29 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1422 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:29.961733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:29.963544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:29.989804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.990319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.990766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.995740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.999448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.000009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:30.138252 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af3595a8-f269-4fd3-b22b-4eb5ac91e72a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action" status: 200 len: 24560 microversion: 2.1 time: 0.181208 Oct 28 18:34:30.140177 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3490/5348] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:29 2022] POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action => generated 24560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:34:30.292474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:30.293043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:30.313493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:30.319887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.321778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:30.353172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:30.353944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.354581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:30.480894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:34:30.731219 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65989536-1d45-4c11-8735-f2db95166da9 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 204 len: 0 microversion: 2.1 time: 0.445788 Oct 28 18:34:30.734823 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3491/5349] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:30 2022] DELETE /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:34:30.774841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:30.775799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:30.792341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:30.815912 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8d9876d8-6bde-425c-874f-c7216233c9bc tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 1.073450 Oct 28 18:34:30.816980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:30.817505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.817806 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1859/5350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:29 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:30.819048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:30.819800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:30.822740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.823210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:30.856261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:30.856864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:30.877029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:30.877290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.881139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:30.882992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:30.884187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.886779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:31.234413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:31.243569 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7da5dade-98d3-4362-8b6e-9dedd951b784 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1683 microversion: 2.1 time: 0.497852 Oct 28 18:34:31.266850 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3492/5351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:30 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1683 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:31.478563 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-533175f2-8147-4837-a1e3-3c2106a3b771 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.628090 Oct 28 18:34:31.495456 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1860/5352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:30 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:31.858885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:31.859578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:31.881579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:31.884632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:31.886890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:31.887799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:31.889680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:31.891063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:32.220917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:32.242928 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01d1dd74-b42e-4cab-bb6a-3f4065be682c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.400490 Oct 28 18:34:32.248837 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3493/5353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:31 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:32.271859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:32.273344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:32.287535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:32.289980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:32.292416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:32.296556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:32.297546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:32.298418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:32.507325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:32.508769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:32.522020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:32.524359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:32.527257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:32.529664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:32.533910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:32.535539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:32.916220 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39affc7d-9eba-4f94-84ef-6a658dfb0544 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.412430 Oct 28 18:34:32.932305 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3494/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:32 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:33.251573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:33.269323 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ac878508-2872-4b60-83e3-d543fbf24672 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1683 microversion: 2.1 time: 1.002038 Oct 28 18:34:33.272225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:33.272807 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1861/5355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:32 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1683 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:33.273773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:33.292960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:33.293960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:33.294589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:33.296048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:33.296686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:33.297301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:33.609831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:33.625991 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2cf40843-d41b-47e7-ab23-991cf71a0b2b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.351861 Oct 28 18:34:33.627909 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3495/5356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:33 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:33.942952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:33.943850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:33.957847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:33.963158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:33.965798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:33.966802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:33.973737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:33.974761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:34.300662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:34.301668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:34.312536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:34.316622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:34.323217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:34.324086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:34.325059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:34.325715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:34.326259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:34.590465 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-84343cee-6db2-449a-8323-03aaddc495a5 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.651195 Oct 28 18:34:34.616208 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1862/5357] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:33 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:34.621987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:34.623398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4ba3eacf-2b4d-440f-b319-f29eed7b3e55 req-5ea2c328-0e4a-48f3-9579-1829fbf33562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7156566e-38d4-44e7-befd-92730e5db14a", "tag": "6dd504b6-95e8-4165-a6e2-2ef5c22cb1a8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:34.638246 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-273ca925-8819-4d25-bfe6-9d89272fbf10 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1683 microversion: 2.1 time: 0.341381 Oct 28 18:34:34.658119 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3496/5358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:34 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1683 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:34.659699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4ba3eacf-2b4d-440f-b319-f29eed7b3e55 req-5ea2c328-0e4a-48f3-9579-1829fbf33562 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:34.669805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4ba3eacf-2b4d-440f-b319-f29eed7b3e55 req-5ea2c328-0e4a-48f3-9579-1829fbf33562 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:34.670259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4ba3eacf-2b4d-440f-b319-f29eed7b3e55 req-5ea2c328-0e4a-48f3-9579-1829fbf33562 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:34.670719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:34.671675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:34.680427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:34.681323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:34.682027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:34.682979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:34.683720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:34.684434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:34.697016 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4ba3eacf-2b4d-440f-b319-f29eed7b3e55 req-5ea2c328-0e4a-48f3-9579-1829fbf33562 service nova] Creating event network-changed:6dd504b6-95e8-4165-a6e2-2ef5c22cb1a8 for instance 7156566e-38d4-44e7-befd-92730e5db14a on n-h2-862404-2 Oct 28 18:34:34.722368 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4ba3eacf-2b4d-440f-b319-f29eed7b3e55 req-5ea2c328-0e4a-48f3-9579-1829fbf33562 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104643 Oct 28 18:34:34.725931 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1863/5359] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:34.870967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:34.882188 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa30c298-db87-4519-9fff-374aa64b8602 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.221752 Oct 28 18:34:34.884399 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3497/5360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:34 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:35.619505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:35.620450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:35.642586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:35.643631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:35.657083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:35.661519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:35.665001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:35.666672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:35.667266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:35.672482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:35.673120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:35.673517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:35.690732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:35.691246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:35.697266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:35.698181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:35.698997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:35.699145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:35.885118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:36.039513 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-802b464a-5621-4d23-8c44-527894e6e4bc tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.424820 Oct 28 18:34:36.042923 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1864/5361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:35 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:36.073220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:36.074198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:36.088474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:36.089352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:36.090040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:36.090980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:36.092344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:36.097748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:36.515713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:36.544755 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-500850a1-72e7-4d2f-9414-c4299a8d921f tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1683 microversion: 2.1 time: 0.873418 Oct 28 18:34:36.561292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3498/5362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:35 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1683 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:36.675291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:36.699066 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a1eb8b7e-5f89-4929-94bd-f9a19b358751 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.640022 Oct 28 18:34:36.700320 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1865/5363] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:36 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:37.072070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:37.072709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:37.088827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.101445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.106424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.110480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.112269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.112941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.331977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-335962bc-d42f-4784-b463-4879b289ee9b req-28a2b30b-52ce-4a4c-97d6-329f3c27510c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9cf817-aac4-44b7-a5f4-ead714699a06", "name": "network-vif-deleted", "tag": "332a3a7a-886f-447d-a9c9-1c3790d6f701"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:37.366975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-335962bc-d42f-4784-b463-4879b289ee9b req-28a2b30b-52ce-4a4c-97d6-329f3c27510c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.370406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-335962bc-d42f-4784-b463-4879b289ee9b req-28a2b30b-52ce-4a4c-97d6-329f3c27510c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.371134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-335962bc-d42f-4784-b463-4879b289ee9b req-28a2b30b-52ce-4a4c-97d6-329f3c27510c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.387977 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-335962bc-d42f-4784-b463-4879b289ee9b req-28a2b30b-52ce-4a4c-97d6-329f3c27510c service nova] Creating event network-vif-deleted:332a3a7a-886f-447d-a9c9-1c3790d6f701 for instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 on n-h1-862404-2 Oct 28 18:34:37.393893 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-335962bc-d42f-4784-b463-4879b289ee9b req-28a2b30b-52ce-4a4c-97d6-329f3c27510c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066310 Oct 28 18:34:37.399356 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1866/5364] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:34:37.563916 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1705d3e0-6575-4782-8ce8-1463ef8f1010 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.498651 Oct 28 18:34:37.564538 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3499/5365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:37 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:37.593787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:37.598039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:37.629901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.630391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.630825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.634977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.636888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.637533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.709747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.713551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.714767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.715736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lazy-loading 'fault' on Instance uuid 2f9cf817-aac4-44b7-a5f4-ead714699a06 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:34:37.723470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:37.724136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:37.732633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.735605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.737185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.741036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.741668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.742184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.799430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0cc266e44dd4f76a95a428bb3676b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2302daf1521c4a0c8059fe6b55b81f4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:37.816745 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de174d41-f5b3-49e6-9167-5021da75bdf1 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 200 len: 1332 microversion: 2.1 time: 0.245974 Oct 28 18:34:37.820031 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1867/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:37 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 1332 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:38.538528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:38.552168 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2915d0ad-0757-4c8b-a095-21acd1790433 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.833914 Oct 28 18:34:38.571604 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3500/5367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:37 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:38.600618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:38.601251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:38.611348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:38.617034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:38.618203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:38.618974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:38.619461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:38.628119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:38.844105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:38.844733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:38.863461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:38.864013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:38.866021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:38.866760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:38.867226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:38.867709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:38.923405 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 HTTP/1.1 Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2f9cf817-aac4-44b7-a5f4-ead714699a06'} Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:38.925711 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:38.929867 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bff2d1ca-4d54-492e-ad0a-50a588bdc1de tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 404 len: 111 microversion: 2.1 time: 0.087901 Oct 28 18:34:38.935237 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3501/5368] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:38 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:34:38.943356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3292ebf2-b654-40e1-8926-4a25cfd5b40a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '.version_select at 0x7f78dd678ca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:38.989829 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3292ebf2-b654-40e1-8926-4a25cfd5b40a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886144267" status: 202 len: 0 microversion: 2.1 time: 0.050210 Oct 28 18:34:38.990698 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3502/5369] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886144267 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:34:39.028872 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3f12d151-2cb8-4006-af65-5e9ce49e6e21 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.433127 Oct 28 18:34:39.040177 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1868/5370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:38 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:39.560557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:39.562732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:39.583810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:39.584342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:39.584925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:39.590558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:39.591804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:39.593691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:39.594271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:39.594720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:39.603626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:39.607228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:39.612458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:39.613982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:39.617202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:39.622045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:39.625763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:39.663473 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33b4d52d-fe2f-4fcc-878d-af3d9f718dbc tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108662 Oct 28 18:34:39.666166 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3503/5371] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:39 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:34:39.897985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:39.910963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:39.941761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:39.943203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:39.943664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:39.948034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:39.948522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:39.949799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:40.111376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56ab60e2-b608-416c-8f9b-2c22a717ea72 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.220828 Oct 28 18:34:40.116312 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3504/5372] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 18:34:39 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2/os-volume_attachments => generated 25 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:34:40.127957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:40.133886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:40.140166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:40.155672 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86340490-f129-4992-af60-e898ac325e1a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.563524 Oct 28 18:34:40.161632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:40.162142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:40.164343 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1869/5373] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:39 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:40.171614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:40.172588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:40.173166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:40.173634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:40.269060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:40.269827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:40.285901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:40.289191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:40.289921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:40.292423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:40.295032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:40.295681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:40.363620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:40.369470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:34:40.698550 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9a5eb410-3352-46af-ac64-dc69de4718f1 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 204 len: 0 microversion: 2.1 time: 0.437993 Oct 28 18:34:40.704600 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1870/5374] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:40 2022] DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:34:40.732171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:40.737435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:40.760505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:40.761024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:40.770009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:40.771207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:40.771711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:40.772180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:41.115599 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f7357d3-d329-4bd7-a8c7-5bbfcc08897b tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.982131 Oct 28 18:34:41.116392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3505/5375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:40 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:41.195176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:41.197299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:41.215349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:41.216251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:41.216927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:41.217816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:41.218435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:41.219629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:41.277530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:41.744196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:41.755181 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50a28dea-7dd7-4b53-9ceb-2ded71a69973 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1676 microversion: 2.1 time: 1.045230 Oct 28 18:34:41.757709 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1871/5376] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:40 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1676 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:41.771852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:41.774774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:41.788893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:41.791563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:41.792238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:41.795240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:41.796364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:41.796852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:41.797296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:41.817591 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-622e8d14-ffc9-454d-8edd-a449b9e4be15 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.626806 Oct 28 18:34:41.826828 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3506/5377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:41 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:42.147067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:42.147914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:42.160188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:42.160956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:42.161691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:42.162650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:42.163335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:42.164006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:42.365087 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5decfd0e-e3aa-4b6a-bbc7-47f9d3df3053 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1834 microversion: 2.1 time: 0.603466 Oct 28 18:34:42.365923 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1872/5378] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:41 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1834 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:42.395255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:42.407858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:42.417098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:42.417588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:42.428532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:42.429575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:42.430431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:42.431031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:42.605220 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8d11901d-230b-413a-b6b2-ce817e98e279 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.462095 Oct 28 18:34:42.608271 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3507/5379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:42 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:42.782141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:42.782997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:42.793500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:42.797278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:42.800303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:42.803259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:42.804018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:42.806615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:42.999835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:43.011557 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-60cc886a-e825-40af-8cc0-e5df3791f4e2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1683 microversion: 2.1 time: 0.622678 Oct 28 18:34:43.012595 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1873/5380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:42 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1683 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:43.021581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:43.033032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:43.054230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:43.075031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:43.075926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:43.076923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:43.089505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:43.090362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:43.446395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:43.475109 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9fa9cf29-aba0-4825-9ab0-3f231d94c285 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1676 microversion: 2.1 time: 0.696606 Oct 28 18:34:43.476057 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3508/5381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:42 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1676 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:43.504165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:43.526973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:43.549351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:43.557509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:43.558259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:43.559183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:43.559835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:43.562116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:43.652633 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51486ffb-2982-43c2-b3c1-6a47a7425b0d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action" status: 200 len: 32626 microversion: 2.1 time: 0.172766 Oct 28 18:34:43.660546 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3509/5382] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:43 2022] POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action => generated 32626 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:34:43.698474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:43.709997 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f65aa68a-ce1b-4ce3-a1c2-5681e67f3cbe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.692926 Oct 28 18:34:43.713370 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1874/5383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:43 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:43.722465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:43.725293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:43.741278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:43.741944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:43.742530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:43.744297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:43.745900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:43.746628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.012143 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3612b27b-bc97-4ed9-84d5-761620da5619 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 0.297325 Oct 28 18:34:44.017420 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1875/5384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:43 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:44.022213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:44.032459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:44.047790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.048679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.051103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.052156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.055101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8ac829fd-b434-40ad-854b-bbcf1921ebeb req-fb971fce-00e1-4aaa-b105-94b3d1bcd137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7156566e-38d4-44e7-befd-92730e5db14a", "name": "network-vif-plugged", "status": "completed", "tag": "6dd504b6-95e8-4165-a6e2-2ef5c22cb1a8"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:44.057040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.060697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.079541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8ac829fd-b434-40ad-854b-bbcf1921ebeb req-fb971fce-00e1-4aaa-b105-94b3d1bcd137 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.080067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8ac829fd-b434-40ad-854b-bbcf1921ebeb req-fb971fce-00e1-4aaa-b105-94b3d1bcd137 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.080509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8ac829fd-b434-40ad-854b-bbcf1921ebeb req-fb971fce-00e1-4aaa-b105-94b3d1bcd137 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.123508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8ac829fd-b434-40ad-854b-bbcf1921ebeb req-fb971fce-00e1-4aaa-b105-94b3d1bcd137 service nova] Creating event network-vif-plugged:6dd504b6-95e8-4165-a6e2-2ef5c22cb1a8 for instance 7156566e-38d4-44e7-befd-92730e5db14a on n-h2-862404-2 Oct 28 18:34:44.135114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2843f2074b4045eaba15b9ca73dcb9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc95c6d0ca184f2fa0d94c9d8ce5c3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:44.135980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] flavor_id is None. Assuming migration. {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 28 18:34:44.136602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:34:44.144552 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8ac829fd-b434-40ad-854b-bbcf1921ebeb req-fb971fce-00e1-4aaa-b105-94b3d1bcd137 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.486147 Oct 28 18:34:44.146789 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3510/5385] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:44.500794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:44.502667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:44.518668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.519017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.522675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.527949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.528698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.530860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.835228 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-67539c1f-4238-4634-865d-251a86c818f5 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action" status: 202 len: 0 microversion: 2.1 time: 0.816515 Oct 28 18:34:44.835894 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1876/5386] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:44 2022] POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:34:44.868990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:44.874797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:44.901949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.906574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.907128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.921749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.922322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.925048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:45.013047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:45.031414 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab0de86d-8755-4c09-b7dc-bf525e9d44c0 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1608 microversion: 2.1 time: 0.530174 Oct 28 18:34:45.043570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3511/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:44 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1608 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:45.049259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:45.052711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:45.075279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:45.076653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:45.078104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:45.081770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:45.082459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:45.083068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:45.522102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:45.531424 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-60f8a4fe-1b85-4659-ba0a-6218e1c21c22 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.682404 Oct 28 18:34:45.538019 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1877/5388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:44 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:45.566263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:45.567204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:45.582342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:45.583173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:45.583860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:45.585588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:45.587083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:45.587739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:45.974423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:45.986779 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6569703-85f1-4111-92e7-0789b88aebbe tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1692 microversion: 2.1 time: 0.951049 Oct 28 18:34:45.991087 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3512/5389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:45 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1692 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:46.077475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:46.078190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:46.094145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:46.094660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:46.095123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:46.095880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:46.096355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:46.096801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:46.687044 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e454bed8-9bf4-45ac-b2bd-2e6ec21e9d10 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1464 microversion: 2.1 time: 1.133387 Oct 28 18:34:46.687932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1878/5390] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:45 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1464 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:46.726386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:46.727222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:46.759035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:46.781372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:46.781869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:46.782632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:46.783104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:46.783525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:46.965595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:46.976025 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4195c66-c5db-4206-80e3-58f6ae040801 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1608 microversion: 2.1 time: 0.902509 Oct 28 18:34:46.981475 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3513/5391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:46 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1608 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:47.018168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:47.018805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:47.036297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:47.043761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:47.044361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:47.053381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:47.054026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:47.054496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:47.340883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:47.358150 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4bb50ff4-af70-4ed3-978a-e4b314c611d8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.650725 Oct 28 18:34:47.359589 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1879/5392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:46 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:47.594915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-aa4fbe54-1592-4e89-bdd5-dc4316425450 req-02b2d679-9af7-400b-9a49-120670b52671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e32484-be7d-43a6-b346-745198a421e2", "name": "network-vif-deleted", "tag": "966b7c3d-f1b2-48b9-b1b4-13d1e15871cf"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:47.629337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aa4fbe54-1592-4e89-bdd5-dc4316425450 req-02b2d679-9af7-400b-9a49-120670b52671 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:47.631779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aa4fbe54-1592-4e89-bdd5-dc4316425450 req-02b2d679-9af7-400b-9a49-120670b52671 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:47.632633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aa4fbe54-1592-4e89-bdd5-dc4316425450 req-02b2d679-9af7-400b-9a49-120670b52671 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:47.676500 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-aa4fbe54-1592-4e89-bdd5-dc4316425450 req-02b2d679-9af7-400b-9a49-120670b52671 service nova] Creating event network-vif-deleted:966b7c3d-f1b2-48b9-b1b4-13d1e15871cf for instance 08e32484-be7d-43a6-b346-745198a421e2 on n-h2-862404-2 Oct 28 18:34:47.693340 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-aa4fbe54-1592-4e89-bdd5-dc4316425450 req-02b2d679-9af7-400b-9a49-120670b52671 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330471 Oct 28 18:34:47.697626 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1880/5393] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:47.714180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:47.715510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:47.738947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:47.739708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:47.740992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:47.745047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:47.745845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:47.746508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:48.103722 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ed2411a-9fa8-4f22-a879-36310e2a8494 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1648 microversion: 2.1 time: 0.396674 Oct 28 18:34:48.112053 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1881/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:47 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1648 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:48.117127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:48.118077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:48.150338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:48.151582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:48.152229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:48.153157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:48.154518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:48.156461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:48.188901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:48.206116 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5011056-09a1-496a-aa86-ae01c92cc716 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1692 microversion: 2.1 time: 1.187398 Oct 28 18:34:48.211910 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3514/5395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:47 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1692 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:48.250313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:48.250994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:48.267450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:48.268427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:48.269625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:48.270695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lazy-loading 'fault' on Instance uuid 08e32484-be7d-43a6-b346-745198a421e2 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:34:48.308737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:48.316229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:48.319672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:48.326334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:48.327423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:48.333806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:48.394745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830f18fef1d1434697a2c552ade4b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d262ef5fd724b1faee11c815b7f1b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:48.407568 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8111dcfc-c7d3-466c-8b4c-51b7c1dceac6 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 200 len: 1328 microversion: 2.1 time: 0.294343 Oct 28 18:34:48.421557 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1882/5396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:48 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 1328 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:48.464892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:48.465459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:48.487589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:48.488241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:48.488651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:48.489390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:48.489855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:48.490282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.038164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:49.059492 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb7b2bdc-8261-41f9-b3af-936982beac4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.598950 Oct 28 18:34:49.068189 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1883/5397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:48 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:49.244848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:49.245713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:49.253162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:49.253906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:49.254780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.255688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:49.256328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:49.256962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.262343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:49.432354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-582e6df3-3dfa-4078-b711-5a56617efb1f tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1648 microversion: 2.1 time: 1.219191 Oct 28 18:34:49.435667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3515/5398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:48 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1648 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:49.451478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:49.454697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:49.487866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:49.490056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:49.491955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.495719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:49.498542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:49.499841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.560408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] HTTP exception thrown: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Request method failure captured: Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 HTTP/1.1 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB8IjUya3a2G7Fs0f9MCae4jU_YovM8f0nLdAgjDzRkQ_YcbPZ8XFvAE-a5RsBcABirCIiVqsB0w52qkaEjpDDSW2yyWnWwek18n9OEICtUDKbPeGDBGMyqqMgkB-nGRfleiUcpA7w6v0lldM5suVxZLHim_AwUu4puBteGOZDVbhuI Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d262ef5fd724b1faee11c815b7f1b65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 830f18fef1d1434697a2c552ade4b793 Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '08e32484-be7d-43a6-b346-745198a421e2'} Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:49.562107 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Returning 404 to user: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:49.566974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-443d715b-4c0b-4360-8d38-6614ca3a5e6d tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 404 len: 111 microversion: 2.1 time: 0.118613 Oct 28 18:34:49.569588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:49.584862 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72b0325c-f30f-4ca0-8d68-47e2e90a5a36 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1692 microversion: 2.1 time: 0.344210 Oct 28 18:34:49.589044 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1884/5399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:49 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1692 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:49.600572 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3516/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:49 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:34:49.608612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:49.613994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60fc73bc-1155-4420-8b7d-67e65bad335a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '.version_select at 0x7f78dd44e940>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:49.620406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:49.637905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:49.638444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:49.638865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.639780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:49.651054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:49.651750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.666709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60fc73bc-1155-4420-8b7d-67e65bad335a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055293608" status: 202 len: 0 microversion: 2.1 time: 0.056626 Oct 28 18:34:49.667635 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3517/5401] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 18:34:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055293608 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:34:49.991593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:49.992940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:50.012526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.016459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.019431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.024026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.024869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.044120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.126273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 HTTP/1.1 Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2f9cf817-aac4-44b7-a5f4-ead714699a06'} Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:50.135455 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.139260 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.143514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:50.144694 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4043575a-0407-4f3d-bd49-65a4a02b4f05 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 404 len: 111 microversion: 2.1 time: 0.159168 Oct 28 18:34:50.151211 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3518/5402] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:49 2022] DELETE /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:34:50.160454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:50.169087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:50.188207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.194942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.195603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.197242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.202389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.204167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.208756 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c99e31f7-8d97-4e6b-9fcc-3965ae8effb3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1648 microversion: 2.1 time: 0.618371 Oct 28 18:34:50.233138 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1885/5403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:49 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1648 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:50.244386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:50.245018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 2f9cf817-aac4-44b7-a5f4-ead714699a06] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:50.260353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.263764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.264209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.264954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.265426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.265862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.296014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 HTTP/1.1 Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '2f9cf817-aac4-44b7-a5f4-ead714699a06'} Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:50.305832 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.310374 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:50.310374 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:50.310374 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:50.310374 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:50.310374 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:50.310374 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. Oct 28 18:34:50.310374 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:50.312639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 2f9cf817-aac4-44b7-a5f4-ead714699a06 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:50.316930 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ff8fdad-1b9b-4aa1-8ada-7be3f44e40a5 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06" status: 404 len: 111 microversion: 2.1 time: 0.079756 Oct 28 18:34:50.326212 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1886/5404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:50 2022] GET /compute/v2.1/servers/2f9cf817-aac4-44b7-a5f4-ead714699a06 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:34:50.333282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:50.335132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:50.348142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.350245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.352745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.353715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.356058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.356674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.440050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:34:50.738597 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f96feea5-ec2c-4a70-a43f-0e330fff17f3 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 204 len: 0 microversion: 2.1 time: 0.410666 Oct 28 18:34:50.743229 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1887/5405] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:50 2022] DELETE /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:34:50.762291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:50.763183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:50.779995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.780414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.783164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.799554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.801183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.802192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:51.291840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:51.300597 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b6ea563d-28c4-4893-a5da-278e6253a51f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1692 microversion: 2.1 time: 0.558140 Oct 28 18:34:51.306419 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1888/5406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:50 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1692 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:51.315545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:51.327587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:51.346334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:51.348489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:51.349152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:51.353591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:51.358360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:51.359224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:51.384112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:51.392312 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f763cd70-bce5-4e49-a498-b05ecc37db0c tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 1.239620 Oct 28 18:34:51.392920 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3519/5407] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:50 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:51.748875 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb90cdb7-a8d5-44cf-a274-e27947798b48 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1654 microversion: 2.1 time: 0.440745 Oct 28 18:34:51.776166 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1889/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:51 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1654 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:52.332436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:52.333119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:52.343461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:52.343992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:52.344453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:52.345302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:52.345705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:52.360248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:52.420424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:52.422362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:52.436032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:52.439904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:52.441083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:52.443739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:52.445502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:52.446306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:52.857475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:52.869413 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6e623e9a-3b86-4744-89c4-46f77721ff82 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.453770 Oct 28 18:34:52.870091 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1890/5409] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:52 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:52.911030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:52.926106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6c481de-0672-4e38-817b-830852eb98c7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1692 microversion: 2.1 time: 0.598061 Oct 28 18:34:52.959595 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3520/5410] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:52 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1692 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:52.994922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:52.996487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:53.021880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.027229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.029512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.032803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.034374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.037286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.203492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-baafa035-e531-47b1-bb01-cfe2a4a30f04 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Action: 'create', calling method: .version_select at 0x7f78dd65b280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1547122992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF21OiwtDLBKZm68wCcHaZfcFbW1xsuf5W6Nr9W+BOZ3QFqRTCjvzKLjWhT232aU8XoqmuwU/QvEaFRnYgfgJ7hMZCHG5a+D2F4dignZEixUnnLTtf3TQallJWBlhUpFZw=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:53.233498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-baafa035-e531-47b1-bb01-cfe2a4a30f04 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Getting quotas for project 6bfe0fd7bdd348fc8300707dff245672. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:34:53.242491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-baafa035-e531-47b1-bb01-cfe2a4a30f04 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Getting quotas for user c4d84d4bf7e64dcbb24dd45894d86642 and project 6bfe0fd7bdd348fc8300707dff245672. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:34:53.306906 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-baafa035-e531-47b1-bb01-cfe2a4a30f04 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.434140 Oct 28 18:34:53.310672 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1891/5411] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:34:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:53.901217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:53.902034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:53.924148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.924651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.925096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.925885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.926351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.926776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.955791 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad7b25b0-884f-40a3-8124-2c903f321263 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1654 microversion: 2.1 time: 0.993713 Oct 28 18:34:53.957368 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3521/5412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:52 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1654 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:53.962811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:53.964820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:53.985514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.988639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.989651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.991854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.997700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:54.001990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:54.578066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:54.624771 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-27d29b69-c601-4729-953d-601a8f498387 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1506 microversion: 2.1 time: 0.727700 Oct 28 18:34:54.628961 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1892/5413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:53 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1506 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:54.905017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3091b0c1-e6f9-4d3c-8ba4-73506a6218e2 req-c317e6f2-65ff-455a-97c2-bb0bb8430452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7156566e-38d4-44e7-befd-92730e5db14a", "name": "network-vif-deleted", "tag": "6dd504b6-95e8-4165-a6e2-2ef5c22cb1a8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:54.931217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3091b0c1-e6f9-4d3c-8ba4-73506a6218e2 req-c317e6f2-65ff-455a-97c2-bb0bb8430452 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:54.931700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3091b0c1-e6f9-4d3c-8ba4-73506a6218e2 req-c317e6f2-65ff-455a-97c2-bb0bb8430452 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:54.932346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3091b0c1-e6f9-4d3c-8ba4-73506a6218e2 req-c317e6f2-65ff-455a-97c2-bb0bb8430452 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:54.967730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:54.969933 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3091b0c1-e6f9-4d3c-8ba4-73506a6218e2 req-c317e6f2-65ff-455a-97c2-bb0bb8430452 service nova] Creating event network-vif-deleted:6dd504b6-95e8-4165-a6e2-2ef5c22cb1a8 for instance 7156566e-38d4-44e7-befd-92730e5db14a on n-h2-862404-2 Oct 28 18:34:54.983770 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0fe8202b-fdf0-4fcf-8643-8087e350af54 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1697 microversion: 2.1 time: 1.024953 Oct 28 18:34:54.993241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3522/5414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:53 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1697 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:55.005432 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3091b0c1-e6f9-4d3c-8ba4-73506a6218e2 req-c317e6f2-65ff-455a-97c2-bb0bb8430452 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103958 Oct 28 18:34:55.009363 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1893/5415] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:55.010087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:55.012120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:55.028807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.033212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.035738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.036962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.040924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.041671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.259056 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3473bb20-2fea-43f0-a73d-d057900641f6 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 200 len: 1449 microversion: 2.1 time: 0.261554 Oct 28 18:34:55.261427 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3523/5416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:54 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 1449 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:55.651671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:55.653127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:55.663021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.663633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.664193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.664997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.667579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.673934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.964399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:55.978944 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-465b65b2-a27d-431e-9c9d-1dc5fe37c328 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1506 microversion: 2.1 time: 0.333310 Oct 28 18:34:55.980544 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1894/5417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:55 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:56.014888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.016763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:56.041626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.043488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.044139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.045739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.047844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.048928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.108998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.109754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:56.119251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.121457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.122159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.123113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.123866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.124446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.143021 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 HTTP/1.1 Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '6d6730fd-e15f-480a-a249-28b7c59a53d7'} Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:56.145197 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.150153 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.153390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:56.155211 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6666ed0b-26c0-406f-a9c3-429b145859ea tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 404 len: 111 microversion: 2.1 time: 0.053040 Oct 28 18:34:56.156442 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1895/5418] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:56 2022] DELETE /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:34:56.165339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.166195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 6d6730fd-e15f-480a-a249-28b7c59a53d7] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:56.173957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.174783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.175453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.176393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.177038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.177607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.193365 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 HTTP/1.1 Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '6d6730fd-e15f-480a-a249-28b7c59a53d7'} Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.195620 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.200249 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.200249 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.200249 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.200249 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:56.200249 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:56.200249 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. Oct 28 18:34:56.200249 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.201374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 6d6730fd-e15f-480a-a249-28b7c59a53d7 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:56.202365 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3e5e6fd2-7c6e-4654-8ef8-310d7b8da88a tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7" status: 404 len: 111 microversion: 2.1 time: 0.042162 Oct 28 18:34:56.204037 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1896/5419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:56 2022] GET /compute/v2.1/servers/6d6730fd-e15f-480a-a249-28b7c59a53d7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:34:56.211920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.212650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:56.220789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.221488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.222071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.222936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.224164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.225348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.263338 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af HTTP/1.1 Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '196979b7-42a0-44ee-a9b8-33099e5937af'} Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:56.265863 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.269844 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.272728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:56.273917 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d9670ee-f09f-465e-ac13-9632106dfc39 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 404 len: 111 microversion: 2.1 time: 0.066103 Oct 28 18:34:56.276226 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1897/5420] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:56 2022] DELETE /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:34:56.284450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.285392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: 196979b7-42a0-44ee-a9b8-33099e5937af] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:56.293618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.294460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.295143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.296135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.297388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.298051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.316868 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af HTTP/1.1 Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '196979b7-42a0-44ee-a9b8-33099e5937af'} Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.318836 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.323155 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.323155 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.323155 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.323155 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:56.323155 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:56.323155 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. Oct 28 18:34:56.323155 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.327338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance 196979b7-42a0-44ee-a9b8-33099e5937af could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:56.328588 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65ed8b47-d1f2-4a49-bf45-a1f72de62e95 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af" status: 404 len: 111 microversion: 2.1 time: 0.048380 Oct 28 18:34:56.329447 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1898/5421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:56 2022] GET /compute/v2.1/servers/196979b7-42a0-44ee-a9b8-33099e5937af => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:34:56.359566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.366751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: 7156566e-38d4-44e7-befd-92730e5db14a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:56.379561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.380254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.380810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.381847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.382559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.383401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.401446 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] HTTP exception thrown: Instance 7156566e-38d4-44e7-befd-92730e5db14a could not be found. Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Request method failure captured: Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a HTTP/1.1 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCCVBYm44KVzXeq4lmlHGd9UJMWAywRlNWIEwo0W14zmo00Z_mUd7NbcFQHABYUXl6MydC4r0lLlY8NdNqUXbOm-0ZJzEqNF6cgTqkv1SRnf82-Fks4o_oBe9twR4MhfQ_3XoAZI8bYYkDz_0LJndbwDGFBaesDnfjhqnl_jUiXq81M Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: c1f4ee93a4234d36a4b46653f4a38fa3 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestServerMultinode-1744467479 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1f4ee93a4234d36a4b46653f4a38fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1f4ee93a4234d36a4b46653f4a38fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1f4ee93a4234d36a4b46653f4a38fa3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1f4ee93a4234d36a4b46653f4a38fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestServerMultinode-1744467479 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: c1f4ee93a4234d36a4b46653f4a38fa3 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestServerMultinode-1744467479 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestServerMultinode-1744467479-project-admin Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 6f830445fe8f4ffc963bff548e087d12 Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestServerMultinode-1744467479-project-admin Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 7156566e-38d4-44e7-befd-92730e5db14a could not be found. Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '7156566e-38d4-44e7-befd-92730e5db14a'} Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7156566e-38d4-44e7-befd-92730e5db14a could not be found. Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7156566e-38d4-44e7-befd-92730e5db14a could not be found. Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:56.403394 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.408041 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:56.408041 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:56.408041 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:56.408041 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:56.408041 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:56.408041 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7156566e-38d4-44e7-befd-92730e5db14a could not be found. Oct 28 18:34:56.408041 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:34:56.410482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Returning 404 to user: Instance 7156566e-38d4-44e7-befd-92730e5db14a could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:56.411667 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b96651f9-5177-4401-8159-867eeca4fffe tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a" status: 404 len: 111 microversion: 2.1 time: 0.081074 Oct 28 18:34:56.416260 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1899/5422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:56 2022] GET /compute/v2.1/servers/7156566e-38d4-44e7-befd-92730e5db14a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:34:56.439218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.439583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:56.460148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.460915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.463252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.465103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.466062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.466530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.532413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:34:56.657341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:56.678999 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc77ed39-39bc-46dc-8d84-d707ed96e9b8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1697 microversion: 2.1 time: 0.669633 Oct 28 18:34:56.695874 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3524/5423] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:56 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1697 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:56.756110 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-98081e56-c404-4645-8e30-3e4b363365a4 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 204 len: 0 microversion: 2.1 time: 0.330970 Oct 28 18:34:56.761883 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1900/5424] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:56 2022] DELETE /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:34:56.766443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.767063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:56.777678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.778895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.779508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.780438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.782291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.783057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.007202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:57.009278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:57.027577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.028452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.029101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.030062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.030729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.031363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.093926 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34383a05-48b4-44bf-a2c7-9c8f377a5d5e tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1654 microversion: 2.1 time: 0.331213 Oct 28 18:34:57.118033 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3525/5425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:56 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1654 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:57.599084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:57.616398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4fa7ffed-6ff2-4657-9df6-75bb4585a7ee tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 200 len: 1509 microversion: 2.1 time: 0.613674 Oct 28 18:34:57.624297 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1901/5426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:57 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 1509 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:57.641494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:57.642140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:57.650924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.651453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.651938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.652678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.653152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.653590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.656777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:57.706026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:57.706664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:57.746600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.747135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.747585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.749542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.750019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.750458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.927234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:57.939181 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30aadb29-3e24-4158-b5ca-bb922313ff9b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.301269 Oct 28 18:34:57.940480 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3526/5427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:57 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:57.975605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:57.976766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:57.990662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.991185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.991648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.995769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.997542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.998441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.042164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:58.054223 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65bf904b-4ef2-4479-9464-33a366482d86 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1697 microversion: 2.1 time: 0.352458 Oct 28 18:34:58.058612 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1902/5428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:57 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1697 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:58.070803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-efbe98e5-167d-422d-8d63-2f08833c686d req-8789e0d1-549a-4e24-ae87-3cf8f33956e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba94308-6ac5-4b60-81ba-3662bd82c3f0", "name": "network-vif-unplugged", "status": "completed", "tag": "5df55407-37c7-4aa2-854a-af22833eff2c"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:58.090990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:58.111858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-efbe98e5-167d-422d-8d63-2f08833c686d req-8789e0d1-549a-4e24-ae87-3cf8f33956e9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.114808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-efbe98e5-167d-422d-8d63-2f08833c686d req-8789e0d1-549a-4e24-ae87-3cf8f33956e9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.115502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-efbe98e5-167d-422d-8d63-2f08833c686d req-8789e0d1-549a-4e24-ae87-3cf8f33956e9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.126573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:58.166396 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-efbe98e5-167d-422d-8d63-2f08833c686d req-8789e0d1-549a-4e24-ae87-3cf8f33956e9 service nova] Creating event network-vif-unplugged:5df55407-37c7-4aa2-854a-af22833eff2c for instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 on n-h1-862404-2 Oct 28 18:34:58.175441 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-efbe98e5-167d-422d-8d63-2f08833c686d req-8789e0d1-549a-4e24-ae87-3cf8f33956e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115156 Oct 28 18:34:58.176879 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1903/5429] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:58.185390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:58.187806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:58.199499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.200346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.200979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.202033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.204187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.204830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.246447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:58.259457 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87fa0330-352f-4c0f-bc96-97fb872316d2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.289883 Oct 28 18:34:58.260123 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3527/5430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:57 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:58.282639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:58.283593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:58.290703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.292056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.292677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.293596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.294257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.294872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.461068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:58.472058 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-613e117b-a8b4-4795-9bf6-aef4314510b0 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.193057 Oct 28 18:34:58.492000 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3528/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:58 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:58.498567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:58.499495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:58.506611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.507394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.508790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.509729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.510369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.510972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.702729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:58.713716 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d956089-3e70-455c-95c9-09284c803236 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.218978 Oct 28 18:34:58.732834 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3529/5432] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:58 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:58.762094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a00696a0-6d10-4387-8379-6eca5f9489fe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:58.787080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a00696a0-6d10-4387-8379-6eca5f9489fe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.789888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a00696a0-6d10-4387-8379-6eca5f9489fe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.794316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a00696a0-6d10-4387-8379-6eca5f9489fe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.859365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a00696a0-6d10-4387-8379-6eca5f9489fe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:34:58.903082 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-06c21be9-a8ca-473a-b050-0757a8a014f0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1654 microversion: 2.1 time: 0.724649 Oct 28 18:34:58.919849 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1904/5433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:58 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1654 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:58.942151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a00696a0-6d10-4387-8379-6eca5f9489fe tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.206307 Oct 28 18:34:58.948935 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3530/5434] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:58 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:34:58.953643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:58.954873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:58.962851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.963596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.964253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.965135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.965777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.966382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:59.080865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:59.082189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:59.093730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:59.094237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:59.094681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:59.095454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:59.095949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:59.096652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:59.287854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:59.334858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e436559f-2d40-4fa7-8ffc-2e2abaeaeba1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1697 microversion: 2.1 time: 0.258873 Oct 28 18:34:59.336660 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3531/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:59 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1697 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:59.777784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:59.808583 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-100cf5d5-14cc-420e-9600-6d8067124c93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.856263 Oct 28 18:34:59.819851 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1905/5436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:58 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:59.944560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:59.945876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:34:59.955304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:59.956008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:59.956606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:59.958103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:59.958103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:59.958611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.181549 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c99a5bd1-2caa-4b38-8d9b-f548ac82e60a tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1654 microversion: 2.1 time: 0.248343 Oct 28 18:35:00.182875 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3532/5437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:59 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1654 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:00.369025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:00.369655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:00.388726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.389837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.390296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.392858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.394648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.395133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.628028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2b62a387-57d7-4f19-953a-fe96c53827f4 req-42ca5743-6553-4c9f-a9b9-62698ba1b702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dd6680-b062-425b-beb9-9d1c22608301", "name": "network-vif-deleted", "tag": "61f00648-d0fe-4496-b865-0126ac5f26f2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:00.654135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2b62a387-57d7-4f19-953a-fe96c53827f4 req-42ca5743-6553-4c9f-a9b9-62698ba1b702 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.655870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2b62a387-57d7-4f19-953a-fe96c53827f4 req-42ca5743-6553-4c9f-a9b9-62698ba1b702 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.657105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2b62a387-57d7-4f19-953a-fe96c53827f4 req-42ca5743-6553-4c9f-a9b9-62698ba1b702 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.694251 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2b62a387-57d7-4f19-953a-fe96c53827f4 req-42ca5743-6553-4c9f-a9b9-62698ba1b702 service nova] Creating event network-vif-deleted:61f00648-d0fe-4496-b865-0126ac5f26f2 for instance a5dd6680-b062-425b-beb9-9d1c22608301 on n-h1-862404-2 Oct 28 18:35:00.707568 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2b62a387-57d7-4f19-953a-fe96c53827f4 req-42ca5743-6553-4c9f-a9b9-62698ba1b702 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085076 Oct 28 18:35:00.715029 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3533/5438] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:00.840583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:00.844845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:00.845139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:00.866284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.866786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.867528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.871922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.873268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.873751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.874612 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae2b12f9-d06d-4265-8c33-a9f980606048 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1697 microversion: 2.1 time: 0.509516 Oct 28 18:35:00.899940 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1906/5439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:00 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1697 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:01.206393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:01.207332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:01.221680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:01.222200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:01.222648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:01.223394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:01.227026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:01.227762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:01.360738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:01.361016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:01.361473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:01.361945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lazy-loading 'fault' on Instance uuid a5dd6680-b062-425b-beb9-9d1c22608301 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:35:01.692686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:01.703152 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-845cae9d-e16a-496d-b19e-1f5bcc82a366 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.870049 Oct 28 18:35:01.703976 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3534/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:00 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:01.812341 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e6b3064-0a5f-49a2-9ecf-499206a19784 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 200 len: 1453 microversion: 2.1 time: 0.607062 Oct 28 18:35:01.814885 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1907/5441] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:01 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 1453 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:01.905882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:01.906576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:01.924956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:01.925407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:01.933176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:01.933176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:01.933176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:01.933582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.174066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:02.174711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:02.189326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:02.197783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:02.199013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.200157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:02.200754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:02.201286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.237171 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 HTTP/1.1 Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'd2297cd3-4ac6-4228-906b-ff4e283c5e23'} Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:02.242667 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.246706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.253802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:02.255047 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd5ca221-ff0e-4aac-ac9d-bc8a50664b2d tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 404 len: 111 microversion: 2.1 time: 0.084833 Oct 28 18:35:02.258009 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1908/5442] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:02 2022] DELETE /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:35:02.268868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:02.272617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] [instance: d2297cd3-4ac6-4228-906b-ff4e283c5e23] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:02.286019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:02.290977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:02.291743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.292804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:02.298677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:02.300775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.336035 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] HTTP exception thrown: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Request method failure captured: Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 HTTP/1.1 Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB7AFCin4n1R4gSKFF4GtijmIr_u5kw-Ccc_OPhFs0363PvP6aKi1Z7_kMWMdGZYzDeB6qGCTIkvImaTxzxygsccTBg6crl0668x6D0XvbYr8O6zIiBvPoumCQCzWoQ_n_YKXIuLIZkG1O2OLH67MoXpKLlj8aCw9n4Qil8-w9bCmvI Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2302daf1521c4a0c8059fe6b55b81f4e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2302daf1521c4a0c8059fe6b55b81f4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 2302daf1521c4a0c8059fe6b55b81f4e Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-219519034 Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e0cc266e44dd4f76a95a428bb3676b99 Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-219519034-project Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'd2297cd3-4ac6-4228-906b-ff4e283c5e23'} Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:02.338256 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.343231 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.343231 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:02.343231 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:02.343231 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:02.343231 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:02.343231 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. Oct 28 18:35:02.343231 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.346620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] Returning 404 to user: Instance d2297cd3-4ac6-4228-906b-ff4e283c5e23 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:02.348773 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a8edea73-5e26-40f1-ab90-e35fe59c9f69 tempest-AttachVolumeNegativeTest-219519034 tempest-AttachVolumeNegativeTest-219519034-project] 10.222.0.16 "GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23" status: 404 len: 111 microversion: 2.1 time: 0.083783 Oct 28 18:35:02.352505 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1909/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:02 2022] GET /compute/v2.1/servers/d2297cd3-4ac6-4228-906b-ff4e283c5e23 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:02.651665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:02.663490 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8dbfffe-bd39-45cc-8584-8429ef99cfb1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1697 microversion: 2.1 time: 0.761542 Oct 28 18:35:02.678019 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3535/5444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:01 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1697 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:02.732947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:02.733517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:02.747337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:02.756605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:02.758875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.761822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:02.765575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:02.769086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.843631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:02.844934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] [instance: a5dd6680-b062-425b-beb9-9d1c22608301] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:02.855653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:02.862355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:02.863556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.864372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:02.873263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:02.873747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:02.911579 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] HTTP exception thrown: Instance a5dd6680-b062-425b-beb9-9d1c22608301 could not be found. Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Request method failure captured: Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 HTTP/1.1 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCCVBYm44KVzXeq4lmlHGd9UJMWAywRlNWIEwo0W14zmo00Z_mUd7NbcFQHABYUXl6MydC4r0lLlY8NdNqUXbOm-0ZJzEqNF6cgTqkv1SRnf82-Fks4o_oBe9twR4MhfQ_3XoAZI8bYYkDz_0LJndbwDGFBaesDnfjhqnl_jUiXq81M Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: c1f4ee93a4234d36a4b46653f4a38fa3 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestServerMultinode-1744467479 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1f4ee93a4234d36a4b46653f4a38fa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1f4ee93a4234d36a4b46653f4a38fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1f4ee93a4234d36a4b46653f4a38fa3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1f4ee93a4234d36a4b46653f4a38fa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestServerMultinode-1744467479 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: c1f4ee93a4234d36a4b46653f4a38fa3 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestServerMultinode-1744467479 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestServerMultinode-1744467479-project-admin Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 6f830445fe8f4ffc963bff548e087d12 Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestServerMultinode-1744467479-project-admin Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance a5dd6680-b062-425b-beb9-9d1c22608301 could not be found. Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'a5dd6680-b062-425b-beb9-9d1c22608301'} Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5dd6680-b062-425b-beb9-9d1c22608301 could not be found. Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5dd6680-b062-425b-beb9-9d1c22608301 could not be found. Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:02.918962 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5dd6680-b062-425b-beb9-9d1c22608301 could not be found. Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] Returning 404 to user: Instance a5dd6680-b062-425b-beb9-9d1c22608301 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5463905b-40f0-4ac2-ab97-c2b1e3e63ba0 tempest-TestServerMultinode-1744467479 tempest-TestServerMultinode-1744467479-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301" status: 404 len: 111 microversion: 2.1 time: 0.081566 Oct 28 18:35:02.927878 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3536/5445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:02 2022] GET /compute/v2.1/servers/a5dd6680-b062-425b-beb9-9d1c22608301 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:03.258263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:03.624465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:03.633874 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-af3a7c76-d077-4349-8506-3109b6d163ab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.905321 Oct 28 18:35:03.644127 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1910/5446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:02 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:03.705816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:03.706482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:03.731107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:03.731634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:03.732182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:03.732938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:03.733413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:03.733855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:04.552223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:04.569795 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a1903f4-b696-4f9f-8332-92b7843f64d0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1697 microversion: 2.1 time: 0.869049 Oct 28 18:35:04.572325 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3537/5447] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:03 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1697 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:04.665993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:04.666625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:04.689423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:04.702511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:04.703894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:04.709812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:04.711214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:04.716880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:05.458325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:05.476117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:05.477071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:05.480743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:05.481916 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49c2d9ca-77cf-431a-a239-47ed2fb0e7f2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.819778 Oct 28 18:35:05.485570 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1911/5448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:04 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:05.504862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:05.507153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:05.508620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:05.511917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:05.512731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:05.521384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:05.582820 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] HTTP exception thrown: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Request method failure captured: Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 HTTP/1.1 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB8IjUya3a2G7Fs0f9MCae4jU_YovM8f0nLdAgjDzRkQ_YcbPZ8XFvAE-a5RsBcABirCIiVqsB0w52qkaEjpDDSW2yyWnWwek18n9OEICtUDKbPeGDBGMyqqMgkB-nGRfleiUcpA7w6v0lldM5suVxZLHim_AwUu4puBteGOZDVbhuI Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d262ef5fd724b1faee11c815b7f1b65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 830f18fef1d1434697a2c552ade4b793 Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '08e32484-be7d-43a6-b346-745198a421e2'} Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:05.584504 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Returning 404 to user: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c732e00-d475-4d1d-b8f3-2935a326730a tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 404 len: 111 microversion: 2.1 time: 0.114432 Oct 28 18:35:05.588724 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3538/5449] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:05 2022] DELETE /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:35:05.604246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:05.604842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: 08e32484-be7d-43a6-b346-745198a421e2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:05.615591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:05.626976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:05.630379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:05.630897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:05.631346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:05.632102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:05.633153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:05.645125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:05.648032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:05.648635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:05.649100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:05.649913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:05.650335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:05.650779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:05.697745 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] HTTP exception thrown: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Request method failure captured: Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 HTTP/1.1 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB8IjUya3a2G7Fs0f9MCae4jU_YovM8f0nLdAgjDzRkQ_YcbPZ8XFvAE-a5RsBcABirCIiVqsB0w52qkaEjpDDSW2yyWnWwek18n9OEICtUDKbPeGDBGMyqqMgkB-nGRfleiUcpA7w6v0lldM5suVxZLHim_AwUu4puBteGOZDVbhuI Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d262ef5fd724b1faee11c815b7f1b65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 830f18fef1d1434697a2c552ade4b793 Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '08e32484-be7d-43a6-b346-745198a421e2'} Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:05.699379 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Returning 404 to user: Instance 08e32484-be7d-43a6-b346-745198a421e2 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:05.703093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c0211171-67ba-44d0-9d8f-2033db99d2b8 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2" status: 404 len: 111 microversion: 2.1 time: 0.108642 Oct 28 18:35:05.717817 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1912/5450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:05 2022] GET /compute/v2.1/servers/08e32484-be7d-43a6-b346-745198a421e2 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:35:06.517693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:06.534021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:06.534789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:06.551896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c131602e-314c-4154-8197-f1a94b7b1481 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1697 microversion: 2.1 time: 0.937911 Oct 28 18:35:06.552608 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3539/5451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:05 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1697 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:06.554523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:06.555027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:06.556517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:06.558138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:06.559777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:06.560271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:07.193947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:07.207256 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e1df2e08-01cc-4352-9041-f878cb809ffa tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.696714 Oct 28 18:35:07.208702 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1913/5452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:06 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:07.583204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:07.584706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:07.608096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:07.619673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:07.620258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:07.620984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:07.625654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:07.626127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:08.233097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:08.237255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:08.238452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:08.250175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:08.253646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:08.256069 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4db4f63b-2d5d-4ff7-87b8-fe3db6e39ef9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1696 microversion: 2.1 time: 0.676782 Oct 28 18:35:08.256671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:08.258178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:08.258662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:08.259091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:08.277373 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3540/5453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:07 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1696 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:08.351204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0b8d0264-aef1-43ae-99d3-9cdeca468329 req-77dce288-6cb2-4dd2-9926-bff41a9ee1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e063de5e-ae3f-4d25-97a3-4ffa18bdf86d", "name": "network-vif-unplugged", "status": "completed", "tag": "6aea57d1-9a26-42db-99e7-ffd76f4f0873"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:08.402646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b8d0264-aef1-43ae-99d3-9cdeca468329 req-77dce288-6cb2-4dd2-9926-bff41a9ee1b2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:08.403139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b8d0264-aef1-43ae-99d3-9cdeca468329 req-77dce288-6cb2-4dd2-9926-bff41a9ee1b2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:08.403581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b8d0264-aef1-43ae-99d3-9cdeca468329 req-77dce288-6cb2-4dd2-9926-bff41a9ee1b2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:08.438390 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0b8d0264-aef1-43ae-99d3-9cdeca468329 req-77dce288-6cb2-4dd2-9926-bff41a9ee1b2 service nova] Creating event network-vif-unplugged:6aea57d1-9a26-42db-99e7-ffd76f4f0873 for instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d on n-h1-862404-2 Oct 28 18:35:08.452776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-0b8d0264-aef1-43ae-99d3-9cdeca468329 req-77dce288-6cb2-4dd2-9926-bff41a9ee1b2 service nova] Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:35:08.468916 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0b8d0264-aef1-43ae-99d3-9cdeca468329 req-77dce288-6cb2-4dd2-9926-bff41a9ee1b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127547 Oct 28 18:35:08.470172 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3541/5454] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:09.184991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:09.223044 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c5169bb0-857c-4364-aa70-09a39d985590 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1681 microversion: 2.1 time: 0.991243 Oct 28 18:35:09.224024 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1914/5455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:08 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1681 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:09.291337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:09.292104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:09.310303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:09.310819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:09.311277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:09.312047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:09.312524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:09.312963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:10.074022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:10.088004 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91ad4c07-4262-4ba8-a43c-680cad5ddbf0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1696 microversion: 2.1 time: 0.802340 Oct 28 18:35:10.089376 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3542/5456] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:09 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1696 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:10.247519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:10.248344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:10.264819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:10.265612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:10.266077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:10.266787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:10.267241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:10.267668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.116142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:11.117665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:11.135553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.144805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.145472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.146403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.156811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.157539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.392361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:11.409517 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-81138012-7d7d-4bba-b033-1a2af18cf336 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1658 microversion: 2.1 time: 1.160225 Oct 28 18:35:11.420155 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1915/5457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:10 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1658 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:11.450328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78bcc631-1fad-4632-91f3-f092a103e864 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:11.471943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78bcc631-1fad-4632-91f3-f092a103e864 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.476600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78bcc631-1fad-4632-91f3-f092a103e864 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.479337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78bcc631-1fad-4632-91f3-f092a103e864 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.732728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78bcc631-1fad-4632-91f3-f092a103e864 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Going to try to start instance {{(pid=120679) start /opt/stack/nova/nova/compute/api.py:2787}} Oct 28 18:35:11.791588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:11.806180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-609d1c98-679e-4d1e-b963-81578b8d066d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1696 microversion: 2.1 time: 0.692453 Oct 28 18:35:11.808920 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3543/5458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:11 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1696 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:11.814776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:11.815596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:11.824719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.825199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.826277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.827240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.828178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.841119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.854870 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78bcc631-1fad-4632-91f3-f092a103e864 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.411345 Oct 28 18:35:11.856217 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1916/5459] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:35:11 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:35:11.884136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-50ac0237-9f2a-4f9f-ad92-879739875fcd req-c1f93b91-1413-47ec-b378-f455a86bf27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063de5e-ae3f-4d25-97a3-4ffa18bdf86d", "tag": "6aea57d1-9a26-42db-99e7-ffd76f4f0873"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:11.905310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:11.909851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] HTTP exception thrown: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Request method failure captured: Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a HTTP/1.1 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB8IjUya3a2G7Fs0f9MCae4jU_YovM8f0nLdAgjDzRkQ_YcbPZ8XFvAE-a5RsBcABirCIiVqsB0w52qkaEjpDDSW2yyWnWwek18n9OEICtUDKbPeGDBGMyqqMgkB-nGRfleiUcpA7w6v0lldM5suVxZLHim_AwUu4puBteGOZDVbhuI Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d262ef5fd724b1faee11c815b7f1b65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 830f18fef1d1434697a2c552ade4b793 Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'cca9f698-5ba3-475b-ba38-5a97256e8c9a'} Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:11.916675 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:11.921063 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:11.925009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-50ac0237-9f2a-4f9f-ad92-879739875fcd req-c1f93b91-1413-47ec-b378-f455a86bf27f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.925530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-50ac0237-9f2a-4f9f-ad92-879739875fcd req-c1f93b91-1413-47ec-b378-f455a86bf27f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.926108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-50ac0237-9f2a-4f9f-ad92-879739875fcd req-c1f93b91-1413-47ec-b378-f455a86bf27f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.929936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Returning 404 to user: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:11.931213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-53c081e4-01a6-4cf6-a3d7-db063e7c874e tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 404 len: 111 microversion: 2.1 time: 0.120905 Oct 28 18:35:11.938820 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3544/5460] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:11 2022] DELETE /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:11.955268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:11.957068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:11.974900 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-50ac0237-9f2a-4f9f-ad92-879739875fcd req-c1f93b91-1413-47ec-b378-f455a86bf27f service nova] Creating event network-changed:6aea57d1-9a26-42db-99e7-ffd76f4f0873 for instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d on n-h1-862404-2 Oct 28 18:35:11.995423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-50ac0237-9f2a-4f9f-ad92-879739875fcd req-c1f93b91-1413-47ec-b378-f455a86bf27f service nova] Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:35:11.996007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.996660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.997280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.998167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.999292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.999908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:12.039126 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-50ac0237-9f2a-4f9f-ad92-879739875fcd req-c1f93b91-1413-47ec-b378-f455a86bf27f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180249 Oct 28 18:35:12.041698 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1917/5461] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:12.074920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:12.075664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] [instance: cca9f698-5ba3-475b-ba38-5a97256e8c9a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:12.093306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:12.096922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:12.097413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:12.098178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:12.098658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:12.099096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:12.132004 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] HTTP exception thrown: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Request method failure captured: Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a HTTP/1.1 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB8IjUya3a2G7Fs0f9MCae4jU_YovM8f0nLdAgjDzRkQ_YcbPZ8XFvAE-a5RsBcABirCIiVqsB0w52qkaEjpDDSW2yyWnWwek18n9OEICtUDKbPeGDBGMyqqMgkB-nGRfleiUcpA7w6v0lldM5suVxZLHim_AwUu4puBteGOZDVbhuI Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d262ef5fd724b1faee11c815b7f1b65", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d262ef5fd724b1faee11c815b7f1b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4d262ef5fd724b1faee11c815b7f1b65 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1880395875 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 830f18fef1d1434697a2c552ade4b793 Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeTestJSON-1880395875-project Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'cca9f698-5ba3-475b-ba38-5a97256e8c9a'} Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:12.134430 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] Returning 404 to user: Instance cca9f698-5ba3-475b-ba38-5a97256e8c9a could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:12.139095 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6cc6fa40-73ba-49fc-b035-5ab7cfa0b5d3 tempest-AttachVolumeTestJSON-1880395875 tempest-AttachVolumeTestJSON-1880395875-project] 10.222.0.16 "GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a" status: 404 len: 111 microversion: 2.1 time: 0.092552 Oct 28 18:35:12.141473 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1918/5462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:12 2022] GET /compute/v2.1/servers/cca9f698-5ba3-475b-ba38-5a97256e8c9a => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:12.840330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:12.841143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:12.863313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:12.863842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:12.864305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:12.865038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:12.865504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:12.865939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:13.504355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:13.525799 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65c11281-fc9e-4795-aafe-22ef2edac770 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1667 microversion: 2.1 time: 1.585412 Oct 28 18:35:13.530708 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3545/5463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:11 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1667 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:14.074579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:14.084978 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-164b6a60-e9c9-49ba-ae7f-a1dc390448fc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1696 microversion: 2.1 time: 1.256809 Oct 28 18:35:14.102566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1919/5464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:12 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1696 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:14.557647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:14.558863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:14.573671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:14.577024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:14.577024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:14.581342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:14.582724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:14.583355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:15.084377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:15.101902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-63ffac07-308b-4ab2-a0df-f00cea03f5bd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1667 microversion: 2.1 time: 0.546674 Oct 28 18:35:15.109614 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3546/5465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:14 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1667 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:15.110658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:15.111294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:15.124286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:15.126753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:15.127387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:15.128173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:15.128635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:15.129069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:15.645381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:15.672025 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4a07b0ce-bd55-441f-a4a9-b6ef6b27b69f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1694 microversion: 2.1 time: 0.555564 Oct 28 18:35:15.673480 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1920/5466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:15 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1694 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:16.128988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:16.129654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:16.144513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:16.145333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:16.146949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:16.148749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:16.149347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:16.149948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:16.699475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:16.700945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:16.717576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:16.718375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:16.719306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:16.721692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:16.722416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:16.723912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:16.925237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:16.954297 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9b67662d-26ec-427c-a80f-8fea8e8b5788 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1667 microversion: 2.1 time: 0.827971 Oct 28 18:35:16.963116 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3547/5467] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:16 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1667 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:17.230540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-791738600-access_point-940510747", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "c9695461-589f-435e-bd7d-8d11456140e9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1547122992", "security_groups": [{"name": "tempest-secgroup_access--191272172"}, {"name": "tempest-secgroup_general--881933679"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:17.602193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:17.617374 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8256c16c-36fa-4090-a65c-5a7f6f8ca5a2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1694 microversion: 2.1 time: 0.921787 Oct 28 18:35:17.635785 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1921/5468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:16 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1694 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:17.731491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] validate_networks() for [('c9695461-589f-435e-bd7d-8d11456140e9', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:35:17.988842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:17.989526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:18.006212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:18.006719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:18.007732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:18.012341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:18.012867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:18.013312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:18.073771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:18.913207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:18.939072 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8734681-fd05-459f-8690-bf898ca92344 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1667 microversion: 2.1 time: 0.954436 Oct 28 18:35:18.941863 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1922/5469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:17 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1667 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:18.951322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:18.955683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:18.969178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:18.980397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:18.981019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:18.981853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:18.982404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:18.982906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:18.998513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:35:18.999003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:35:19.000178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:35:19.000672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:35:19.001168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:35:19.021547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:19.022212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:19.022699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:19.030350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:19.032393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:19.033726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:19.098436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Getting quotas for project 6bfe0fd7bdd348fc8300707dff245672. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:35:19.113230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Getting quotas for user c4d84d4bf7e64dcbb24dd45894d86642 and project 6bfe0fd7bdd348fc8300707dff245672. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:35:19.150471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:35:19.152619 n-d-862404-2 devstack@n-api.service[120680]: WARNING nova.utils [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-791738600-access_point-940510747 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-791738600-acc Oct 28 18:35:19.153409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:35:19.254085 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-255b592d-6ac5-44f5-bde8-59c97a0554f2 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.029007 Oct 28 18:35:19.254775 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3548/5470] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:35:17 2022] POST /compute/v2.1/servers => generated 456 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:35:19.267073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43312e9d-74fe-42e3-b970-57ac1605836d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:19.267711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-43312e9d-74fe-42e3-b970-57ac1605836d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:19.424514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-43312e9d-74fe-42e3-b970-57ac1605836d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:19.444590 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43312e9d-74fe-42e3-b970-57ac1605836d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1293 microversion: 2.1 time: 0.181422 Oct 28 18:35:19.453970 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3549/5471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:19 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1293 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:19.968529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:19.970681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:19.990543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:19.997882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:19.998839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:20.001290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:20.006408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:20.011233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:20.239775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:20.252967 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14fb0d3f-1538-4d9d-be1d-b9b0d8e97bd6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1691 microversion: 2.1 time: 1.307502 Oct 28 18:35:20.255633 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1923/5472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:18 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1691 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:20.281335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:20.282260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:20.289573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:20.290459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:20.291121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:20.292113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:20.293024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:20.293686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:20.337152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:20.355537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a34224c9-fe34-44ae-93df-89a5bbab8033 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.389394 Oct 28 18:35:20.357445 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3550/5473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:19 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:20.387236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:20.388429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:20.390422 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9eb381bf-3026-457a-aade-57b1981195fb tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action" status: 204 len: 0 microversion: 2.1 time: 0.111842 Oct 28 18:35:20.392680 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1924/5474] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:35:20 2022] POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:35:20.406902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:20.409513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:20.409674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:20.410061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:20.410510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:20.417281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:20.418030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:20.418850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:20.419038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:20.419734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:20.420478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:20.421418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:20.422102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:20.422760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.015043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:21.043798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42cd374b-5e38-476a-bd97-e4eb5d270b9f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.664266 Oct 28 18:35:21.046584 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3551/5475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:20 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:21.060993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:21.065926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:21.081869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.083619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.084725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.089888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.090947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.090947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.166411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:21.177496 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c907cf0f-250c-48d7-9a13-bfe357af82f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1691 microversion: 2.1 time: 0.780533 Oct 28 18:35:21.202972 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1925/5476] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:20 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1691 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:21.214877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:21.221009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:21.229738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.234093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.235349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.236843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.237317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.237754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.252571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:21.272210 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2857db6-4e8c-43ec-9429-ae9d1c6c482b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1345 microversion: 2.1 time: 0.224299 Oct 28 18:35:21.273536 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3552/5477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:21 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:21.823128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-89e7a658-89f6-48eb-8264-1270e2ff6166 req-f00fa921-63a7-41e6-a6ed-ddbbd8840cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e063de5e-ae3f-4d25-97a3-4ffa18bdf86d", "name": "network-vif-plugged", "status": "completed", "tag": "6aea57d1-9a26-42db-99e7-ffd76f4f0873"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:21.837531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-89e7a658-89f6-48eb-8264-1270e2ff6166 req-f00fa921-63a7-41e6-a6ed-ddbbd8840cd4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.838025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-89e7a658-89f6-48eb-8264-1270e2ff6166 req-f00fa921-63a7-41e6-a6ed-ddbbd8840cd4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.838632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-89e7a658-89f6-48eb-8264-1270e2ff6166 req-f00fa921-63a7-41e6-a6ed-ddbbd8840cd4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.853280 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-89e7a658-89f6-48eb-8264-1270e2ff6166 req-f00fa921-63a7-41e6-a6ed-ddbbd8840cd4 service nova] Creating event network-vif-plugged:6aea57d1-9a26-42db-99e7-ffd76f4f0873 for instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d on n-h1-862404-2 Oct 28 18:35:21.859343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-89e7a658-89f6-48eb-8264-1270e2ff6166 req-f00fa921-63a7-41e6-a6ed-ddbbd8840cd4 service nova] Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:35:21.873588 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-89e7a658-89f6-48eb-8264-1270e2ff6166 req-f00fa921-63a7-41e6-a6ed-ddbbd8840cd4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054667 Oct 28 18:35:21.874758 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3553/5478] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:22.206435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:22.207930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:22.214740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:22.215478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:22.216292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:22.217164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:22.217872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:22.218463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:22.340631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:22.352286 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a245a008-1459-443f-95f4-bfc59972c38b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 1.148029 Oct 28 18:35:22.352971 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1926/5479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:21 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:22.362516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:22.367641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:22.379049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:22.379558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:22.386157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:22.388025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:22.393919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:22.394487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:22.549307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:22.560288 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e51eb33a-4436-4fef-8c2e-b45878afd8db tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1351 microversion: 2.1 time: 0.205577 Oct 28 18:35:22.561122 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1927/5480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:22 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1351 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:22.572491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:22.578950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:22.586031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:22.586770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:22.587371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:22.588725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:22.589366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:22.589960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:22.896745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:22.925528 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b838eae6-625f-4f1c-904f-d3396c0f12f7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1691 microversion: 2.1 time: 0.718174 Oct 28 18:35:22.926301 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3554/5481] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:22 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1691 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:23.074992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:23.091370 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8bc33596-0a78-4920-ae6a-867c924d1f4d tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.528890 Oct 28 18:35:23.093344 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1928/5482] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:22 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:23.121838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:23.124804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:23.152540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:23.171598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:23.175583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:23.179522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:23.183491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:23.185602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:23.585741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:23.587859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:23.598611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:23.599287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:23.600314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:23.601640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:23.602268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:23.602860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:23.746337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:23.764815 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08ddade9-e180-4f13-aa1b-0e6da391fadd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.651020 Oct 28 18:35:23.765387 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3555/5483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:23 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:23.784578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:23.792651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:23.793476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:23.796672 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3f26c4dd-a6f7-46e0-a8c0-00811ce1eb77 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1351 microversion: 2.1 time: 0.215242 Oct 28 18:35:23.800530 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1929/5484] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:23 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1351 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:23.813441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:23.813945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:23.814562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:23.815448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:23.816124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:23.816707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:23.892237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lazy-loading 'flavor' on Instance uuid 4bb7b4b4-62b3-4f08-92a2-69c78746a21b {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:35:23.957153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:23.958595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:23.970021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:23.971596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:23.973031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:23.974589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:23.977116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:23.978545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:24.038319 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-947b0168-37fb-4eba-995c-5d2876228cf2 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.250162 Oct 28 18:35:24.039278 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3556/5485] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:35:23 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:35:24.052167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:24.053180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:24.062024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:24.062868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:24.063530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:24.064603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:24.065238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:24.065847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:24.515235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:24.535953 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c059caa8-2471-45a3-bfc1-57a05f97d1b5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1683 microversion: 2.1 time: 0.584537 Oct 28 18:35:24.536735 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1930/5486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:23 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1683 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:24.638638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:24.650364 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-74588605-9a0b-42e9-922a-b1c48d6c134a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1679 microversion: 2.1 time: 0.604482 Oct 28 18:35:24.658132 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3557/5487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:24 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1679 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:24.828104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:24.829242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:24.840259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:24.843288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:24.845319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:24.849099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:24.850034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:24.852272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:25.397922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:25.410961 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c6259f24-0d84-4779-a06e-0da66eed2914 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 0.590943 Oct 28 18:35:25.415559 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1931/5488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:24 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:25.689095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:25.690209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:25.708987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:25.709796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:25.711233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:25.712270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:25.712919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:25.713511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:26.090945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:26.107711 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24cbc392-cae3-4f95-8d58-f51a1ddbcdf6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1662 microversion: 2.1 time: 0.426995 Oct 28 18:35:26.108854 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3558/5489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:25 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1662 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:26.141117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:26.142039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:26.169907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:26.170422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:26.170851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:26.172227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:26.172691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:26.184120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:26.343316 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9add763c-0b24-46e9-a880-9bae38b7f2b7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action" status: 202 len: 0 microversion: 2.1 time: 0.208043 Oct 28 18:35:26.344672 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1932/5490] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:35:26 2022] POST /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:35:26.354823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:26.355550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:26.371223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:26.371735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:26.372210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:26.373109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:26.373502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:26.373830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:26.439347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:26.440274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:26.451601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:26.454853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:26.457998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:26.458645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:26.459128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:26.459589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:27.082532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:27.095642 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1209a8bf-b6dd-49e1-8f1b-d683b4cfad39 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1668 microversion: 2.1 time: 0.746479 Oct 28 18:35:27.102724 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3559/5491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:26 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1668 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:27.763009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:27.780132 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-38ac4d9a-11a9-4720-b542-253b6566709d tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 1.345037 Oct 28 18:35:27.783701 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1933/5492] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:26 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:28.133502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:28.134111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:28.154805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:28.158489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:28.159335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:28.160044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:28.160812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:28.161980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:28.548788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:28.565704 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fdde8047-bcbc-4c86-94ed-a82e2ba4d47e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1668 microversion: 2.1 time: 0.438068 Oct 28 18:35:28.586255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3560/5493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:28 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1668 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:28.684508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2dbbdb52-d959-45d9-82c6-c163731e04a2 req-18a7040a-cdbf-4b8f-bfc3-f78b489a024c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe", "tag": "c3b354eb-686a-4786-8199-87493a5d5665"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:28.709994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=64 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:28.734238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2dbbdb52-d959-45d9-82c6-c163731e04a2 req-18a7040a-cdbf-4b8f-bfc3-f78b489a024c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:28.734905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2dbbdb52-d959-45d9-82c6-c163731e04a2 req-18a7040a-cdbf-4b8f-bfc3-f78b489a024c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:28.737345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2dbbdb52-d959-45d9-82c6-c163731e04a2 req-18a7040a-cdbf-4b8f-bfc3-f78b489a024c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:28.780814 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2dbbdb52-d959-45d9-82c6-c163731e04a2 req-18a7040a-cdbf-4b8f-bfc3-f78b489a024c service nova] Creating event network-changed:c3b354eb-686a-4786-8199-87493a5d5665 for instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe on n-h1-862404-2 Oct 28 18:35:28.800461 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2dbbdb52-d959-45d9-82c6-c163731e04a2 req-18a7040a-cdbf-4b8f-bfc3-f78b489a024c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121767 Oct 28 18:35:28.808380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:28.809174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:28.821509 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1934/5494] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:28.825445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:28.828290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:28.828830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:28.830624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:28.831983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:28.832655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:29.049712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:29.230900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:29.234705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:29.255864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f2f5ee0-9ac2-484b-ac35-c944e81b22e7 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 0.453398 Oct 28 18:35:29.258341 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3561/5495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:28 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:29.594305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:29.595044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:29.605805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:29.606566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:29.607238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:29.608250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:29.609003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:29.609652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:29.945041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:29.958242 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b5a6e167-5120-4aab-8bc4-3a66e64efaab tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1668 microversion: 2.1 time: 0.371619 Oct 28 18:35:29.958853 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1935/5496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:29 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1668 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:30.285246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:30.285981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:30.288628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:30.300451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:30.301036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:30.301685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:30.302870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:30.304396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:30.305060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:30.848992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:30.858091 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9bc8a2e-d826-499e-9794-516dd25fbf4e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 0.577496 Oct 28 18:35:30.876511 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3562/5497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:30 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:30.985731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:30.990249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:31.000362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:31.001145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:31.001651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:31.002806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:31.003508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:31.004724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:31.292438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:31.308664 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5b08048-a3dd-47f8-ac97-ac33de6e1ee9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1668 microversion: 2.1 time: 0.330122 Oct 28 18:35:31.313766 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1936/5498] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:30 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1668 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:31.885311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:31.885985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:31.905348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:31.906201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:31.906952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:31.908414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:31.910816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:31.911473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:32.244117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:32.252707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0445c18f-2525-48b9-8e1c-bdb25460bb6c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 0.373277 Oct 28 18:35:32.254717 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3563/5499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:31 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:32.336890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:32.338253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:32.351684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:32.355413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:32.357670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:32.360648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:32.362460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:32.365121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:32.370620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:32.736186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:32.751398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a257a0ab-fb57-4727-a248-68e9967efebd tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.419367 Oct 28 18:35:32.755442 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1937/5500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:32 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:32.785716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:32.786412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:32.795253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:32.799985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:32.799985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:32.800909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:32.801392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:32.801969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:33.169288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:33.191800 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b668aee4-267c-4e15-9c5a-c796bb6e5b43 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1671 microversion: 2.1 time: 0.408637 Oct 28 18:35:33.192478 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3564/5501] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:32 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1671 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:33.220838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:33.221346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:33.237735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:33.238363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:33.238681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:33.239463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:33.239921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:33.240323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:33.279460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:33.280336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:33.290814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:33.292106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:33.293113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:33.300033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:35:33.300158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:33.300158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:33.300618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:33.312405 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.compute.api [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Working on deleting snapshot 362040a7-75b0-4ded-98a0-5f5b91baa377 from shelved instance... Oct 28 18:35:33.561555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:33.571394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-315ced97-2f14-4028-b017-a0d9210a1613 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 0.296384 Oct 28 18:35:33.572031 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3565/5502] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:33 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:34.588087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Doing local delete in cell 43f74929-bc21-41df-9120-e6be09c18015(cell1) {{(pid=120679) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 18:35:34.588826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:34.589559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:34.599016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:34.601198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:34.607283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:34.609199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.compute.api [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 18:35:34.616381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:34.618196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:34.618799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] deallocate_for_instance() {{(pid=120679) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 18:35:34.619895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:34.621072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:34.622873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:34.623319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:34.905674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:34.918065 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8f7cdcc4-3480-47ac-b410-ac1b31def299 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 0.326436 Oct 28 18:35:34.930240 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3566/5503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:34 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:35.885344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-dc5d5a56-9031-4bb2-abe9-5a524e2493ce req-6c971bf5-db26-4ac7-bc87-b1bd24a92478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe", "name": "network-vif-plugged", "status": "completed", "tag": "c3b354eb-686a-4786-8199-87493a5d5665"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:35.896763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:35.918417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dc5d5a56-9031-4bb2-abe9-5a524e2493ce req-6c971bf5-db26-4ac7-bc87-b1bd24a92478 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:35.919299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dc5d5a56-9031-4bb2-abe9-5a524e2493ce req-6c971bf5-db26-4ac7-bc87-b1bd24a92478 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:35.920587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dc5d5a56-9031-4bb2-abe9-5a524e2493ce req-6c971bf5-db26-4ac7-bc87-b1bd24a92478 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:35.981730 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-dc5d5a56-9031-4bb2-abe9-5a524e2493ce req-6c971bf5-db26-4ac7-bc87-b1bd24a92478 service nova] Creating event network-vif-plugged:c3b354eb-686a-4786-8199-87493a5d5665 for instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe on n-h1-862404-2 Oct 28 18:35:35.988217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-dc5d5a56-9031-4bb2-abe9-5a524e2493ce req-6c971bf5-db26-4ac7-bc87-b1bd24a92478 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107316 Oct 28 18:35:35.995638 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3567/5504] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:35:36.013339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:36.014264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:36.022105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:36.023562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:36.024187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:36.025127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:36.025686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:36.026305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:36.119127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Updating instance_info_cache with network_info: [] {{(pid=120679) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 18:35:36.472227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:36.488649 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-578cb8a3-e5ce-4d4a-932b-bf65b1300941 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 0.482509 Oct 28 18:35:36.489260 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3568/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:35 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:36.498566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a0eec9bf-3576-4a29-8c4f-2035c44499fe req-446385ed-f03d-454a-929e-607c97e22643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba94308-6ac5-4b60-81ba-3662bd82c3f0", "name": "network-vif-deleted", "tag": "5df55407-37c7-4aa2-854a-af22833eff2c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:36.523029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0eec9bf-3576-4a29-8c4f-2035c44499fe req-446385ed-f03d-454a-929e-607c97e22643 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:36.525693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0eec9bf-3576-4a29-8c4f-2035c44499fe req-446385ed-f03d-454a-929e-607c97e22643 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:36.528038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0eec9bf-3576-4a29-8c4f-2035c44499fe req-446385ed-f03d-454a-929e-607c97e22643 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:36.540135 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28566f70-4dae-4090-acf8-2b0a043cfd0f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 204 len: 0 microversion: 2.1 time: 3.321141 Oct 28 18:35:36.541002 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1938/5506] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:33 2022] DELETE /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 0 bytes in 3325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:35:36.563456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.server_external_events [req-a0eec9bf-3576-4a29-8c4f-2035c44499fe req-446385ed-f03d-454a-929e-607c97e22643 service nova] Unable to find a host for instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0. Dropping event network-vif-deleted {{(pid=120680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 18:35:36.564862 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a0eec9bf-3576-4a29-8c4f-2035c44499fe req-446385ed-f03d-454a-929e-607c97e22643 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.074226 Oct 28 18:35:36.566826 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3569/5507] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 18:35:36.914086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:36.914708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 5ba94308-6ac5-4b60-81ba-3662bd82c3f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:36.921068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:36.921563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:36.922058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:36.923097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:36.923730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:36.924333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:36.940823 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] HTTP exception thrown: Instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 could not be found. Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Request method failure captured: Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 HTTP/1.1 Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB6dBWom9PfWWrVlOz28i6q1JTEGnX4a38Ezyy2-BWbQb5KwjqAEGZhlqT-dGZLI01HlbriOiZH66pzf1EE7Oqt23aDgyc2ihZ8cz7p9s5jamZRMIVgJ2IOvuBCLLTbe22MQa4HNHPydsiT3bq4yFq5y-NIEqeiWcA3tE3JGICcOyfc Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089f168818394b139c87b28362e23ece", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089f168818394b139c87b28362e23ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4666e4ac2e124ed9bf3579707986cb43 Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 could not be found. Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '5ba94308-6ac5-4b60-81ba-3662bd82c3f0'} Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 could not be found. Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 could not be found. Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:36.943251 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:36.947947 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:36.947947 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:36.947947 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:36.947947 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:36.947947 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:36.947947 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 could not be found. Oct 28 18:35:36.947947 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:36.949797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Returning 404 to user: Instance 5ba94308-6ac5-4b60-81ba-3662bd82c3f0 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:36.951791 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d21089c6-bc61-4965-9817-616332b4bcc6 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0" status: 404 len: 111 microversion: 2.1 time: 0.404356 Oct 28 18:35:36.953011 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1939/5508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:36 2022] GET /compute/v2.1/servers/5ba94308-6ac5-4b60-81ba-3662bd82c3f0 => generated 111 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:36.961704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:36.962229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:36.970099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:36.971226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:36.971907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:36.972708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:36.973348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:36.973698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:37.007397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:35:37.109196 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9abec910-8454-4f25-b236-1ee71dcabeb4 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 204 len: 0 microversion: 2.1 time: 0.151831 Oct 28 18:35:37.110369 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3570/5509] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:36 2022] DELETE /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:35:37.119122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:37.119946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:37.126550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:37.127132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:37.127652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:37.128601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:37.129149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:37.129705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:37.312518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:37.321676 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cc0df322-fed4-4ece-a2c2-2653e511ff49 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1466 microversion: 2.1 time: 0.207295 Oct 28 18:35:37.322566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1940/5510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:37 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1466 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:37.513308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:37.514222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:37.520418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:37.520933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:37.521364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:37.522097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:37.523156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:37.524162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:37.764245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:37.773950 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cb82b3f3-5bac-4f2e-bafd-4108c2988dcb tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1469 microversion: 2.1 time: 0.264642 Oct 28 18:35:37.774752 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3571/5511] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:37 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:38.373818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:38.377681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:38.395463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:38.396215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:38.398811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:38.400941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:38.401648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:38.402980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:38.550031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:38.560309 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-478e5597-849b-4920-ba5f-4f0a055ee1af tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1466 microversion: 2.1 time: 0.217389 Oct 28 18:35:38.562125 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1941/5512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:38 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1466 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:38.798296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:38.799622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:38.810894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:38.811991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:38.812662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:38.813793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:38.814874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:38.815918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:39.133198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:39.145373 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fbde7862-4cb5-4a2d-9e57-01e036dd288b tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1641 microversion: 2.1 time: 0.349705 Oct 28 18:35:39.146537 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3572/5513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:38 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1641 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:39.170984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:39.171948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:39.182035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:39.182626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:39.183167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:39.185534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:39.186016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:39.186804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:39.438267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:39.452878 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2fdc251c-4491-48e7-9612-7e8220dc57a5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1641 microversion: 2.1 time: 0.285708 Oct 28 18:35:39.454977 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1942/5514] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:39 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1641 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:39.481834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:39.482726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:39.493016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:39.494013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:39.494756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:39.497696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:39.500029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:39.500556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:39.586777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:39.587501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:39.602229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:39.602807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:39.606681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:39.608341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:39.609328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:39.611951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:39.769660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:39.781475 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eb9869f6-9414-4735-93fc-1fade22cb881 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 200 len: 1466 microversion: 2.1 time: 0.199576 Oct 28 18:35:39.795799 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1943/5515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:39 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 1466 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:39.884098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-1607f993-37b1-4d01-abe3-df0c90af06c2 req-c30b7111-7f89-4b89-8a6c-f1dbd94e162f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4362b20-fe39-4f11-a4e6-0b889f750fb0", "name": "network-vif-deleted", "tag": "78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:39.913097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1607f993-37b1-4d01-abe3-df0c90af06c2 req-c30b7111-7f89-4b89-8a6c-f1dbd94e162f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:39.913911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1607f993-37b1-4d01-abe3-df0c90af06c2 req-c30b7111-7f89-4b89-8a6c-f1dbd94e162f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:39.914410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1607f993-37b1-4d01-abe3-df0c90af06c2 req-c30b7111-7f89-4b89-8a6c-f1dbd94e162f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:39.932156 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-1607f993-37b1-4d01-abe3-df0c90af06c2 req-c30b7111-7f89-4b89-8a6c-f1dbd94e162f service nova] Creating event network-vif-deleted:78d08b8f-4d4d-48b9-b1e3-3c89dc9b1fdd for instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 on n-h1-862404-2 Oct 28 18:35:39.949483 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-1607f993-37b1-4d01-abe3-df0c90af06c2 req-c30b7111-7f89-4b89-8a6c-f1dbd94e162f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071201 Oct 28 18:35:39.950280 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1944/5516] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:35:40.134128 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8cc793a-654b-4ef7-84d7-f04507ad7711 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1792 microversion: 2.1 time: 0.656821 Oct 28 18:35:40.149783 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3573/5517] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:39 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1792 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:40.808672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:40.809391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: e4362b20-fe39-4f11-a4e6-0b889f750fb0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:40.819719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:40.821471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:40.822249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:40.826280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:40.827006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:40.827471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:40.852668 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] HTTP exception thrown: Instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 could not be found. Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Request method failure captured: Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 HTTP/1.1 Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXB6dBWom9PfWWrVlOz28i6q1JTEGnX4a38Ezyy2-BWbQb5KwjqAEGZhlqT-dGZLI01HlbriOiZH66pzf1EE7Oqt23aDgyc2ihZ8cz7p9s5jamZRMIVgJ2IOvuBCLLTbe22MQa4HNHPydsiT3bq4yFq5y-NIEqeiWcA3tE3JGICcOyfc Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089f168818394b139c87b28362e23ece", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089f168818394b139c87b28362e23ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 4666e4ac2e124ed9bf3579707986cb43 Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 could not be found. Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'e4362b20-fe39-4f11-a4e6-0b889f750fb0'} Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 could not be found. Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 could not be found. Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:40.855653 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:40.859687 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:40.859687 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:40.859687 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:40.859687 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:40.859687 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:40.859687 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 could not be found. Oct 28 18:35:40.859687 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:35:40.863122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Returning 404 to user: Instance e4362b20-fe39-4f11-a4e6-0b889f750fb0 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:40.864038 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a2469022-a4e7-424b-9456-dc203c434ace tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0" status: 404 len: 111 microversion: 2.1 time: 0.061559 Oct 28 18:35:40.864627 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1945/5518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:40 2022] GET /compute/v2.1/servers/e4362b20-fe39-4f11-a4e6-0b889f750fb0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:40.873361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:40.873887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:40.881819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:40.882409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:40.883173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:40.884030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:40.886006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:40.886461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:40.922555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:35:41.031593 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0f3374b-d378-458a-a26d-ae077caaf67b tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 204 len: 0 microversion: 2.1 time: 0.161433 Oct 28 18:35:41.033818 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3574/5519] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:40 2022] DELETE /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:35:41.047826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:41.048774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:41.056951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:41.062511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:41.063151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:41.064977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:41.066237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:41.069055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:41.446684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:41.458950 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25b0275c-42b4-4c0f-87e9-92620f626460 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1509 microversion: 2.1 time: 0.419016 Oct 28 18:35:41.461592 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1946/5520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:41 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1509 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:42.297269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-036574a3-957e-4874-86f8-ac5e2d2090d2 req-403aa093-ded1-49b1-89a0-a971eadb9e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d005ca-c602-45a1-88b0-104243706a04", "name": "network-vif-deleted", "tag": "b69145d4-ebfc-44da-b866-5e1cd042e0d3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:42.312602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-036574a3-957e-4874-86f8-ac5e2d2090d2 req-403aa093-ded1-49b1-89a0-a971eadb9e05 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:42.313534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-036574a3-957e-4874-86f8-ac5e2d2090d2 req-403aa093-ded1-49b1-89a0-a971eadb9e05 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:42.314226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-036574a3-957e-4874-86f8-ac5e2d2090d2 req-403aa093-ded1-49b1-89a0-a971eadb9e05 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:42.331602 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-036574a3-957e-4874-86f8-ac5e2d2090d2 req-403aa093-ded1-49b1-89a0-a971eadb9e05 service nova] Creating event network-vif-deleted:b69145d4-ebfc-44da-b866-5e1cd042e0d3 for instance 78d005ca-c602-45a1-88b0-104243706a04 on n-h2-862404-2 Oct 28 18:35:42.341626 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-036574a3-957e-4874-86f8-ac5e2d2090d2 req-403aa093-ded1-49b1-89a0-a971eadb9e05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050289 Oct 28 18:35:42.343213 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3575/5521] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:42.494085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:42.495366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:42.503853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:42.509086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:42.511385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:42.512438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:42.514908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:42.515627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:42.571941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:42.572704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:42.573317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:42.573947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lazy-loading 'fault' on Instance uuid 78d005ca-c602-45a1-88b0-104243706a04 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:35:42.737033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:42.747502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42f5bc89-bb39-4099-ad57-4005191ea9f9 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 200 len: 1305 microversion: 2.1 time: 0.264831 Oct 28 18:35:42.750628 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1947/5522] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:42 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:43.777848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:43.778599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 78d005ca-c602-45a1-88b0-104243706a04] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:43.795116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:43.796683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:43.797177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:43.797923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:43.798403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:43.798847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:43.832547 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] HTTP exception thrown: Instance 78d005ca-c602-45a1-88b0-104243706a04 could not be found. Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Request method failure captured: Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 HTTP/1.1 Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB6dBWom9PfWWrVlOz28i6q1JTEGnX4a38Ezyy2-BWbQb5KwjqAEGZhlqT-dGZLI01HlbriOiZH66pzf1EE7Oqt23aDgyc2ihZ8cz7p9s5jamZRMIVgJ2IOvuBCLLTbe22MQa4HNHPydsiT3bq4yFq5y-NIEqeiWcA3tE3JGICcOyfc Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089f168818394b139c87b28362e23ece", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089f168818394b139c87b28362e23ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4666e4ac2e124ed9bf3579707986cb43 Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 78d005ca-c602-45a1-88b0-104243706a04 could not be found. Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '78d005ca-c602-45a1-88b0-104243706a04'} Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d005ca-c602-45a1-88b0-104243706a04 could not be found. Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d005ca-c602-45a1-88b0-104243706a04 could not be found. Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:43.834510 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:43.839288 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:43.839288 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:43.839288 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:43.839288 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:43.839288 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:43.839288 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d005ca-c602-45a1-88b0-104243706a04 could not be found. Oct 28 18:35:43.839288 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:43.841967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Returning 404 to user: Instance 78d005ca-c602-45a1-88b0-104243706a04 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:43.843495 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75550a70-4290-4648-96e4-ff2fc3e6f22f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04" status: 404 len: 111 microversion: 2.1 time: 0.070050 Oct 28 18:35:43.847627 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3576/5523] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:43 2022] GET /compute/v2.1/servers/78d005ca-c602-45a1-88b0-104243706a04 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:43.854380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:43.855617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:43.873522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:43.875523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:43.876460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:43.877095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:43.877573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:43.878015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:43.911941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:35:43.916610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:44.080439 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4a50a50-858e-48d0-a7ff-6e272009ca93 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 204 len: 0 microversion: 2.1 time: 0.230814 Oct 28 18:35:44.082553 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1948/5524] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:43 2022] DELETE /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:35:44.099500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:44.102745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:44.113347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:44.114336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:44.115741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:44.117300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:44.118269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:44.118924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:44.397842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:44.400599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:44.417440 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-19fad811-e549-4753-901a-2b7d0f10f68e tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1495 microversion: 2.1 time: 0.329486 Oct 28 18:35:44.417870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3577/5525] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:44 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1495 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:35:45.164112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4738eb3e-9421-4e65-a4b4-0bb468aea4f6 req-3cf7a689-0e6b-4077-8e49-e94e7208c41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2823b77-91c9-404b-b0a4-df3f3a4c2158", "name": "network-vif-deleted", "tag": "5f851dac-7fa1-44b5-9e09-917b9e450294"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:45.183870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4738eb3e-9421-4e65-a4b4-0bb468aea4f6 req-3cf7a689-0e6b-4077-8e49-e94e7208c41b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:45.185115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4738eb3e-9421-4e65-a4b4-0bb468aea4f6 req-3cf7a689-0e6b-4077-8e49-e94e7208c41b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:45.185918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4738eb3e-9421-4e65-a4b4-0bb468aea4f6 req-3cf7a689-0e6b-4077-8e49-e94e7208c41b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:45.204146 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4738eb3e-9421-4e65-a4b4-0bb468aea4f6 req-3cf7a689-0e6b-4077-8e49-e94e7208c41b service nova] Creating event network-vif-deleted:5f851dac-7fa1-44b5-9e09-917b9e450294 for instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 on n-h2-862404-2 Oct 28 18:35:45.211749 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4738eb3e-9421-4e65-a4b4-0bb468aea4f6 req-3cf7a689-0e6b-4077-8e49-e94e7208c41b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053680 Oct 28 18:35:45.217738 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1949/5526] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:45.442112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:45.443534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:45.452846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:45.454190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:45.454774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:45.455606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:45.456203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:45.457263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:45.506268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:45.506929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:45.507883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:45.517177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lazy-loading 'fault' on Instance uuid f2823b77-91c9-404b-b0a4-df3f3a4c2158 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:35:45.648198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:45.668510 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc47b7c5-1cac-4c51-8c5e-226e323d3fa8 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 200 len: 1305 microversion: 2.1 time: 0.229015 Oct 28 18:35:45.669077 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3578/5527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:45 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 1305 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:45.687682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-cfec49a8-326b-498e-9301-d2a6648d8307 req-49c81185-f703-4d05-82ca-77d96d5e8b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe", "tag": "c3b354eb-686a-4786-8199-87493a5d5665"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:45.729671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cfec49a8-326b-498e-9301-d2a6648d8307 req-49c81185-f703-4d05-82ca-77d96d5e8b4f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:45.732471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cfec49a8-326b-498e-9301-d2a6648d8307 req-49c81185-f703-4d05-82ca-77d96d5e8b4f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:45.732971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cfec49a8-326b-498e-9301-d2a6648d8307 req-49c81185-f703-4d05-82ca-77d96d5e8b4f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:45.780364 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-cfec49a8-326b-498e-9301-d2a6648d8307 req-49c81185-f703-4d05-82ca-77d96d5e8b4f service nova] Creating event network-changed:c3b354eb-686a-4786-8199-87493a5d5665 for instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe on n-h1-862404-2 Oct 28 18:35:45.793417 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-cfec49a8-326b-498e-9301-d2a6648d8307 req-49c81185-f703-4d05-82ca-77d96d5e8b4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110635 Oct 28 18:35:45.794752 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1950/5528] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:46.690952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:46.692346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: f2823b77-91c9-404b-b0a4-df3f3a4c2158] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:46.705711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:46.711794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:46.712312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:46.713117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:46.715555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:46.716148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:46.780391 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] HTTP exception thrown: Instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 could not be found. Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Request method failure captured: Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 HTTP/1.1 Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB6dBWom9PfWWrVlOz28i6q1JTEGnX4a38Ezyy2-BWbQb5KwjqAEGZhlqT-dGZLI01HlbriOiZH66pzf1EE7Oqt23aDgyc2ihZ8cz7p9s5jamZRMIVgJ2IOvuBCLLTbe22MQa4HNHPydsiT3bq4yFq5y-NIEqeiWcA3tE3JGICcOyfc Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089f168818394b139c87b28362e23ece", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089f168818394b139c87b28362e23ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4666e4ac2e124ed9bf3579707986cb43 Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 could not be found. Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f2823b77-91c9-404b-b0a4-df3f3a4c2158'} Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 could not be found. Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 could not be found. Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:46.783163 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 could not be found. Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Returning 404 to user: Instance f2823b77-91c9-404b-b0a4-df3f3a4c2158 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79d8a94b-d803-4792-a92f-8c6dfd53f0de tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158" status: 404 len: 111 microversion: 2.1 time: 0.097963 Oct 28 18:35:46.789166 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3579/5529] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:46 2022] GET /compute/v2.1/servers/f2823b77-91c9-404b-b0a4-df3f3a4c2158 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:46.798779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:46.799360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:46.816209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:46.817519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:46.818735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:46.822249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:46.825021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:46.826891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:46.870926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:35:47.044566 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22740496-c8aa-44f5-91ec-bfb5bb2bb7a7 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 204 len: 0 microversion: 2.1 time: 0.250021 Oct 28 18:35:47.045440 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1951/5530] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:46 2022] DELETE /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:35:47.055809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:47.056478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:47.072366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:47.075775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:47.076379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:47.077166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:47.077645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:47.078084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:47.403885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:47.419926 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b8d3822-7259-4f31-a2f9-3d1c11159a3a tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1677 microversion: 2.1 time: 0.369277 Oct 28 18:35:47.422194 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3580/5531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:47 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1677 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:48.447100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:48.448435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:48.455258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:48.455982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:48.456603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:48.457469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:48.458084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:48.458676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:48.687060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:48.698923 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8639ab7e-7bcf-40f0-bf45-a43be5270746 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1677 microversion: 2.1 time: 0.256778 Oct 28 18:35:48.700179 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1952/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:48 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:49.724386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:49.725876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:49.738324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:49.742047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:49.743390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:49.744498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:49.745884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:49.746334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:49.948786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4666e4ac2e124ed9bf3579707986cb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089f168818394b139c87b28362e23ece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:49.965949 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8051f164-59c0-4951-92ac-7dc675fc2a23 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 200 len: 1609 microversion: 2.1 time: 0.246121 Oct 28 18:35:49.992832 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3581/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:49 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 1609 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:50.044709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-de0b313c-e4aa-4f94-9632-74ccffac53a3 req-e5675cfd-9d2f-46b0-a788-221c5e117a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb7b4b4-62b3-4f08-92a2-69c78746a21b", "name": "network-vif-deleted", "tag": "d73dbdf2-57a8-48ad-84f4-7542a64d2039"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:50.070778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de0b313c-e4aa-4f94-9632-74ccffac53a3 req-e5675cfd-9d2f-46b0-a788-221c5e117a5b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:50.075259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de0b313c-e4aa-4f94-9632-74ccffac53a3 req-e5675cfd-9d2f-46b0-a788-221c5e117a5b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:50.076015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de0b313c-e4aa-4f94-9632-74ccffac53a3 req-e5675cfd-9d2f-46b0-a788-221c5e117a5b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:50.105710 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-de0b313c-e4aa-4f94-9632-74ccffac53a3 req-e5675cfd-9d2f-46b0-a788-221c5e117a5b service nova] Creating event network-vif-deleted:d73dbdf2-57a8-48ad-84f4-7542a64d2039 for instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b on n-h1-862404-2 Oct 28 18:35:50.117488 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-de0b313c-e4aa-4f94-9632-74ccffac53a3 req-e5675cfd-9d2f-46b0-a788-221c5e117a5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076936 Oct 28 18:35:50.119359 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1953/5534] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:50.998813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:50.999638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] [instance: 4bb7b4b4-62b3-4f08-92a2-69c78746a21b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:51.019225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:51.019857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:51.021098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:51.024108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:51.026837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:51.027663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:51.073461 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] HTTP exception thrown: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b could not be found. Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Request method failure captured: Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b HTTP/1.1 Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXB6dBWom9PfWWrVlOz28i6q1JTEGnX4a38Ezyy2-BWbQb5KwjqAEGZhlqT-dGZLI01HlbriOiZH66pzf1EE7Oqt23aDgyc2ihZ8cz7p9s5jamZRMIVgJ2IOvuBCLLTbe22MQa4HNHPydsiT3bq4yFq5y-NIEqeiWcA3tE3JGICcOyfc Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/089f168818394b139c87b28362e23ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_089f168818394b139c87b28362e23ece", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/089f168818394b139c87b28362e23ece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 089f168818394b139c87b28362e23ece Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228341290 Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 4666e4ac2e124ed9bf3579707986cb43 Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1228341290-project Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b could not be found. Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4bb7b4b4-62b3-4f08-92a2-69c78746a21b'} Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b could not be found. Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b could not be found. Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:51.079134 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:51.083985 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:51.083985 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:51.083985 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:51.083985 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:51.083985 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:51.083985 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b could not be found. Oct 28 18:35:51.083985 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:35:51.085341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Returning 404 to user: Instance 4bb7b4b4-62b3-4f08-92a2-69c78746a21b could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:51.090179 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6bf82be3-50ef-4d65-911e-217884a6f92f tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b" status: 404 len: 111 microversion: 2.1 time: 0.095966 Oct 28 18:35:51.093528 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3582/5535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:50 2022] GET /compute/v2.1/servers/4bb7b4b4-62b3-4f08-92a2-69c78746a21b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:51.107457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0099c382-9240-499f-897e-c1aac10cc244 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] Calling method '.version_select at 0x7f78e23e8ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:51.139667 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0099c382-9240-499f-897e-c1aac10cc244 tempest-ServerActionsTestJSON-1228341290 tempest-ServerActionsTestJSON-1228341290-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165590215" status: 202 len: 0 microversion: 2.1 time: 0.040437 Oct 28 18:35:51.144297 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1954/5536] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:35:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165590215 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:35:52.939724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:52.943912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:35:52.952395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:52.953650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:52.954281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:52.955201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:52.955846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:52.957699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:53.028152 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39ddf6ae-c768-4fb6-8256-f0890f26b968 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action" status: 200 len: 24575 microversion: 2.1 time: 0.092493 Oct 28 18:35:53.029992 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3583/5537] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:35:52 2022] POST /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d/action => generated 24575 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:36:13.812468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:13.816232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:14.370450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-abf8d990-0730-48ed-9f23-ce97f66fac26 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Action: 'create', calling method: .version_select at 0x7f78e23629d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:14.465350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-abf8d990-0730-48ed-9f23-ce97f66fac26 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Getting quotas for project 3f5f333ac62a4aa9adf6d518d5fc3cfe. Resources: {'server_groups'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:36:14.475865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-abf8d990-0730-48ed-9f23-ce97f66fac26 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Getting quotas for user 3ae85c30bf6147b9854490705b6b0d9a and project 3f5f333ac62a4aa9adf6d518d5fc3cfe. Resources: {'server_groups'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:36:14.575186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-abf8d990-0730-48ed-9f23-ce97f66fac26 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Getting quotas for project 3f5f333ac62a4aa9adf6d518d5fc3cfe. Resources: {'server_groups'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:36:14.593115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-abf8d990-0730-48ed-9f23-ce97f66fac26 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Getting quotas for user 3ae85c30bf6147b9854490705b6b0d9a and project 3f5f333ac62a4aa9adf6d518d5fc3cfe. Resources: {'server_groups'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:36:14.612131 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-abf8d990-0730-48ed-9f23-ce97f66fac26 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.819421 Oct 28 18:36:14.619466 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1955/5538] 10.222.0.16 () {62 vars in 1214 bytes} [Fri Oct 28 18:36:13 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:36:14.625683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03af7b1e-90a6-47db-8a62-a48533d388cb tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:14.633945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:14.637916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=29 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:14.663144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03af7b1e-90a6-47db-8a62-a48533d388cb tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.041857 Oct 28 18:36:14.671526 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3584/5539] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 18:36:14 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:36:14.684335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d837a0ad-ee4f-4d1a-a83f-fb18a93067b3 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:14.717763 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d837a0ad-ee4f-4d1a-a83f-fb18a93067b3 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/7f93d2bf-3fb3-41e5-91a5-554070e251be" status: 200 len: 235 microversion: 2.64 time: 0.038421 Oct 28 18:36:14.718692 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1956/5540] 10.222.0.16 () {60 vars in 1304 bytes} [Fri Oct 28 18:36:14 2022] GET /compute/v2.1/os-server-groups/7f93d2bf-3fb3-41e5-91a5-554070e251be => generated 235 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:36:14.730745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c25bacea-bd5a-4785-bc10-5f4de4295386 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:14.778390 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c25bacea-bd5a-4785-bc10-5f4de4295386 tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/7f93d2bf-3fb3-41e5-91a5-554070e251be" status: 204 len: 0 microversion: 2.64 time: 0.051597 Oct 28 18:36:14.778990 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3585/5541] 10.222.0.16 () {60 vars in 1307 bytes} [Fri Oct 28 18:36:14 2022] DELETE /compute/v2.1/os-server-groups/7f93d2bf-3fb3-41e5-91a5-554070e251be => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 18:36:14.798949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-139570a7-0683-4fd2-aa28-5e68a3db106d tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:14.821047 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-139570a7-0683-4fd2-aa28-5e68a3db106d tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] HTTP exception thrown: Instance group 7f93d2bf-3fb3-41e5-91a5-554070e251be could not be found. Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-139570a7-0683-4fd2-aa28-5e68a3db106d tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Request method failure captured: Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-server-groups/7f93d2bf-3fb3-41e5-91a5-554070e251be HTTP/1.1 Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCEd0QqTQVnKI8TA-ZMf-nKIakXQly4zWg4GoyyTb9JCOAldIBXajS9qVpA13xbY9BIsW2u8CPl9ySqFHihRuckUKiQm3kJqW5o7uhTfCANAnYJYBpT9kcd0HTN9IvIAd4Fl7jZWZajLsJewiGArTBsXaAwGu4UbH8faxDDhXv-D-OI Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.64 Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 3f5f333ac62a4aa9adf6d518d5fc3cfe Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerGroup264TestJSON-4802397 Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5f333ac62a4aa9adf6d518d5fc3cfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f5f333ac62a4aa9adf6d518d5fc3cfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f5f333ac62a4aa9adf6d518d5fc3cfe", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f5f333ac62a4aa9adf6d518d5fc3cfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerGroup264TestJSON-4802397 Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 3f5f333ac62a4aa9adf6d518d5fc3cfe Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerGroup264TestJSON-4802397 Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerGroup264TestJSON-4802397-project Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 3ae85c30bf6147b9854490705b6b0d9a Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerGroup264TestJSON-4802397-project Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance group 7f93d2bf-3fb3-41e5-91a5-554070e251be could not be found. Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '7f93d2bf-3fb3-41e5-91a5-554070e251be'} Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7f93d2bf-3fb3-41e5-91a5-554070e251be could not be found. Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7f93d2bf-3fb3-41e5-91a5-554070e251be could not be found. Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:14.829637 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:14.835659 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:14.835659 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:14.835659 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:36:14.835659 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:36:14.835659 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7f93d2bf-3fb3-41e5-91a5-554070e251be could not be found. Oct 28 18:36:14.835659 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:14.837684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-139570a7-0683-4fd2-aa28-5e68a3db106d tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] Returning 404 to user: Instance group 7f93d2bf-3fb3-41e5-91a5-554070e251be could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:14.842228 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-139570a7-0683-4fd2-aa28-5e68a3db106d tempest-ServerGroup264TestJSON-4802397 tempest-ServerGroup264TestJSON-4802397-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/7f93d2bf-3fb3-41e5-91a5-554070e251be" status: 404 len: 117 microversion: 2.64 time: 0.054398 Oct 28 18:36:14.843221 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1957/5542] 10.222.0.16 () {60 vars in 1307 bytes} [Fri Oct 28 18:36:14 2022] DELETE /compute/v2.1/os-server-groups/7f93d2bf-3fb3-41e5-91a5-554070e251be => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:36:15.760818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:15.761575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:15.769074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:15.769572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:15.776158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:15.777268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:15.783564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:15.785024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:16.354612 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ecef934-f6c6-44bc-a8ad-795d7d548e66 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1834 microversion: 2.1 time: 0.601901 Oct 28 18:36:16.363443 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3586/5543] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:15 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1834 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:20.076130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:20.079719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:20.096077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:20.097797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:20.101110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:20.102837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:20.103384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:20.103852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:20.107656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7dbf0eab-fe00-4be5-b6a0-bdbc8c63e8de req-2cf78fd7-3e83-4309-bbc7-4051f561151c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e063de5e-ae3f-4d25-97a3-4ffa18bdf86d", "tag": "6aea57d1-9a26-42db-99e7-ffd76f4f0873"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:20.131895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7dbf0eab-fe00-4be5-b6a0-bdbc8c63e8de req-2cf78fd7-3e83-4309-bbc7-4051f561151c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:20.138162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7dbf0eab-fe00-4be5-b6a0-bdbc8c63e8de req-2cf78fd7-3e83-4309-bbc7-4051f561151c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:20.140240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:36:20.143085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7dbf0eab-fe00-4be5-b6a0-bdbc8c63e8de req-2cf78fd7-3e83-4309-bbc7-4051f561151c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:20.170324 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7dbf0eab-fe00-4be5-b6a0-bdbc8c63e8de req-2cf78fd7-3e83-4309-bbc7-4051f561151c service nova] Creating event network-changed:6aea57d1-9a26-42db-99e7-ffd76f4f0873 for instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d on n-h1-862404-2 Oct 28 18:36:20.184468 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7dbf0eab-fe00-4be5-b6a0-bdbc8c63e8de req-2cf78fd7-3e83-4309-bbc7-4051f561151c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081385 Oct 28 18:36:20.197016 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3587/5544] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:36:20.337213 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f57e50c0-64ea-4248-a0c5-65fe414e9e44 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 204 len: 0 microversion: 2.1 time: 0.267098 Oct 28 18:36:20.338049 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1958/5545] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:36:20 2022] DELETE /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:36:20.347737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:20.348495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:20.372255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:20.372255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:20.372255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:20.372255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:20.372255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:20.372255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:21.214435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:21.238203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-adc39606-533e-4a6f-81f8-4be87083fe09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1689 microversion: 2.1 time: 0.894725 Oct 28 18:36:21.241489 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3588/5546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:20 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1689 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:22.265282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:22.266611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:22.277904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:22.279541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:22.281522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:22.293759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:22.294961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:22.296994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:22.924882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:22.944229 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e135c6f-6fbf-4a14-8c74-a0f08bce3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1689 microversion: 2.1 time: 0.682376 Oct 28 18:36:22.945625 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1959/5547] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:22 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1689 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:23.976560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:23.977599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:23.989674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:23.990420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:23.991051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:23.993484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:23.994018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:23.994457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:24.108834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:24.132422 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bed0e287-958f-4a14-b105-32e3cd0a9735 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 200 len: 1502 microversion: 2.1 time: 0.161374 Oct 28 18:36:24.137102 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3589/5548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:23 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:24.322101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0e3304ba-b499-4da3-a398-eaa142566dd8 req-1cb5d6b4-d937-40fe-aaf4-2d2e3d1e95fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e063de5e-ae3f-4d25-97a3-4ffa18bdf86d", "name": "network-vif-deleted", "tag": "6aea57d1-9a26-42db-99e7-ffd76f4f0873"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:24.351141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e3304ba-b499-4da3-a398-eaa142566dd8 req-1cb5d6b4-d937-40fe-aaf4-2d2e3d1e95fa service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:24.352431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e3304ba-b499-4da3-a398-eaa142566dd8 req-1cb5d6b4-d937-40fe-aaf4-2d2e3d1e95fa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:24.353841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e3304ba-b499-4da3-a398-eaa142566dd8 req-1cb5d6b4-d937-40fe-aaf4-2d2e3d1e95fa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:24.395224 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0e3304ba-b499-4da3-a398-eaa142566dd8 req-1cb5d6b4-d937-40fe-aaf4-2d2e3d1e95fa service nova] Creating event network-vif-deleted:6aea57d1-9a26-42db-99e7-ffd76f4f0873 for instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d on n-h1-862404-2 Oct 28 18:36:24.406471 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0e3304ba-b499-4da3-a398-eaa142566dd8 req-1cb5d6b4-d937-40fe-aaf4-2d2e3d1e95fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088837 Oct 28 18:36:24.408559 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1960/5549] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:36:25.168452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:25.170515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e063de5e-ae3f-4d25-97a3-4ffa18bdf86d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:25.187159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:25.187986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:25.188720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:25.189644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:25.190142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:25.190653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:25.226019 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] HTTP exception thrown: Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d could not be found. Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Request method failure captured: Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d HTTP/1.1 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCBvc0YflF8rdCSJK9k6feqbsVmfTyN8LB8kG2K52dnwbeAWDEga0e3Qk_53zZR-oQU21yf38NMhPvsSxFlBHCPi4wNEgvRNviGdQHu6PLLHjTzAKlw5vk1MAxvpDp7nGyF8QRnha0Rkwy6iP9lJeZbWLld9X9TIIcL8SHJYIWKaQ74 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 946b8055a69f4f979036482e1fd37f67 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_946b8055a69f4f979036482e1fd37f67", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 946b8055a69f4f979036482e1fd37f67 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestNetworkAdvancedServerOps-156931648-project Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 379680f3dd0542389b53a8a4f20ae800 Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestNetworkAdvancedServerOps-156931648-project Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d could not be found. Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'e063de5e-ae3f-4d25-97a3-4ffa18bdf86d'} Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d could not be found. Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d could not be found. Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:25.228155 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:25.232902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:25.232902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:25.232902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:25.232902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:25.232902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:36:25.232902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:36:25.232902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d could not be found. Oct 28 18:36:25.232902 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:25.234216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Returning 404 to user: Instance e063de5e-ae3f-4d25-97a3-4ffa18bdf86d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:25.237549 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-611ae906-9893-4b74-84e9-e2d92eed7e4a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d" status: 404 len: 111 microversion: 2.1 time: 0.078912 Oct 28 18:36:25.240902 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3590/5550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:25 2022] GET /compute/v2.1/servers/e063de5e-ae3f-4d25-97a3-4ffa18bdf86d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:36:35.656783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:35.660968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:35.664317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:36.280692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1822574126", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:36.329861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f703c19-29bf-44ad-848c-667b4cce7e09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '.version_select at 0x7f78de077f70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:36.345121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:36.346777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=22 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:36.384972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] validate_networks() for [('b3e73f24-08e1-4542-93a5-011d88bb8725', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:36:36.412117 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f703c19-29bf-44ad-848c-667b4cce7e09 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-233759918" status: 202 len: 0 microversion: 2.1 time: 0.086983 Oct 28 18:36:36.415885 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3591/5551] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 18:36:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-233759918 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:36:36.451257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbb72eba-c0d4-467a-b6b7-efce176dceac tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'create', calling method: .version_select at 0x7f78dd5a3d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1205215823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm9jASOpD3ZOSjEqwo7tqfP3QpCe9GwDFwn/IXGWU1bOSEU6Ha0nu0KpDBWNYoiZ8EfW7OO1l3ivU7E8cDKfh4+cQ2c7ad6fzhZ5T6db+0GFI3fMbBAZHpc4EQtejOPzw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:36.509469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bbb72eba-c0d4-467a-b6b7-efce176dceac tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for project 946b8055a69f4f979036482e1fd37f67. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:36:36.525788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-bbb72eba-c0d4-467a-b6b7-efce176dceac tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for user 379680f3dd0542389b53a8a4f20ae800 and project 946b8055a69f4f979036482e1fd37f67. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:36:36.562928 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbb72eba-c0d4-467a-b6b7-efce176dceac tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.120173 Oct 28 18:36:36.572760 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3592/5552] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:36:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:36:38.445383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:36:38.447569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:36:38.449048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:36:38.449748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:36:38.454069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:36:38.465500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:38.466381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:38.467262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:38.469051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:38.470116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:38.470888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:38.501775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Getting quotas for project 4d4749728e134a28b8e43a0f059694b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:36:38.512218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Getting quotas for user 1a7d8dd84e0c4ec88e7d7c502d31dd6c and project 4d4749728e134a28b8e43a0f059694b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:36:38.527155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:36:38.530938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:36:38.603169 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c34e7d38-36af-4f0c-a0b7-aa6630b11a38 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.956451 Oct 28 18:36:38.603864 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1961/5553] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:36:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:36:38.617092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e924dc41-9629-4497-88ff-68921caba992 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:38.620693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e924dc41-9629-4497-88ff-68921caba992 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:38.970293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e924dc41-9629-4497-88ff-68921caba992 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:38.982630 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e924dc41-9629-4497-88ff-68921caba992 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1224 microversion: 2.1 time: 0.371614 Oct 28 18:36:38.985702 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3593/5554] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:38 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1224 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:40.010346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:40.011736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:40.018619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:40.019264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:40.019808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:40.020664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:40.021532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:40.022057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:40.162554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:40.191680 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-daa58c7f-4e14-49b3-8d03-d37dfa3e7a36 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1276 microversion: 2.1 time: 0.186369 Oct 28 18:36:40.200264 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1962/5555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:40 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:41.221855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:41.223094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:41.231225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:41.232052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:41.232676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:41.233565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:41.234198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:41.234802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:41.461590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:41.473454 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b136760-82e8-4cdb-a2b1-3edf61f7f361 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1282 microversion: 2.1 time: 0.255361 Oct 28 18:36:41.474508 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3594/5556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:41 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1282 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:42.501086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:42.502351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:42.513178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:42.513771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:42.514479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:42.521361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:42.522057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:42.522732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:43.032381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:43.042390 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2975991b-5c83-4db2-a902-ad3e7f97ce89 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1282 microversion: 2.1 time: 0.545274 Oct 28 18:36:43.044459 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1963/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:42 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1282 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:44.070229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:44.070989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:44.113110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:44.113934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:44.115890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:44.119330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:44.120669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:44.126931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:44.636728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:44.648312 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8587e429-f351-4544-8eec-d1309d1d9bb9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1324 microversion: 2.1 time: 0.584065 Oct 28 18:36:44.665611 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3595/5558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:44 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:45.675972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:45.676610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:45.692068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:45.693412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:45.694098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:45.695097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:45.697962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:45.698729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.346606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:46.378455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d448f886-c380-45d4-a891-f382c41fa0f5 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1324 microversion: 2.1 time: 0.706629 Oct 28 18:36:46.386028 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1964/5559] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:45 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:46.625633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-353bd161-5876-40f8-bf91-368e82ed11bb req-a798bbce-2f89-485d-8b38-4b0e0b297474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd66398-bacd-4dc9-865c-dcfa1e41ad05", "tag": "1c54549c-03f2-4256-ab8f-e1fd48935192"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:46.648256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-353bd161-5876-40f8-bf91-368e82ed11bb req-a798bbce-2f89-485d-8b38-4b0e0b297474 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:46.648906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-353bd161-5876-40f8-bf91-368e82ed11bb req-a798bbce-2f89-485d-8b38-4b0e0b297474 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:46.649447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-353bd161-5876-40f8-bf91-368e82ed11bb req-a798bbce-2f89-485d-8b38-4b0e0b297474 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.689745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-353bd161-5876-40f8-bf91-368e82ed11bb req-a798bbce-2f89-485d-8b38-4b0e0b297474 service nova] Creating event network-changed:1c54549c-03f2-4256-ab8f-e1fd48935192 for instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 on n-h2-862404-2 Oct 28 18:36:46.725041 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-353bd161-5876-40f8-bf91-368e82ed11bb req-a798bbce-2f89-485d-8b38-4b0e0b297474 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.576126 Oct 28 18:36:46.733636 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3596/5560] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:36:47.416732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:47.417370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:47.435297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:47.439947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:47.449062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:47.450616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:47.451286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:47.453360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:47.921609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:47.930906 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3bd428df-3363-4204-aaf7-f9e64197d0d8 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1324 microversion: 2.1 time: 0.520142 Oct 28 18:36:47.931501 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1965/5561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:47 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1324 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:48.958324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:48.962087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:48.973144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:48.975540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:48.978019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:48.981351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:48.983345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:48.985122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:48.988153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:49.521267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:49.541498 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aea92e04-6b25-4735-ac00-69e893d949aa tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1324 microversion: 2.1 time: 0.588931 Oct 28 18:36:49.563912 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3597/5562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:48 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1324 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:50.572546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:50.576736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:50.592198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:50.593778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:50.597981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:50.599007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:50.600728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:50.602983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:50.603653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:50.604298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:51.233217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:51.243182 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e86551a9-45f4-4ec3-9016-2c1fb4a9bfab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1324 microversion: 2.1 time: 0.680131 Oct 28 18:36:51.244784 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1966/5563] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:50 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1324 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:51.596334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c4aaabe8-7f71-4767-a5ca-0cc179b8573d req-78cfd9b6-2720-41f5-b788-4e33dc67f39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd66398-bacd-4dc9-865c-dcfa1e41ad05", "name": "network-vif-plugged", "status": "completed", "tag": "1c54549c-03f2-4256-ab8f-e1fd48935192"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:51.611462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c4aaabe8-7f71-4767-a5ca-0cc179b8573d req-78cfd9b6-2720-41f5-b788-4e33dc67f39a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:51.612450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c4aaabe8-7f71-4767-a5ca-0cc179b8573d req-78cfd9b6-2720-41f5-b788-4e33dc67f39a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:51.612935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c4aaabe8-7f71-4767-a5ca-0cc179b8573d req-78cfd9b6-2720-41f5-b788-4e33dc67f39a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:51.636289 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c4aaabe8-7f71-4767-a5ca-0cc179b8573d req-78cfd9b6-2720-41f5-b788-4e33dc67f39a service nova] Creating event network-vif-plugged:1c54549c-03f2-4256-ab8f-e1fd48935192 for instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 on n-h2-862404-2 Oct 28 18:36:51.643037 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c4aaabe8-7f71-4767-a5ca-0cc179b8573d req-78cfd9b6-2720-41f5-b788-4e33dc67f39a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050285 Oct 28 18:36:51.648013 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3598/5564] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:36:52.273613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:52.276257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:52.285476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:52.286841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:52.287538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:52.288390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:52.289095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:52.289748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:53.053893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-917706429", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "ed43c0c4-0c36-417e-aa0e-1ecc4237d24a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1205215823", "security_groups": [{"name": "tempest-secgroup-smoke-1572762643"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:53.139228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:53.150439 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7a8dd6d7-c729-4437-89d5-1e6697f6fca9 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1324 microversion: 2.1 time: 0.881699 Oct 28 18:36:53.155427 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1967/5565] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:52 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1324 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:53.487078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] validate_networks() for [('ed43c0c4-0c36-417e-aa0e-1ecc4237d24a', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:36:54.178710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:54.180365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:54.195859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:54.196717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:54.197374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:54.203509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:54.204303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:54.204953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:54.683026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:36:54.684023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:36:54.684688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:36:54.685281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:36:54.685878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:36:54.701939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:54.702441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:54.702883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:54.706843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:54.707503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:54.708349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:54.752089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for project 946b8055a69f4f979036482e1fd37f67. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:36:54.759673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:54.767502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for user 379680f3dd0542389b53a8a4f20ae800 and project 946b8055a69f4f979036482e1fd37f67. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:36:54.781123 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-34768561-fa44-4743-86cd-c1f62fadffa2 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1519 microversion: 2.1 time: 0.607685 Oct 28 18:36:54.782691 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1968/5566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:54 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1519 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:36:54.794788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:36:54.797314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:36:54.931208 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f3fd398-48e0-4a65-898f-6b13affe40c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.882866 Oct 28 18:36:54.946557 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3599/5567] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:36:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:36:54.955502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d2694db-1aea-4218-a515-9d791f473dc8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:54.956636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d2694db-1aea-4218-a515-9d791f473dc8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:55.039641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a016b636-8e69-49dd-b169-da494c9883ab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-324609573", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a016b636-8e69-49dd-b169-da494c9883ab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Request method failure captured: Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 242 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCEzIGGqlS5I5inNOHf7_v7VBNWMIrxhfCdTm9gwb7aucEBOaBFshA0wMkj9Z2Uo3RMUnxXoJQHkKMc7y8rctMp-E7-6CF2eqEWjWfdsyAj1OcBedjgt59u9uQh9eckBfAXbdEnMDzJVudtb1C_YDYbVaPvqAtkAPVtCKTrMSDa_Cyk Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d4749728e134a28b8e43a0f059694b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 1a7d8dd84e0c4ec88e7d7c502d31dd6c Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-324609573", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-324609573', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'b3e73f24-08e1-4542-93a5-011d88bb8725'}]}}} Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:55.044240 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a016b636-8e69-49dd-b169-da494c9883ab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:55.048599 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a016b636-8e69-49dd-b169-da494c9883ab tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011107 Oct 28 18:36:55.064210 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3600/5568] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:36:55 2022] POST /compute/v2.1/servers => generated 175 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:36:55.071928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d160854-bb25-4353-8814-19193ba7e757 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:55.087893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d160854-bb25-4353-8814-19193ba7e757 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: 92479b9c-d8b8-4d98-b1b2-44d4fc527410] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:55.110676 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-9d160854-bb25-4353-8814-19193ba7e757 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] HTTP exception thrown: Instance 92479b9c-d8b8-4d98-b1b2-44d4fc527410 could not be found. Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d160854-bb25-4353-8814-19193ba7e757 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Request method failure captured: Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/92479b9c-d8b8-4d98-b1b2-44d4fc527410/metadata HTTP/1.1 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCEzIGGqlS5I5inNOHf7_v7VBNWMIrxhfCdTm9gwb7aucEBOaBFshA0wMkj9Z2Uo3RMUnxXoJQHkKMc7y8rctMp-E7-6CF2eqEWjWfdsyAj1OcBedjgt59u9uQh9eckBfAXbdEnMDzJVudtb1C_YDYbVaPvqAtkAPVtCKTrMSDa_Cyk Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d4749728e134a28b8e43a0f059694b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 1a7d8dd84e0c4ec88e7d7c502d31dd6c Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 92479b9c-d8b8-4d98-b1b2-44d4fc527410 could not be found. Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '92479b9c-d8b8-4d98-b1b2-44d4fc527410'} Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92479b9c-d8b8-4d98-b1b2-44d4fc527410 could not be found. Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92479b9c-d8b8-4d98-b1b2-44d4fc527410 could not be found. Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.124834 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.129246 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:36:55.129246 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:36:55.129246 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92479b9c-d8b8-4d98-b1b2-44d4fc527410 could not be found. Oct 28 18:36:55.129246 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.129246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d160854-bb25-4353-8814-19193ba7e757 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Returning 404 to user: Instance 92479b9c-d8b8-4d98-b1b2-44d4fc527410 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:55.129246 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d160854-bb25-4353-8814-19193ba7e757 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/92479b9c-d8b8-4d98-b1b2-44d4fc527410/metadata" status: 404 len: 111 microversion: 2.1 time: 0.060891 Oct 28 18:36:55.129246 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3601/5569] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:36:55 2022] GET /compute/v2.1/servers/92479b9c-d8b8-4d98-b1b2-44d4fc527410/metadata => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:36:55.229493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4bce8e83-e866-482f-b52c-007e33f78163 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-574302917", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4bce8e83-e866-482f-b52c-007e33f78163 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Request method failure captured: Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 498 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCEzIGGqlS5I5inNOHf7_v7VBNWMIrxhfCdTm9gwb7aucEBOaBFshA0wMkj9Z2Uo3RMUnxXoJQHkKMc7y8rctMp-E7-6CF2eqEWjWfdsyAj1OcBedjgt59u9uQh9eckBfAXbdEnMDzJVudtb1C_YDYbVaPvqAtkAPVtCKTrMSDa_Cyk Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d4749728e134a28b8e43a0f059694b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 1a7d8dd84e0c4ec88e7d7c502d31dd6c Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-574302917", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-574302917', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b3e73f24-08e1-4542-93a5-011d88bb8725'}]}}} Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 18:36:55.237044 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.241743 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.249198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4bce8e83-e866-482f-b52c-007e33f78163 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:55.260925 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4bce8e83-e866-482f-b52c-007e33f78163 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.035634 Oct 28 18:36:55.264617 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3602/5570] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:36:55 2022] POST /compute/v2.1/servers => generated 687 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:36:55.269277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d2694db-1aea-4218-a515-9d791f473dc8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:55.280558 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d2694db-1aea-4218-a515-9d791f473dc8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1266 microversion: 2.1 time: 0.331939 Oct 28 18:36:55.303208 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1969/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:54 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:55.378271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e47608ab-53ae-40de-b925-fe38f806b02e tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1416757361", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e47608ab-53ae-40de-b925-fe38f806b02e tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Request method failure captured: Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 500 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCEzIGGqlS5I5inNOHf7_v7VBNWMIrxhfCdTm9gwb7aucEBOaBFshA0wMkj9Z2Uo3RMUnxXoJQHkKMc7y8rctMp-E7-6CF2eqEWjWfdsyAj1OcBedjgt59u9uQh9eckBfAXbdEnMDzJVudtb1C_YDYbVaPvqAtkAPVtCKTrMSDa_Cyk Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d4749728e134a28b8e43a0f059694b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 1a7d8dd84e0c4ec88e7d7c502d31dd6c Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1416757361", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1416757361', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b3e73f24-08e1-4542-93a5-011d88bb8725'}]}}} Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 18:36:55.383492 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.386795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.393030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e47608ab-53ae-40de-b925-fe38f806b02e tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:55.401191 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e47608ab-53ae-40de-b925-fe38f806b02e tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.028551 Oct 28 18:36:55.404508 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3603/5572] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:36:55 2022] POST /compute/v2.1/servers => generated 689 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:36:55.500700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-274c3f82-33d7-427d-b893-5c0647dd02b6 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-996646109", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-274c3f82-33d7-427d-b893-5c0647dd02b6 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Request method failure captured: Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 753 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCEzIGGqlS5I5inNOHf7_v7VBNWMIrxhfCdTm9gwb7aucEBOaBFshA0wMkj9Z2Uo3RMUnxXoJQHkKMc7y8rctMp-E7-6CF2eqEWjWfdsyAj1OcBedjgt59u9uQh9eckBfAXbdEnMDzJVudtb1C_YDYbVaPvqAtkAPVtCKTrMSDa_Cyk Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d4749728e134a28b8e43a0f059694b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 1a7d8dd84e0c4ec88e7d7c502d31dd6c Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-996646109", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-996646109', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b3e73f24-08e1-4542-93a5-011d88bb8725'}]}}} Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:36:55.513239 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:36:55.517328 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:36:55.520606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.520606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.524252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-274c3f82-33d7-427d-b893-5c0647dd02b6 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:55.531509 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-274c3f82-33d7-427d-b893-5c0647dd02b6 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.037755 Oct 28 18:36:55.542662 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1970/5573] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:36:55 2022] POST /compute/v2.1/servers => generated 1197 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 18:36:55.601923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97e478ef-9dcc-436b-9c7b-2c995fba52cd tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-727512630", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97e478ef-9dcc-436b-9c7b-2c995fba52cd tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Request method failure captured: Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 1265 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCEzIGGqlS5I5inNOHf7_v7VBNWMIrxhfCdTm9gwb7aucEBOaBFshA0wMkj9Z2Uo3RMUnxXoJQHkKMc7y8rctMp-E7-6CF2eqEWjWfdsyAj1OcBedjgt59u9uQh9eckBfAXbdEnMDzJVudtb1C_YDYbVaPvqAtkAPVtCKTrMSDa_Cyk Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d4749728e134a28b8e43a0f059694b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 1a7d8dd84e0c4ec88e7d7c502d31dd6c Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-727512630", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3e73f24-08e1-4542-93a5-011d88bb8725"}]}} Oct 28 18:36:55.607649 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-727512630', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b3e73f24-08e1-4542-93a5-011d88bb8725'}]}}} Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.610213 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:36:55.618553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:36:55.622207 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 18:36:55.622207 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.622207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97e478ef-9dcc-436b-9c7b-2c995fba52cd tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:55.622207 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97e478ef-9dcc-436b-9c7b-2c995fba52cd tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012855 Oct 28 18:36:55.622207 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3604/5574] 10.222.0.16 () {60 vars in 1148 bytes} [Fri Oct 28 18:36:55 2022] POST /compute/v2.1/servers => generated 2221 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 18:36:55.626199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-766b17fd-2fa6-4c55-bf7d-072bbd89b0ed tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:55.628382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-766b17fd-2fa6-4c55-bf7d-072bbd89b0ed tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: 7d61180b-fb20-45c0-ad6e-4167f1733952] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:55.640805 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-766b17fd-2fa6-4c55-bf7d-072bbd89b0ed tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] HTTP exception thrown: Instance 7d61180b-fb20-45c0-ad6e-4167f1733952 could not be found. Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-766b17fd-2fa6-4c55-bf7d-072bbd89b0ed tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Request method failure captured: Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/7d61180b-fb20-45c0-ad6e-4167f1733952/metadata/test2 HTTP/1.1 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCEzIGGqlS5I5inNOHf7_v7VBNWMIrxhfCdTm9gwb7aucEBOaBFshA0wMkj9Z2Uo3RMUnxXoJQHkKMc7y8rctMp-E7-6CF2eqEWjWfdsyAj1OcBedjgt59u9uQh9eckBfAXbdEnMDzJVudtb1C_YDYbVaPvqAtkAPVtCKTrMSDa_Cyk Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d4749728e134a28b8e43a0f059694b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 1a7d8dd84e0c4ec88e7d7c502d31dd6c Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 7d61180b-fb20-45c0-ad6e-4167f1733952 could not be found. Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'server_id': '7d61180b-fb20-45c0-ad6e-4167f1733952', 'id': 'test2'} Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d61180b-fb20-45c0-ad6e-4167f1733952 could not be found. Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d61180b-fb20-45c0-ad6e-4167f1733952 could not be found. Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:55.642693 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:55.654638 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:36:55.654638 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:36:55.654638 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d61180b-fb20-45c0-ad6e-4167f1733952 could not be found. Oct 28 18:36:55.654638 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:36:55.654638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-766b17fd-2fa6-4c55-bf7d-072bbd89b0ed tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Returning 404 to user: Instance 7d61180b-fb20-45c0-ad6e-4167f1733952 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:55.654638 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-766b17fd-2fa6-4c55-bf7d-072bbd89b0ed tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/7d61180b-fb20-45c0-ad6e-4167f1733952/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.027517 Oct 28 18:36:55.654638 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1971/5575] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 18:36:55 2022] GET /compute/v2.1/servers/7d61180b-fb20-45c0-ad6e-4167f1733952/metadata/test2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:36:55.664087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:55.665749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:55.677742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:55.678251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:55.678795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:55.679547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:55.680055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:55.680491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:55.732418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:36:55.972730 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-489375e2-225a-4431-aac9-ed47dca84e5c tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 204 len: 0 microversion: 2.1 time: 0.314065 Oct 28 18:36:55.977516 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3605/5576] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:36:55 2022] DELETE /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:36:55.986588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:55.987218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:56.009437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:56.010208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:56.011045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:56.012584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:56.013579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:56.014520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:56.325346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:56.326085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:56.338232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:56.339121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:56.339808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:56.340894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:56.341376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:56.341819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:56.630566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:56.661238 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a07d2492-113a-4c18-87f9-6f95f4f1751a tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1525 microversion: 2.1 time: 0.679609 Oct 28 18:36:56.664837 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1972/5577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:55 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1525 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:57.405177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:57.415093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b22febf5-7402-402e-983c-b5673e01e788 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1318 microversion: 2.1 time: 1.094807 Oct 28 18:36:57.451215 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3606/5578] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:56 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1318 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:36:57.690268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:57.696102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:57.716127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:57.716959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:57.717602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:57.718503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:57.719267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:57.719884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:58.448348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:58.449615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:58.465668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:58.466484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:58.468224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:58.470255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:58.472499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:58.475601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:58.683437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:58.702322 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96abf27f-dc74-4de6-90e3-8cb98ef612cc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1324 microversion: 2.1 time: 0.257960 Oct 28 18:36:58.706382 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3607/5579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:58 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:58.761262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:58.775974 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9957c85f-a31e-48a7-b3e6-b5b316d1b501 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1525 microversion: 2.1 time: 1.091253 Oct 28 18:36:58.784676 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1973/5580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:57 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1525 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:59.101925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-88a3084d-82dc-4e83-b906-3161cce94c73 req-f603c198-5a28-43cf-bbdf-32a78151b893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd66398-bacd-4dc9-865c-dcfa1e41ad05", "name": "network-vif-deleted", "tag": "1c54549c-03f2-4256-ab8f-e1fd48935192"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:59.154009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-88a3084d-82dc-4e83-b906-3161cce94c73 req-f603c198-5a28-43cf-bbdf-32a78151b893 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:59.157747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-88a3084d-82dc-4e83-b906-3161cce94c73 req-f603c198-5a28-43cf-bbdf-32a78151b893 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:59.160710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-88a3084d-82dc-4e83-b906-3161cce94c73 req-f603c198-5a28-43cf-bbdf-32a78151b893 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:59.202178 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-88a3084d-82dc-4e83-b906-3161cce94c73 req-f603c198-5a28-43cf-bbdf-32a78151b893 service nova] Creating event network-vif-deleted:1c54549c-03f2-4256-ab8f-e1fd48935192 for instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 on n-h2-862404-2 Oct 28 18:36:59.219018 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-88a3084d-82dc-4e83-b906-3161cce94c73 req-f603c198-5a28-43cf-bbdf-32a78151b893 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122739 Oct 28 18:36:59.219672 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3608/5581] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:36:59.731286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:59.731938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:59.743092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:59.743451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:59.743923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:59.745684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:59.745684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:59.750210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:59.811997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:59.816481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:36:59.839489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:59.841937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:59.842548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:59.843475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:59.849679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:59.852429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:59.925792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:59.926209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:59.927233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:59.927785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lazy-loading 'fault' on Instance uuid fdd66398-bacd-4dc9-865c-dcfa1e41ad05 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:36:59.971355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:59.981172 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cb6df4ae-4032-4e1a-9ffd-77d00540398f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1324 microversion: 2.1 time: 0.254622 Oct 28 18:36:59.996368 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1974/5582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:59 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:00.025826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7d8dd84e0c4ec88e7d7c502d31dd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d4749728e134a28b8e43a0f059694b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:00.038403 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6164a724-ec9d-4779-bd68-f4a81b603ebf tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 200 len: 1314 microversion: 2.1 time: 0.233559 Oct 28 18:37:00.040861 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3609/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:59 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:01.007564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:01.008969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:01.038676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:01.040312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:01.041012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:01.042128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:01.042921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:01.044152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:01.077208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:01.078701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] [instance: fdd66398-bacd-4dc9-865c-dcfa1e41ad05] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:01.095309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:01.096485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:01.097119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:01.098167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:01.100242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:01.101837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:01.154748 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] HTTP exception thrown: Instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 could not be found. Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Request method failure captured: Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 HTTP/1.1 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCEzIGGqlS5I5inNOHf7_v7VBNWMIrxhfCdTm9gwb7aucEBOaBFshA0wMkj9Z2Uo3RMUnxXoJQHkKMc7y8rctMp-E7-6CF2eqEWjWfdsyAj1OcBedjgt59u9uQh9eckBfAXbdEnMDzJVudtb1C_YDYbVaPvqAtkAPVtCKTrMSDa_Cyk Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4d4749728e134a28b8e43a0f059694b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4d4749728e134a28b8e43a0f059694b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 4d4749728e134a28b8e43a0f059694b5 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1216766723 Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 1a7d8dd84e0c4ec88e7d7c502d31dd6c Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1216766723-project Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 could not be found. Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'fdd66398-bacd-4dc9-865c-dcfa1e41ad05'} Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 could not be found. Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 could not be found. Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:01.161775 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:01.166485 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:01.166485 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:01.166485 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:37:01.166485 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:37:01.166485 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:37:01.166485 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:37:01.166485 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 could not be found. Oct 28 18:37:01.166485 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:01.173474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] Returning 404 to user: Instance fdd66398-bacd-4dc9-865c-dcfa1e41ad05 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:37:01.174430 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45876175-c703-4dfe-828d-b19184e7ae99 tempest-ServerMetadataNegativeTestJSON-1216766723 tempest-ServerMetadataNegativeTestJSON-1216766723-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05" status: 404 len: 111 microversion: 2.1 time: 0.112683 Oct 28 18:37:01.183755 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3610/5584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:01 2022] GET /compute/v2.1/servers/fdd66398-bacd-4dc9-865c-dcfa1e41ad05 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:37:01.420478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:01.432673 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04b71b00-49df-40b3-ab4c-2b3cb4280164 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1324 microversion: 2.1 time: 0.430709 Oct 28 18:37:01.456637 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1975/5585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:01 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:02.460069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:02.460738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:02.471967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:02.477650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:02.478320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:02.479253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:02.480377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:02.480813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:03.432043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:03.443521 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f469e26-6df5-4ca2-9d95-55b7267e3916 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1392 microversion: 2.1 time: 0.985969 Oct 28 18:37:03.444639 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3611/5586] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:02 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1392 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:04.480463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:04.485242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:04.514908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:04.519354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:04.520121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:04.521435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:04.522144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:04.523787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:05.100168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:05.116934 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0357003b-3db1-4dec-8250-4e82aea62944 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1392 microversion: 2.1 time: 0.644908 Oct 28 18:37:05.128686 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1976/5587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:04 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1392 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:05.637979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1812163547", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "8771194c-b4a6-4f22-99f0-dddd5c98d413"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1547122992", "security_groups": []}, "os:scheduler_hints": {"different_host": ["5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe"]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:05.666809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:05.668335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:05.760045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] validate_networks() for [('8771194c-b4a6-4f22-99f0-dddd5c98d413', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:37:06.110134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-77f01ebb-38be-4eea-9059-86a35f839f41 req-0722aaa0-f335-4a9d-8700-e6ce47ee1dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:06.118958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:06.126394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:06.147332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-77f01ebb-38be-4eea-9059-86a35f839f41 req-0722aaa0-f335-4a9d-8700-e6ce47ee1dac service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:06.147855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-77f01ebb-38be-4eea-9059-86a35f839f41 req-0722aaa0-f335-4a9d-8700-e6ce47ee1dac service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:06.153813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-77f01ebb-38be-4eea-9059-86a35f839f41 req-0722aaa0-f335-4a9d-8700-e6ce47ee1dac service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:06.161718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=75 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:06.190616 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-77f01ebb-38be-4eea-9059-86a35f839f41 req-0722aaa0-f335-4a9d-8700-e6ce47ee1dac service nova] Creating event network-changed:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h1-862404-2 Oct 28 18:37:06.203992 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-77f01ebb-38be-4eea-9059-86a35f839f41 req-0722aaa0-f335-4a9d-8700-e6ce47ee1dac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099104 Oct 28 18:37:06.206074 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1977/5588] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:37:06.227898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:06.228625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:06.249780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:06.250300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:06.250770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:06.251484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:06.252171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:06.252803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:06.907651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:06.941678 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4f8f5725-1cae-429d-aefb-efaa191c624d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1392 microversion: 2.1 time: 0.732103 Oct 28 18:37:06.942884 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1978/5589] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:06 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1392 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:06.995718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:37:06.996228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:37:06.996642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:37:06.997605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:37:06.998446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:37:07.000895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:07.030404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:07.030907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:07.034980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:07.036397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:07.036894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:07.039520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:07.093235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:07.126926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Getting quotas for project 6bfe0fd7bdd348fc8300707dff245672. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:37:07.146198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Getting quotas for user c4d84d4bf7e64dcbb24dd45894d86642 and project 6bfe0fd7bdd348fc8300707dff245672. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:37:07.175462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:37:07.180423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:37:07.257173 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34da1a9e-4efb-4512-9c2a-60f08c990a07 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.623676 Oct 28 18:37:07.258779 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3612/5590] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:37:05 2022] POST /compute/v2.1/servers => generated 361 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:37:07.274343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7acdfc42-8957-4812-95f2-744e90b739dc tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:07.275479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7acdfc42-8957-4812-95f2-744e90b739dc tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:07.506217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7acdfc42-8957-4812-95f2-744e90b739dc tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:07.519243 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7acdfc42-8957-4812-95f2-744e90b739dc tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1242 microversion: 2.1 time: 0.249992 Oct 28 18:37:07.556315 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1979/5591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:07 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1242 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:07.969377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:07.970015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:07.992154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:07.992575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:07.993025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:08.002166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:08.010486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:08.022027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:08.422317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:08.450895 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33ff887a-b78a-4e05-9255-6f08d9ca3c58 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1392 microversion: 2.1 time: 0.484420 Oct 28 18:37:08.474156 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3613/5592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:07 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:08.547420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:08.549715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:08.567313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:08.570003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:08.570491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:08.571254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:08.574228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:08.574699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:08.780937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:08.799557 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e2d53a2-15af-484b-9ad9-8a6d144297ee tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1238 microversion: 2.1 time: 0.257645 Oct 28 18:37:08.804256 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1980/5593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:08 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1238 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:09.493252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:09.494155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:09.519545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:09.523861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:09.524363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:09.525147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:09.525638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:09.532925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:09.826885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:09.827571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:09.845513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:09.847755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:09.851359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:09.852242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:09.852741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:09.857046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:10.156375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:10.187062 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f27dc45-5202-487f-9f3b-895dca295d94 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1312 microversion: 2.1 time: 0.364276 Oct 28 18:37:10.187678 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1981/5594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:09 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:10.477621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:10.489461 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d415e81-75fa-4aae-9168-5b09a49b61ec tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1392 microversion: 2.1 time: 1.011086 Oct 28 18:37:10.491092 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3614/5595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:09 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1392 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:11.214564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:11.215361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:11.234424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:11.234995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:11.235678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:11.236304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:11.236780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:11.237220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:11.404260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:11.417879 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3c74d791-f31c-4b58-b4b7-fb9bf444f035 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.210799 Oct 28 18:37:11.418497 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1982/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:11 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:11.517846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:11.518525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:11.533467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:11.533903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:11.534399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:11.535179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:11.536266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:11.537967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:12.047408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:12.060590 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26a977bb-51b3-4529-bd1a-c29d16c401d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1392 microversion: 2.1 time: 0.545968 Oct 28 18:37:12.085292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3615/5597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:11 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1392 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:12.443363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:12.444131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:12.462881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:12.463401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:12.463870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:12.464871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:12.465614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:12.466255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:12.856188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:12.876817 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c95818dd-2f2e-4aca-842a-4b096e66a2cd tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.439961 Oct 28 18:37:12.878358 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1983/5598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:12 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:13.088241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:13.088849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:13.098937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:13.099518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:13.108224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:13.109090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:13.109586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:13.110032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:13.902572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:13.912780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:13.930364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:13.935863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:13.937316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:13.937964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:13.939323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:13.939994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:13.940621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:13.946594 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a816407-84b0-474e-a004-d01e170091db tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1392 microversion: 2.1 time: 0.862511 Oct 28 18:37:13.947445 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3616/5599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:13 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1392 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:14.080738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:14.090273 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-639af111-bfe9-4cf6-a5c1-d054e5b10720 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.192395 Oct 28 18:37:14.095628 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1984/5600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:13 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:14.194872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-374ea137-70fa-4c3c-9e3c-d1b9f55adc21 req-e000e6fd-e498-4368-83bf-b38acde65d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "name": "network-vif-plugged", "status": "completed", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:14.222062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-374ea137-70fa-4c3c-9e3c-d1b9f55adc21 req-e000e6fd-e498-4368-83bf-b38acde65d61 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:14.225771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-374ea137-70fa-4c3c-9e3c-d1b9f55adc21 req-e000e6fd-e498-4368-83bf-b38acde65d61 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:14.226552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-374ea137-70fa-4c3c-9e3c-d1b9f55adc21 req-e000e6fd-e498-4368-83bf-b38acde65d61 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:14.246486 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-374ea137-70fa-4c3c-9e3c-d1b9f55adc21 req-e000e6fd-e498-4368-83bf-b38acde65d61 service nova] Creating event network-vif-plugged:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h1-862404-2 Oct 28 18:37:14.253593 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-374ea137-70fa-4c3c-9e3c-d1b9f55adc21 req-e000e6fd-e498-4368-83bf-b38acde65d61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063274 Oct 28 18:37:14.255606 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3617/5601] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:14.978137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:14.980192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:14.997745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:14.999050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:15.001260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:15.003331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:15.006338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:15.007446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:15.119515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:15.120623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:15.135153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:15.135649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:15.136119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:15.136833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:15.137289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:15.137722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:15.394318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:15.412187 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72b6c59b-4af3-47f6-a0a3-894023cfee93 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1392 microversion: 2.1 time: 0.441545 Oct 28 18:37:15.429306 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1985/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:14 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1392 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:15.448830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b6370a48-a192-440a-9e8f-2ea870616f3d req-8b8dbaf2-da6f-48a0-a4d4-f80ac646e558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac281bef-75ac-4cbc-93b1-786ed3fc2d08", "tag": "ffab9f89-0d22-49ba-b697-9218da746f93"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:15.456560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:15.474952 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f418e16-6c3b-4e7a-8218-3e8c1e126eb1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.359564 Oct 28 18:37:15.475373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6370a48-a192-440a-9e8f-2ea870616f3d req-8b8dbaf2-da6f-48a0-a4d4-f80ac646e558 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:15.476316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6370a48-a192-440a-9e8f-2ea870616f3d req-8b8dbaf2-da6f-48a0-a4d4-f80ac646e558 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:15.477498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6370a48-a192-440a-9e8f-2ea870616f3d req-8b8dbaf2-da6f-48a0-a4d4-f80ac646e558 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:15.478508 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3618/5603] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:15 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:15.494126 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b6370a48-a192-440a-9e8f-2ea870616f3d req-8b8dbaf2-da6f-48a0-a4d4-f80ac646e558 service nova] Creating event network-changed:ffab9f89-0d22-49ba-b697-9218da746f93 for instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 on n-h2-862404-2 Oct 28 18:37:15.503527 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b6370a48-a192-440a-9e8f-2ea870616f3d req-8b8dbaf2-da6f-48a0-a4d4-f80ac646e558 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072649 Oct 28 18:37:15.504202 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1986/5604] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:16.440304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:16.441061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:16.451151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:16.451648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:16.452109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:16.452826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:16.453380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:16.453717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:16.502227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:16.503124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:16.513775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:16.514258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:16.514699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:16.515403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:16.515875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:16.516548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:16.666707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:16.677773 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-05542149-645d-4ceb-856b-b0793ce83232 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.180062 Oct 28 18:37:16.678796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1987/5605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:16 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:37:16.720458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:16.730878 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac712741-cc56-44f1-9469-ec14c4ed50be tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1563 microversion: 2.1 time: 0.294279 Oct 28 18:37:16.731678 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3619/5606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:16 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1563 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:16.760361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:16.761269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:16.769728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:16.775387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:16.777500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:16.778824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:16.779417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:16.779941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:17.159601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:17.181848 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a061d0f3-3a9b-41fb-9e14-ac43e79aa02b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1563 microversion: 2.1 time: 0.426810 Oct 28 18:37:17.183481 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1988/5607] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:16 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1563 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:17.718264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:17.726819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:17.739660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:17.742627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:17.756685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:17.758710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:17.760546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:17.762424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:17.764040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:17.765610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:18.057915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:18.076868 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-354add9e-ef9f-46ae-858e-2c1f3830ec76 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.376925 Oct 28 18:37:18.097043 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3620/5608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:17 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:19.117418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:19.118110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:19.150177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:19.153979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:19.157379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:19.159459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:19.161733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:19.162480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:19.164482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:19.404776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:19.423735 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3a6892f-9a7a-4f00-aac5-860979901ca4 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.321088 Oct 28 18:37:19.425421 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1989/5609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:19 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:20.448332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:20.448949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:20.455924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:20.464380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:20.465045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:20.465994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:20.466634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:20.467073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:20.743451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:20.759587 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea35fc62-2a24-4ae2-9ec2-d679efc14a69 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.315055 Oct 28 18:37:20.760711 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3621/5610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:20 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:21.784624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:21.785208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:21.797449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:21.797948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:21.798400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:21.799118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:21.799580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:21.800057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:22.225798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1662cb72-0cb9-4b4f-bd44-be67d2f03b1c req-48f94c06-9f4e-44cf-82b8-fae09bad0108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac281bef-75ac-4cbc-93b1-786ed3fc2d08", "name": "network-vif-plugged", "status": "completed", "tag": "ffab9f89-0d22-49ba-b697-9218da746f93"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:22.250567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1662cb72-0cb9-4b4f-bd44-be67d2f03b1c req-48f94c06-9f4e-44cf-82b8-fae09bad0108 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:22.252589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1662cb72-0cb9-4b4f-bd44-be67d2f03b1c req-48f94c06-9f4e-44cf-82b8-fae09bad0108 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:22.253271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1662cb72-0cb9-4b4f-bd44-be67d2f03b1c req-48f94c06-9f4e-44cf-82b8-fae09bad0108 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:22.261425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:22.270655 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b0127c33-ebbf-47e5-8f8b-2da67b983967 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.489839 Oct 28 18:37:22.279298 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1990/5611] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:21 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:22.303718 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1662cb72-0cb9-4b4f-bd44-be67d2f03b1c req-48f94c06-9f4e-44cf-82b8-fae09bad0108 service nova] Creating event network-vif-plugged:ffab9f89-0d22-49ba-b697-9218da746f93 for instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 on n-h2-862404-2 Oct 28 18:37:22.320358 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1662cb72-0cb9-4b4f-bd44-be67d2f03b1c req-48f94c06-9f4e-44cf-82b8-fae09bad0108 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092841 Oct 28 18:37:22.321772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3622/5612] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:22.885588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:22.889181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:22.926775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:22.927689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:22.928426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:22.929323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:22.933834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:22.934400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:22.956251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6e0ea150-7c62-4001-99b4-0b2de4639288 req-b00f4abf-3a2c-4d6e-8492-bec95dde5729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:23.008830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6e0ea150-7c62-4001-99b4-0b2de4639288 req-b00f4abf-3a2c-4d6e-8492-bec95dde5729 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:23.014884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6e0ea150-7c62-4001-99b4-0b2de4639288 req-b00f4abf-3a2c-4d6e-8492-bec95dde5729 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:23.017842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6e0ea150-7c62-4001-99b4-0b2de4639288 req-b00f4abf-3a2c-4d6e-8492-bec95dde5729 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:23.074326 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6e0ea150-7c62-4001-99b4-0b2de4639288 req-b00f4abf-3a2c-4d6e-8492-bec95dde5729 service nova] Creating event network-changed:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h1-862404-2 Oct 28 18:37:23.089068 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6e0ea150-7c62-4001-99b4-0b2de4639288 req-b00f4abf-3a2c-4d6e-8492-bec95dde5729 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136757 Oct 28 18:37:23.119361 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3623/5613] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:23.314097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:23.316169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:23.337123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:23.337871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:23.338492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:23.339638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:23.340465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:23.341103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:23.585650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:23.602644 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9bacd0c-7476-448e-b46f-14d48f00bc3c tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1300 microversion: 2.1 time: 0.304423 Oct 28 18:37:23.603919 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3624/5614] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:23 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1300 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:37:24.111112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:24.124653 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1cf71136-dee0-4ede-a137-f5dc44987432 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1563 microversion: 2.1 time: 1.244856 Oct 28 18:37:24.125633 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1991/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:22 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1563 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:24.630410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:24.631240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:24.644012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:24.645882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:24.651271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:24.652236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:24.652844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:24.653556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:25.123701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:25.136378 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3efdc9b-8b5d-44c5-9df2-a8cedb735925 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1473 microversion: 2.1 time: 0.510746 Oct 28 18:37:25.138916 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3625/5616] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:24 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1473 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:25.166320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:25.167809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:25.179059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:25.179974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:25.180704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:25.181683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:25.182378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:25.183512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:26.216834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:26.232441 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6099d409-f9f5-4063-a1d3-4034a7a0a335 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1473 microversion: 2.1 time: 1.070557 Oct 28 18:37:26.234166 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1992/5617] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:25 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1473 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:26.264873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:26.266318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:26.282082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:26.282589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:26.284300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:26.285859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:26.289073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:26.289711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:26.496727 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5410ec7-6be5-40b5-b3da-ababd5561ce4 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1624 microversion: 2.1 time: 0.242650 Oct 28 18:37:26.522837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:26.523484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:26.530924 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3626/5618] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:26 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1624 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:26.534431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:26.534938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:26.538097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:26.539331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:26.541535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:26.543134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:26.948432 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2d264b6e-1442-414c-b67c-e23cc9c54884 tempest-TestSecurityGroupsBasicOps-1706917619 tempest-TestSecurityGroupsBasicOps-1706917619-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1910 microversion: 2.1 time: 0.429520 Oct 28 18:37:26.951721 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1993/5619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:26 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1910 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:27.059972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:27.060845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:27.106397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:27.110753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:27.111212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:27.118283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:27.120125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:27.120955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:27.187208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:37:27.357240 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-46b36a4f-8f02-4441-b39a-2bf2e3894089 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 204 len: 0 microversion: 2.1 time: 0.302244 Oct 28 18:37:27.358925 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3627/5620] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:37:27 2022] DELETE /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:37:27.368978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:27.369887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:27.378513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:27.379429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:27.380505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:27.381508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:27.382051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:27.382641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:27.710515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:27.722420 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd3efe66-c7df-4b19-8045-0eaa2bb20267 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1479 microversion: 2.1 time: 0.358950 Oct 28 18:37:27.723972 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1994/5621] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:27 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1479 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:28.749219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:28.749946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:28.763729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:28.764263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:28.764705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:28.799436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:28.800419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:28.802877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:29.076285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:29.102983 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a68db92b-d116-4a14-bf76-f11d4388a610 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1479 microversion: 2.1 time: 0.357769 Oct 28 18:37:29.117739 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3628/5622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:28 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1479 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:29.529895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-82280282", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "40558d36-80d4-459b-bebf-564251832359"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:29.604164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] validate_networks() for [('40558d36-80d4-459b-bebf-564251832359', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:37:30.135590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:30.136377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:30.153358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:30.154962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:30.157336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:30.161710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:30.163074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:30.163526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:30.373579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:30.377756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:30.403505 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00e01510-42af-4f15-bef9-8764cdab3044 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 200 len: 1479 microversion: 2.1 time: 0.272466 Oct 28 18:37:30.405186 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3629/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:30 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 1479 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:37:30.440062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7b34d32b-970e-43c7-9700-c790c2c10999 req-e518723f-0ed4-4b59-bf83-402c795ddc90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac281bef-75ac-4cbc-93b1-786ed3fc2d08", "name": "network-vif-deleted", "tag": "ffab9f89-0d22-49ba-b697-9218da746f93"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:30.470307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7b34d32b-970e-43c7-9700-c790c2c10999 req-e518723f-0ed4-4b59-bf83-402c795ddc90 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:30.471264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7b34d32b-970e-43c7-9700-c790c2c10999 req-e518723f-0ed4-4b59-bf83-402c795ddc90 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:30.473620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7b34d32b-970e-43c7-9700-c790c2c10999 req-e518723f-0ed4-4b59-bf83-402c795ddc90 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:30.520988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7b34d32b-970e-43c7-9700-c790c2c10999 req-e518723f-0ed4-4b59-bf83-402c795ddc90 service nova] Creating event network-vif-deleted:ffab9f89-0d22-49ba-b697-9218da746f93 for instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 on n-h2-862404-2 Oct 28 18:37:30.530758 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7b34d32b-970e-43c7-9700-c790c2c10999 req-e518723f-0ed4-4b59-bf83-402c795ddc90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112387 Oct 28 18:37:30.534687 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3630/5624] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:31.030384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:37:31.031262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:37:31.032144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:37:31.032639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:37:31.034267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:37:31.062725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:31.067488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:31.068548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:31.070078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:31.070742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:31.072820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:31.133734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:37:31.149641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:37:31.184683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:37:31.187638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:37:31.270930 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7b92ee2d-04ce-4bd9-8c33-ad991c7a7963 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973362 Oct 28 18:37:31.273690 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1995/5625] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:37:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:37:31.309493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b48e7184-45f5-4745-b73c-98478dbf7a32 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:31.314412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b48e7184-45f5-4745-b73c-98478dbf7a32 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:31.433279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:31.433989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: ac281bef-75ac-4cbc-93b1-786ed3fc2d08] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:31.449869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:31.450372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:31.455172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:31.458942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:31.459554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:31.460038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:31.500378 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] HTTP exception thrown: Instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 could not be found. Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Request method failure captured: Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 HTTP/1.1 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCDJGv1oNFO53_ujcSuXf3S7cK8fssYVXGu1MQiKACBQuo1O8UyYVQgGGUqY1OZBAmP5Hvf99qDq55Sylfij5QQ0nhBgpn1_geG79oxmBt8ql3FeYtM9f6H2R-PyZzCgiGCQTvdI3aWioPoaSBQIIye1mucqk0iX_d3HAWjJsuDacJA Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 6bfe0fd7bdd348fc8300707dff245672 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-791738600 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6bfe0fd7bdd348fc8300707dff245672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6bfe0fd7bdd348fc8300707dff245672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6bfe0fd7bdd348fc8300707dff245672", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6bfe0fd7bdd348fc8300707dff245672"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestSecurityGroupsBasicOps-791738600 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 6bfe0fd7bdd348fc8300707dff245672 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-791738600 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestSecurityGroupsBasicOps-791738600-project Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c4d84d4bf7e64dcbb24dd45894d86642 Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestSecurityGroupsBasicOps-791738600-project Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 could not be found. Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'ac281bef-75ac-4cbc-93b1-786ed3fc2d08'} Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 could not be found. Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 could not be found. Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:31.510673 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 could not be found. Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Returning 404 to user: Instance ac281bef-75ac-4cbc-93b1-786ed3fc2d08 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3260abea-3ba7-43b8-b017-2d6dd4461a56 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08" status: 404 len: 111 microversion: 2.1 time: 0.083459 Oct 28 18:37:31.516731 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1996/5626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:31 2022] GET /compute/v2.1/servers/ac281bef-75ac-4cbc-93b1-786ed3fc2d08 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:37:31.717904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b48e7184-45f5-4745-b73c-98478dbf7a32 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:31.731412 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b48e7184-45f5-4745-b73c-98478dbf7a32 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1191 microversion: 2.1 time: 0.442140 Oct 28 18:37:31.736034 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3631/5627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:31 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1191 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:32.761216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:32.761936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:32.792355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:32.792872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:32.793325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:32.797389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:32.797939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:32.798384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:32.888897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:32.952467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:32.965422 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eabdc610-24fc-4b40-b1be-35371f7f38e2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1243 microversion: 2.1 time: 0.204751 Oct 28 18:37:32.969662 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1997/5628] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:32 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1243 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:33.991846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:33.993526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:34.005465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:34.006759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:34.007386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:34.008693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:34.009471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:34.010426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:34.180227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:34.190401 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9bd6d860-09b2-41fc-8d61-4a83e2f7bd1b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1249 microversion: 2.1 time: 0.203459 Oct 28 18:37:34.208340 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3632/5629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:33 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1249 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:35.216893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:35.217543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:35.230596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:35.235256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:35.235731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:35.236527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:35.243408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:35.247877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:35.681354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:35.690528 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a60b953e-15bb-4604-b263-c7127ec84982 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1249 microversion: 2.1 time: 0.479485 Oct 28 18:37:35.691137 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1998/5630] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:35 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1249 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:36.725264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:36.727905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:36.757940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:36.759868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:36.759868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:36.760389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:36.761026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:36.761742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:37.341490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:37.357128 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ea731464-286a-4d06-bc55-b826f0b5d432 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1291 microversion: 2.1 time: 0.643923 Oct 28 18:37:37.359034 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3633/5631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:36 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1291 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:38.383884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:38.384703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:38.396820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:38.398300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:38.398820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:38.402069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:38.402829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:38.403298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:38.403729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:39.490920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:39.500771 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49c5a507-d1b3-476c-8f1c-e5bfd3e7ba85 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1291 microversion: 2.1 time: 1.122439 Oct 28 18:37:39.506813 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1999/5632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:38 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1291 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:39.621693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7d10900e-d812-47e4-b4ad-cb4db1b124dc req-566c277a-3d60-42fb-9a6b-6141fa85b339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd32c27b-92bb-4507-84cf-f224740d9143", "tag": "508fbfa8-2871-4a2f-b9c8-13f38bbecff4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:39.649155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:39.665925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d10900e-d812-47e4-b4ad-cb4db1b124dc req-566c277a-3d60-42fb-9a6b-6141fa85b339 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:39.667250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d10900e-d812-47e4-b4ad-cb4db1b124dc req-566c277a-3d60-42fb-9a6b-6141fa85b339 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:39.672737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d10900e-d812-47e4-b4ad-cb4db1b124dc req-566c277a-3d60-42fb-9a6b-6141fa85b339 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:39.706008 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7d10900e-d812-47e4-b4ad-cb4db1b124dc req-566c277a-3d60-42fb-9a6b-6141fa85b339 service nova] Creating event network-changed:508fbfa8-2871-4a2f-b9c8-13f38bbecff4 for instance cd32c27b-92bb-4507-84cf-f224740d9143 on n-h2-862404-2 Oct 28 18:37:39.721703 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7d10900e-d812-47e4-b4ad-cb4db1b124dc req-566c277a-3d60-42fb-9a6b-6141fa85b339 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108739 Oct 28 18:37:39.725312 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3634/5633] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:40.535882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:40.536608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:40.550384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:40.551104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:40.555969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:40.558791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:40.560911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:40.561540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:40.983995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:41.001088 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a22b78ec-62a4-40c8-8973-5b1f2a7a4455 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1291 microversion: 2.1 time: 0.475716 Oct 28 18:37:41.002965 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2000/5634] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:40 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1291 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:41.732144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:41.741751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b32e6a67-1a25-419b-937f-1a22232204b1 req-b6826d00-46f9-4e38-a4d3-057c8953e076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe", "tag": "c3b354eb-686a-4786-8199-87493a5d5665"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:41.748391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:41.754253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:41.754797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:41.766346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:41.788653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:41.790825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:41.791294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:41.795964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:41.796515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:41.796966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:41.808570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b32e6a67-1a25-419b-937f-1a22232204b1 req-b6826d00-46f9-4e38-a4d3-057c8953e076 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:41.809046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b32e6a67-1a25-419b-937f-1a22232204b1 req-b6826d00-46f9-4e38-a4d3-057c8953e076 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:41.809485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b32e6a67-1a25-419b-937f-1a22232204b1 req-b6826d00-46f9-4e38-a4d3-057c8953e076 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:41.837328 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b32e6a67-1a25-419b-937f-1a22232204b1 req-b6826d00-46f9-4e38-a4d3-057c8953e076 service nova] Creating event network-changed:c3b354eb-686a-4786-8199-87493a5d5665 for instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe on n-h1-862404-2 Oct 28 18:37:41.849827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:37:41.854324 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b32e6a67-1a25-419b-937f-1a22232204b1 req-b6826d00-46f9-4e38-a4d3-057c8953e076 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117378 Oct 28 18:37:41.855212 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2001/5635] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:37:42.023875 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-213ee047-96d4-438f-a0b7-d2090512b3e5 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 204 len: 0 microversion: 2.1 time: 0.294175 Oct 28 18:37:42.025770 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3635/5636] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:37:41 2022] DELETE /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:37:42.030457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:42.031409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:42.042572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:42.044240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:42.044791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:42.045249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:42.045702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:42.046422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:42.046879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:42.059449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:42.059746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:42.061035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:42.061744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:42.064691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:42.065527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:42.066434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:42.485334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:42.496703 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d88cd4f2-1dab-49d9-9e54-29abe66e6969 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1291 microversion: 2.1 time: 0.470747 Oct 28 18:37:42.497594 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2002/5637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:42 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1291 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:37:42.913542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:42.922097 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-758627f1-6bca-464d-a59f-ad271654e61e tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1765 microversion: 2.1 time: 0.885620 Oct 28 18:37:42.922697 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3636/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:42 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1765 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:43.527376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:43.528710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:43.542729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:43.546060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:43.546704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:43.547558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:43.550215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:43.551015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:43.946939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:43.948429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:43.960103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:43.960866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:43.961437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:43.962862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:43.963627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:43.966603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:44.308373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:44.340714 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c504441b-722b-4d66-9b00-bbbf50641315 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1291 microversion: 2.1 time: 0.823514 Oct 28 18:37:44.341616 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2003/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:43 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1291 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:44.372071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d84d4bf7e64dcbb24dd45894d86642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfe0fd7bdd348fc8300707dff245672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:44.383058 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc338fdb-131d-4b9a-b690-3909d4a1585f tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 200 len: 1765 microversion: 2.1 time: 0.438807 Oct 28 18:37:44.389831 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3637/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:43 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 1765 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:37:44.637725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c089fb82-1a85-408b-9487-a742848a8608 req-a321a570-1a80-490a-ae05-6abdb431d8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe", "name": "network-vif-deleted", "tag": "c3b354eb-686a-4786-8199-87493a5d5665"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:44.652502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c089fb82-1a85-408b-9487-a742848a8608 req-a321a570-1a80-490a-ae05-6abdb431d8d2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:44.653295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c089fb82-1a85-408b-9487-a742848a8608 req-a321a570-1a80-490a-ae05-6abdb431d8d2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:44.653906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c089fb82-1a85-408b-9487-a742848a8608 req-a321a570-1a80-490a-ae05-6abdb431d8d2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:44.675967 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c089fb82-1a85-408b-9487-a742848a8608 req-a321a570-1a80-490a-ae05-6abdb431d8d2 service nova] Creating event network-vif-deleted:c3b354eb-686a-4786-8199-87493a5d5665 for instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe on n-h1-862404-2 Oct 28 18:37:44.683996 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c089fb82-1a85-408b-9487-a742848a8608 req-a321a570-1a80-490a-ae05-6abdb431d8d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051507 Oct 28 18:37:44.685232 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2004/5641] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:45.370744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:45.371333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:45.380678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:45.381176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:45.381756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:45.382473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:45.383125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:45.383961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:45.406695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:45.408930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] [instance: 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:45.420018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:45.423856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:45.424296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:45.425337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:45.430922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:45.431405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:45.467803 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] HTTP exception thrown: Instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe could not be found. Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Request method failure captured: Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe HTTP/1.1 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCDJGv1oNFO53_ujcSuXf3S7cK8fssYVXGu1MQiKACBQuo1O8UyYVQgGGUqY1OZBAmP5Hvf99qDq55Sylfij5QQ0nhBgpn1_geG79oxmBt8ql3FeYtM9f6H2R-PyZzCgiGCQTvdI3aWioPoaSBQIIye1mucqk0iX_d3HAWjJsuDacJA Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 6bfe0fd7bdd348fc8300707dff245672 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-791738600 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6bfe0fd7bdd348fc8300707dff245672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6bfe0fd7bdd348fc8300707dff245672"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6bfe0fd7bdd348fc8300707dff245672", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6bfe0fd7bdd348fc8300707dff245672"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestSecurityGroupsBasicOps-791738600 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 6bfe0fd7bdd348fc8300707dff245672 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-791738600 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestSecurityGroupsBasicOps-791738600-project Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c4d84d4bf7e64dcbb24dd45894d86642 Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestSecurityGroupsBasicOps-791738600-project Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe could not be found. Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe'} Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe could not be found. Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe could not be found. Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:45.474502 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:45.481062 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:45.481062 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:37:45.481062 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:37:45.481062 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:37:45.481062 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:37:45.481062 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe could not be found. Oct 28 18:37:45.481062 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:37:45.483065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Returning 404 to user: Instance 5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:37:45.484513 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6c06776f-30b7-42f4-a14e-e4b081339791 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe" status: 404 len: 111 microversion: 2.1 time: 0.081993 Oct 28 18:37:45.485648 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2005/5642] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:45 2022] GET /compute/v2.1/servers/5f00edbb-0bea-4e24-9d98-cd8c51ca0ffe => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:37:45.747002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:45.756726 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d0c45a39-67bd-47c1-8a75-7cbeb63cb6f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1291 microversion: 2.1 time: 0.391878 Oct 28 18:37:45.763570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3638/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:45 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1291 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:45.953862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f2f785a5-38b9-4770-a3c7-3c424c9f1e2e req-4079be69-3d9f-4d36-a417-0069be8afe32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd32c27b-92bb-4507-84cf-f224740d9143", "name": "network-vif-plugged", "status": "completed", "tag": "508fbfa8-2871-4a2f-b9c8-13f38bbecff4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:45.976352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f2f785a5-38b9-4770-a3c7-3c424c9f1e2e req-4079be69-3d9f-4d36-a417-0069be8afe32 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:45.976968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f2f785a5-38b9-4770-a3c7-3c424c9f1e2e req-4079be69-3d9f-4d36-a417-0069be8afe32 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:45.977428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f2f785a5-38b9-4770-a3c7-3c424c9f1e2e req-4079be69-3d9f-4d36-a417-0069be8afe32 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:46.020563 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f2f785a5-38b9-4770-a3c7-3c424c9f1e2e req-4079be69-3d9f-4d36-a417-0069be8afe32 service nova] Creating event network-vif-plugged:508fbfa8-2871-4a2f-b9c8-13f38bbecff4 for instance cd32c27b-92bb-4507-84cf-f224740d9143 on n-h2-862404-2 Oct 28 18:37:46.035386 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f2f785a5-38b9-4770-a3c7-3c424c9f1e2e req-4079be69-3d9f-4d36-a417-0069be8afe32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085788 Oct 28 18:37:46.046944 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2006/5644] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:46.787334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:46.788779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:46.816291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:46.825030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:46.825770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:46.828686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:46.829412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:46.832413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:47.196236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:47.208847 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9a96ae2-bb03-4c59-a748-27f1a191a935 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1291 microversion: 2.1 time: 0.424729 Oct 28 18:37:47.213225 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3639/5645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:46 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1291 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:48.236230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:48.237556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:48.250797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:48.251301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:48.251748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:48.252492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:48.252955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:48.253388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:48.669389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:48.679963 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfc4301a-a229-4441-82a4-9b71dee2f4ef tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1471 microversion: 2.1 time: 0.448667 Oct 28 18:37:48.696663 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2007/5646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:48 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1471 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:48.842488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1509209482", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:48.938640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] validate_networks() for [('40558d36-80d4-459b-bebf-564251832359', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:37:50.382358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:37:50.383464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:37:50.383974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:37:50.384653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:37:50.385240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:37:50.402290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:50.404662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:50.405140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:50.405924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:50.406384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:50.420648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:50.452601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:37:50.468407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:37:50.506068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:37:50.513962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: f3c371a0-32e1-489d-86db-74dc34d3aec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:37:50.601585 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d0e5a77-6c3e-4612-b479-772e568fb4be tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763562 Oct 28 18:37:50.603168 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3640/5647] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:37:50.614288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-238690c8-7ff7-4a65-a75f-fa2f8da87b59 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:50.615422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-238690c8-7ff7-4a65-a75f-fa2f8da87b59 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: f3c371a0-32e1-489d-86db-74dc34d3aec1] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:50.668573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-238690c8-7ff7-4a65-a75f-fa2f8da87b59 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: f3c371a0-32e1-489d-86db-74dc34d3aec1] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:37:50.805480 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-238690c8-7ff7-4a65-a75f-fa2f8da87b59 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1" status: 204 len: 0 microversion: 2.1 time: 0.195066 Oct 28 18:37:50.809857 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2008/5648] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:37:50 2022] DELETE /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:37:50.826590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71a2dfa4-3987-43e1-8a27-df4f8a3d1b86 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:50.827484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71a2dfa4-3987-43e1-8a27-df4f8a3d1b86 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: f3c371a0-32e1-489d-86db-74dc34d3aec1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:50.864751 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-71a2dfa4-3987-43e1-8a27-df4f8a3d1b86 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71a2dfa4-3987-43e1-8a27-df4f8a3d1b86 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1 HTTP/1.1 Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f3c371a0-32e1-489d-86db-74dc34d3aec1'} Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2934, in _get_instance Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance f3c371a0-32e1-489d-86db-74dc34d3aec1 Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2946, in _get_instance Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:37:50.893192 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71a2dfa4-3987-43e1-8a27-df4f8a3d1b86 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:37:50.900550 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71a2dfa4-3987-43e1-8a27-df4f8a3d1b86 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1" status: 404 len: 111 microversion: 2.1 time: 0.084553 Oct 28 18:37:50.906705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3641/5649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:50 2022] GET /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:37:50.962197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:50.966192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:50.982868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:50.984879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:50.986638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:50.989806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:50.990796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:50.992292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:50.999010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-189706777", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "40558d36-80d4-459b-bebf-564251832359"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:51.090698 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e2f3f6fa-2849-4830-aace-0a3aaa13a8e7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action" status: 200 len: 24575 microversion: 2.1 time: 0.133280 Oct 28 18:37:51.100675 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2009/5650] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:37:50 2022] POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action => generated 24575 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:37:51.112413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] validate_networks() for [('40558d36-80d4-459b-bebf-564251832359', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:37:52.217429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:37:52.217941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:37:52.218977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:37:52.219573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:37:52.220046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:37:52.231424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:52.232069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:52.239363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:52.254837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:52.255736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:52.256387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:52.299949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:37:52.312764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:37:52.330625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:37:52.333447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:37:52.394820 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-88f5aa9b-d38c-4fb0-8c18-09d90a0431b6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400466 Oct 28 18:37:52.396995 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3642/5651] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:37:52.409555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-833a6e35-23ba-4473-aa84-907d8ef86f95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:52.410918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-833a6e35-23ba-4473-aa84-907d8ef86f95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:52.540672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-833a6e35-23ba-4473-aa84-907d8ef86f95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:52.552153 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-833a6e35-23ba-4473-aa84-907d8ef86f95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1220 microversion: 2.1 time: 0.147460 Oct 28 18:37:52.553472 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2010/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:52 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:53.580920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:53.583312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:53.604817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:53.605594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:53.608111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:53.609545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:53.610248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:53.610994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:53.802572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:53.813133 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b01925ef-7ca1-431d-9432-93f71ae2cd38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1272 microversion: 2.1 time: 0.238809 Oct 28 18:37:53.814666 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3643/5653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:53 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:54.849194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:54.850487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:54.858536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:54.859189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:54.860320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:54.861200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:54.861772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:54.862311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:55.009564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:55.024834 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-15685046-dac7-4047-bdbe-ed332ab34dba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1278 microversion: 2.1 time: 0.187018 Oct 28 18:37:55.026680 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2011/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:54 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:55.283726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fcd6ac0b-3836-4067-aae4-5668cb96e2f1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] Calling method '.version_select at 0x7f78dc9d0670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:55.322095 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fcd6ac0b-3836-4067-aae4-5668cb96e2f1 tempest-TestSecurityGroupsBasicOps-791738600 tempest-TestSecurityGroupsBasicOps-791738600-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1547122992" status: 202 len: 0 microversion: 2.1 time: 0.042764 Oct 28 18:37:55.322633 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3644/5655] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 18:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1547122992 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:37:56.049467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:56.050806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:56.068843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:56.069355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:56.069802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:56.070673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:56.071140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:56.071570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:56.493716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:56.504713 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-71cdb1bf-a896-4e2b-820a-aa7acc8fba4f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1320 microversion: 2.1 time: 0.459413 Oct 28 18:37:56.506167 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2012/5656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:56 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:57.547081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:57.550971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:57.592744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:57.595244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:57.601785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:57.603147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:57.604343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:57.605984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:57.681318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f4917bac-7157-463a-90d3-9282515354da req-ac78cda6-f492-459f-8662-fb3e33dd49e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c64bd4-4bba-4f15-be74-b59a7a93ff40", "tag": "f252a1be-f8e2-4205-9878-44efa43b2de4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:57.729919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f4917bac-7157-463a-90d3-9282515354da req-ac78cda6-f492-459f-8662-fb3e33dd49e8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:57.736987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f4917bac-7157-463a-90d3-9282515354da req-ac78cda6-f492-459f-8662-fb3e33dd49e8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:57.737637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f4917bac-7157-463a-90d3-9282515354da req-ac78cda6-f492-459f-8662-fb3e33dd49e8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:57.796451 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f4917bac-7157-463a-90d3-9282515354da req-ac78cda6-f492-459f-8662-fb3e33dd49e8 service nova] Creating event network-changed:f252a1be-f8e2-4205-9878-44efa43b2de4 for instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 on n-h1-862404-2 Oct 28 18:37:57.808398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f4917bac-7157-463a-90d3-9282515354da req-ac78cda6-f492-459f-8662-fb3e33dd49e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133883 Oct 28 18:37:57.812863 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2013/5657] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:58.663670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:58.683988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbc51b96-c7a2-4f17-9f76-5d596a4bb0bd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1320 microversion: 2.1 time: 1.156799 Oct 28 18:37:58.689476 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3645/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:57 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1320 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:59.713126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:59.726073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:37:59.737282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:59.741596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:59.742468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:59.745097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:59.748483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:59.749087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:00.256482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:00.267052 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e2e6fc1-f450-4e9b-a783-abf7a3b4b93a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1320 microversion: 2.1 time: 0.558924 Oct 28 18:38:00.271371 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2014/5659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:59 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1320 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:01.300509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:01.301731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:01.317680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:01.318508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:01.319131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:01.320089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:01.320729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:01.321358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:01.335143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:01.982389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:02.013598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-412d36c8-36b6-47d8-94ad-7af074909513 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1320 microversion: 2.1 time: 0.721242 Oct 28 18:38:02.017783 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3646/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:01 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1320 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:03.041122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:03.041753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:03.045197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:03.069443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:03.076892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:03.082483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:03.084463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:03.096047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:03.096581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:03.101410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=72 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:03.600682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:03.615677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b21ed75b-f656-4d45-a226-9aeb8e745a89 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1320 microversion: 2.1 time: 0.580216 Oct 28 18:38:03.622960 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2015/5661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:03 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1320 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:04.556023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a12be17b-0d02-42a9-8922-36c6e7c1a0d6 req-e74a657c-7c41-45dc-b987-4eae98be6ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c64bd4-4bba-4f15-be74-b59a7a93ff40", "name": "network-vif-plugged", "status": "completed", "tag": "f252a1be-f8e2-4205-9878-44efa43b2de4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:04.571894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:04.572962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:04.580066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a12be17b-0d02-42a9-8922-36c6e7c1a0d6 req-e74a657c-7c41-45dc-b987-4eae98be6ef9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:04.580656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a12be17b-0d02-42a9-8922-36c6e7c1a0d6 req-e74a657c-7c41-45dc-b987-4eae98be6ef9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:04.581238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a12be17b-0d02-42a9-8922-36c6e7c1a0d6 req-e74a657c-7c41-45dc-b987-4eae98be6ef9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:04.611478 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a12be17b-0d02-42a9-8922-36c6e7c1a0d6 req-e74a657c-7c41-45dc-b987-4eae98be6ef9 service nova] Creating event network-vif-plugged:f252a1be-f8e2-4205-9878-44efa43b2de4 for instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 on n-h1-862404-2 Oct 28 18:38:04.632108 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a12be17b-0d02-42a9-8922-36c6e7c1a0d6 req-e74a657c-7c41-45dc-b987-4eae98be6ef9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079661 Oct 28 18:38:04.633081 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3647/5662] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:38:04.652048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:04.652677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:04.678266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:04.678773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:04.679223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:04.682284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:04.682804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:04.683248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:05.040340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:05.054225 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-767555a0-2aac-4f01-907a-d5e1ed144683 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1320 microversion: 2.1 time: 0.404657 Oct 28 18:38:05.059900 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2016/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:04 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:06.080379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:06.080857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:06.096625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:06.098059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:06.098706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:06.099630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:06.103163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:06.103865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:06.742201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:06.757264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7454e1a-2882-4748-88a2-d49416cb0757 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1320 microversion: 2.1 time: 0.682441 Oct 28 18:38:06.757890 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3648/5664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:06 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1320 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:07.786809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:07.787631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:07.810108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:07.810776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:07.811985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:07.814208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:07.814807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:07.816105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:08.356301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:08.380191 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-77eb0cc3-8f73-4c61-98f7-afa49e952003 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1500 microversion: 2.1 time: 0.596784 Oct 28 18:38:08.381244 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2017/5665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:07 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1500 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:08.412804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:08.414098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:08.430854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:08.434508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:08.437445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:08.438937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:08.440101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:08.444026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:09.784402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:09.800228 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ae3ba26-aef7-4282-b872-59df2cac5e5e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1500 microversion: 2.1 time: 1.395940 Oct 28 18:38:09.804303 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3649/5666] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:08 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1500 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:09.831208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:09.832354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:09.840128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:09.842459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:09.843722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:09.844435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:09.845520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:09.846264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:09.846942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:09.898077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:38:10.049474 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-33229ec7-c578-4dce-8a19-772a51efba30 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 204 len: 0 microversion: 2.1 time: 0.220778 Oct 28 18:38:10.051757 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2018/5667] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:38:09 2022] DELETE /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:38:10.060175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:10.060815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:10.068924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:10.071113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:10.073390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:10.074162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:10.076755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:10.088378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:10.088928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:10.572533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:10.582104 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b0fb557-9b38-43eb-9149-bf82228190b9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1506 microversion: 2.1 time: 0.525915 Oct 28 18:38:10.601898 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3650/5668] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:10 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:11.610626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:11.611438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:11.633980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:11.634407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:11.634859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:11.635589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:11.636081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:11.636517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:12.622402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:12.640219 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-418a4202-24f3-418c-a3b6-53e838cf5f31 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1506 microversion: 2.1 time: 1.034238 Oct 28 18:38:12.641919 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2019/5669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:11 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1506 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:13.666007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:13.668347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:13.682333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:13.693563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:13.694051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:13.698680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:13.699179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:13.701757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:13.868851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-96d10240-0e0a-4171-91e3-3ec4883b9404 req-690290fd-b814-4ead-9f33-69c7698b4e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c64bd4-4bba-4f15-be74-b59a7a93ff40", "name": "network-vif-deleted", "tag": "f252a1be-f8e2-4205-9878-44efa43b2de4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:13.896859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-96d10240-0e0a-4171-91e3-3ec4883b9404 req-690290fd-b814-4ead-9f33-69c7698b4e90 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:13.901776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-96d10240-0e0a-4171-91e3-3ec4883b9404 req-690290fd-b814-4ead-9f33-69c7698b4e90 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:13.908465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-96d10240-0e0a-4171-91e3-3ec4883b9404 req-690290fd-b814-4ead-9f33-69c7698b4e90 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:13.947287 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-96d10240-0e0a-4171-91e3-3ec4883b9404 req-690290fd-b814-4ead-9f33-69c7698b4e90 service nova] Creating event network-vif-deleted:f252a1be-f8e2-4205-9878-44efa43b2de4 for instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 on n-h1-862404-2 Oct 28 18:38:13.963031 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-96d10240-0e0a-4171-91e3-3ec4883b9404 req-690290fd-b814-4ead-9f33-69c7698b4e90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106794 Oct 28 18:38:13.968155 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2020/5670] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:14.058514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:14.082939 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ec210f3-3fd0-4ab8-a653-e8548350b774 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 200 len: 1464 microversion: 2.1 time: 0.421175 Oct 28 18:38:14.088631 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3651/5671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:13 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 1464 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:15.117678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:15.118392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:15.127024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:15.127661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:15.128245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:15.129876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:15.130751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:15.131843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:15.155891 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 HTTP/1.1 Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '26c64bd4-4bba-4f15-be74-b59a7a93ff40'} Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:15.158738 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:15.166595 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:15.166595 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:15.166595 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:38:15.166595 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:38:15.166595 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:38:15.166595 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:15.172734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:38:15.178937 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45fa928a-0a2d-4e9a-96a0-a77cbb1edd01 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 404 len: 111 microversion: 2.1 time: 0.069227 Oct 28 18:38:15.185270 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2021/5672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:15 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:38:15.199330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a5d6be5-9c9e-4d65-8c57-5e0f65613b20 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: .version_select at 0x7f78dc993550>, body: {"keypair": {"name": "tempest-key-41762106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHURNhbc1k9RM+3PMYFZxsXRnFXJ8JaCs026fscYCcJNcR6MPvArepnMNqVJcTjnYOowjBFUGvquBcBtjlCFkB+WWIY57GXPH0VHRY/8XsY7pTppB9ZZ5zAHlYhWE7ZboQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:15.227459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2a5d6be5-9c9e-4d65-8c57-5e0f65613b20 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:38:15.241020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2a5d6be5-9c9e-4d65-8c57-5e0f65613b20 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:38:15.302151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a5d6be5-9c9e-4d65-8c57-5e0f65613b20 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 380 microversion: 2.1 time: 0.106577 Oct 28 18:38:15.303021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3652/5673] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:38:15 2022] POST /compute/v2.1/os-keypairs => generated 380 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:15.317267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9889e4c5-863f-4950-b2c9-a1ddcbc9084a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '.version_select at 0x7f78dd67f820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:15.322534 n-d-862404-2 devstack@n-api.service[120679]: WARNING oslo_db.sqlalchemy.utils [None req-9889e4c5-863f-4950-b2c9-a1ddcbc9084a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 18:38:15.340480 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9889e4c5-863f-4950-b2c9-a1ddcbc9084a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 349 microversion: 2.1 time: 0.030586 Oct 28 18:38:15.353585 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2022/5674] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:38:15 2022] GET /compute/v2.1/os-keypairs => generated 349 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:15.656219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1821518186", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-key-41762106", "networks": [{"uuid": "40558d36-80d4-459b-bebf-564251832359"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:15.791753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] validate_networks() for [('40558d36-80d4-459b-bebf-564251832359', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:38:17.614000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:38:17.618430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:38:17.618971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:38:17.619399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:38:17.620062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:38:17.642029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:17.642713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:17.643164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:17.644251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:17.648642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:17.649170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:17.693964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:38:17.708591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:38:17.747184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:38:17.755143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:38:17.896870 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ce5f16f-46a7-4253-bfc0-3c5ec8368216 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.247108 Oct 28 18:38:17.900625 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3653/5675] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:38:17.910161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b6c9ceab-e42d-4100-b07f-82108eaaf2c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:17.911804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b6c9ceab-e42d-4100-b07f-82108eaaf2c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:18.249968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b6c9ceab-e42d-4100-b07f-82108eaaf2c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:18.259927 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b6c9ceab-e42d-4100-b07f-82108eaaf2c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1227 microversion: 2.1 time: 0.355029 Oct 28 18:38:18.260531 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2023/5676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:17 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1227 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:19.291306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:19.292257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:19.315411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:19.316331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:19.316931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:19.332898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:19.334139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:19.335304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:19.470819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:19.489789 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39ffe005-bedc-4fa7-8ed4-fa13c6d89b71 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1279 microversion: 2.1 time: 0.209966 Oct 28 18:38:19.492192 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3654/5677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:19 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1279 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:20.521405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:20.523056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:20.536518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:20.537511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:20.537969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:20.538707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:20.543366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:20.543922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:21.414482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:21.427641 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8871f627-0fac-443c-8e9f-1b2680f993ea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1285 microversion: 2.1 time: 0.910034 Oct 28 18:38:21.429462 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2024/5678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:20 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1285 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:21.519605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:21.520339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:21.531266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:21.531764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:21.532226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:21.532945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:21.533398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:21.533827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:21.880619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-19525739-d3d5-46ec-8ed7-e2e55cda74fd tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1832 microversion: 2.1 time: 0.364751 Oct 28 18:38:21.895856 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3655/5679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:21 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1832 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:22.208528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:22.209346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:22.221418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:22.223038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:22.223803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:22.224490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:22.224960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:22.225625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:22.451675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:22.452505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:22.461636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:22.465990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:22.468254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:22.469337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:22.476387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:22.477397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:22.644331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:22.658080 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4545887-a2dc-4162-b22b-58a041cc178f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1285 microversion: 2.1 time: 0.209249 Oct 28 18:38:22.659113 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3656/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:22 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:22.966922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:22.975170 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b2351be9-fa81-4cf1-9fac-e1dcff84c66e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1681 microversion: 2.1 time: 1.067837 Oct 28 18:38:22.975773 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2025/5681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:21 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1681 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:23.140337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:23.143020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:23.180666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.184708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.187129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.188971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.189675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.193707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.284530 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-845d435b-5fe3-42c9-93a0-c26492b1f82a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action" status: 200 len: 32650 microversion: 2.1 time: 0.147761 Oct 28 18:38:23.291548 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3657/5682] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:38:23 2022] POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action => generated 32650 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:38:23.476664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:23.478056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:23.516460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.517440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.519910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.521635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.525346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.526356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.587557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2843f2074b4045eaba15b9ca73dcb9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc95c6d0ca184f2fa0d94c9d8ce5c3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:23.588707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] flavor_id is None. Assuming migration. {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 28 18:38:23.589386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:38:23.685765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:23.687054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:23.711910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.712253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.712997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.714768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.715446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.716336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.826417 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b436db03-80b5-4850-a209-44a2ba9b0ab4 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action" status: 202 len: 0 microversion: 2.1 time: 0.354104 Oct 28 18:38:23.828185 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2026/5683] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:38:23 2022] POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:38:23.839652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:23.846893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:23.855414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.859134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.861786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.866943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.868037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.869796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.942520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:23.953419 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f77420f8-cfeb-4691-a994-688602c8c578 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1285 microversion: 2.1 time: 0.272987 Oct 28 18:38:23.956686 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3658/5684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:23 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1285 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:24.478512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:24.491579 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bbd4ff62-28e3-4b3c-8311-c107e0b86263 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1690 microversion: 2.1 time: 0.658667 Oct 28 18:38:24.504010 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2027/5685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:23 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1690 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:24.985441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:24.986131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:25.006057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:25.006564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:25.007003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:25.011009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:25.011721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:25.012365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:25.522769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:25.523513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:25.531277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:25.532007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:25.532791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:25.535368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:25.537317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:25.538746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:26.195243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:26.211971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:26.226299 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c12384a-6f89-4791-9bf2-7e34b9143fc7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 1.241419 Oct 28 18:38:26.227164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3659/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:24 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:26.227298 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f47cbae7-952a-41cd-86a9-801d80e00b83 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1690 microversion: 2.1 time: 0.709416 Oct 28 18:38:26.238724 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2028/5687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:25 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1690 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:27.252454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:27.254890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:27.269472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.273183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:27.273881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:27.274117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.275060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.276683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.278767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.279475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.300960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.301672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.302140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.302891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.303360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.308995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.672105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:27.731955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:27.867436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:27.876023 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aca33a43-c6ef-4ef6-88f8-bcd557075279 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1690 microversion: 2.1 time: 0.611937 Oct 28 18:38:27.891284 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2029/5688] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:27 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1690 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:27.891284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-560813948", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "fe17ab76-3595-4089-8cd2-fc9bf2e93a10"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:27.937915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:27.960257 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c14d080b-afe9-4e87-9ad9-a8d4b394738f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 0.710433 Oct 28 18:38:27.965709 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3660/5689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:27 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:28.011571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] validate_networks() for [('fe17ab76-3595-4089-8cd2-fc9bf2e93a10', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:38:28.255124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:28.906691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:28.907319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:28.927452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:28.943455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:28.959053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:28.960669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:28.962798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:28.964951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:29.381134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:29.423971 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe0e00d5-24de-48e5-9651-2bc3aca3e5f2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1690 microversion: 2.1 time: 0.525113 Oct 28 18:38:29.425314 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3661/5690] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:28 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1690 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:29.439530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:29.463626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:29.490870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:29.491381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:29.491878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:29.496791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:29.497953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:29.498479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:29.763886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:29.788322 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-267b743a-7c6d-4e13-928d-276d8e4c0d5d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 0.355515 Oct 28 18:38:29.789377 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3662/5691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:29 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:29.796005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fce716fb-fca2-4812-9297-b9e8db2cf9a8 req-5d5a770d-990e-4540-9d76-813177cda7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb88800-02c5-4f93-a250-b10d8f1ecf5d", "tag": "e1aae3dc-14c3-4283-b7ae-02af731a88f1"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:29.808380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fce716fb-fca2-4812-9297-b9e8db2cf9a8 req-5d5a770d-990e-4540-9d76-813177cda7e5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:29.809147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fce716fb-fca2-4812-9297-b9e8db2cf9a8 req-5d5a770d-990e-4540-9d76-813177cda7e5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:29.809593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fce716fb-fca2-4812-9297-b9e8db2cf9a8 req-5d5a770d-990e-4540-9d76-813177cda7e5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:29.852987 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fce716fb-fca2-4812-9297-b9e8db2cf9a8 req-5d5a770d-990e-4540-9d76-813177cda7e5 service nova] Creating event network-changed:e1aae3dc-14c3-4283-b7ae-02af731a88f1 for instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d on n-h1-862404-2 Oct 28 18:38:29.867613 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fce716fb-fca2-4812-9297-b9e8db2cf9a8 req-5d5a770d-990e-4540-9d76-813177cda7e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075450 Oct 28 18:38:29.871808 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3663/5692] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:29.906029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:38:29.906762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:38:29.907369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:38:29.907946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:38:29.908480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:38:29.924981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:29.927550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:29.928837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:29.930898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:29.934029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:29.936421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:29.982785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Getting quotas for project 5a8d87973ad7418cb0a8fdf3bed54f86. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:38:29.990209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Getting quotas for user ca8dce1a0fdc46aa867d01c601880762 and project 5a8d87973ad7418cb0a8fdf3bed54f86. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:38:30.008057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:38:30.011640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:38:30.093053 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1bc05cfc-035c-49ba-b26b-0593cb950fea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.211600 Oct 28 18:38:30.106602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dde5070a-0c51-47f7-b75e-3dd5e444130a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:30.107327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dde5070a-0c51-47f7-b75e-3dd5e444130a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:30.112734 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2030/5693] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:38:30.250924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dde5070a-0c51-47f7-b75e-3dd5e444130a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:30.275203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dde5070a-0c51-47f7-b75e-3dd5e444130a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1213 microversion: 2.1 time: 0.170699 Oct 28 18:38:30.277462 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3664/5694] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:30 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:30.453619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:30.454446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:30.468389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.469165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.470008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.470971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.472223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.472854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.795706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:30.813550 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f490c1da-3f35-4719-89c0-19cfb96d481e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1695 microversion: 2.1 time: 0.367221 Oct 28 18:38:30.816123 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2031/5695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:30 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1695 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:30.820359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:30.821324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:30.836094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.838719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.839288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.841329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.841949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.842537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.305620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:31.307368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:31.347038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:31.350121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:31.351736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.352928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:31.353842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:31.354533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.360613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:31.382568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:31.386267 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9789d89b-ca1c-4686-884a-0fc3e74a1a35 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 0.575403 Oct 28 18:38:31.397614 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3665/5696] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:30 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:31.479121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:31.498495 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-509faf7d-625c-47e0-8318-9c0b30c08db8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1209 microversion: 2.1 time: 0.198663 Oct 28 18:38:31.499717 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2032/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:31 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1209 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:31.838620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:31.839365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:31.848042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:31.851284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:31.851746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.852522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:31.852978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:31.853712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.892556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=94 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:32.415107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:32.416416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:32.429813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:32.432008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:32.434432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:32.437767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:32.438304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:32.438754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:32.751690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:32.761733 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3cdc9ea7-019e-47ba-bddd-d649ce4e46f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 0.350889 Oct 28 18:38:32.766152 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2033/5698] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:32 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:32.782564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:32.783407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:32.807667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:32.810735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:32.812079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:32.813662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:32.814973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:32.816295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:32.912555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:32.919944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:32.936376 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-02b2c0ef-b5cc-459e-b4b2-97b0086352f9 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1271 microversion: 2.1 time: 0.168549 Oct 28 18:38:32.937708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d4c6f4fe-fbd8-4311-88ea-e257deeb079e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1695 microversion: 2.1 time: 1.103406 Oct 28 18:38:32.957400 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2034/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:32 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:32.965423 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3666/5700] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:31 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1695 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:33.794191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:33.794820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:33.811768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:33.812194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:33.812648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:33.813429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:33.816549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:33.817023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:33.965034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:33.966268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:33.977489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:33.988687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:33.989158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:33.989923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:33.990392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:33.990840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:34.343594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:34.364183 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d657ecc4-d786-4521-bd9c-a90929114d67 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1695 microversion: 2.1 time: 0.399053 Oct 28 18:38:34.379843 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3667/5701] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:33 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1695 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:34.386465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:34.387664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:34.403788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:34.406204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:34.406666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:34.408311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:34.409350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:34.410861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:34.559198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:34.572230 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-caf977cb-6e31-44cf-90f9-83f30d1cc347 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 0.780800 Oct 28 18:38:34.574890 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2035/5702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:33 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:34.860186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:34.875504 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2df0e57c-3890-46ff-ae53-cc1cb339e7a8 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1313 microversion: 2.1 time: 0.506159 Oct 28 18:38:34.876701 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3668/5703] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:34 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:35.394677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:35.395296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:35.411267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.411766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.412227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:35.412948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.418300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.418982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:35.599237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:35.600546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:35.609684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.610672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.611333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:35.612597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.613324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.613957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:35.805462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:35.814683 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbe128a5-247f-48e0-8e29-5a5d2dcd6c8d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1695 microversion: 2.1 time: 0.425158 Oct 28 18:38:35.831592 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2036/5704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:35 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1695 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:35.849490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:35.859777 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b12d68ad-ed6c-4836-a801-b120a9c4660f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 0.265806 Oct 28 18:38:35.860764 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3669/5705] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:35 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:35.902498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:35.903005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:35.911224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.914562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.915025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:35.915759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.916678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.917492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:35.970512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1331c596-a919-4ac0-99bf-19ecf9ad7254 req-5569817e-9fcc-4d45-94c2-e1223fe37911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309e2abe-ff01-4393-950d-67c98e642dcf", "tag": "4e071330-f2e9-4283-9616-b3349107d69c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:35.987033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1331c596-a919-4ac0-99bf-19ecf9ad7254 req-5569817e-9fcc-4d45-94c2-e1223fe37911 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.988134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1331c596-a919-4ac0-99bf-19ecf9ad7254 req-5569817e-9fcc-4d45-94c2-e1223fe37911 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.988752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1331c596-a919-4ac0-99bf-19ecf9ad7254 req-5569817e-9fcc-4d45-94c2-e1223fe37911 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:36.006383 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1331c596-a919-4ac0-99bf-19ecf9ad7254 req-5569817e-9fcc-4d45-94c2-e1223fe37911 service nova] Creating event network-changed:4e071330-f2e9-4283-9616-b3349107d69c for instance 309e2abe-ff01-4393-950d-67c98e642dcf on n-h2-862404-2 Oct 28 18:38:36.019375 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1331c596-a919-4ac0-99bf-19ecf9ad7254 req-5569817e-9fcc-4d45-94c2-e1223fe37911 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054654 Oct 28 18:38:36.020552 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3670/5706] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:36.162165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:36.185960 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-175abb88-68f3-4fd9-8b0a-c1a535374b8a tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1313 microversion: 2.1 time: 0.286888 Oct 28 18:38:36.187197 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2037/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:35 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:36.665734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-48b2d751-e643-4a2c-965b-f365561c0296 req-9410a836-0767-45a0-8f22-537b79eee341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb88800-02c5-4f93-a250-b10d8f1ecf5d", "name": "network-vif-plugged", "status": "completed", "tag": "e1aae3dc-14c3-4283-b7ae-02af731a88f1"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:36.690547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-48b2d751-e643-4a2c-965b-f365561c0296 req-9410a836-0767-45a0-8f22-537b79eee341 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:36.693548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-48b2d751-e643-4a2c-965b-f365561c0296 req-9410a836-0767-45a0-8f22-537b79eee341 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:36.695401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-48b2d751-e643-4a2c-965b-f365561c0296 req-9410a836-0767-45a0-8f22-537b79eee341 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:36.727648 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-48b2d751-e643-4a2c-965b-f365561c0296 req-9410a836-0767-45a0-8f22-537b79eee341 service nova] Creating event network-vif-plugged:e1aae3dc-14c3-4283-b7ae-02af731a88f1 for instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d on n-h1-862404-2 Oct 28 18:38:36.735452 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-48b2d751-e643-4a2c-965b-f365561c0296 req-9410a836-0767-45a0-8f22-537b79eee341 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073178 Oct 28 18:38:36.737369 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3671/5708] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:36.841204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:36.842006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:36.850137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:36.851254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:36.852191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:36.853171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:36.853869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:36.855103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:36.888529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:36.889576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:36.900416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:36.900921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:36.901422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:36.902142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:36.902852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:36.903405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:37.145598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:37.160709 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-715fc0e0-cd07-4ab0-ba19-0e615c2f9634 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1695 microversion: 2.1 time: 0.321876 Oct 28 18:38:37.172944 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2038/5709] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:36 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1695 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:37.197794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:37.209359 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e7b1e24-83ea-49f0-aa99-46d84d6fc0bf tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 0.328818 Oct 28 18:38:37.210593 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3672/5710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:36 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:37.224132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:37.225454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:37.235368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:37.236446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:37.238082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:37.239410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:37.240284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:37.241731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:37.483184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:37.497979 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c3b08fc2-ddda-436b-bbec-b84ce8d3382f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1313 microversion: 2.1 time: 0.278748 Oct 28 18:38:37.498860 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2039/5711] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:37 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:38.189063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:38.189679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:38.222954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.223517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.223940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.224681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.225163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.225588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.234535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:38.235154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:38.247989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.248863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.250193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.253492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.257066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.257793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.561368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:38.574927 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-665a9993-4cbb-4dff-b25b-a791ee32579d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1327 microversion: 2.1 time: 0.342787 Oct 28 18:38:38.577643 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2040/5712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:38 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1327 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:38.590761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:38.593868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:38.603169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.604853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.605708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.606674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.608218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.608873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.837073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:38.846334 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfcf5adc-d5fa-47ac-ab39-19f70b36456c tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1313 microversion: 2.1 time: 0.266916 Oct 28 18:38:38.863460 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2041/5713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:38 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:38.900593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:38.914892 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e50509e-9751-40a4-9682-d16660286bf7 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1695 microversion: 2.1 time: 0.728796 Oct 28 18:38:38.918444 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3673/5714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:38 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1695 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:39.601547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:39.602811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:39.616287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:39.617776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:39.618561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:39.619489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:39.620812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:39.621433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:39.870486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:39.871778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:39.886210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:39.887382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:39.888427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:39.892583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:39.894890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:39.895601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:39.930172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:39.942137 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1472a01-6a86-486f-a5eb-7a0689a64df1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1508 microversion: 2.1 time: 0.343628 Oct 28 18:38:39.945897 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2042/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:39 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1508 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:39.953943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:39.959131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:39.974475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:39.975512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:39.979023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:39.979777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:39.981544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:39.986664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:39.987746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:39.988239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:40.051739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:40.235666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:40.244253 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86276862-7171-477e-a983-a818b82d1fc4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1313 microversion: 2.1 time: 0.377998 Oct 28 18:38:40.249294 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3674/5716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:39 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:40.255566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:40.256162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:40.276267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:40.277657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:40.279591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:40.280419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:40.281507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:40.283087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:40.285299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:40.287557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:40.459089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:40.476326 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3b8c0737-35b7-4298-b78e-cc0d1cfbdb77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1695 microversion: 2.1 time: 0.525254 Oct 28 18:38:40.489095 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2043/5717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:39 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1695 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:41.068564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:41.107040 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc2d0476-5473-47cf-afd0-4809cb8321bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1508 microversion: 2.1 time: 0.851786 Oct 28 18:38:41.107838 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3675/5718] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:40 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1508 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:41.136704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:41.137502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:41.160911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:41.163023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:41.168001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:41.170864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:41.171472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:41.173579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:41.234970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:38:41.272160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:41.275149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:41.289117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:41.291676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:41.293481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:41.294464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:41.296113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:41.298146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:41.431298 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bdac3064-db3d-4fe0-affa-1891b0af5c9c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 204 len: 0 microversion: 2.1 time: 0.300656 Oct 28 18:38:41.437191 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2044/5719] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:38:41 2022] DELETE /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:38:41.459504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:41.465049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:41.480969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:41.482392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:41.483727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:41.485320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:41.492167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:41.492629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:41.850709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:41.860512 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c6d75a8c-ce91-49bb-bcba-87ce455e5bde tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1514 microversion: 2.1 time: 0.420618 Oct 28 18:38:41.861738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:41.863147 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2045/5720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:41 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1514 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:41.876286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:41.876914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:41.878389 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ff4d3c6-a224-4819-b67c-6e3a665e4bae tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1313 microversion: 2.1 time: 0.613379 Oct 28 18:38:41.885257 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3676/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:41 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:41.894356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:41.895030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:41.895634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:41.897852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:41.898450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:41.900060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.104820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ed8b4e65-0859-4840-9caa-c667fc1ec14c req-57595fce-ad79-483b-850c-d748309b107d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309e2abe-ff01-4393-950d-67c98e642dcf", "name": "network-vif-plugged", "status": "completed", "tag": "4e071330-f2e9-4283-9616-b3349107d69c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:42.129041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed8b4e65-0859-4840-9caa-c667fc1ec14c req-57595fce-ad79-483b-850c-d748309b107d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:42.129611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed8b4e65-0859-4840-9caa-c667fc1ec14c req-57595fce-ad79-483b-850c-d748309b107d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:42.131423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ed8b4e65-0859-4840-9caa-c667fc1ec14c req-57595fce-ad79-483b-850c-d748309b107d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.165526 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ed8b4e65-0859-4840-9caa-c667fc1ec14c req-57595fce-ad79-483b-850c-d748309b107d service nova] Creating event network-vif-plugged:4e071330-f2e9-4283-9616-b3349107d69c for instance 309e2abe-ff01-4393-950d-67c98e642dcf on n-h2-862404-2 Oct 28 18:38:42.171972 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ed8b4e65-0859-4840-9caa-c667fc1ec14c req-57595fce-ad79-483b-850c-d748309b107d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072802 Oct 28 18:38:42.175613 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3677/5722] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:42.590710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-defc49fd-0b5f-461b-bb0b-757a8f3d06c0 req-46a7faf5-5437-4846-b14e-518f43c8b1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "name": "network-vif-unplugged", "status": "completed", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:42.611008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-defc49fd-0b5f-461b-bb0b-757a8f3d06c0 req-46a7faf5-5437-4846-b14e-518f43c8b1e6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:42.612742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-defc49fd-0b5f-461b-bb0b-757a8f3d06c0 req-46a7faf5-5437-4846-b14e-518f43c8b1e6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:42.613882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-defc49fd-0b5f-461b-bb0b-757a8f3d06c0 req-46a7faf5-5437-4846-b14e-518f43c8b1e6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.633408 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-defc49fd-0b5f-461b-bb0b-757a8f3d06c0 req-46a7faf5-5437-4846-b14e-518f43c8b1e6 service nova] Creating event network-vif-unplugged:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h2-862404-2 Oct 28 18:38:42.642509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-defc49fd-0b5f-461b-bb0b-757a8f3d06c0 req-46a7faf5-5437-4846-b14e-518f43c8b1e6 service nova] Instance e7559170-4309-45f7-bfbe-b0a65422abf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:38:42.669647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-defc49fd-0b5f-461b-bb0b-757a8f3d06c0 req-46a7faf5-5437-4846-b14e-518f43c8b1e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076588 Oct 28 18:38:42.672122 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3678/5723] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:42.709909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:42.718355 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-471b37a3-1d87-4fe5-99b8-61da71aa20b3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1694 microversion: 2.1 time: 0.852773 Oct 28 18:38:42.732280 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2046/5724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:41 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1694 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:42.889222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:42.890545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:42.897556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:42.898828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:42.899498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.900435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:42.901128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:42.901775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.911412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:42.913774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:42.927543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:42.942482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:42.944154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.946849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:42.952502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:42.953242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.983839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:43.267376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:43.288245 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bf1f2a19-0429-4586-af4e-c7dedbceb1ea tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1313 microversion: 2.1 time: 0.380648 Oct 28 18:38:43.305841 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2047/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:42 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:43.678451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5de86274-432c-4e8e-88a9-0acc76be3d87 req-5381c5ad-624e-44a7-8de9-5fccaf202014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb88800-02c5-4f93-a250-b10d8f1ecf5d", "name": "network-vif-deleted", "tag": "e1aae3dc-14c3-4283-b7ae-02af731a88f1"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:43.730076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5de86274-432c-4e8e-88a9-0acc76be3d87 req-5381c5ad-624e-44a7-8de9-5fccaf202014 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:43.732528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5de86274-432c-4e8e-88a9-0acc76be3d87 req-5381c5ad-624e-44a7-8de9-5fccaf202014 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:43.733625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5de86274-432c-4e8e-88a9-0acc76be3d87 req-5381c5ad-624e-44a7-8de9-5fccaf202014 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:43.769881 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5de86274-432c-4e8e-88a9-0acc76be3d87 req-5381c5ad-624e-44a7-8de9-5fccaf202014 service nova] Creating event network-vif-deleted:e1aae3dc-14c3-4283-b7ae-02af731a88f1 for instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d on n-h1-862404-2 Oct 28 18:38:43.783255 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5de86274-432c-4e8e-88a9-0acc76be3d87 req-5381c5ad-624e-44a7-8de9-5fccaf202014 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110643 Oct 28 18:38:43.789115 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2048/5726] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:43.807007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:43.811283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:43.828051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:43.829563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:43.833634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:43.836898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:43.837702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:43.839956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:44.137394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:44.152825 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08f0d623-088d-41ac-ad06-a98ef618cfe2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1694 microversion: 2.1 time: 0.359626 Oct 28 18:38:44.163850 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2049/5727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:43 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1694 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:44.164133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:44.171416 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fca5bedb-c956-4416-a6df-802073450702 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 200 len: 1514 microversion: 2.1 time: 1.289140 Oct 28 18:38:44.178011 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3679/5728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:42 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 1514 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:44.317608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:44.320195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:44.336070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:44.340768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:44.341454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:44.342440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:44.343549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:44.344108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:44.699540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:44.717669 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f5734afc-61e7-4d94-91b9-8126e5392ad4 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1497 microversion: 2.1 time: 0.408463 Oct 28 18:38:44.720935 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2050/5729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:44 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1497 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:45.090844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2f8c4a2c-6770-49f0-844d-b23ceb8f4403 req-f6fe597b-605c-4bd3-b7d1-ac9eb6f291ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:45.128802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2f8c4a2c-6770-49f0-844d-b23ceb8f4403 req-f6fe597b-605c-4bd3-b7d1-ac9eb6f291ed service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.129764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2f8c4a2c-6770-49f0-844d-b23ceb8f4403 req-f6fe597b-605c-4bd3-b7d1-ac9eb6f291ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.130299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2f8c4a2c-6770-49f0-844d-b23ceb8f4403 req-f6fe597b-605c-4bd3-b7d1-ac9eb6f291ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.154640 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2f8c4a2c-6770-49f0-844d-b23ceb8f4403 req-f6fe597b-605c-4bd3-b7d1-ac9eb6f291ed service nova] Creating event network-changed:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h2-862404-2 Oct 28 18:38:45.163210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-2f8c4a2c-6770-49f0-844d-b23ceb8f4403 req-f6fe597b-605c-4bd3-b7d1-ac9eb6f291ed service nova] Instance e7559170-4309-45f7-bfbe-b0a65422abf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:38:45.180316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:45.181580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:45.202438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.205951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.206852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.209016 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2f8c4a2c-6770-49f0-844d-b23ceb8f4403 req-f6fe597b-605c-4bd3-b7d1-ac9eb6f291ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123060 Oct 28 18:38:45.211617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.212291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.214406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.215139 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3680/5730] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:45.229292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:45.241063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:45.265634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.266213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.266671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.267411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.267951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.268997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.298928 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d HTTP/1.1 Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0fb88800-02c5-4f93-a250-b10d8f1ecf5d'} Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:38:45.301195 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:45.305054 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:45.305054 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:45.305054 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:38:45.305054 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:38:45.305054 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:38:45.305054 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:38:45.305054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:38:45.307681 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6911ffd2-38e3-4d10-8ea9-cefab07201fc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 404 len: 111 microversion: 2.1 time: 0.079890 Oct 28 18:38:45.311578 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3681/5731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:45 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:38:45.318324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-375c4bb5-c1c5-488d-a463-9d8f305c2b9d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '.version_select at 0x7f78dc969430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:45.343020 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-375c4bb5-c1c5-488d-a463-9d8f305c2b9d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-41762106" status: 202 len: 0 microversion: 2.1 time: 0.030091 Oct 28 18:38:45.343993 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3682/5732] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 18:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-41762106 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:38:45.509001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1407460193", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "40558d36-80d4-459b-bebf-564251832359"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:45.638179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] validate_networks() for [('40558d36-80d4-459b-bebf-564251832359', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:38:45.755908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:45.766971 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-040e920f-b51d-4a71-894f-4dd8228e7a8a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1694 microversion: 2.1 time: 0.592767 Oct 28 18:38:45.780211 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2051/5733] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:45 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1694 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:45.786330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:45.786843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:45.803834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.804423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.804863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.805581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.806045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.806476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.853876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:38:46.055748 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b16d0cdb-2404-4d3c-9366-5d5951b2d5bb tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "DELETE /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 204 len: 0 microversion: 2.1 time: 0.274099 Oct 28 18:38:46.059127 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2052/5734] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:38:45 2022] DELETE /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:38:46.071126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:46.081537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:46.093050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:46.093812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:46.095448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:46.099475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:46.100213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:46.101901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:46.501093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:38:46.501552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:38:46.501971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:38:46.502969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:38:46.503726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:38:46.521211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:46.522490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:46.522926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:46.524204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:46.524959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:46.525752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:46.574043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:38:46.580150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:38:46.602358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:38:46.603236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:46.605743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:38:46.613938 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e079cbdf-7655-4dc0-bcce-cbe4148f93d6 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1503 microversion: 2.1 time: 0.550311 Oct 28 18:38:46.614552 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2053/5735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:46 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1503 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:46.670823 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-456c9374-9d90-4d8f-a849-c6fe7c64c9ff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167943 Oct 28 18:38:46.686107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-668799ba-d9bc-4011-b172-37f431713207 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:46.687119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-668799ba-d9bc-4011-b172-37f431713207 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:46.691630 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3683/5736] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:38:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:38:46.793966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:46.794819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:46.802886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-668799ba-d9bc-4011-b172-37f431713207 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:46.810774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:46.812696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:46.814117 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-668799ba-d9bc-4011-b172-37f431713207 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1209 microversion: 2.1 time: 0.133171 Oct 28 18:38:46.815952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:46.817051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:46.817165 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2054/5737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:46 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:46.818156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:46.819351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:47.140380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:47.151121 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44d7b1fa-5559-419f-b7f9-0ce5251cd7b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1694 microversion: 2.1 time: 0.364148 Oct 28 18:38:47.168405 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3684/5738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:46 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1694 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:47.638616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:47.639867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:47.664329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:47.666768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:47.671709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:47.672884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:47.673550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:47.674714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:47.843483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:47.844939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:47.855187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:47.855687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:47.856153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:47.856866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:47.857328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:47.857758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:47.967444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:47.983875 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-402ade3e-3c5e-4a2e-bc13-939ac202f96f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1205 microversion: 2.1 time: 0.148496 Oct 28 18:38:48.001705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3685/5739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:47 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1205 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:48.078281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:48.088339 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a150bf49-e3ef-4364-b436-17684a2aa041 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1503 microversion: 2.1 time: 0.453964 Oct 28 18:38:48.089377 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2055/5740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:47 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1503 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:48.179914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:48.181015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:48.187319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:48.188039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:48.188643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:48.189508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:48.190692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:48.191312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:48.368609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6a102b43-f6c1-414f-bc20-abaeb26ccea6 req-6f561728-14c8-4147-a5be-56cb45e5ae70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309e2abe-ff01-4393-950d-67c98e642dcf", "name": "network-vif-deleted", "tag": "4e071330-f2e9-4283-9616-b3349107d69c"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:48.391906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a102b43-f6c1-414f-bc20-abaeb26ccea6 req-6f561728-14c8-4147-a5be-56cb45e5ae70 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:48.392307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a102b43-f6c1-414f-bc20-abaeb26ccea6 req-6f561728-14c8-4147-a5be-56cb45e5ae70 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:48.393934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a102b43-f6c1-414f-bc20-abaeb26ccea6 req-6f561728-14c8-4147-a5be-56cb45e5ae70 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:48.422695 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6a102b43-f6c1-414f-bc20-abaeb26ccea6 req-6f561728-14c8-4147-a5be-56cb45e5ae70 service nova] Creating event network-vif-deleted:4e071330-f2e9-4283-9616-b3349107d69c for instance 309e2abe-ff01-4393-950d-67c98e642dcf on n-h2-862404-2 Oct 28 18:38:48.432024 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6a102b43-f6c1-414f-bc20-abaeb26ccea6 req-6f561728-14c8-4147-a5be-56cb45e5ae70 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067569 Oct 28 18:38:48.433796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2056/5741] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:38:48.487053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:48.498698 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e117135e-2f9c-41d5-98a4-aaea49caeba3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1692 microversion: 2.1 time: 0.324037 Oct 28 18:38:48.500320 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3686/5742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:48 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1692 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:49.010307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:49.012064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:49.023051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:49.024111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:49.025010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:49.026015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:49.026697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:49.027938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:49.116466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:49.117743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:49.140884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:49.141550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:49.142351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:49.143360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:49.144736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:49.146304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:49.164728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:49.182621 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eeaef3bd-a097-4fa6-aa35-817282e433a4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1267 microversion: 2.1 time: 0.177738 Oct 28 18:38:49.187193 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2057/5743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:49 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:49.524990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:49.525925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:49.547354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:49.549627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:49.555255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:49.558837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:49.559509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:49.561656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:49.609809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:49.613053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:49.625921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b4b099a-77b1-4d71-9daf-8d491d43f531 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 200 len: 1298 microversion: 2.1 time: 0.516185 Oct 28 18:38:49.650968 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3687/5744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:49 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 1298 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:50.212785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:50.213629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:50.233237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:50.234134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:50.234600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:50.235530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:50.236073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:50.236548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:50.558056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:50.578120 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-936760d8-596a-4a62-b861-405073494711 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1692 microversion: 2.1 time: 1.055808 Oct 28 18:38:50.584694 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2058/5745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:49 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1692 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:50.597618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:50.625161 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41271b00-91f2-41b1-bf99-ab6585dc9934 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1309 microversion: 2.1 time: 0.413972 Oct 28 18:38:50.625161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3688/5746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:50 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:50.659605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:50.661189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 309e2abe-ff01-4393-950d-67c98e642dcf] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:50.669935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:50.670852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:50.671735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:50.672706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:50.673387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:50.674000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:50.711312 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] HTTP exception thrown: Instance 309e2abe-ff01-4393-950d-67c98e642dcf could not be found. Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Request method failure captured: Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf HTTP/1.1 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCGgJMcHwyyMPhhk23s6QBZlOsOfpjXHrlIhhO488EeqhZW3ubO7czXtt_Z3Pb2RB4I0jRLfFwkdQRAdZs4Ckw_30f6d06gXadKtCPYPitC9cSv6XBLI5eKY5Uuv_ROtTuJGwiUucEM5IeUR9VvK4hEXcYJYNcsJy25TOP1_8VBbdjc Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 5a8d87973ad7418cb0a8fdf3bed54f86 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesActionsTest-1229587644 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a8d87973ad7418cb0a8fdf3bed54f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a8d87973ad7418cb0a8fdf3bed54f86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a8d87973ad7418cb0a8fdf3bed54f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a8d87973ad7418cb0a8fdf3bed54f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-VolumesActionsTest-1229587644 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 5a8d87973ad7418cb0a8fdf3bed54f86 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesActionsTest-1229587644 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-VolumesActionsTest-1229587644-project Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: ca8dce1a0fdc46aa867d01c601880762 Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-VolumesActionsTest-1229587644-project Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 309e2abe-ff01-4393-950d-67c98e642dcf could not be found. Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '309e2abe-ff01-4393-950d-67c98e642dcf'} Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309e2abe-ff01-4393-950d-67c98e642dcf could not be found. Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309e2abe-ff01-4393-950d-67c98e642dcf could not be found. Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:50.717439 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:50.721615 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:50.721615 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:50.721615 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:50.721615 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:38:50.721615 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:38:50.721615 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309e2abe-ff01-4393-950d-67c98e642dcf could not be found. Oct 28 18:38:50.721615 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:38:50.723869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Returning 404 to user: Instance 309e2abe-ff01-4393-950d-67c98e642dcf could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:38:50.726353 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c8bf623-f282-4ad5-9706-5b4469145480 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf" status: 404 len: 111 microversion: 2.1 time: 0.073527 Oct 28 18:38:50.728796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2059/5747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:50 2022] GET /compute/v2.1/servers/309e2abe-ff01-4393-950d-67c98e642dcf => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:38:50.974407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1278947165", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "fe17ab76-3595-4089-8cd2-fc9bf2e93a10"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:51.068136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] validate_networks() for [('fe17ab76-3595-4089-8cd2-fc9bf2e93a10', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:38:51.612818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:51.613994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:51.633766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:51.634488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:51.635082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:51.636499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:51.637104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:51.637779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:52.159993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:52.169020 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfa35b45-8872-46b8-8bf6-631c89397b74 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1689 microversion: 2.1 time: 0.560727 Oct 28 18:38:52.171611 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2060/5748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:51 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1689 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:52.188183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-64ca2f4d-6e90-40e6-a5e5-60c55709ab6b req-d91b674a-9304-4e5a-a8a7-b58d981729a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c9ec074-c988-4a61-96c3-f38fdfa0da31", "tag": "aed7e151-935c-4f43-abfa-e85ce4cc472e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:52.212405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64ca2f4d-6e90-40e6-a5e5-60c55709ab6b req-d91b674a-9304-4e5a-a8a7-b58d981729a6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:52.214116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64ca2f4d-6e90-40e6-a5e5-60c55709ab6b req-d91b674a-9304-4e5a-a8a7-b58d981729a6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:52.214565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64ca2f4d-6e90-40e6-a5e5-60c55709ab6b req-d91b674a-9304-4e5a-a8a7-b58d981729a6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:52.253145 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-64ca2f4d-6e90-40e6-a5e5-60c55709ab6b req-d91b674a-9304-4e5a-a8a7-b58d981729a6 service nova] Creating event network-changed:aed7e151-935c-4f43-abfa-e85ce4cc472e for instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 on n-h1-862404-2 Oct 28 18:38:52.273772 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-64ca2f4d-6e90-40e6-a5e5-60c55709ab6b req-d91b674a-9304-4e5a-a8a7-b58d981729a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100292 Oct 28 18:38:52.275120 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2061/5749] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:52.296353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:52.297362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:52.316788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:52.317388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:52.318906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:52.320627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:52.324731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:52.325322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:52.423306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:38:52.423859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:38:52.425951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:38:52.426557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:38:52.427102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:38:52.454567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:52.456019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:52.457763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:52.462779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:52.463442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:52.464109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:52.507539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Getting quotas for project 5a8d87973ad7418cb0a8fdf3bed54f86. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:38:52.516686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Getting quotas for user ca8dce1a0fdc46aa867d01c601880762 and project 5a8d87973ad7418cb0a8fdf3bed54f86. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:38:52.541346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:38:52.560745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:38:52.688818 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9205d35-36d1-41a9-abb7-46bd4a47232d tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719716 Oct 28 18:38:52.692316 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3689/5750] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:38:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:38:52.707372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:52.708139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:52.723424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:52.724104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:52.724559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:52.725297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:52.725751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:52.730454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:52.753776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:52.766143 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0daa7d1c-1bfa-4af6-81cb-07b0c1d2c789 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1309 microversion: 2.1 time: 0.489383 Oct 28 18:38:52.766987 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2062/5751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:52 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:52.797527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-027971e1-fb06-4c7c-baed-8a3b6fce4370 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:52.804019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-027971e1-fb06-4c7c-baed-8a3b6fce4370 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:53.070803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52bf12d8-e4f3-47c4-a3c5-960f658cdde5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action" status: 202 len: 0 microversion: 2.1 time: 0.372684 Oct 28 18:38:53.071859 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3690/5752] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:38:52 2022] POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:38:53.085790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-027971e1-fb06-4c7c-baed-8a3b6fce4370 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:53.113251 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-027971e1-fb06-4c7c-baed-8a3b6fce4370 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1214 microversion: 2.1 time: 0.318463 Oct 28 18:38:53.114103 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2063/5753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:52 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:53.116371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:53.117258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:53.125961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:53.126686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:53.127462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:53.128427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:53.141736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:53.142513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:53.704759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:53.719728 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f1073a7-e458-4ce4-82db-f798d734c601 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.618193 Oct 28 18:38:53.732327 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3691/5754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:53 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:53.803468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:53.804118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:53.820613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:53.821117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:53.821562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:53.822290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:53.822739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:53.823166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:54.136243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:54.137082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:54.146127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:54.150338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:54.151088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:54.155091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:54.155833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:54.156419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:54.240562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:54.253484 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3803d6f3-a430-43e2-b40c-6480cf8346f5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1309 microversion: 2.1 time: 0.455737 Oct 28 18:38:54.261710 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2064/5755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:53 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:54.359935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:54.371628 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60a198d9-7cb7-4838-b04a-15fc3238b0a3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1266 microversion: 2.1 time: 0.239236 Oct 28 18:38:54.379153 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3692/5756] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:54 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:54.493345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e4012ec7-4f19-4e4c-8688-23c0229d1158 req-31f740e7-51c7-45c1-8578-5c7a738c1f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "name": "network-vif-plugged", "status": "completed", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:54.518093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e4012ec7-4f19-4e4c-8688-23c0229d1158 req-31f740e7-51c7-45c1-8578-5c7a738c1f83 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:54.519510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e4012ec7-4f19-4e4c-8688-23c0229d1158 req-31f740e7-51c7-45c1-8578-5c7a738c1f83 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:54.520157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e4012ec7-4f19-4e4c-8688-23c0229d1158 req-31f740e7-51c7-45c1-8578-5c7a738c1f83 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:54.545725 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e4012ec7-4f19-4e4c-8688-23c0229d1158 req-31f740e7-51c7-45c1-8578-5c7a738c1f83 service nova] Creating event network-vif-plugged:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h2-862404-2 Oct 28 18:38:54.576586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-e4012ec7-4f19-4e4c-8688-23c0229d1158 req-31f740e7-51c7-45c1-8578-5c7a738c1f83 service nova] Instance e7559170-4309-45f7-bfbe-b0a65422abf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:38:54.638604 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e4012ec7-4f19-4e4c-8688-23c0229d1158 req-31f740e7-51c7-45c1-8578-5c7a738c1f83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148239 Oct 28 18:38:54.640911 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2065/5757] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:54.748983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:54.750326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:54.763017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:54.763772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:54.764517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:54.766699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:54.770705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:54.771543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:55.283963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:55.284691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:55.303568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:55.304786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:55.305241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:55.305980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:55.306506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:55.307180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:55.317745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:55.337646 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e627c6a0-84d0-4f6c-b71e-04e49a97d87e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.591624 Oct 28 18:38:55.338813 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3693/5758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:54 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:55.405790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:55.408010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:55.422505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:55.423900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:55.425793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:55.426951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:55.428001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:55.428644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:55.568412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:55.577474 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5aa462c8-069f-47ee-a13e-9af0c1014942 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1272 microversion: 2.1 time: 0.176362 Oct 28 18:38:55.578667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3694/5759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:55 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:55.774147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:55.794610 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-58d95870-8be0-4b1f-b52d-f2546ba4ab38 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1309 microversion: 2.1 time: 0.515654 Oct 28 18:38:55.796702 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2066/5760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:55 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1309 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:56.363786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:56.365057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:56.376189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:56.386512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:56.387209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:56.388192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:56.388811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:56.389391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:56.602905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:56.604469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:56.612713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:56.613505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:56.614254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:56.615288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:56.615982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:56.617297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:56.637233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:56.694047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:56.708032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68d65f63-6741-4b76-94b1-91708f1a0fd1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.348942 Oct 28 18:38:56.709184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3695/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:56 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:56.828199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:56.829920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:56.839030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:56.839876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:56.840503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:56.841506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:56.842367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:56.843034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:57.046130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:57.056714 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fd3fa78c-5496-4f22-a603-b457258956c1 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1314 microversion: 2.1 time: 0.458099 Oct 28 18:38:57.074778 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2067/5762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:56 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:57.132694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:57.141358 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dee9ff83-999b-4a2c-96d1-959a1ae1aa2c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1309 microversion: 2.1 time: 0.320726 Oct 28 18:38:57.141968 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3696/5763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:56 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1309 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:57.753037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:57.755364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:57.771288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:57.774433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:57.775077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:57.776933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:57.778784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:57.779735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:58.104340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:58.105062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:58.113170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:58.117294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:58.118443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:58.119243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:58.121174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:58.122180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:58.122802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:58.136574 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-794dee37-4411-40b1-9c83-3cc24e5f99ba tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.390066 Oct 28 18:38:58.152508 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2068/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:57 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:58.169591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:58.170273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:58.184517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:58.186094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:58.186577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:58.188417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:58.190412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:58.191176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:58.419870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:58.446239 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60870597-e6d4-4d9e-98d1-ba37c65d782f tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1314 microversion: 2.1 time: 0.351062 Oct 28 18:38:58.446973 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3697/5765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:58 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:58.700956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-01d2094e-8570-4136-a427-601a6ead1e1d req-dc43f7fd-53c2-482c-b50a-a742fedca732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9ec074-c988-4a61-96c3-f38fdfa0da31", "name": "network-vif-plugged", "status": "completed", "tag": "aed7e151-935c-4f43-abfa-e85ce4cc472e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:58.716429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01d2094e-8570-4136-a427-601a6ead1e1d req-dc43f7fd-53c2-482c-b50a-a742fedca732 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:58.716913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01d2094e-8570-4136-a427-601a6ead1e1d req-dc43f7fd-53c2-482c-b50a-a742fedca732 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:58.717569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-01d2094e-8570-4136-a427-601a6ead1e1d req-dc43f7fd-53c2-482c-b50a-a742fedca732 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:58.741440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:58.755606 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-01d2094e-8570-4136-a427-601a6ead1e1d req-dc43f7fd-53c2-482c-b50a-a742fedca732 service nova] Creating event network-vif-plugged:aed7e151-935c-4f43-abfa-e85ce4cc472e for instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 on n-h1-862404-2 Oct 28 18:38:58.765138 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-01d2094e-8570-4136-a427-601a6ead1e1d req-dc43f7fd-53c2-482c-b50a-a742fedca732 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069584 Oct 28 18:38:58.766423 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3692c36-2959-466c-be2a-82a5c0a16af2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1309 microversion: 2.1 time: 0.601621 Oct 28 18:38:58.768299 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3698/5766] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:58.783852 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2069/5767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:58 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1309 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:58.855592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-bcc11ff9-0b76-41cb-a953-6b4a84be48af req-4daa0e51-451e-4acb-bafc-fcf211cefd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008fdb2f-a08b-405f-9f69-60da672d744d", "tag": "66bea867-fd04-4293-b31a-210da6653453"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:58.871210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bcc11ff9-0b76-41cb-a953-6b4a84be48af req-4daa0e51-451e-4acb-bafc-fcf211cefd7b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:58.872267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bcc11ff9-0b76-41cb-a953-6b4a84be48af req-4daa0e51-451e-4acb-bafc-fcf211cefd7b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:58.872969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bcc11ff9-0b76-41cb-a953-6b4a84be48af req-4daa0e51-451e-4acb-bafc-fcf211cefd7b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:58.893213 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-bcc11ff9-0b76-41cb-a953-6b4a84be48af req-4daa0e51-451e-4acb-bafc-fcf211cefd7b service nova] Creating event network-changed:66bea867-fd04-4293-b31a-210da6653453 for instance 008fdb2f-a08b-405f-9f69-60da672d744d on n-h2-862404-2 Oct 28 18:38:58.900217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-bcc11ff9-0b76-41cb-a953-6b4a84be48af req-4daa0e51-451e-4acb-bafc-fcf211cefd7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049174 Oct 28 18:38:58.901469 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3699/5768] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:59.164051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:59.164906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:59.174477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:59.177029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:59.178050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:59.178978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:59.179596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:59.180244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:59.479500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:59.481079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:59.492012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:59.492012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:59.492343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:59.493317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:59.495414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:59.496359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:59.773661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:59.787168 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df2cfc01-9336-41d6-9f77-a1f52e561aed tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.627712 Oct 28 18:38:59.788052 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2070/5769] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:59 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:59.806339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:59.809368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:59.810286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:38:59.819430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:59.822456 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-388988f1-a217-4b4d-806f-1b1d384d04d2 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1314 microversion: 2.1 time: 0.352337 Oct 28 18:38:59.823197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:59.824027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3700/5770] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:59 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:59.824617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:59.827100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:59.827696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:59.828271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:00.209217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:00.232572 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3f7187ef-8462-4159-889a-7073de549ad8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1309 microversion: 2.1 time: 0.436260 Oct 28 18:39:00.256348 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2071/5771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:59 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1309 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:00.815556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:00.817162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:00.828370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:00.831517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:00.832984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:00.834006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:00.836472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:00.837297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:00.851086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:00.853320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:00.875042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:00.875988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:00.880142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:00.882728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:00.883735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:00.885072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:01.085994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:01.094979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a0fd6910-21db-4a1b-85e7-2c790ad678aa tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.283926 Oct 28 18:39:01.096795 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3701/5772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:00 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:01.273480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:01.273480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:01.282897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:01.284560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:01.286077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:01.287147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:01.291851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:01.292704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:01.459741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:01.492388 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-580cd588-630e-4d7e-b975-efc0f4242e94 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1314 microversion: 2.1 time: 0.641846 Oct 28 18:39:01.493716 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2072/5773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:00 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:01.506785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e715177e-2d24-44fa-826c-6edbd2d8aca6 req-f5a32544-e36f-4cce-9792-d77051ea2d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "name": "network-vif-unplugged", "status": "completed", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}, {"name": "network-changed", "server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:01.523151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e715177e-2d24-44fa-826c-6edbd2d8aca6 req-f5a32544-e36f-4cce-9792-d77051ea2d96 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:01.523986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e715177e-2d24-44fa-826c-6edbd2d8aca6 req-f5a32544-e36f-4cce-9792-d77051ea2d96 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:01.524933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e715177e-2d24-44fa-826c-6edbd2d8aca6 req-f5a32544-e36f-4cce-9792-d77051ea2d96 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:01.543398 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e715177e-2d24-44fa-826c-6edbd2d8aca6 req-f5a32544-e36f-4cce-9792-d77051ea2d96 service nova] Creating event network-vif-unplugged:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h1-862404-2 Oct 28 18:39:01.544556 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e715177e-2d24-44fa-826c-6edbd2d8aca6 req-f5a32544-e36f-4cce-9792-d77051ea2d96 service nova] Creating event network-changed:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h1-862404-2 Oct 28 18:39:01.545334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:01.552855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-e715177e-2d24-44fa-826c-6edbd2d8aca6 req-f5a32544-e36f-4cce-9792-d77051ea2d96 service nova] Instance e7559170-4309-45f7-bfbe-b0a65422abf5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:39:01.554764 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da0fb38c-9bc8-4419-bf89-3fad103f8ee6 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1489 microversion: 2.1 time: 0.295635 Oct 28 18:39:01.559429 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3702/5774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:01 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1489 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:01.569795 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e715177e-2d24-44fa-826c-6edbd2d8aca6 req-f5a32544-e36f-4cce-9792-d77051ea2d96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.073020 Oct 28 18:39:01.571056 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2073/5775] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:01.733740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1407460193", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "40558d36-80d4-459b-bebf-564251832359"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:01.807653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] validate_networks() for [('40558d36-80d4-459b-bebf-564251832359', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:39:02.121261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:02.122158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:02.137252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:02.138727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:02.141058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:02.143284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:02.144183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:02.147224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:02.480630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:02.516064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:02.532546 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9d2fe017-0c27-4062-81ac-b55e4f13fa1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.415656 Oct 28 18:39:02.533520 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2074/5776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:02 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:02.539255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:02.540584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:02.554389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:02.559633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:39:02.560269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:39:02.561062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:39:02.561877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:39:02.562455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:02.562861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:02.563309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:02.566027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:02.566227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:39:02.568666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:02.569273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:02.585727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:02.586536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:02.587122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:02.588037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:02.588850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:02.589436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:02.628338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:39:02.639478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:39:02.651327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:02.657037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:39:02.660621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:39:02.782760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9599af29-7063-480b-8d01-a9455db6cd50 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050788 Oct 28 18:39:02.787075 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3703/5777] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:39:02.801522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2aeaa794-f2d7-47e0-9b5b-4a3efaca5426 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:02.808853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2aeaa794-f2d7-47e0-9b5b-4a3efaca5426 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:02.895482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2aeaa794-f2d7-47e0-9b5b-4a3efaca5426 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:02.905575 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2aeaa794-f2d7-47e0-9b5b-4a3efaca5426 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1209 microversion: 2.1 time: 0.111921 Oct 28 18:39:02.910832 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3704/5778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:02 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:03.094215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:03.564294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:03.565990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:03.575410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:03.580158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:03.580992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:03.581668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:03.583928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:03.587406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:03.587898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:03.590089 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5ab9ef60-fea4-4653-9786-e572769eaf12 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1314 microversion: 2.1 time: 1.054667 Oct 28 18:39:03.590960 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2075/5779] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:02 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1314 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:03.932733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:03.941396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:03.943289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:03.951103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-20d0012c-9c1c-4aea-b12e-64c2cc5080af tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.392601 Oct 28 18:39:03.952200 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3705/5780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:03 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:03.959441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:03.964890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:03.965401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:03.967461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:03.972034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:03.972646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:04.144167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:04.156965 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28a1ea6b-29c2-42c4-8a62-27bdd73cbcaa tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1261 microversion: 2.1 time: 0.225512 Oct 28 18:39:04.161454 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2076/5781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:03 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:04.619363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:04.620917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:04.628709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:04.630692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:04.631629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:04.633258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:04.633962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:04.637063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:04.672382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:04.921196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:04.929911 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c04ecf3-7532-470b-ab57-9645943b7a05 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1314 microversion: 2.1 time: 0.315383 Oct 28 18:39:04.934770 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3706/5782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:04 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:04.982994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:04.984435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:05.000337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:05.004084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:05.006021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:05.007348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:05.010229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:05.017247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:05.187068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:05.188014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:05.194955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:05.195659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:05.196489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:05.197556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:05.198272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:05.198903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:05.328565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:05.347801 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d45d0bb-f258-4f4b-a803-a16392e46bbc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1261 microversion: 2.1 time: 0.164747 Oct 28 18:39:05.349712 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3707/5783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:05 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:05.357307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:05.370336 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a4819b4-fafc-4791-9beb-d8f43bafcdb6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.393811 Oct 28 18:39:05.372001 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2077/5784] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:04 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:05.961824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:05.962528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:05.973222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:05.973850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:05.974525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:05.975465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:05.976610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:05.977130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:05.985674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9dcece54-3d74-420c-bec0-edfe7573a858 req-eebfaa1c-71aa-4fb9-96ee-aa3ff948f363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008fdb2f-a08b-405f-9f69-60da672d744d", "name": "network-vif-plugged", "status": "completed", "tag": "66bea867-fd04-4293-b31a-210da6653453"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:06.006284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9dcece54-3d74-420c-bec0-edfe7573a858 req-eebfaa1c-71aa-4fb9-96ee-aa3ff948f363 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:06.008206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9dcece54-3d74-420c-bec0-edfe7573a858 req-eebfaa1c-71aa-4fb9-96ee-aa3ff948f363 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:06.009211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9dcece54-3d74-420c-bec0-edfe7573a858 req-eebfaa1c-71aa-4fb9-96ee-aa3ff948f363 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:06.042358 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9dcece54-3d74-420c-bec0-edfe7573a858 req-eebfaa1c-71aa-4fb9-96ee-aa3ff948f363 service nova] Creating event network-vif-plugged:66bea867-fd04-4293-b31a-210da6653453 for instance 008fdb2f-a08b-405f-9f69-60da672d744d on n-h2-862404-2 Oct 28 18:39:06.054049 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9dcece54-3d74-420c-bec0-edfe7573a858 req-eebfaa1c-71aa-4fb9-96ee-aa3ff948f363 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073171 Oct 28 18:39:06.056629 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2078/5785] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:39:06.308741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:06.323390 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e50197c-4e42-403d-a892-85d0888f42c3 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1314 microversion: 2.1 time: 0.366856 Oct 28 18:39:06.323390 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3708/5786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:05 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:06.377523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:06.378358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:06.390356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:06.390991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:06.391719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:06.393512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:06.394435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:06.395203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:06.396855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:06.397560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:06.418294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:06.421037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:06.423065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:06.424378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:06.426182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:06.426884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:06.488416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:06.500080 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-70da0324-607e-4954-9376-767570118ad3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1261 microversion: 2.1 time: 0.127617 Oct 28 18:39:06.502217 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2079/5787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:06 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1261 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:06.731144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:06.743356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8c48ff3-76c8-4e60-95a7-26075c6a817c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1688 microversion: 2.1 time: 0.352107 Oct 28 18:39:06.748715 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3709/5788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:06 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1688 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:07.355333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:07.356179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:07.372654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:07.374369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:07.382513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:07.383362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:07.383747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:07.384312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:07.531069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:07.540348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:07.557171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:07.557856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:07.558462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:07.560613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:07.562874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:07.563467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:07.712500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:07.722028 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3804872b-07a1-42ef-a9c4-0dfd9ce6f6cd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1267 microversion: 2.1 time: 0.199943 Oct 28 18:39:07.723794 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3710/5789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:07 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:07.772567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:07.773267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:07.785185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:07.786253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:07.786901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:07.787800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:07.792068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:07.792705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:07.943768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:07.960089 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c5fae1fb-2340-469f-9f25-83e87f1e87bd tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1314 microversion: 2.1 time: 0.616084 Oct 28 18:39:07.960692 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2080/5790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:07 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:08.068093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:08.076029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df699eb3-f12f-4fed-a429-eaf146be10c9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1681 microversion: 2.1 time: 0.308952 Oct 28 18:39:08.080528 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3711/5791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:07 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1681 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:08.747423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:08.748701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:08.763000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:08.763946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:08.764610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:08.765528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:08.771329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:08.771866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:08.987896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:08.988834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:09.001589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:09.003789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:09.004489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:09.005606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:09.006260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:09.006876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:09.273503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:09.284767 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5446beb-349d-45b3-8e09-8b107cc842fa tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1498 microversion: 2.1 time: 0.301134 Oct 28 18:39:09.287536 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3712/5792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:08 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1498 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:09.292646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5f511dc9-486c-4c7d-a89d-fe7b8f1db473 req-9cc88bf3-a386-49a8-b8e8-833180da0d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "name": "network-vif-plugged", "status": "completed", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:09.313558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f511dc9-486c-4c7d-a89d-fe7b8f1db473 req-9cc88bf3-a386-49a8-b8e8-833180da0d41 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:09.314123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f511dc9-486c-4c7d-a89d-fe7b8f1db473 req-9cc88bf3-a386-49a8-b8e8-833180da0d41 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:09.315249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5f511dc9-486c-4c7d-a89d-fe7b8f1db473 req-9cc88bf3-a386-49a8-b8e8-833180da0d41 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:09.366332 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5f511dc9-486c-4c7d-a89d-fe7b8f1db473 req-9cc88bf3-a386-49a8-b8e8-833180da0d41 service nova] Creating event network-vif-plugged:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h1-862404-2 Oct 28 18:39:09.387445 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5f511dc9-486c-4c7d-a89d-fe7b8f1db473 req-9cc88bf3-a386-49a8-b8e8-833180da0d41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098492 Oct 28 18:39:09.388460 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3713/5793] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:09.490540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:09.498938 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f60ea8c9-bdf5-4c11-9b38-25cf22d3d501 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1309 microversion: 2.1 time: 0.755943 Oct 28 18:39:09.512604 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2081/5794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:08 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1309 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:09.969819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:09.970932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:09.978156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:09.979449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:09.980163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:09.981139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:09.981833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:09.982629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:10.017388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:39:10.137245 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51df5982-06cf-463a-9f93-264b19cef42e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "DELETE /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 204 len: 0 microversion: 2.1 time: 0.171243 Oct 28 18:39:10.138228 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3714/5795] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:39:09 2022] DELETE /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:39:10.149165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:10.150804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:10.155073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:10.181173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:10.181731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:10.182186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:10.182926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:10.183556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:10.184034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:10.431488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:10.445662 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a1c28d90-cf23-4d0b-95d3-78c51d16d7a0 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1504 microversion: 2.1 time: 0.302263 Oct 28 18:39:10.447393 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2082/5796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:10 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:10.498679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c877c730-31ab-4670-8b04-e59585ebeb54 req-03ee0605-bb8f-4282-be72-a80bc65c2414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387da72b-6f52-4057-bed8-0c509954c49d", "tag": "6b4960e8-0507-489f-b906-3ee3aadfb51b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:10.524872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:10.525847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:10.531092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c877c730-31ab-4670-8b04-e59585ebeb54 req-03ee0605-bb8f-4282-be72-a80bc65c2414 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:10.532038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c877c730-31ab-4670-8b04-e59585ebeb54 req-03ee0605-bb8f-4282-be72-a80bc65c2414 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:10.533756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c877c730-31ab-4670-8b04-e59585ebeb54 req-03ee0605-bb8f-4282-be72-a80bc65c2414 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:10.534917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:10.536419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:10.537643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:10.541626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:10.542318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:10.542971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:10.566667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c877c730-31ab-4670-8b04-e59585ebeb54 req-03ee0605-bb8f-4282-be72-a80bc65c2414 service nova] Creating event network-changed:6b4960e8-0507-489f-b906-3ee3aadfb51b for instance 387da72b-6f52-4057-bed8-0c509954c49d on n-h1-862404-2 Oct 28 18:39:10.574081 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c877c730-31ab-4670-8b04-e59585ebeb54 req-03ee0605-bb8f-4282-be72-a80bc65c2414 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079633 Oct 28 18:39:10.578471 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3715/5797] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:10.834656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:10.844848 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c3adc13-ba90-4115-93d2-f1893664de6c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1309 microversion: 2.1 time: 0.323729 Oct 28 18:39:10.846053 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2083/5798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:10 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1309 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:11.474008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:11.475409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:11.482523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:11.483307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:11.484034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:11.484975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:11.485647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:11.486326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:11.750430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:11.759853 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8fd998f-35a1-4326-a0e8-3b1d5804bf40 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1504 microversion: 2.1 time: 0.291182 Oct 28 18:39:11.761157 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3716/5799] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:11 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:11.872195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:11.873369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:11.889467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:11.892930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:11.893398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:11.897502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:11.904252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:11.904925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:12.297799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:12.307999 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d846252-d5af-4432-9027-81ff1e3fd016 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1309 microversion: 2.1 time: 0.439624 Oct 28 18:39:12.316316 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2084/5800] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:11 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1309 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:12.494980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c95766d9-a962-4da1-a040-1d26c2aa7d23 req-55454833-c786-4582-8896-3876418f5f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008fdb2f-a08b-405f-9f69-60da672d744d", "name": "network-vif-deleted", "tag": "66bea867-fd04-4293-b31a-210da6653453"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:12.508964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c95766d9-a962-4da1-a040-1d26c2aa7d23 req-55454833-c786-4582-8896-3876418f5f06 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:12.509484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c95766d9-a962-4da1-a040-1d26c2aa7d23 req-55454833-c786-4582-8896-3876418f5f06 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:12.509949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c95766d9-a962-4da1-a040-1d26c2aa7d23 req-55454833-c786-4582-8896-3876418f5f06 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:12.523744 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c95766d9-a962-4da1-a040-1d26c2aa7d23 req-55454833-c786-4582-8896-3876418f5f06 service nova] Creating event network-vif-deleted:66bea867-fd04-4293-b31a-210da6653453 for instance 008fdb2f-a08b-405f-9f69-60da672d744d on n-h2-862404-2 Oct 28 18:39:12.528800 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c95766d9-a962-4da1-a040-1d26c2aa7d23 req-55454833-c786-4582-8896-3876418f5f06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038974 Oct 28 18:39:12.529663 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3717/5801] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:12.790112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:12.790737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:12.796970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:12.797460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:12.797899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:12.799255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:12.799925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:12.800400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:12.803210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:12.834869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:12.835360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:12.835802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:12.836290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lazy-loading 'fault' on Instance uuid 008fdb2f-a08b-405f-9f69-60da672d744d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:39:12.882359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8dce1a0fdc46aa867d01c601880762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8d87973ad7418cb0a8fdf3bed54f86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:12.891431 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65afd5b9-134e-4240-8b2f-9aa94f53fc1e tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 200 len: 1304 microversion: 2.1 time: 0.105188 Oct 28 18:39:12.892359 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2085/5802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:12 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:13.341219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:13.342513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:13.349704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:13.351102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:13.368771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:13.369626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:13.370299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:13.371146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:13.371798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:13.372267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:13.587773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:13.599236 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73982094-1396-4bec-bd9e-b7c8528bc47e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1309 microversion: 2.1 time: 0.259826 Oct 28 18:39:13.599867 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3718/5803] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:13 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:13.916134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:13.916943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] [instance: 008fdb2f-a08b-405f-9f69-60da672d744d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:13.929774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:13.930687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:13.931647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:13.933530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:13.934190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:13.934805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:13.958277 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] HTTP exception thrown: Instance 008fdb2f-a08b-405f-9f69-60da672d744d could not be found. Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Request method failure captured: Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d HTTP/1.1 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCGgJMcHwyyMPhhk23s6QBZlOsOfpjXHrlIhhO488EeqhZW3ubO7czXtt_Z3Pb2RB4I0jRLfFwkdQRAdZs4Ckw_30f6d06gXadKtCPYPitC9cSv6XBLI5eKY5Uuv_ROtTuJGwiUucEM5IeUR9VvK4hEXcYJYNcsJy25TOP1_8VBbdjc Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 5a8d87973ad7418cb0a8fdf3bed54f86 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesActionsTest-1229587644 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a8d87973ad7418cb0a8fdf3bed54f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5a8d87973ad7418cb0a8fdf3bed54f86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5a8d87973ad7418cb0a8fdf3bed54f86", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5a8d87973ad7418cb0a8fdf3bed54f86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-VolumesActionsTest-1229587644 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 5a8d87973ad7418cb0a8fdf3bed54f86 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesActionsTest-1229587644 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-VolumesActionsTest-1229587644-project Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: ca8dce1a0fdc46aa867d01c601880762 Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-VolumesActionsTest-1229587644-project Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 008fdb2f-a08b-405f-9f69-60da672d744d could not be found. Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '008fdb2f-a08b-405f-9f69-60da672d744d'} Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008fdb2f-a08b-405f-9f69-60da672d744d could not be found. Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008fdb2f-a08b-405f-9f69-60da672d744d could not be found. Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:39:13.960794 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:39:13.964045 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:13.964045 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:39:13.964045 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:39:13.964045 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:39:13.964045 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:39:13.964045 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008fdb2f-a08b-405f-9f69-60da672d744d could not be found. Oct 28 18:39:13.964045 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:39:13.965164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] Returning 404 to user: Instance 008fdb2f-a08b-405f-9f69-60da672d744d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:39:13.966038 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fc6e8878-eb77-437e-9c2f-453dd0550b18 tempest-VolumesActionsTest-1229587644 tempest-VolumesActionsTest-1229587644-project] 10.222.0.16 "GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d" status: 404 len: 111 microversion: 2.1 time: 0.054909 Oct 28 18:39:13.966894 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2086/5804] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:13 2022] GET /compute/v2.1/servers/008fdb2f-a08b-405f-9f69-60da672d744d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:39:14.628152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:14.629458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:14.640340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:14.640918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:14.641364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:14.643204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:14.643881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:14.644370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:14.929298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:14.947157 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d250638-addd-45c3-a52a-a88d121b2929 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1309 microversion: 2.1 time: 0.327476 Oct 28 18:39:14.957529 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3719/5805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:14 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:15.984083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:15.984881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:16.000525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:16.006631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:16.008997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:16.010196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:16.011266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:16.012293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:16.233002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:16.243091 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0259254d-7908-4fbc-9211-a0c7da735a8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1309 microversion: 2.1 time: 0.265606 Oct 28 18:39:16.244303 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2087/5806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:15 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:17.271844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:17.278184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:17.308671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:17.311110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:17.313685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:17.315359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:17.316728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:17.317313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:17.412856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-13082e03-5afc-4b2c-90e3-53b47797cc96 req-b3b5fd7f-590c-40d0-8cac-fd16f9a68d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387da72b-6f52-4057-bed8-0c509954c49d", "name": "network-vif-plugged", "status": "completed", "tag": "6b4960e8-0507-489f-b906-3ee3aadfb51b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:17.461040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13082e03-5afc-4b2c-90e3-53b47797cc96 req-b3b5fd7f-590c-40d0-8cac-fd16f9a68d24 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:17.464086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13082e03-5afc-4b2c-90e3-53b47797cc96 req-b3b5fd7f-590c-40d0-8cac-fd16f9a68d24 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:17.464901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13082e03-5afc-4b2c-90e3-53b47797cc96 req-b3b5fd7f-590c-40d0-8cac-fd16f9a68d24 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:17.519411 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-13082e03-5afc-4b2c-90e3-53b47797cc96 req-b3b5fd7f-590c-40d0-8cac-fd16f9a68d24 service nova] Creating event network-vif-plugged:6b4960e8-0507-489f-b906-3ee3aadfb51b for instance 387da72b-6f52-4057-bed8-0c509954c49d on n-h1-862404-2 Oct 28 18:39:17.534246 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-13082e03-5afc-4b2c-90e3-53b47797cc96 req-b3b5fd7f-590c-40d0-8cac-fd16f9a68d24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126634 Oct 28 18:39:17.538781 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2088/5807] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:39:17.777646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:17.791864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a73d880-6657-48f2-a65b-93dd112a0618 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1309 microversion: 2.1 time: 0.526584 Oct 28 18:39:17.792996 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3720/5808] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:17 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1309 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:18.820880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:18.822107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:18.838090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:18.838957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:18.839612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:18.840567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:18.841282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:18.841915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:19.120513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:19.147869 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0367ffd4-c852-45d3-b0e5-377e05a9e401 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1309 microversion: 2.1 time: 0.331699 Oct 28 18:39:19.151179 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2089/5809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:18 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1309 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:20.179935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:20.180655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:20.196046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:20.196939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:20.198743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:20.200124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:20.202085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:20.203690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:20.541945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:20.552988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-20618e37-d1e7-47d1-b481-05bf8d0ae6a7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1489 microversion: 2.1 time: 0.379891 Oct 28 18:39:20.586400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:20.587853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:20.600921 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3721/5810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:20 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1489 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:20.607280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:20.609410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:20.611053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:20.612861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:20.615992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:20.616694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:20.885719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:20.899286 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df264905-3a3b-4cc9-a8be-c5edd0a9bde8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1489 microversion: 2.1 time: 0.321659 Oct 28 18:39:20.913488 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2090/5811] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:20 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1489 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:20.922232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:20.923077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:20.929786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:20.930418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:20.931010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:20.931867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:20.932460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:20.933022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:21.223660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:21.233447 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80e69e3b-5686-4a90-83af-9188cca33f28 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1489 microversion: 2.1 time: 0.314920 Oct 28 18:39:21.255451 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3722/5812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:20 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1489 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:21.258627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:21.259763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:21.270605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:21.272183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:21.274236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:21.276496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:21.277084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:21.277528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:21.323670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:39:21.504490 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13708ea3-f4d9-4fe6-9a48-7b4ae855cf7a tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 204 len: 0 microversion: 2.1 time: 0.250228 Oct 28 18:39:21.505442 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2091/5813] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:39:21 2022] DELETE /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:39:21.514563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:21.515195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:21.533549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:21.534421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:21.535063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:21.536027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:21.536683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:21.537310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:21.541917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:21.923918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:21.937073 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67b71082-2636-46f0-a638-2bfb352ed213 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1495 microversion: 2.1 time: 0.426839 Oct 28 18:39:21.956772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3723/5814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:21 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1495 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:22.968895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:22.969603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:22.982329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:22.982821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:22.983292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:22.984004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:22.984464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:22.984889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:23.391432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:23.401623 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4017a21e-9572-493c-976f-1294b0f2a881 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1495 microversion: 2.1 time: 0.436931 Oct 28 18:39:23.405497 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2092/5815] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:22 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1495 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:24.116160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-08d2fadc-06ef-4cd6-bcef-f91a4a358512 req-ca73bf1a-36cd-4513-b97b-091ddce2cf0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387da72b-6f52-4057-bed8-0c509954c49d", "name": "network-vif-deleted", "tag": "6b4960e8-0507-489f-b906-3ee3aadfb51b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:24.157224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-08d2fadc-06ef-4cd6-bcef-f91a4a358512 req-ca73bf1a-36cd-4513-b97b-091ddce2cf0f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:24.158253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-08d2fadc-06ef-4cd6-bcef-f91a4a358512 req-ca73bf1a-36cd-4513-b97b-091ddce2cf0f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:24.225468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-08d2fadc-06ef-4cd6-bcef-f91a4a358512 req-ca73bf1a-36cd-4513-b97b-091ddce2cf0f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.068s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:24.269523 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-08d2fadc-06ef-4cd6-bcef-f91a4a358512 req-ca73bf1a-36cd-4513-b97b-091ddce2cf0f service nova] Creating event network-vif-deleted:6b4960e8-0507-489f-b906-3ee3aadfb51b for instance 387da72b-6f52-4057-bed8-0c509954c49d on n-h1-862404-2 Oct 28 18:39:24.286379 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-08d2fadc-06ef-4cd6-bcef-f91a4a358512 req-ca73bf1a-36cd-4513-b97b-091ddce2cf0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174123 Oct 28 18:39:24.297975 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3724/5816] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:24.437178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:24.437929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:24.456217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:24.456717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:24.473801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:24.474595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:24.475022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:24.475459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:24.617663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:24.618874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:24.619696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:24.621559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lazy-loading 'fault' on Instance uuid 387da72b-6f52-4057-bed8-0c509954c49d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:39:24.678076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:24.687388 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59d6dff4-f4f9-494b-8b90-a9235f9683c9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 200 len: 1299 microversion: 2.1 time: 0.259781 Oct 28 18:39:24.690541 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2093/5817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:24 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:25.721799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:25.722552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:25.735138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:25.784414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:25.792068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:25.792928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:25.793428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:25.793879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:25.859040 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d HTTP/1.1 Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '387da72b-6f52-4057-bed8-0c509954c49d'} Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:25.861248 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:25.864567 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:39:25.864567 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:39:25.864567 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:39:25.864567 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:39:25.864567 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:39:25.864567 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:25.868440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:39:25.871380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ccd6a82-bacf-41f3-9189-357753e0f68d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 404 len: 111 microversion: 2.1 time: 0.162882 Oct 28 18:39:25.876214 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3725/5818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:25 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:39:25.881669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:25.882174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:25.905994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:25.906502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:25.906949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:25.908280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:25.908872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:25.909304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:25.964050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:39:26.199329 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d98f3cde-5c03-46a1-9ee1-e90ded4b7b24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 204 len: 0 microversion: 2.1 time: 0.320856 Oct 28 18:39:26.204058 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2094/5819] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:39:25 2022] DELETE /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:39:26.209058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:26.209681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:26.223132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:26.223803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:26.224440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:26.225329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:26.225940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:26.226778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:26.514073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:26.522772 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-85a04a81-5da7-4632-a4e8-220a8cc29b57 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1495 microversion: 2.1 time: 0.317419 Oct 28 18:39:26.524053 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3726/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:26 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1495 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:27.553558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:27.555061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:27.564953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:27.565763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:27.566725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:27.568007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:27.568739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:27.569922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:27.827569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:27.858107 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-317e1665-2adb-45fd-935f-cb6cb471b944 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1495 microversion: 2.1 time: 0.310338 Oct 28 18:39:27.858730 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2095/5821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:27 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1495 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:28.534583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-46353d55-a53d-4b13-afa2-7efaeffc525a req-fdedc043-eacc-44c2-b4b3-30d3b4eb3b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9ec074-c988-4a61-96c3-f38fdfa0da31", "name": "network-vif-deleted", "tag": "aed7e151-935c-4f43-abfa-e85ce4cc472e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:28.578498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-46353d55-a53d-4b13-afa2-7efaeffc525a req-fdedc043-eacc-44c2-b4b3-30d3b4eb3b67 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:28.593601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-46353d55-a53d-4b13-afa2-7efaeffc525a req-fdedc043-eacc-44c2-b4b3-30d3b4eb3b67 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:28.596728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-46353d55-a53d-4b13-afa2-7efaeffc525a req-fdedc043-eacc-44c2-b4b3-30d3b4eb3b67 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:28.674482 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-46353d55-a53d-4b13-afa2-7efaeffc525a req-fdedc043-eacc-44c2-b4b3-30d3b4eb3b67 service nova] Creating event network-vif-deleted:aed7e151-935c-4f43-abfa-e85ce4cc472e for instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 on n-h1-862404-2 Oct 28 18:39:28.697247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-46353d55-a53d-4b13-afa2-7efaeffc525a req-fdedc043-eacc-44c2-b4b3-30d3b4eb3b67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167499 Oct 28 18:39:28.704973 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3727/5822] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:28.891974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:28.894460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:28.947365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:28.948197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:28.948654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:28.949460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:28.953817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:28.959904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:29.052771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:29.053483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:29.056287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:29.057155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lazy-loading 'fault' on Instance uuid 4c9ec074-c988-4a61-96c3-f38fdfa0da31 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:39:29.152731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:29.166365 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14c72ca4-2b5c-4897-80fd-b95b057985b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 200 len: 1299 microversion: 2.1 time: 0.284566 Oct 28 18:39:29.167160 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2096/5823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:28 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 1299 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:30.193520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:30.194226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:30.201493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:30.204437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:30.206069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:30.209072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:30.209709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:30.210317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:30.241685 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 HTTP/1.1 Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4c9ec074-c988-4a61-96c3-f38fdfa0da31'} Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:30.243369 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:30.247537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:39:30.247537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:39:30.247537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:39:30.247537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:39:30.247537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:39:30.247537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:30.247537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:39:30.247537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b0293c9-5367-4a75-9bd3-87ce385b079f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 404 len: 111 microversion: 2.1 time: 0.056605 Oct 28 18:39:30.272259 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3728/5824] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:30 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:39:30.500804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-726485964", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "40558d36-80d4-459b-bebf-564251832359"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:30.604072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] validate_networks() for [('40558d36-80d4-459b-bebf-564251832359', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:39:31.547522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:39:31.549064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:39:31.549556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:39:31.549954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:39:31.550542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:39:31.565839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:31.566331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:31.566767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:31.567497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:31.571798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:31.572333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:31.609243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:39:31.617189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:39:31.677814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:39:31.681136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:39:31.815688 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb2d7f77-63cf-4d40-b6e2-5559ebaeb741 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.318993 Oct 28 18:39:31.816372 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2097/5825] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:39:31.827497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4303e549-d892-4da3-a241-70fbd64e2e3b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:31.828733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4303e549-d892-4da3-a241-70fbd64e2e3b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:31.947212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4303e549-d892-4da3-a241-70fbd64e2e3b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:31.968487 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4303e549-d892-4da3-a241-70fbd64e2e3b tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1208 microversion: 2.1 time: 0.144562 Oct 28 18:39:31.969652 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3729/5826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:31 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:33.000104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:33.000713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:33.012265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:33.013801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:33.015218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:33.016536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:33.017378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:33.018282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:33.154466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:33.166704 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-494302ba-d22e-4a7d-bf47-2f72d67dd2cb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1212 microversion: 2.1 time: 0.172179 Oct 28 18:39:33.167804 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2098/5827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:32 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1212 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:34.193269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:34.193930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:34.196887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:34.215031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:34.215519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:34.233849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:34.234773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:34.235264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:34.237879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:34.401796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:34.414824 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b78fd95d-e999-4780-823f-5e19bf9d4772 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1266 microversion: 2.1 time: 0.227975 Oct 28 18:39:34.434442 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3730/5828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:34 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:35.449117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:35.449716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:35.452815 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:39:35.455958 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:39:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 (ip 10.222.0.16) !!! Oct 28 18:39:35.467655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:35.472637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:35.473694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:35.476117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:35.477905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:35.478548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:35.568103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:36.558122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:36.588902 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b3c7ebae-d5b8-43ee-bc51-0f36ff1a014c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 1.143493 Oct 28 18:39:36.592528 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2099/5829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:35 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:37.621266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-518970da-3db6-4029-aff3-1370ee95576b req-b65251c9-4c95-49c3-a3ba-86510516b478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b2fa8b-e1eb-4342-b454-7af0ebc755c9", "tag": "6ded8746-7efc-420d-afab-1c05475c3bcc"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:37.626647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:37.628977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:37.646919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:37.648641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:37.650716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:37.652439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:37.654305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:37.656035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:37.665756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-518970da-3db6-4029-aff3-1370ee95576b req-b65251c9-4c95-49c3-a3ba-86510516b478 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:37.666259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-518970da-3db6-4029-aff3-1370ee95576b req-b65251c9-4c95-49c3-a3ba-86510516b478 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:37.666701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-518970da-3db6-4029-aff3-1370ee95576b req-b65251c9-4c95-49c3-a3ba-86510516b478 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:37.716412 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-518970da-3db6-4029-aff3-1370ee95576b req-b65251c9-4c95-49c3-a3ba-86510516b478 service nova] Creating event network-changed:6ded8746-7efc-420d-afab-1c05475c3bcc for instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 on n-h1-862404-2 Oct 28 18:39:37.743280 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-518970da-3db6-4029-aff3-1370ee95576b req-b65251c9-4c95-49c3-a3ba-86510516b478 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124066 Oct 28 18:39:37.748584 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2100/5830] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:38.016311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:38.030322 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2bd3dabc-93b5-4710-b1fc-40473ac67be9 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 0.413166 Oct 28 18:39:38.049923 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3731/5831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:37 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:39.060571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:39.061966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:39.081958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:39.082678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:39.083329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:39.084261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:39.088654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:39.099880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:39.515118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:39.527148 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42b035d5-34aa-4236-bf78-ffe9972ca465 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 0.472146 Oct 28 18:39:39.542136 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2101/5832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:39 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:40.493410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:40.495998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:40.507880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:40.507880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:40.510313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:40.511517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:40.511939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:40.512376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:40.554054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:40.554913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:40.558340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:40.575589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:40.578074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:40.578929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:40.583056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:40.583702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:40.585444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:40.872855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:40.886979 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e514f1b-8e6c-49d0-8647-13c2ea73af95 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 0.337490 Oct 28 18:39:40.888129 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2102/5833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:40 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:40.942805 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b525031-3e54-4fa5-b84b-4db97b9dfe77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action" status: 200 len: 63215 microversion: 2.1 time: 0.455617 Oct 28 18:39:40.945972 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3732/5834] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:39:40 2022] POST /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5/action => generated 63215 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:39:41.912247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:41.913492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:41.926856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:41.934126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:41.942355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:41.946391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:41.947034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:41.950403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:41.951053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:41.954214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:42.277996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:42.291290 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-35fd75db-6e47-443e-bb84-866cffb216cc tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 0.384496 Oct 28 18:39:42.292013 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2103/5835] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:41 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:43.316677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:43.317481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:43.329751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:43.331571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:43.332094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:43.332774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:43.338788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:43.339327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:43.341953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:43.706484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:43.734614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc6afc27-5078-433b-bdf2-c8b336ab7412 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 0.422579 Oct 28 18:39:43.756514 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3733/5836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:43 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:44.762673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:44.763196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:44.781804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:44.783314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:44.783933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:44.784789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:44.785386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:44.785946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:45.047107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:45.055265 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b887bc0c-74d1-4d5f-a753-c07a0aff8a92 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 0.296492 Oct 28 18:39:45.058705 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2104/5837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:44 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:45.834035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4b6f47f0-cf8a-4a88-b6f5-646b6a84557d req-4526f111-3e86-45dc-bdaa-85a09b42628b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b2fa8b-e1eb-4342-b454-7af0ebc755c9", "name": "network-vif-plugged", "status": "completed", "tag": "6ded8746-7efc-420d-afab-1c05475c3bcc"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:45.899577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4b6f47f0-cf8a-4a88-b6f5-646b6a84557d req-4526f111-3e86-45dc-bdaa-85a09b42628b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:45.899577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4b6f47f0-cf8a-4a88-b6f5-646b6a84557d req-4526f111-3e86-45dc-bdaa-85a09b42628b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:45.899577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4b6f47f0-cf8a-4a88-b6f5-646b6a84557d req-4526f111-3e86-45dc-bdaa-85a09b42628b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:45.899577 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4b6f47f0-cf8a-4a88-b6f5-646b6a84557d req-4526f111-3e86-45dc-bdaa-85a09b42628b service nova] Creating event network-vif-plugged:6ded8746-7efc-420d-afab-1c05475c3bcc for instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 on n-h1-862404-2 Oct 28 18:39:46.021813 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4b6f47f0-cf8a-4a88-b6f5-646b6a84557d req-4526f111-3e86-45dc-bdaa-85a09b42628b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.408600 Oct 28 18:39:46.022831 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3734/5838] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:46.082426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:46.083616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:46.103383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:46.106571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:46.107099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:46.110079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:46.116731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:46.117433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:46.371567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:46.387532 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-68fe1eaa-c5cb-44cf-8f54-8d7ce455d2c7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 0.309815 Oct 28 18:39:46.392969 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2105/5839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:46 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:47.415895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:47.416607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:47.434580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:47.435326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:47.435764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:47.436503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:47.436975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:47.437401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:47.633333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:47.642203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5102afa9-0d38-4003-91fa-23f0470098e8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1308 microversion: 2.1 time: 0.230681 Oct 28 18:39:47.642794 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3735/5840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:47 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:48.669238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:48.670055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:48.681611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:48.689249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:48.689820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:48.690663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:48.691248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:48.701128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:48.973401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:48.987929 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-502067c6-1e47-4c37-b89b-94d63898a116 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1488 microversion: 2.1 time: 0.322506 Oct 28 18:39:49.015092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:49.017678 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2106/5841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:48 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1488 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:49.018961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:49.041692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:49.050519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:49.053637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:49.054685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:49.057426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:49.057873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:49.209318 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f53742fd-2a03-4c4a-8670-0f31844ec034 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "PUT /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1083 microversion: 2.1 time: 0.198375 Oct 28 18:39:49.221446 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3736/5842] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:39:49 2022] PUT /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1083 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:39:49.233918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:49.234783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:49.244182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:49.245600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:49.246724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:49.247980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:49.248719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:49.249308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:49.515034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:49.526269 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-638f33e7-5f81-45c7-9dd8-bba6ca2d97d1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1509 microversion: 2.1 time: 0.298232 Oct 28 18:39:49.532700 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2107/5843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:49 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:49.557811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:49.558985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:49.572994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:49.573520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:49.573987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:49.574873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:49.575347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:49.575940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:49.825428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:49.837262 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c200387a-6ab2-49f0-8ca5-ab45455c2506 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1509 microversion: 2.1 time: 0.283847 Oct 28 18:39:49.846015 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3737/5844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:49 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:49.861308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:49.861938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:49.879357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:49.879913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:49.880523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:49.881432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:49.882942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:49.883550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:49.926300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:39:50.053937 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-749b0685-8d41-499a-86a2-2c53fdb94d15 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 204 len: 0 microversion: 2.1 time: 0.196165 Oct 28 18:39:50.063336 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2108/5845] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:39:49 2022] DELETE /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:39:50.073348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:50.074527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:50.085674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:50.087649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:50.088299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:50.090878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:50.091954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:50.092296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:50.414338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:50.430280 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-14b21f2a-b63c-4931-83fc-a79861f4c3ba tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1515 microversion: 2.1 time: 0.359927 Oct 28 18:39:50.444037 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3738/5846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:50 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:51.455363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:51.456502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:51.469096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:51.471531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:51.472120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:51.473362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:51.475110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:51.476313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:51.821177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:51.829830 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-97f5d8ff-5bcf-49ec-b996-d20c39e10fd7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1515 microversion: 2.1 time: 0.379164 Oct 28 18:39:51.845642 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2109/5847] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:51 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1515 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:52.655767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-71f00cc5-e636-42b0-8309-d2219c9616bd req-e63fac11-0f74-4701-a52a-d7cbd687048c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b2fa8b-e1eb-4342-b454-7af0ebc755c9", "name": "network-vif-deleted", "tag": "6ded8746-7efc-420d-afab-1c05475c3bcc"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:52.674695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-71f00cc5-e636-42b0-8309-d2219c9616bd req-e63fac11-0f74-4701-a52a-d7cbd687048c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:52.675199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-71f00cc5-e636-42b0-8309-d2219c9616bd req-e63fac11-0f74-4701-a52a-d7cbd687048c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:52.675640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-71f00cc5-e636-42b0-8309-d2219c9616bd req-e63fac11-0f74-4701-a52a-d7cbd687048c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:52.701979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:52.705198 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-71f00cc5-e636-42b0-8309-d2219c9616bd req-e63fac11-0f74-4701-a52a-d7cbd687048c service nova] Creating event network-vif-deleted:6ded8746-7efc-420d-afab-1c05475c3bcc for instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 on n-h1-862404-2 Oct 28 18:39:52.715991 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-71f00cc5-e636-42b0-8309-d2219c9616bd req-e63fac11-0f74-4701-a52a-d7cbd687048c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.347233 Oct 28 18:39:52.719079 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3739/5848] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:52.858866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:52.859565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:52.867754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:52.868294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:52.868705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:52.869411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:52.869870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:52.870326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:52.917805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:52.918681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:52.919300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:52.920583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lazy-loading 'fault' on Instance uuid 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:39:53.001836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:53.013260 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-10d8f425-e564-40ca-871d-adccaec7cfea tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 200 len: 1319 microversion: 2.1 time: 0.158286 Oct 28 18:39:53.015046 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2110/5849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:52 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:54.055733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:54.055733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:54.074481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:54.074997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:54.075655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:54.076578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:54.077448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:54.078039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:54.099137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 HTTP/1.1 Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '23b2fa8b-e1eb-4342-b454-7af0ebc755c9'} Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:54.101188 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-381bcf8b-8e63-405f-bc34-11a17f046aff tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 404 len: 111 microversion: 2.1 time: 0.065269 Oct 28 18:39:54.118040 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3740/5850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:54 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:39:54.275917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1947823395", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "40558d36-80d4-459b-bebf-564251832359"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:54.347084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] validate_networks() for [('40558d36-80d4-459b-bebf-564251832359', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:39:55.041168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:39:55.041776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:39:55.042415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:39:55.043029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:39:55.043623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:39:55.056142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:55.057025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:55.058100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:55.058985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:55.060387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:55.060961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:55.086171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:39:55.092608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Getting quotas for user 735e781a390044d4a986c1aba207421a and project f12c957db6f44e958801cb0beab9507d. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:39:55.109690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:39:55.113415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:39:55.195957 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b3d7f6cb-29c8-4e77-bfd7-b25425c1e3b0 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920520 Oct 28 18:39:55.202637 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2111/5851] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:39:55.209558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-294e428c-ff23-4383-9cb7-79c83cd03783 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:55.210255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-294e428c-ff23-4383-9cb7-79c83cd03783 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:55.285368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-294e428c-ff23-4383-9cb7-79c83cd03783 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:55.297421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-294e428c-ff23-4383-9cb7-79c83cd03783 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1209 microversion: 2.1 time: 0.093328 Oct 28 18:39:55.299351 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3741/5852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:55 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:56.335587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:56.336259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:56.379644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:56.380530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:56.381614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:56.384990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:56.386143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:56.386734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:56.546563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:56.558088 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d0369b47-0bc7-4208-ae79-87a666414206 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1261 microversion: 2.1 time: 0.230952 Oct 28 18:39:56.560235 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2112/5853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:56 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:57.620554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:57.621883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:57.648328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:57.652260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:57.653122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:57.655037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:57.656057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:57.658115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:57.840938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:57.842052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:57.860118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:57.860929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:57.871948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:57.873001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:57.873500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:57.874068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:57.882750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:57.901508 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9b7319bb-1d65-4283-b7a3-fae6919ba8bb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1267 microversion: 2.1 time: 0.308939 Oct 28 18:39:57.911850 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2113/5854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:57 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:58.227549 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91fd15fd-bd7a-48dd-be4d-5bf38a8c4805 tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1832 microversion: 2.1 time: 0.872573 Oct 28 18:39:58.240056 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3742/5855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:57 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1832 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:39:58.931600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:39:58.932553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:39:58.970412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:58.973757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:58.975878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:58.976932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:58.981534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:58.982260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:59.458158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:59.576805 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b2d02914-eeed-4f2a-ac50-08374d29d913 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1309 microversion: 2.1 time: 0.584908 Oct 28 18:39:59.578055 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2114/5856] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:39:58 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1309 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:00.175421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:00.176044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:00.183930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e2eb9a71-3012-4533-b903-ad95a7b1a59e req-17b24582-dad5-4c9b-8f42-4e8acbbbef76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:00.192875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.194944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.197787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:00.200999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.201499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.201945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:00.205170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2eb9a71-3012-4533-b903-ad95a7b1a59e req-17b24582-dad5-4c9b-8f42-4e8acbbbef76 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.212583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2eb9a71-3012-4533-b903-ad95a7b1a59e req-17b24582-dad5-4c9b-8f42-4e8acbbbef76 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.213134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2eb9a71-3012-4533-b903-ad95a7b1a59e req-17b24582-dad5-4c9b-8f42-4e8acbbbef76 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:00.263513 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e2eb9a71-3012-4533-b903-ad95a7b1a59e req-17b24582-dad5-4c9b-8f42-4e8acbbbef76 service nova] Creating event network-changed:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h1-862404-2 Oct 28 18:40:00.284801 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e2eb9a71-3012-4533-b903-ad95a7b1a59e req-17b24582-dad5-4c9b-8f42-4e8acbbbef76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104443 Oct 28 18:40:00.285822 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2115/5857] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:00.296332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:40:00.452228 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0baaf9c1-44cb-409a-82e4-4eea34d77c3f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 204 len: 0 microversion: 2.1 time: 0.282563 Oct 28 18:40:00.459172 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3743/5858] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:00 2022] DELETE /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:40:00.463336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:00.464119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:00.483860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.484383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.484869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:00.485762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.486303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.486932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:00.491988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:00.602433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:00.603142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:00.613086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.613502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.613950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:00.614670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.615138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.615575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:01.068151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:01.091464 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fc418393-1ec9-431c-8093-a8af936738d2 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1687 microversion: 2.1 time: 0.632833 Oct 28 18:40:01.112783 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2116/5859] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:00 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1687 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:01.114460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:01.124393 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dcaeec33-7322-42fe-abf2-6713bb927d24 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1309 microversion: 2.1 time: 0.526465 Oct 28 18:40:01.147263 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3744/5860] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:00 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1309 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:01.584696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-13787401-fd86-4fa3-95f8-513abd0ef061 req-8fe0bfd5-b2c7-4a68-8a08-b5cb8359690a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3723a7b3-c1fe-4b80-96c8-eb04db93a1ef", "tag": "6f09390d-6914-40ca-833d-99853ff40d0c"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:01.618565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13787401-fd86-4fa3-95f8-513abd0ef061 req-8fe0bfd5-b2c7-4a68-8a08-b5cb8359690a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:01.619613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13787401-fd86-4fa3-95f8-513abd0ef061 req-8fe0bfd5-b2c7-4a68-8a08-b5cb8359690a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:01.621727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13787401-fd86-4fa3-95f8-513abd0ef061 req-8fe0bfd5-b2c7-4a68-8a08-b5cb8359690a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:01.676782 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-13787401-fd86-4fa3-95f8-513abd0ef061 req-8fe0bfd5-b2c7-4a68-8a08-b5cb8359690a service nova] Creating event network-changed:6f09390d-6914-40ca-833d-99853ff40d0c for instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef on n-h1-862404-2 Oct 28 18:40:01.723966 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-13787401-fd86-4fa3-95f8-513abd0ef061 req-8fe0bfd5-b2c7-4a68-8a08-b5cb8359690a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141304 Oct 28 18:40:01.736893 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2117/5861] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:02.124816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:02.125464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:02.139721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:02.140284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:02.140738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:02.141542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:02.142012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:02.142453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:02.152851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:02.153564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:02.163523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:02.164062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:02.173581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:02.174447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:02.174936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:02.175378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:02.480608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:02.507041 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8d4e8abc-0d95-421c-9313-a99358aa90bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1687 microversion: 2.1 time: 0.385955 Oct 28 18:40:02.524295 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3745/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:02 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1687 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:03.535111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:03.535743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:03.552676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:03.554262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:03.555278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:03.559129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:03.559834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:03.560439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:03.788688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:03.800504 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33ef971b-bac0-4fb0-bf9c-c323933a3480 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1687 microversion: 2.1 time: 0.270113 Oct 28 18:40:03.816538 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3746/5863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:03 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1687 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:03.825424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:03.837874 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-32f8c71c-66f0-49bf-b274-09bf287cb40e tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1309 microversion: 2.1 time: 1.689676 Oct 28 18:40:03.853211 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2118/5864] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:02 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1309 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:04.833407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:04.834032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:04.849468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:04.850981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:04.851481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:04.852211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:04.853076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:04.853710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:04.854294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:04.857925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-75abdeda-faae-45da-9faf-e16e2abc8b47 req-8974dcde-67d8-4ecd-948e-1ce7ada6f51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7559170-4309-45f7-bfbe-b0a65422abf5", "name": "network-vif-deleted", "tag": "72fa6b52-a11e-4160-b4a8-8f51297cf64a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:04.873808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-75abdeda-faae-45da-9faf-e16e2abc8b47 req-8974dcde-67d8-4ecd-948e-1ce7ada6f51d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:04.874531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-75abdeda-faae-45da-9faf-e16e2abc8b47 req-8974dcde-67d8-4ecd-948e-1ce7ada6f51d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:04.875112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-75abdeda-faae-45da-9faf-e16e2abc8b47 req-8974dcde-67d8-4ecd-948e-1ce7ada6f51d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:04.902989 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-75abdeda-faae-45da-9faf-e16e2abc8b47 req-8974dcde-67d8-4ecd-948e-1ce7ada6f51d service nova] Creating event network-vif-deleted:72fa6b52-a11e-4160-b4a8-8f51297cf64a for instance e7559170-4309-45f7-bfbe-b0a65422abf5 on n-h1-862404-2 Oct 28 18:40:04.914822 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-75abdeda-faae-45da-9faf-e16e2abc8b47 req-8974dcde-67d8-4ecd-948e-1ce7ada6f51d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060406 Oct 28 18:40:04.919831 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2119/5865] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:40:04.932719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:04.933669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:04.946694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:04.947187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:04.947617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:04.948360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:04.948815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:04.949243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:05.006620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:05.014678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00c8b00d-b3c5-4b90-b5cb-0cc7cc686ba6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1501 microversion: 2.1 time: 0.186035 Oct 28 18:40:05.015750 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3747/5866] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:04 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:05.071542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:05.102938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:05.125505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:05.134804 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-edd6d442-0239-4260-ac19-94191bb08db7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1309 microversion: 2.1 time: 0.211089 Oct 28 18:40:05.136498 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2120/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:04 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1309 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:06.039710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:06.041509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:06.050924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:06.056769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:06.057487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:06.060729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:06.061705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:06.064388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:06.065031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:06.161253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:06.162541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:06.189586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:06.190322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:06.190967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:06.191917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:06.192581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:06.193243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:06.226812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:06.240682 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2095603b-deae-48ed-9eb0-ade86a4e28a5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 200 len: 1501 microversion: 2.1 time: 0.202675 Oct 28 18:40:06.241340 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3748/5868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:06 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 1501 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:06.369645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:06.382264 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b390ea28-9870-4011-a7f8-49393e8d1f97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1309 microversion: 2.1 time: 0.226278 Oct 28 18:40:06.388654 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2121/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:06 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1309 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:07.265501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:07.266205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: e7559170-4309-45f7-bfbe-b0a65422abf5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:07.279409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:07.280194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:07.280792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:07.283019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:07.284377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:07.288360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:07.318405 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] HTTP exception thrown: Instance e7559170-4309-45f7-bfbe-b0a65422abf5 could not be found. Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Request method failure captured: Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 HTTP/1.1 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCBvc0YflF8rdCSJK9k6feqbsVmfTyN8LB8kG2K52dnwbeAWDEga0e3Qk_53zZR-oQU21yf38NMhPvsSxFlBHCPi4wNEgvRNviGdQHu6PLLHjTzAKlw5vk1MAxvpDp7nGyF8QRnha0Rkwy6iP9lJeZbWLld9X9TIIcL8SHJYIWKaQ74 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 946b8055a69f4f979036482e1fd37f67 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_946b8055a69f4f979036482e1fd37f67", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 946b8055a69f4f979036482e1fd37f67 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestNetworkAdvancedServerOps-156931648-project Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 379680f3dd0542389b53a8a4f20ae800 Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestNetworkAdvancedServerOps-156931648-project Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance e7559170-4309-45f7-bfbe-b0a65422abf5 could not be found. Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'e7559170-4309-45f7-bfbe-b0a65422abf5'} Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7559170-4309-45f7-bfbe-b0a65422abf5 could not be found. Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7559170-4309-45f7-bfbe-b0a65422abf5 could not be found. Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:07.320208 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7559170-4309-45f7-bfbe-b0a65422abf5 could not be found. Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:07.325965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Returning 404 to user: Instance e7559170-4309-45f7-bfbe-b0a65422abf5 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:07.332675 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3cbf1fc8-54db-45d1-b60d-90e289c54a98 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5" status: 404 len: 111 microversion: 2.1 time: 0.060299 Oct 28 18:40:07.333359 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3749/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:07 2022] GET /compute/v2.1/servers/e7559170-4309-45f7-bfbe-b0a65422abf5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:07.421541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:07.423053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:07.436592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:07.439426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:07.441230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:07.442313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:07.443600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:07.444219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:08.009450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:08.030613 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-44a8a4b8-70d0-4270-ba86-e96bb8a9e9f4 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1309 microversion: 2.1 time: 0.613630 Oct 28 18:40:08.032640 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2122/5871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:07 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1309 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:09.059749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:09.060731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:09.088922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:09.091834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:09.092318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:09.093060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:09.097749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:09.098263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:09.671668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:09.692362 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-696ecd15-f8ca-488c-9ad9-72aa2f95aed8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1309 microversion: 2.1 time: 0.637037 Oct 28 18:40:09.695200 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3750/5872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:09 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1309 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:09.753687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3d8ffa8f-cd27-431b-bf8a-ccf96e03591b req-8bdd7348-ab53-4ff6-8140-285b10f23488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3723a7b3-c1fe-4b80-96c8-eb04db93a1ef", "name": "network-vif-plugged", "status": "completed", "tag": "6f09390d-6914-40ca-833d-99853ff40d0c"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:09.779097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3d8ffa8f-cd27-431b-bf8a-ccf96e03591b req-8bdd7348-ab53-4ff6-8140-285b10f23488 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:09.780005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3d8ffa8f-cd27-431b-bf8a-ccf96e03591b req-8bdd7348-ab53-4ff6-8140-285b10f23488 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:09.782077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3d8ffa8f-cd27-431b-bf8a-ccf96e03591b req-8bdd7348-ab53-4ff6-8140-285b10f23488 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:09.819969 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3d8ffa8f-cd27-431b-bf8a-ccf96e03591b req-8bdd7348-ab53-4ff6-8140-285b10f23488 service nova] Creating event network-vif-plugged:6f09390d-6914-40ca-833d-99853ff40d0c for instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef on n-h1-862404-2 Oct 28 18:40:09.837482 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3d8ffa8f-cd27-431b-bf8a-ccf96e03591b req-8bdd7348-ab53-4ff6-8140-285b10f23488 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089673 Oct 28 18:40:09.838453 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2123/5873] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:40:10.727100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:10.727718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:10.742472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:10.742980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:10.743428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:10.744182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:10.745399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:10.749634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:11.371405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:11.407591 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc4f9a11-84c3-4760-bc50-0bc41e455330 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1309 microversion: 2.1 time: 0.683304 Oct 28 18:40:11.422729 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3751/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:10 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1309 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:12.448183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:12.448968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:12.452436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:12.480632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:12.481179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:12.482707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:12.484398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:12.489171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:12.490897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:13.276637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:13.290536 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-61aa777b-a4e8-42cf-b846-9e84e910d8f1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1490 microversion: 2.1 time: 0.848392 Oct 28 18:40:13.294285 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2124/5875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:12 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1490 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:13.334952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-294626569"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:13.350357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:13.388471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:13.389044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:13.389735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:13.390499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:13.391017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:13.391438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:13.579107 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb5fcd1c-57e8-4130-ad33-6711c6c4d0eb tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "PUT /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1074 microversion: 2.1 time: 0.261495 Oct 28 18:40:13.580357 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3752/5876] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:40:13 2022] PUT /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1074 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:13.609552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:13.612424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:13.629717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:13.634179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:13.634824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:13.639332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:13.641196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:13.650128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:14.065690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:14.104865 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1153a0e6-ee88-4fa0-8901-24475dd348a5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1500 microversion: 2.1 time: 0.500064 Oct 28 18:40:14.106461 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2125/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:13 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1500 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:14.135762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:14.136543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:14.165598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:14.171690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:14.173721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:14.176736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:14.177336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:14.180216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:14.649421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:14.658362 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c83219f0-de29-4640-8a71-aa0585ea7447 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1500 microversion: 2.1 time: 0.528767 Oct 28 18:40:14.658958 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3753/5878] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:14 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1500 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:14.683373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-85423239-f404-4378-993b-a721f2c39f75 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:14.705292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85423239-f404-4378-993b-a721f2c39f75 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:14.706017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85423239-f404-4378-993b-a721f2c39f75 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:14.706731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-85423239-f404-4378-993b-a721f2c39f75 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:14.753018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-85423239-f404-4378-993b-a721f2c39f75 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Going to try to stop instance {{(pid=120679) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 18:40:14.919092 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-85423239-f404-4378-993b-a721f2c39f75 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "POST /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef/action" status: 202 len: 0 microversion: 2.1 time: 0.241213 Oct 28 18:40:14.920661 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2126/5879] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:40:14 2022] POST /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:40:14.936689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:14.940133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:14.956941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:14.958683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:14.960203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:14.961904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:14.963726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:14.964197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:15.221567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:15.232780 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f396153b-2326-43a7-86c4-ee88771c8375 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.306589 Oct 28 18:40:15.235886 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3754/5880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:14 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:15.742814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53771666-2303-46db-83e9-97e63cba82f5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '.version_select at 0x7f78de267790>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:15.789661 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-53771666-2303-46db-83e9-97e63cba82f5 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1205215823" status: 202 len: 0 microversion: 2.1 time: 0.051951 Oct 28 18:40:15.790894 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2127/5881] 10.222.0.16 () {58 vars in 1284 bytes} [Fri Oct 28 18:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1205215823 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:40:15.844787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4758b50d-0bd7-44ee-bf50-7f3dfd33d0e8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'create', calling method: .version_select at 0x7f78dd542820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-860836138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH2tLaQEwOaQuUaH0keC51m4UICS3n8/KOfl3VW8pSxj8CAsvHa17AIOeJpO17FJJNAnJwbVGxoSn/zn8y51t/8ja2BtYYwJYikKTQqeELKxa3lAQkygXbeklwS9T3fUQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:15.861257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-4758b50d-0bd7-44ee-bf50-7f3dfd33d0e8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for project 946b8055a69f4f979036482e1fd37f67. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:40:15.880629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-4758b50d-0bd7-44ee-bf50-7f3dfd33d0e8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for user 379680f3dd0542389b53a8a4f20ae800 and project 946b8055a69f4f979036482e1fd37f67. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:40:15.932321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4758b50d-0bd7-44ee-bf50-7f3dfd33d0e8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.093217 Oct 28 18:40:15.939338 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3755/5882] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:40:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:16.263852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:16.264623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:16.276008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:16.276511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:16.276955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:16.277680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:16.278133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:16.283454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:16.627613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:16.638935 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-68906dae-15cd-4758-919d-2a4be85c2cf2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.379262 Oct 28 18:40:16.639525 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2128/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:16 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:17.669409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:17.671378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:17.682812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:17.683745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:17.684488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:17.685774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:17.686558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:17.687135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:17.961771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:17.975348 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f9d2545-f32b-435d-b176-4c06d6ed8076 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.312304 Oct 28 18:40:17.989023 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3756/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:17 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:19.001080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:19.001701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:19.011143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:19.011639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:19.012206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:19.012924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:19.013390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:19.013895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:19.459600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:19.467657 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1906db74-4e0a-4aca-8b6a-448384536941 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.470472 Oct 28 18:40:19.468287 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2129/5885] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:18 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:20.510393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:20.513116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:20.542848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:20.545892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:20.546554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:20.548547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:20.549957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:20.551230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:20.587354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:21.132316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:21.141953 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1df19eed-06fd-4b2c-b56a-4b9423ed48d3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.647604 Oct 28 18:40:21.142550 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3757/5886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:20 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:22.172369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:22.173184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:22.199529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:22.202622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:22.203140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:22.204074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:22.206705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:22.207354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:23.215753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:23.229012 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7c687ab6-76af-4dd3-a055-101fe15ec7c5 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 1.061595 Oct 28 18:40:23.231567 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2130/5887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:22 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:24.258725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:24.259350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:24.269692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:24.270541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:24.271139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.272038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:24.272642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:24.273231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.638528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:24.655239 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5635fa8-4177-4098-8900-a8caa1bd0d8d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.399978 Oct 28 18:40:24.658075 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3758/5888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:24 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:25.694746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:25.695374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:25.725418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:25.725910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:25.730362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:25.738333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:25.739029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:25.739492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:26.370916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:26.388115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-634381bb-9554-47a6-a684-4e132d8e887c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.692886 Oct 28 18:40:26.389148 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2131/5889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:25 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:27.183297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1286434353", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "0e0d3893-c405-472d-a09b-22cea80bca37"}], "key_name": "tempest-TestNetworkAdvancedServerOps-860836138", "security_groups": [{"name": "tempest-secgroup-smoke-1979399938"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:27.196891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:27.417916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:27.419435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:27.428587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] validate_networks() for [('0e0d3893-c405-472d-a09b-22cea80bca37', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:40:27.441352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:27.443172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:27.444245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:27.447454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:27.448342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:27.450064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:28.174997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:28.192907 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-70c66d9a-7389-4ab3-b072-535d3e1c3b84 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.780545 Oct 28 18:40:28.194967 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2132/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:27 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:29.226096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:29.226663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:29.240655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:29.241391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:29.244385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:29.245872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:29.255191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:29.257871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:29.591550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:29.630947 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a2546aa8-0b24-46dc-b998-74942cc95bc1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.405262 Oct 28 18:40:29.636441 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2133/5891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:29 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:29.677345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:40:29.678610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:40:29.679352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:40:29.679964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:40:29.680685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:40:29.696732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:29.697597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:29.699277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:29.700569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:29.701187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:29.701830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:29.728188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for project 946b8055a69f4f979036482e1fd37f67. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:40:29.735288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for user 379680f3dd0542389b53a8a4f20ae800 and project 946b8055a69f4f979036482e1fd37f67. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:40:29.784016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:40:29.794942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:40:29.863477 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a0aa8eb6-1409-4e4b-9824-80adf2ce1a1f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.684421 Oct 28 18:40:29.864993 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3759/5892] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:40:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:40:29.877537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-70d568e5-82d5-4b88-8435-d7f87810a732 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:29.878237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-70d568e5-82d5-4b88-8435-d7f87810a732 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:30.056612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-70d568e5-82d5-4b88-8435-d7f87810a732 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:30.083303 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-70d568e5-82d5-4b88-8435-d7f87810a732 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1266 microversion: 2.1 time: 0.211390 Oct 28 18:40:30.103896 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2134/5893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:29 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:30.660884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:30.661886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:30.701278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:30.702500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:30.703923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:30.715094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:30.715712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:30.716362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:31.072410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:31.083543 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-278c7236-162c-4242-b782-4c8a7aad4f49 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.428726 Oct 28 18:40:31.085349 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3760/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:30 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:31.113963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:31.114582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:31.146575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:31.147095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:31.147536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:31.153407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:31.153912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:31.160810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:31.180463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:31.396165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:31.413945 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a3b113c4-c27c-4330-b871-010d670b223c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1270 microversion: 2.1 time: 0.303581 Oct 28 18:40:31.426874 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2135/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:31 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1270 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:32.110324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:32.110954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:32.121176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.123194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.124062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.126757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.128382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.131715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.449311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:32.469574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:32.487304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.487796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.507689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.511411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.513339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.513988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.609557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:32.618974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50a74c45-3455-4165-8218-e0fbc00b0481 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.512515 Oct 28 18:40:32.619754 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3761/5896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:32 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:32.686770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:32.696347 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bbb24b9e-3bde-4019-b751-171ad338a725 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1324 microversion: 2.1 time: 0.252057 Oct 28 18:40:32.697584 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2136/5897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:32 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:33.657259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:33.660298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:33.675915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:33.680974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:33.681769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.684680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:33.685437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:33.687745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.729724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:33.731532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:33.740048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:33.740853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:33.741991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.743384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:33.744095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:33.744767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.855931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:33.866844 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a9203946-2c0b-4dec-b861-8af0c0535e95 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1324 microversion: 2.1 time: 0.145457 Oct 28 18:40:33.868010 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2137/5898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:33 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1324 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:33.934705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:33.945773 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e5da193b-9b1c-4f4c-b059-3b542ce29b97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.300492 Oct 28 18:40:33.948360 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3762/5899] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:33 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:34.894675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:34.896074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:34.923640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:34.925081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:34.927032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:34.933819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:34.935657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:34.936913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:34.973694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:34.974297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:34.988228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:34.992390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:34.994689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:34.995291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:34.996852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:34.998417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:35.001515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:35.279778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:35.289154 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b6afa8a-2cdd-4be6-bc7e-c43d2cfe32b4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1392 microversion: 2.1 time: 0.400488 Oct 28 18:40:35.289969 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2138/5900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:34 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1392 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:35.310386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:35.324327 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf7a6cee-9853-4c60-bff4-88eee94e51b2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.354386 Oct 28 18:40:35.342896 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3763/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:34 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:35.537538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-32e5b93c-7877-42e1-b8bb-ded072acde48 req-483e0852-26e9-4244-9fc3-c980fb2abc9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e63405d-08e7-4cb9-a5e7-3062422d4b5b", "tag": "3f7bd752-ef85-43dc-a585-23a64d74dc83"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:35.568269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-32e5b93c-7877-42e1-b8bb-ded072acde48 req-483e0852-26e9-4244-9fc3-c980fb2abc9d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:35.568867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-32e5b93c-7877-42e1-b8bb-ded072acde48 req-483e0852-26e9-4244-9fc3-c980fb2abc9d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:35.569395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-32e5b93c-7877-42e1-b8bb-ded072acde48 req-483e0852-26e9-4244-9fc3-c980fb2abc9d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:35.590730 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-32e5b93c-7877-42e1-b8bb-ded072acde48 req-483e0852-26e9-4244-9fc3-c980fb2abc9d service nova] Creating event network-changed:3f7bd752-ef85-43dc-a585-23a64d74dc83 for instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b on n-h2-862404-2 Oct 28 18:40:35.599306 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-32e5b93c-7877-42e1-b8bb-ded072acde48 req-483e0852-26e9-4244-9fc3-c980fb2abc9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065347 Oct 28 18:40:35.600199 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2139/5902] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:36.317362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:36.318730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:36.326185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:36.326982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:36.327649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:36.328977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:36.329669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:36.330310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:36.356474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:36.357116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:36.372770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:36.373283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:36.375688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:36.376689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:36.377256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:36.380164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:36.546384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:36.555797 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2caae42e-a067-472d-9188-5cd8368178f8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1392 microversion: 2.1 time: 0.243442 Oct 28 18:40:36.556422 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3764/5903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:36 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:36.610798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:36.620275 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45c30fd5-dcd4-4c18-8e92-7f32fabb306c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.269263 Oct 28 18:40:36.623123 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2140/5904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:36 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:37.580005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:37.581475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:37.590640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:37.591302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:37.591755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:37.592510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:37.592975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:37.594185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:37.646383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:37.647065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:37.657745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:37.658462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:37.659253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:37.663128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:37.663700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:37.664237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:37.830045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:37.839735 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a7e58fdf-5e48-4dc4-80c8-60740eeb7126 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.197700 Oct 28 18:40:37.841401 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2141/5905] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:37 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:37.899904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:37.911264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ccae225e-1c7e-4f1b-88b6-c863ba70e115 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1392 microversion: 2.1 time: 0.336319 Oct 28 18:40:37.929571 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3765/5906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:37 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1392 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:38.142928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1583620651", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:38.280902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:40:38.634604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:40:38.635101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:40:38.635844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:40:38.636260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:40:38.636751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:40:38.651808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:38.656659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:38.657383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:38.658960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:38.659641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:38.660487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:38.696780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Getting quotas for project 3711fbde528d4abbb7c8a573a9087561. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:40:38.702839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Getting quotas for user bdd1002a0280407382a0558e3c789b61 and project 3711fbde528d4abbb7c8a573a9087561. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:40:38.717498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:40:38.720259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:40:38.786977 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-33df5e0c-6b22-4a9e-bd9e-ab105bf8a754 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648531 Oct 28 18:40:38.788102 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2142/5907] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:40:38.799683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f744b510-ef1b-4201-884d-dfff58136e2f tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:38.800364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f744b510-ef1b-4201-884d-dfff58136e2f tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:38.865961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:38.866553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:38.882016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:38.882539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:38.882990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:38.883721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:38.884293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:38.884731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:38.946691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f744b510-ef1b-4201-884d-dfff58136e2f tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:38.955341 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f744b510-ef1b-4201-884d-dfff58136e2f tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1214 microversion: 2.1 time: 0.160237 Oct 28 18:40:38.959086 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3766/5908] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:38 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:38.966466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:38.967088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:38.986789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:38.987681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:38.988322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:38.989639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:38.990249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:38.990837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:39.279085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:39.297329 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7693bf0e-acac-4ea1-919f-2e2c6162e971 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1392 microversion: 2.1 time: 0.336426 Oct 28 18:40:39.298398 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3767/5909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:38 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1392 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:39.302485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:39.321575 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe1bfaec-67bd-40be-ae3b-ad308df3daa8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1510 microversion: 2.1 time: 0.459354 Oct 28 18:40:39.338992 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2143/5910] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:38 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:39.982180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:39.983566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:39.986086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:39.992568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:39.993646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:39.994327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:39.995266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:39.996002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:39.996640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.095993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:40.105340 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47b19c48-7024-4056-87be-ee6a4a3ca047 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1266 microversion: 2.1 time: 0.127007 Oct 28 18:40:40.106612 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3768/5911] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:39 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:40.324631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:40.326212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:40.336953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.337660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.338256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.344956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.345712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.345869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:40.346395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:40.346614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.358037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.361136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.361637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.362414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.367084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.370227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.646726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:40.659299 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77beabb0-8c09-4693-aacb-90ffdd81eb4d tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1487 microversion: 2.1 time: 0.317418 Oct 28 18:40:40.660810 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3769/5912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:40 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1487 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:40.688527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1730313814"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:40.691856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:40.701569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.702408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.703501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.704898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.705608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.706276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.833971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:40.835704 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5a37072b-21e8-41c1-b9ee-1ab511654528 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "PUT /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1061 microversion: 2.1 time: 0.152606 Oct 28 18:40:40.842446 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-268273a8-3416-46c6-aa52-62317478488e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1392 microversion: 2.1 time: 0.523146 Oct 28 18:40:40.845205 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3770/5913] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:40:40 2022] PUT /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1061 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:40.848217 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2144/5914] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:40 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1392 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:40.871364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-552b8d8b-cc84-4dc9-b3a9-17e5ea1d97c7 req-e566a2d1-95be-4e40-8c9b-49801c4d2ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e63405d-08e7-4cb9-a5e7-3062422d4b5b", "name": "network-vif-plugged", "status": "completed", "tag": "3f7bd752-ef85-43dc-a585-23a64d74dc83"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:40.881808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:40.882761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:40.882871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-552b8d8b-cc84-4dc9-b3a9-17e5ea1d97c7 req-e566a2d1-95be-4e40-8c9b-49801c4d2ae1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.883315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-552b8d8b-cc84-4dc9-b3a9-17e5ea1d97c7 req-e566a2d1-95be-4e40-8c9b-49801c4d2ae1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.883944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-552b8d8b-cc84-4dc9-b3a9-17e5ea1d97c7 req-e566a2d1-95be-4e40-8c9b-49801c4d2ae1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.891282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.897248 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-552b8d8b-cc84-4dc9-b3a9-17e5ea1d97c7 req-e566a2d1-95be-4e40-8c9b-49801c4d2ae1 service nova] Creating event network-vif-plugged:3f7bd752-ef85-43dc-a585-23a64d74dc83 for instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b on n-h2-862404-2 Oct 28 18:40:40.902656 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-552b8d8b-cc84-4dc9-b3a9-17e5ea1d97c7 req-e566a2d1-95be-4e40-8c9b-49801c4d2ae1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056269 Oct 28 18:40:40.903427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.904041 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3771/5915] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:40.904157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.905060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.906248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.907348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.133494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:41.134975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:41.147942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.149049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.149725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.150966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.152228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.153050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.179506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:41.196570 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43881bf4-785c-4186-b4bf-d36c7406dfcd tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1488 microversion: 2.1 time: 0.327098 Oct 28 18:40:41.197537 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2145/5916] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:40 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1488 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:41.225505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:41.228295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:41.245168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.246023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.246810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.247760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.248436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.249182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.297255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:41.306890 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eeba8537-7d65-4137-9615-8140a1ee18eb tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1272 microversion: 2.1 time: 0.179438 Oct 28 18:40:41.307753 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3772/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:41 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:41.671164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:41.682389 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2769bab9-6e8d-430f-96ea-df1825dbb552 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1488 microversion: 2.1 time: 0.460945 Oct 28 18:40:41.682987 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2146/5918] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:41 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1488 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:41.707524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:41.708346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:41.714757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.715428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.716150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.716995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.717653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.718287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.765140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:40:41.875646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:41.876390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:41.927427 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e75ad887-0d42-46e7-ae0d-748047caf20f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 204 len: 0 microversion: 2.1 time: 0.223848 Oct 28 18:40:41.928599 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3773/5919] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:41 2022] DELETE /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:40:41.939087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:41.939294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.940346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:41.941258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.942766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.946110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.946920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.947439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.949156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.951747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.952509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.954862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:41.955556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:41.956300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:41.983480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:42.215927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:42.230864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4baa3408-d3c7-4e7e-9605-08032a1b4a3f tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1494 microversion: 2.1 time: 0.297930 Oct 28 18:40:42.233012 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3774/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:41 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1494 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:42.352231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:42.352896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:42.363204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:42.363707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:42.364185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:42.377798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:42.378308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:42.378931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:42.674628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:42.682753 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e8e095d-1bc4-49dc-9aaa-ea5a3b5e51c3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1392 microversion: 2.1 time: 0.811929 Oct 28 18:40:42.696412 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2147/5921] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:41 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1392 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:42.834183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:42.848558 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf2ad505-f105-41d5-a113-759c20c097f7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 0.508173 Oct 28 18:40:42.857955 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3775/5922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:42 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:43.255267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:43.256215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:43.265782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:43.268486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:43.268998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:43.269591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:43.270172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:43.270638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:43.282101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:43.706913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:43.707535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:43.717602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:43.718107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:43.719128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:43.719966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:43.720605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:43.726282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:43.732872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:43.751329 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b69eb351-4c74-44ac-ae11-609154f8d84c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1494 microversion: 2.1 time: 0.499975 Oct 28 18:40:43.756147 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2148/5923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:43 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1494 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:43.881669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:43.882330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:43.894813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:43.895772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:43.896492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:43.897400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:43.898708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:43.899703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:43.990092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:43.998819 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07e8c245-2c87-44f9-9b40-21d1b7dbd2a0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1565 microversion: 2.1 time: 0.296004 Oct 28 18:40:43.999447 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3776/5924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:43 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1565 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:44.033999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:44.034921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:44.042648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:44.043424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:44.044105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:44.044988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:44.045605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:44.046339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:44.291192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:44.300957 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4bc2fb6c-828f-4709-87e0-a7ca56655027 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1565 microversion: 2.1 time: 0.273045 Oct 28 18:40:44.306698 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3777/5925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:44 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1565 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:44.775603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:44.776470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:44.787386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:44.787924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:44.788363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:44.789479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:44.789479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:44.789917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:44.920167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:44.937444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61daa977-7439-4ab9-8424-460d4c9776f8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 200 len: 1452 microversion: 2.1 time: 0.166599 Oct 28 18:40:44.938283 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3778/5926] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:44 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:45.067943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:45.081154 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-347237b6-a84b-40aa-a648-b68cd589d6a1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 1.203486 Oct 28 18:40:45.083014 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2149/5927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:43 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:45.116319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-760fac26-c7b0-4cae-afb5-778562ac663e req-eece00a1-61c0-4363-9fa4-a055b2a595d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3723a7b3-c1fe-4b80-96c8-eb04db93a1ef", "name": "network-vif-deleted", "tag": "6f09390d-6914-40ca-833d-99853ff40d0c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:45.139745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-760fac26-c7b0-4cae-afb5-778562ac663e req-eece00a1-61c0-4363-9fa4-a055b2a595d0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:45.140300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-760fac26-c7b0-4cae-afb5-778562ac663e req-eece00a1-61c0-4363-9fa4-a055b2a595d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:45.140887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-760fac26-c7b0-4cae-afb5-778562ac663e req-eece00a1-61c0-4363-9fa4-a055b2a595d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:45.163502 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-760fac26-c7b0-4cae-afb5-778562ac663e req-eece00a1-61c0-4363-9fa4-a055b2a595d0 service nova] Creating event network-vif-deleted:6f09390d-6914-40ca-833d-99853ff40d0c for instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef on n-h1-862404-2 Oct 28 18:40:45.189074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-760fac26-c7b0-4cae-afb5-778562ac663e req-eece00a1-61c0-4363-9fa4-a055b2a595d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076536 Oct 28 18:40:45.193509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3779/5928] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:45.962260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:45.963061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:45.976772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:45.978466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:45.980347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:45.982489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:45.984834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:45.985767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.015645 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef HTTP/1.1 Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '3723a7b3-c1fe-4b80-96c8-eb04db93a1ef'} Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.017737 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.021481 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.021481 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.021481 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.021481 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.021481 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.021481 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.024299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.026801 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c5fe1f85-3605-4ce6-a3a4-c209a50fc166 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 404 len: 111 microversion: 2.1 time: 0.068502 Oct 28 18:40:46.027877 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2150/5929] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:45 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.051385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.053234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.073246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.074068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.074677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.076532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.077389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.080162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.097877 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.105411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.106585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef HTTP/1.1 Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '3723a7b3-c1fe-4b80-96c8-eb04db93a1ef'} Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.112978 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.117179 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.119301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.121966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.122468 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-10184761-1526-4830-a7d9-bba3d1e538a8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 404 len: 111 microversion: 2.1 time: 0.076434 Oct 28 18:40:46.123540 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3780/5930] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:46 2022] DELETE /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.124328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.125321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.126346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.131368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.134457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.137117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.137938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.158240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.167695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.168631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.170194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.173154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.177179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.216894 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef HTTP/1.1 Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '3723a7b3-c1fe-4b80-96c8-eb04db93a1ef'} Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.218585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.222559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.222559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.222559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.222559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.222559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. Oct 28 18:40:46.222559 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.222559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 3723a7b3-c1fe-4b80-96c8-eb04db93a1ef could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.225492 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51a72c2b-f1b6-4269-b4e5-ad0a76135a73 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef" status: 404 len: 111 microversion: 2.1 time: 0.092253 Oct 28 18:40:46.226131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3781/5931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/3723a7b3-c1fe-4b80-96c8-eb04db93a1ef => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.238833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.239696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.257747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.258476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.259074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.260119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.260742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.261316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.291401 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 HTTP/1.1 Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '23b2fa8b-e1eb-4342-b454-7af0ebc755c9'} Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.293418 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.298391 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.301622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.302642 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2356c55a-68ad-4558-a3bc-28bf4d259d97 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 404 len: 111 microversion: 2.1 time: 0.069720 Oct 28 18:40:46.308570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3782/5932] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:46 2022] DELETE /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.317450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.320188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 23b2fa8b-e1eb-4342-b454-7af0ebc755c9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.337171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.337691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.338146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.338883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.339349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.339780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.387182 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 HTTP/1.1 Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '23b2fa8b-e1eb-4342-b454-7af0ebc755c9'} Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.390150 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 23b2fa8b-e1eb-4342-b454-7af0ebc755c9 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c66210a-70c7-415a-9047-ac7a62663b04 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9" status: 404 len: 111 microversion: 2.1 time: 0.079782 Oct 28 18:40:46.393838 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3783/5933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/23b2fa8b-e1eb-4342-b454-7af0ebc755c9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.402731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.403536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.411388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.412508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.413197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.414117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.414821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.415439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.439798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d HTTP/1.1 Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '387da72b-6f52-4057-bed8-0c509954c49d'} Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.442059 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.445445 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.448672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.449747 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0dbc3e14-e669-4402-84c9-bbd4e8e1f149 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 404 len: 111 microversion: 2.1 time: 0.052574 Oct 28 18:40:46.450513 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3784/5934] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:46 2022] DELETE /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.459226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.460108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 387da72b-6f52-4057-bed8-0c509954c49d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.468765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.470052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.470773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.472414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.473081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.473701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.493341 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d HTTP/1.1 Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '387da72b-6f52-4057-bed8-0c509954c49d'} Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.496009 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.501515 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.501515 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.501515 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.501515 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.501515 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. Oct 28 18:40:46.501515 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.501515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 387da72b-6f52-4057-bed8-0c509954c49d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.502387 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4678a140-ca7a-4c01-af45-5c9911bcdbe3 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d" status: 404 len: 111 microversion: 2.1 time: 0.046378 Oct 28 18:40:46.503049 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3785/5935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/387da72b-6f52-4057-bed8-0c509954c49d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:40:46.517705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.518226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.532526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.532925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.535405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.536187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.536662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.537099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.567248 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 HTTP/1.1 Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4c9ec074-c988-4a61-96c3-f38fdfa0da31'} Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.569071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c8e8f99-b65c-4c7c-8924-8e6035545732 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 404 len: 111 microversion: 2.1 time: 0.063039 Oct 28 18:40:46.573261 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3786/5936] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:46 2022] DELETE /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.581069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.582571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 4c9ec074-c988-4a61-96c3-f38fdfa0da31] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.590247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.590846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.591361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.592210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.593855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.595034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.620707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 HTTP/1.1 Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4c9ec074-c988-4a61-96c3-f38fdfa0da31'} Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.622805 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.627500 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.627500 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.627500 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.627500 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.627500 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. Oct 28 18:40:46.627500 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.629432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 4c9ec074-c988-4a61-96c3-f38fdfa0da31 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.630523 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d8f0bec-4eb7-4e9f-8448-37f6af7b0f03 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31" status: 404 len: 111 microversion: 2.1 time: 0.054574 Oct 28 18:40:46.631736 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3787/5937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/4c9ec074-c988-4a61-96c3-f38fdfa0da31 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.642045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.642884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.650141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.651046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.651767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.652799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.653469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.654313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.699414 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d HTTP/1.1 Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0fb88800-02c5-4f93-a250-b10d8f1ecf5d'} Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.701312 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.705846 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.708658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.709813 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-921c5e9b-ad4b-4356-8d2d-ae23d1158883 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 404 len: 111 microversion: 2.1 time: 0.074415 Oct 28 18:40:46.710933 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3788/5938] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:46 2022] DELETE /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:40:46.720259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.720990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 0fb88800-02c5-4f93-a250-b10d8f1ecf5d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.728586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.729088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.730099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.730828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.731295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.731735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.746270 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d HTTP/1.1 Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0fb88800-02c5-4f93-a250-b10d8f1ecf5d'} Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.747966 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.752585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.752585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.752585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.752585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.752585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. Oct 28 18:40:46.752585 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.752585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 0fb88800-02c5-4f93-a250-b10d8f1ecf5d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.752585 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3256f9e6-e783-478e-9876-9756279fbee2 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d" status: 404 len: 111 microversion: 2.1 time: 0.033513 Oct 28 18:40:46.754699 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3789/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/0fb88800-02c5-4f93-a250-b10d8f1ecf5d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.762145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.762145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.784209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.784713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.785159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.785882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.800171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.800171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.847704 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 HTTP/1.1 Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '26c64bd4-4bba-4f15-be74-b59a7a93ff40'} Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.849386 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe090fb0-f814-41ca-8c71-d22f8b21ed8c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 404 len: 111 microversion: 2.1 time: 0.095117 Oct 28 18:40:46.857461 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3790/5940] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:46 2022] DELETE /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.872121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.873438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: 26c64bd4-4bba-4f15-be74-b59a7a93ff40] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.889754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.891075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.891925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.892868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.894473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.895181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.925155 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 HTTP/1.1 Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '26c64bd4-4bba-4f15-be74-b59a7a93ff40'} Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.927216 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.931693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.931693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.931693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.931693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.931693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. Oct 28 18:40:46.931693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.935547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance 26c64bd4-4bba-4f15-be74-b59a7a93ff40 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.936756 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81b30f90-c543-4337-b001-15076f0aa7c1 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40" status: 404 len: 111 microversion: 2.1 time: 0.078545 Oct 28 18:40:46.941878 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3791/5941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/26c64bd4-4bba-4f15-be74-b59a7a93ff40 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.948618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6469de1d-365d-4a5d-8dac-36aaf0c60099 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.949459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6469de1d-365d-4a5d-8dac-36aaf0c60099 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: f3c371a0-32e1-489d-86db-74dc34d3aec1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:46.957277 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6469de1d-365d-4a5d-8dac-36aaf0c60099 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6469de1d-365d-4a5d-8dac-36aaf0c60099 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1 HTTP/1.1 Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f3c371a0-32e1-489d-86db-74dc34d3aec1'} Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:46.960526 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.964640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:46.964640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:46.964640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:46.964640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:46.964640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:46.964640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:46.964640 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:46.967531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6469de1d-365d-4a5d-8dac-36aaf0c60099 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:46.969374 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6469de1d-365d-4a5d-8dac-36aaf0c60099 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1" status: 404 len: 111 microversion: 2.1 time: 0.024879 Oct 28 18:40:46.970921 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3792/5942] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:46 2022] DELETE /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:46.984918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4cd4278c-25c0-46cf-9c8f-3672570758d8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.988058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4cd4278c-25c0-46cf-9c8f-3672570758d8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: f3c371a0-32e1-489d-86db-74dc34d3aec1] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:47.009320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:47.021301 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed34d83e-1aeb-4310-86c9-9637b874c3dd tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 0.920280 Oct 28 18:40:47.021902 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2151/5943] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:47.024270 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4cd4278c-25c0-46cf-9c8f-3672570758d8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4cd4278c-25c0-46cf-9c8f-3672570758d8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1 HTTP/1.1 Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f3c371a0-32e1-489d-86db-74dc34d3aec1'} Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:47.025988 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:47.030317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:47.030317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:47.030317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. Oct 28 18:40:47.030317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:47.031986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4cd4278c-25c0-46cf-9c8f-3672570758d8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance f3c371a0-32e1-489d-86db-74dc34d3aec1 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:47.033016 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4cd4278c-25c0-46cf-9c8f-3672570758d8 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1" status: 404 len: 111 microversion: 2.1 time: 0.057563 Oct 28 18:40:47.037070 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3793/5944] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/f3c371a0-32e1-489d-86db-74dc34d3aec1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:47.042958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:47.043791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:47.052769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:47.053510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:47.054166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:47.055095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:47.055766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:47.056453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:47.128003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:40:47.217482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:47.288426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1b870d4d-1f23-4502-895d-1e793496bcc9 req-a3e5b6d7-4dd5-41d9-8267-91ca2dee97aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6233d002-520e-4789-bdbe-6cd545986651", "tag": "886f131a-6513-4d95-b68c-53edfb66c014"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:47.318648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1b870d4d-1f23-4502-895d-1e793496bcc9 req-a3e5b6d7-4dd5-41d9-8267-91ca2dee97aa service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:47.336759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1b870d4d-1f23-4502-895d-1e793496bcc9 req-a3e5b6d7-4dd5-41d9-8267-91ca2dee97aa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:47.338043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1b870d4d-1f23-4502-895d-1e793496bcc9 req-a3e5b6d7-4dd5-41d9-8267-91ca2dee97aa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:47.352734 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-610811df-5377-48f8-9c8a-5b975c8a4336 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 204 len: 0 microversion: 2.1 time: 0.313769 Oct 28 18:40:47.353335 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2152/5945] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:47 2022] DELETE /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:40:47.364719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:47.365671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:47.373141 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1b870d4d-1f23-4502-895d-1e793496bcc9 req-a3e5b6d7-4dd5-41d9-8267-91ca2dee97aa service nova] Creating event network-changed:886f131a-6513-4d95-b68c-53edfb66c014 for instance 6233d002-520e-4789-bdbe-6cd545986651 on n-h1-862404-2 Oct 28 18:40:47.378391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:47.381632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:47.382345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:47.384967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:47.386097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:47.390113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:47.393615 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1b870d4d-1f23-4502-895d-1e793496bcc9 req-a3e5b6d7-4dd5-41d9-8267-91ca2dee97aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108784 Oct 28 18:40:47.398165 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3794/5946] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:40:47.736380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:47.759650 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d825d0f4-c28c-4f12-9856-e910e173e2e7 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1477 microversion: 2.1 time: 0.401660 Oct 28 18:40:47.760593 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2153/5947] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:47 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:48.045222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:48.045944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:48.057649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:48.058000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:48.075174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:48.076248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:48.076740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:48.079518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:48.335473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:48.343761 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4d49ece-9aa6-4bd3-bf8e-06ae14416684 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 0.302758 Oct 28 18:40:48.349174 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3795/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:48 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:48.714578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:48.716129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:48.722289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:48.723408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:48.733610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:48.735442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:48.736143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:48.737122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:48.737797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:48.738624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:48.791657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:48.794046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:48.815756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:48.816435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:48.817180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:48.819913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:48.820564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:48.821103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:48.951271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:48.954953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:48.966173 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ac83885-e8b5-45a8-bc2a-7e857c2c6510 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1565 microversion: 2.1 time: 0.253359 Oct 28 18:40:48.969328 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2154/5949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:48 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:49.370750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:49.371782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:49.384933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:49.393497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:49.394685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:49.395707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:49.396496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:49.397141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:49.559667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:49.587920 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b99464f-e5e9-450d-ae2f-52c2d659266c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1477 microversion: 2.1 time: 0.806276 Oct 28 18:40:49.588543 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3796/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:48 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1477 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:49.665304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-50f9fc11-bd7a-4928-b4b9-cb800b0a74ac req-5e9b3a46-c05a-4bfb-9d5e-b4d1dce33656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e63405d-08e7-4cb9-a5e7-3062422d4b5b", "tag": "3f7bd752-ef85-43dc-a585-23a64d74dc83"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:49.684972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-50f9fc11-bd7a-4928-b4b9-cb800b0a74ac req-5e9b3a46-c05a-4bfb-9d5e-b4d1dce33656 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:49.686453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-50f9fc11-bd7a-4928-b4b9-cb800b0a74ac req-5e9b3a46-c05a-4bfb-9d5e-b4d1dce33656 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:49.687624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-50f9fc11-bd7a-4928-b4b9-cb800b0a74ac req-5e9b3a46-c05a-4bfb-9d5e-b4d1dce33656 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:49.704372 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-50f9fc11-bd7a-4928-b4b9-cb800b0a74ac req-5e9b3a46-c05a-4bfb-9d5e-b4d1dce33656 service nova] Creating event network-changed:3f7bd752-ef85-43dc-a585-23a64d74dc83 for instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b on n-h2-862404-2 Oct 28 18:40:49.729490 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-50f9fc11-bd7a-4928-b4b9-cb800b0a74ac req-5e9b3a46-c05a-4bfb-9d5e-b4d1dce33656 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074853 Oct 28 18:40:49.734954 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3797/5951] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:49.760139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2d703146-960c-4df6-9a2e-7ab3c1a8f0d6 req-ea096c58-1f40-4b94-bdb6-34d5f100e5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd32c27b-92bb-4507-84cf-f224740d9143", "name": "network-vif-deleted", "tag": "508fbfa8-2871-4a2f-b9c8-13f38bbecff4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:49.796089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2d703146-960c-4df6-9a2e-7ab3c1a8f0d6 req-ea096c58-1f40-4b94-bdb6-34d5f100e5c5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:49.814340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2d703146-960c-4df6-9a2e-7ab3c1a8f0d6 req-ea096c58-1f40-4b94-bdb6-34d5f100e5c5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:49.814999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2d703146-960c-4df6-9a2e-7ab3c1a8f0d6 req-ea096c58-1f40-4b94-bdb6-34d5f100e5c5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:49.853268 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2d703146-960c-4df6-9a2e-7ab3c1a8f0d6 req-ea096c58-1f40-4b94-bdb6-34d5f100e5c5 service nova] Creating event network-vif-deleted:508fbfa8-2871-4a2f-b9c8-13f38bbecff4 for instance cd32c27b-92bb-4507-84cf-f224740d9143 on n-h2-862404-2 Oct 28 18:40:49.877237 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2d703146-960c-4df6-9a2e-7ab3c1a8f0d6 req-ea096c58-1f40-4b94-bdb6-34d5f100e5c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129968 Oct 28 18:40:49.879347 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3798/5952] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:50.281173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:50.302035 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b525d983-6628-41f5-a706-59ca44e95d37 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 0.934622 Oct 28 18:40:50.320020 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2155/5953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:49 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:50.612479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:50.613236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:50.639726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:50.641515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:50.641515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:50.642156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:50.642617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:50.643048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:50.746632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:50.747147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:50.747588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:50.748381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lazy-loading 'fault' on Instance uuid cd32c27b-92bb-4507-84cf-f224740d9143 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:40:50.935568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735e781a390044d4a986c1aba207421a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12c957db6f44e958801cb0beab9507d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:50.945105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dd380226-d26f-42f3-973f-e18a2a7eb452 tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 200 len: 1281 microversion: 2.1 time: 0.338042 Oct 28 18:40:50.948237 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3799/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:50 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:51.335093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:51.336315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:51.365146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:51.366238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:51.369055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:51.370184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:51.370812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:51.372277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:51.756289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:51.771703 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14af0c49-660f-48f1-aa71-076aa6274ed4 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 0.444370 Oct 28 18:40:51.775490 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2156/5955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:51 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:51.973520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:51.975062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] [instance: cd32c27b-92bb-4507-84cf-f224740d9143] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:51.994650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:51.997996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:52.000329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:52.001870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:52.007299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:52.008199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:52.051373 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] HTTP exception thrown: Instance cd32c27b-92bb-4507-84cf-f224740d9143 could not be found. Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Request method failure captured: Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 HTTP/1.1 Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCFpGl9cGtllH5dA5enCzD1PDzwiFJpggM5vEijcJmNjDBPi8uyZtm5qIZKBzHn_edIRmVwLLd_j1rYHtZAlXclt9YPawn9mJlD6qDQUUj8UjuEHMQyyBFYRdTL3sqN0w2bufFFBF8MtkPUBDXYZ2mlIbpbXuDDTaYETbGS6ZMEvh0I Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f12c957db6f44e958801cb0beab9507d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f12c957db6f44e958801cb0beab9507d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersTestJSON-563545102 Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: f12c957db6f44e958801cb0beab9507d Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersTestJSON-563545102 Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersTestJSON-563545102-project Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 735e781a390044d4a986c1aba207421a Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersTestJSON-563545102-project Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance cd32c27b-92bb-4507-84cf-f224740d9143 could not be found. Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'cd32c27b-92bb-4507-84cf-f224740d9143'} Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd32c27b-92bb-4507-84cf-f224740d9143 could not be found. Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd32c27b-92bb-4507-84cf-f224740d9143 could not be found. Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:52.056377 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:52.060733 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:52.060733 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:52.060733 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:52.060733 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:52.060733 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd32c27b-92bb-4507-84cf-f224740d9143 could not be found. Oct 28 18:40:52.060733 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:40:52.062795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] Returning 404 to user: Instance cd32c27b-92bb-4507-84cf-f224740d9143 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:52.065849 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e18c6bc-f125-4d07-86bb-d42bb0a4810c tempest-ServersTestJSON-563545102 tempest-ServersTestJSON-563545102-project] 10.222.0.16 "GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143" status: 404 len: 111 microversion: 2.1 time: 0.098078 Oct 28 18:40:52.066682 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3800/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:51 2022] GET /compute/v2.1/servers/cd32c27b-92bb-4507-84cf-f224740d9143 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:52.805218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:52.806092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:52.815851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:52.816362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:52.816800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:52.826470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:52.828673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:52.830636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:53.609719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:53.626495 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-37fa6d89-1775-4e91-a180-718782754ac8 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 0.825150 Oct 28 18:40:53.627106 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2157/5957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:52 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:54.335339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-eb34eed9-78b8-49da-9c3e-a5f222240a7e req-7815a03d-5808-4e12-baf4-8c30f3773164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6233d002-520e-4789-bdbe-6cd545986651", "name": "network-vif-plugged", "status": "completed", "tag": "886f131a-6513-4d95-b68c-53edfb66c014"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:54.355590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb34eed9-78b8-49da-9c3e-a5f222240a7e req-7815a03d-5808-4e12-baf4-8c30f3773164 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:54.356097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb34eed9-78b8-49da-9c3e-a5f222240a7e req-7815a03d-5808-4e12-baf4-8c30f3773164 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:54.356532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-eb34eed9-78b8-49da-9c3e-a5f222240a7e req-7815a03d-5808-4e12-baf4-8c30f3773164 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:54.406139 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-eb34eed9-78b8-49da-9c3e-a5f222240a7e req-7815a03d-5808-4e12-baf4-8c30f3773164 service nova] Creating event network-vif-plugged:886f131a-6513-4d95-b68c-53edfb66c014 for instance 6233d002-520e-4789-bdbe-6cd545986651 on n-h1-862404-2 Oct 28 18:40:54.410569 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-eb34eed9-78b8-49da-9c3e-a5f222240a7e req-7815a03d-5808-4e12-baf4-8c30f3773164 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078891 Oct 28 18:40:54.412337 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3801/5958] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:54.654493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:54.656980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:54.666731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:54.667687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:54.668382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:54.670013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:54.671151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:54.671792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:54.981959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:54.994050 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df5a0f85-380e-4cbc-969c-b60a328c1724 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 0.347366 Oct 28 18:40:54.998578 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2158/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:54 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:56.041304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:56.044348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:56.082641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:56.091584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:56.092243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:56.093899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:56.094688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:56.095803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:57.033755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:57.046896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-698f2157-5c10-4e95-93d2-3136a737834c tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1314 microversion: 2.1 time: 1.024917 Oct 28 18:40:57.050595 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3802/5960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:56 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1314 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:58.073935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:58.075531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:58.091874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:58.092379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:58.092862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:58.097829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:58.098334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:58.098788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:58.810644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:58.829869 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cbb804ed-38b5-46c0-b7f8-4131cb2ed3c1 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1463 microversion: 2.1 time: 0.757071 Oct 28 18:40:58.845244 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2159/5961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:58 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1463 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:58.864681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f4b4106-ba25-439a-9e40-fae4b25f2b06", "device": "/dev/sdb"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:58.870416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:40:58.889664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:58.890870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:58.891615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:58.892605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:58.893273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:58.895087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:59.250937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:59.614693 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba59ae2a-fa02-47de-90f4-767356f69fca tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "POST /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756649 Oct 28 18:40:59.622990 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3803/5962] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 18:40:58 2022] POST /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:07.314868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb6b28d0-0483-4826-b52b-1f5a31d562ba tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1349461117", "availability_zone": "foo_zone"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:07.345473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.aggregate [None req-eb6b28d0-0483-4826-b52b-1f5a31d562ba tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Generated uuid ef8b4ed9-838c-4126-b0c0-9f9920866806 for aggregate {{(pid=120679) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:41:07.427880 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eb6b28d0-0483-4826-b52b-1f5a31d562ba tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.439045 Oct 28 18:41:07.440508 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2160/5963] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 18:41:06 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:07.463070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b968f0c-3751-4a85-a81a-358f8365b12d tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:07.505615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:07.570666 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b968f0c-3751-4a85-a81a-358f8365b12d tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.131762 Oct 28 18:41:07.572023 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3804/5964] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:41:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:07.590284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea1ec55c-8f82-49aa-a631-6d0af8e0dbf4 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:07.597147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1ec55c-8f82-49aa-a631-6d0af8e0dbf4 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:07.610038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1ec55c-8f82-49aa-a631-6d0af8e0dbf4 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:07.612022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1ec55c-8f82-49aa-a631-6d0af8e0dbf4 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:07.618687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1ec55c-8f82-49aa-a631-6d0af8e0dbf4 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:07.621440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1ec55c-8f82-49aa-a631-6d0af8e0dbf4 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:07.622460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea1ec55c-8f82-49aa-a631-6d0af8e0dbf4 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:07.744348 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea1ec55c-8f82-49aa-a631-6d0af8e0dbf4 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.163130 Oct 28 18:41:07.746621 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2161/5965] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 18:41:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:07.763805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5ab4293-6e70-410d-8f3d-ac18a9a64c7d tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:07.772125 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5ab4293-6e70-410d-8f3d-ac18a9a64c7d tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014603 Oct 28 18:41:07.781545 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3805/5966] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 18:41:07 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:07.786519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c86b57a-dea9-4ad8-9bb6-c958c02d2024 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-862404-2"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:07.808478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c86b57a-dea9-4ad8-9bb6-c958c02d2024 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:07.810571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c86b57a-dea9-4ad8-9bb6-c958c02d2024 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:07.813911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c86b57a-dea9-4ad8-9bb6-c958c02d2024 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:08.222387 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c86b57a-dea9-4ad8-9bb6-c958c02d2024 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.439910 Oct 28 18:41:08.223538 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2162/5967] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:41:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:08.238130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cc9480a-51ef-4242-b10f-480c7dba129d tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:08.249958 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cc9480a-51ef-4242-b10f-480c7dba129d tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.015861 Oct 28 18:41:08.251465 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3806/5968] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:41:08 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:08.266137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-56e22ea4-3b03-4cb7-82de-9113f9b3c8f9 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-734479666", "availability_zone": "foo_zone"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:08.566857 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-56e22ea4-3b03-4cb7-82de-9113f9b3c8f9 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.306077 Oct 28 18:41:08.570769 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2163/5969] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 18:41:08 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:08.585361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f671ebc-ec99-4474-addc-68fba9ffeebd tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:08.645302 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f671ebc-ec99-4474-addc-68fba9ffeebd tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.066097 Oct 28 18:41:08.650379 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3807/5970] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:41:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:08.662380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b111fe11-a90d-429a-83b9-405c07729d90 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:08.685477 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b111fe11-a90d-429a-83b9-405c07729d90 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.026946 Oct 28 18:41:08.694842 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2164/5971] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 18:41:08 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:08.708508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79762d54-68d0-40a2-9e90-fd37429c30b1 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-862404-2"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:08.745604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79762d54-68d0-40a2-9e90-fd37429c30b1 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:08.745604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79762d54-68d0-40a2-9e90-fd37429c30b1 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:08.746138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79762d54-68d0-40a2-9e90-fd37429c30b1 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:09.156960 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79762d54-68d0-40a2-9e90-fd37429c30b1 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.460161 Oct 28 18:41:09.158109 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3808/5972] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 18:41:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:09.170339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-18ecf756-486c-43e5-a586-38e58362a3e7 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:09.251332 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-18ecf756-486c-43e5-a586-38e58362a3e7 tempest-TestAggregatesBasicOps-623924766 tempest-TestAggregatesBasicOps-623924766-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.085852 Oct 28 18:41:09.253961 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2165/5973] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 18:41:09 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 18:41:10.237200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:10.244380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:10.267653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:10.272213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:10.275000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:10.278744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:10.280823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:10.283308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:10.398067 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d44f3b87-240d-4e25-b255-eaac3df17654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b/action" status: 200 len: 24570 microversion: 2.1 time: 0.167386 Oct 28 18:41:10.400692 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3809/5974] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:41:10 2022] POST /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b/action => generated 24570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:41:14.669224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-451264284", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:14.693077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:14.828270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] validate_networks() for [('384418cc-86cf-4a13-b7a1-6bd7b463bb92', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:41:16.122717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:41:16.125730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:41:16.126505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:41:16.127143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:41:16.127788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:41:16.166214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:16.182316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:16.183276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:16.186225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:16.187028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:16.192563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:16.251127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Getting quotas for project 072aaddceb9e44a7b5bb9234d6846a70. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:41:16.264037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Getting quotas for user aea5186334f04a09b3ba8496d6658a94 and project 072aaddceb9e44a7b5bb9234d6846a70. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:41:16.295248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:41:16.299629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:41:16.410016 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ac58a93c-7692-40e2-96b4-1dbfb1711dc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973270 Oct 28 18:41:16.413599 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2166/5975] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:41:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:41:16.423649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ecc34dbf-e16a-4f45-a432-35ad3add3477 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:16.425166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ecc34dbf-e16a-4f45-a432-35ad3add3477 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:16.925333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ecc34dbf-e16a-4f45-a432-35ad3add3477 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:16.934912 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ecc34dbf-e16a-4f45-a432-35ad3add3477 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1216 microversion: 2.1 time: 0.516261 Oct 28 18:41:16.938177 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3810/5976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:16 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1216 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:17.962227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:17.962845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:17.973735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:17.977674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:17.978276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:17.979124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:17.979567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:17.980020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:18.013429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:18.226873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:18.247161 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d77626f0-98b2-435b-a814-472b5be47238 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1268 microversion: 2.1 time: 0.288494 Oct 28 18:41:18.250309 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2167/5977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:17 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1268 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:19.284636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:19.292320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:19.324232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:19.325254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:19.326669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:19.327946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:19.328848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:19.329559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:19.541826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:19.554788 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40e949c2-b702-4d1b-88b0-0805a4f4b7df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1274 microversion: 2.1 time: 0.284244 Oct 28 18:41:19.560418 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3811/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:19 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1274 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:20.585261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:20.585958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:20.601600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:20.602843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:20.606278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:20.607525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:20.608972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:20.614086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:20.806539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:20.828903 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-10d47cf4-b5b8-4378-9a59-4f03f9dbe2d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1274 microversion: 2.1 time: 0.247746 Oct 28 18:41:20.832333 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2168/5979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:20 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:21.548895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:21.549531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:21.583679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:21.586244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:21.588143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:21.589491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:21.594333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:21.594997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:21.862048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:21.862670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:21.888975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:21.890709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:21.892445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:21.895232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:21.895994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:21.900165 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5772ff4-974e-47bb-aa71-8b12fecd3982 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1684 microversion: 2.1 time: 0.376263 Oct 28 18:41:21.900635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:21.902924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:21.916681 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3812/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:21 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1684 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:22.047673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:22.050161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:22.083503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:22.089609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:22.093520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:22.094368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:22.094856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:22.095301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:22.183285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b28a09ee-b36f-4d38-bab5-70d44f02335b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b/action" status: 200 len: 32641 microversion: 2.1 time: 0.150111 Oct 28 18:41:22.192901 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3813/5981] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:41:22 2022] POST /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b/action => generated 32641 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:41:22.367326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:22.368944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:22.407540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:22.410031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:22.412850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:22.413928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:22.415563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:22.418883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:22.886380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6046f560-9d2f-429c-b084-c44662c4417e tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1835 microversion: 2.1 time: 0.523371 Oct 28 18:41:22.887331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3814/5982] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:22 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1835 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:22.928806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:22.931690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:22.959113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:22.960644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:22.962096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:22.965631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:22.969053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:22.969636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:23.052598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lazy-loading 'flavor' on Instance uuid 5e63405d-08e7-4cb9-a5e7-3062422d4b5b {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:41:23.081719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Going to try to live migrate instance to another host {{(pid=120680) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 28 18:41:23.142967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:23.153408 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-763391ef-d7d7-4d7e-909c-6c78f7de2ba3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1316 microversion: 2.1 time: 1.302655 Oct 28 18:41:23.154549 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2169/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:21 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1316 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:41:24.182628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:24.183240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:24.201521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:24.202053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:24.202497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:24.203217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:24.203675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:24.204133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:25.407471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:25.435799 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6619ec42-a9c6-46ca-b3b7-222938fe68dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1316 microversion: 2.1 time: 1.256885 Oct 28 18:41:25.436782 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2170/5984] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:24 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1316 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:25.443062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-76ee5eb5-2936-4bc6-9a64-ca5101b53c5c req-d6bbcf4e-277a-47e3-94db-029bec3b5729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614a9ab9-91a1-4941-96d6-3d2837c9993d", "tag": "dc97c4e6-2ee1-49ff-988b-49ca90baefa7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:25.466940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-76ee5eb5-2936-4bc6-9a64-ca5101b53c5c req-d6bbcf4e-277a-47e3-94db-029bec3b5729 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:25.468652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-76ee5eb5-2936-4bc6-9a64-ca5101b53c5c req-d6bbcf4e-277a-47e3-94db-029bec3b5729 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:25.469212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-76ee5eb5-2936-4bc6-9a64-ca5101b53c5c req-d6bbcf4e-277a-47e3-94db-029bec3b5729 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:25.498147 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-76ee5eb5-2936-4bc6-9a64-ca5101b53c5c req-d6bbcf4e-277a-47e3-94db-029bec3b5729 service nova] Creating event network-changed:dc97c4e6-2ee1-49ff-988b-49ca90baefa7 for instance 614a9ab9-91a1-4941-96d6-3d2837c9993d on n-h1-862404-2 Oct 28 18:41:25.509941 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-76ee5eb5-2936-4bc6-9a64-ca5101b53c5c req-d6bbcf4e-277a-47e3-94db-029bec3b5729 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067917 Oct 28 18:41:25.510575 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2171/5985] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:26.464974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:26.466629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:26.495671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:26.499474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:26.502683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:26.503918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:26.504683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:26.510739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:26.512745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:26.513629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:26.936804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:27.483802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:27.518989 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fccc2c34-83f8-40ba-8cbc-f1ae5226cc71 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1316 microversion: 2.1 time: 1.059899 Oct 28 18:41:27.538160 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2172/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:26 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1316 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:27.946807 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9e4d73ef-8b34-403a-b82d-12790dba1cec tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b/action" status: 202 len: 0 microversion: 2.1 time: 5.023034 Oct 28 18:41:27.952847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3815/5987] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:41:22 2022] POST /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b/action => generated 0 bytes in 5030 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:41:27.959984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:27.963017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:27.976441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:27.977393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:27.978719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:27.980575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:27.982130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:27.985084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:28.245720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:28.263012 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b19b7044-f32d-47a1-9559-9765beb781e4 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.309102 Oct 28 18:41:28.278399 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2173/5988] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:27 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:41:28.545120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:28.545900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:28.575716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:28.576312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:28.577633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:28.578531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:28.579078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:28.579582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:28.802002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:28.813090 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e085f338-427a-4128-9d30-11534770809d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1316 microversion: 2.1 time: 0.272988 Oct 28 18:41:28.814277 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3816/5989] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:28 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:29.304160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:29.304823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:29.317543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:29.317896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:29.322020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:29.322756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:29.323908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:29.324662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:29.856240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:29.856240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:29.884687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:29.887783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:29.888589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:29.898318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:29.912324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:29.914732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:29.982189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:30.252283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:30.265081 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bd193e68-c9e9-4c6e-a798-a03c9b2ff65e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.971485 Oct 28 18:41:30.267545 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2174/5990] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:29 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:30.571042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:30.583760 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fb7298ff-b4b3-4671-b845-c8a44d090969 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1316 microversion: 2.1 time: 0.746314 Oct 28 18:41:30.584407 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3817/5991] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:29 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:41:31.297728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:31.299726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:31.326520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:31.327936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:31.329449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:31.331807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:31.333905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:31.335080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:31.616831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:31.618115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:31.631983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:31.632855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:31.633289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:31.635040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:31.635458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:31.635955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:31.874669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:31.893301 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ceb6ea3f-95c2-4289-9067-d3e3323ba7bc tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.600766 Oct 28 18:41:31.909621 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2175/5992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:31 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:31.917912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-11233ade-5189-4de9-8665-926cee69affb req-12568784-8ec8-4910-98f3-d4b5bb9597da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e63405d-08e7-4cb9-a5e7-3062422d4b5b", "name": "network-vif-unplugged", "status": "completed", "tag": "3f7bd752-ef85-43dc-a585-23a64d74dc83"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:31.947503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-11233ade-5189-4de9-8665-926cee69affb req-12568784-8ec8-4910-98f3-d4b5bb9597da service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:31.948278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-11233ade-5189-4de9-8665-926cee69affb req-12568784-8ec8-4910-98f3-d4b5bb9597da service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:31.948934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-11233ade-5189-4de9-8665-926cee69affb req-12568784-8ec8-4910-98f3-d4b5bb9597da service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:31.992619 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-11233ade-5189-4de9-8665-926cee69affb req-12568784-8ec8-4910-98f3-d4b5bb9597da service nova] Creating event network-vif-unplugged:3f7bd752-ef85-43dc-a585-23a64d74dc83 for instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b on n-h2-862404-2 Oct 28 18:41:31.995484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:32.002317 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-11233ade-5189-4de9-8665-926cee69affb req-12568784-8ec8-4910-98f3-d4b5bb9597da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091216 Oct 28 18:41:32.003191 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2176/5993] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:32.020844 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc58b245-81fa-4e43-b485-1e6d82dd27f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1316 microversion: 2.1 time: 0.409157 Oct 28 18:41:32.021874 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3818/5994] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:31 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:32.685725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-761a0c3a-65b9-49ed-afd5-221b27dca4e0 req-e8a374c8-3729-4719-a8b4-ea9a1d8f075a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614a9ab9-91a1-4941-96d6-3d2837c9993d", "name": "network-vif-plugged", "status": "completed", "tag": "dc97c4e6-2ee1-49ff-988b-49ca90baefa7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:32.701649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-761a0c3a-65b9-49ed-afd5-221b27dca4e0 req-e8a374c8-3729-4719-a8b4-ea9a1d8f075a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:32.703139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-761a0c3a-65b9-49ed-afd5-221b27dca4e0 req-e8a374c8-3729-4719-a8b4-ea9a1d8f075a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:32.703775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-761a0c3a-65b9-49ed-afd5-221b27dca4e0 req-e8a374c8-3729-4719-a8b4-ea9a1d8f075a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:32.731298 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-761a0c3a-65b9-49ed-afd5-221b27dca4e0 req-e8a374c8-3729-4719-a8b4-ea9a1d8f075a service nova] Creating event network-vif-plugged:dc97c4e6-2ee1-49ff-988b-49ca90baefa7 for instance 614a9ab9-91a1-4941-96d6-3d2837c9993d on n-h1-862404-2 Oct 28 18:41:32.753358 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-761a0c3a-65b9-49ed-afd5-221b27dca4e0 req-e8a374c8-3729-4719-a8b4-ea9a1d8f075a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070662 Oct 28 18:41:32.756215 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2177/5995] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:41:32.929727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:32.930431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:32.986002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:32.986426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:32.987878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:32.987878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:32.990846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:32.990846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:33.053505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:33.054340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:33.061766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:33.062441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:33.063033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:33.063753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:33.065185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:33.065652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:33.259173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:33.271584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a22ce09-d976-4716-b2ce-2d69c8a1ee55 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.348225 Oct 28 18:41:33.275972 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3819/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:32 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:33.368307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:33.377459 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4ff8403-9230-469d-9b4a-3380fd83061d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1316 microversion: 2.1 time: 0.329637 Oct 28 18:41:33.394711 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2178/5997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:33 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:34.086536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8b03c902-c708-40e2-98ed-1f400180fcb5 req-aabce71a-be09-428e-81a1-3629934be196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e63405d-08e7-4cb9-a5e7-3062422d4b5b", "tag": "3f7bd752-ef85-43dc-a585-23a64d74dc83"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:34.131890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8b03c902-c708-40e2-98ed-1f400180fcb5 req-aabce71a-be09-428e-81a1-3629934be196 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:34.135036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8b03c902-c708-40e2-98ed-1f400180fcb5 req-aabce71a-be09-428e-81a1-3629934be196 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:34.141312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8b03c902-c708-40e2-98ed-1f400180fcb5 req-aabce71a-be09-428e-81a1-3629934be196 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:34.164886 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8b03c902-c708-40e2-98ed-1f400180fcb5 req-aabce71a-be09-428e-81a1-3629934be196 service nova] Creating event network-changed:3f7bd752-ef85-43dc-a585-23a64d74dc83 for instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b on n-h2-862404-2 Oct 28 18:41:34.186288 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8b03c902-c708-40e2-98ed-1f400180fcb5 req-aabce71a-be09-428e-81a1-3629934be196 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099591 Oct 28 18:41:34.194138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3820/5998] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:34.298570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:34.300163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:34.315848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:34.316580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:34.318712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:34.319447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:34.321795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:34.322396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:34.414208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:34.414964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:34.442300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:34.442817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:34.443257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:34.444017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:34.444477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:34.447872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:34.759164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:34.773845 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b796611b-16d0-462f-b8ae-72856856c012 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.479325 Oct 28 18:41:34.774468 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2179/5999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:34 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:35.071418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:35.081722 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f616b0b5-93fa-463d-a2a7-054040895600 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1316 microversion: 2.1 time: 0.679397 Oct 28 18:41:35.082596 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3821/6000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:34 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:35.804653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:35.805565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:35.815928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:35.816580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:35.817089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:35.817804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:35.818328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:35.819578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:36.122671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:36.125303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:36.149613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:36.150365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:36.150810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:36.151532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:36.152692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:36.153145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:36.153356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:36.179741 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-15a3919a-fe9e-4925-a22f-4c2ce6484000 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.379784 Oct 28 18:41:36.181791 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2180/6001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:35 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:36.361311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:36.372630 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8197b361-d34a-4d14-a108-f123cc94c9c2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.265793 Oct 28 18:41:36.374622 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3822/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:36 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:36.539513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1484280915", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:36.618448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] validate_networks() for [('384418cc-86cf-4a13-b7a1-6bd7b463bb92', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:41:37.149025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:41:37.149599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:41:37.149935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:41:37.150631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:41:37.151231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:41:37.162129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:37.162870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:37.163470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:37.164231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:37.164856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:37.165421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:37.183986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Getting quotas for project 072aaddceb9e44a7b5bb9234d6846a70. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:41:37.189737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Getting quotas for user aea5186334f04a09b3ba8496d6658a94 and project 072aaddceb9e44a7b5bb9234d6846a70. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:41:37.204615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:41:37.210141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:37.211845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:37.219090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:41:37.223204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:37.224419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:37.231849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:37.233145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:37.234094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:37.234686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:37.324011 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5c37c35c-38fe-4c69-b83a-fcf71a42311d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789943 Oct 28 18:41:37.325230 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2181/6003] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:41:37.336515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d8c5c62-ce72-4d6a-9886-4ebb2d4b2ec2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:37.337575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0d8c5c62-ce72-4d6a-9886-4ebb2d4b2ec2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:37.437292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d8c5c62-ce72-4d6a-9886-4ebb2d4b2ec2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:37.448548 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d8c5c62-ce72-4d6a-9886-4ebb2d4b2ec2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1217 microversion: 2.1 time: 0.116557 Oct 28 18:41:37.449133 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2182/6004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:37 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:37.486525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:37.507297 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5eeeee6-4424-4c1e-acf2-d39a9dfed3e1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.300283 Oct 28 18:41:37.507926 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3823/6005] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:37 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:38.473727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:38.474346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:38.488657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:38.489693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:38.490151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:38.490933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:38.491394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:38.491842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:38.532861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:38.533476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:38.537017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:38.550422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:38.551473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:38.552112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:38.561804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:38.562296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:38.562933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:38.598259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:38.610056 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-487037b6-e6df-4b73-a3f5-9ad5d94c4a0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1269 microversion: 2.1 time: 0.140604 Oct 28 18:41:38.622708 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2183/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:38 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:38.829393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:38.844667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1dfa64e0-ea5e-45cb-a488-6fe6d6f6cff3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.316014 Oct 28 18:41:38.847356 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3824/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:38 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:39.635591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:39.636408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:39.643801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:39.644746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:39.645405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:39.646341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:39.647037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:39.647682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:39.723693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:39.736148 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a1a93d99-3d9a-4e01-b2ab-3b4f563a507a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1275 microversion: 2.1 time: 0.104243 Oct 28 18:41:39.752884 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2184/6008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:39 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:39.870597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:39.871847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:39.878953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:39.879655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:39.880296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:39.881160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:39.881795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:39.882374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:40.261426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:40.275664 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f42dd79-9165-4c49-ae3c-242e1f4f14ff tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.408837 Oct 28 18:41:40.277386 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3825/6009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:39 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:40.761016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:40.762233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:40.770070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:40.770565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:40.770999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:40.772278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:40.772758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:40.773184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:40.986589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:40.998135 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-950b6ba5-d4a7-4e5c-9c0a-d286f9fdf026 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1317 microversion: 2.1 time: 0.241598 Oct 28 18:41:41.011946 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2185/6010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:40 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:41.305185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:41.305800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:41.313796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:41.314521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:41.315151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:41.316043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:41.316650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:41.317317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:41.857300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:41.866684 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-53e0ece7-2b53-4182-8b22-d79e91b9e227 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.565297 Oct 28 18:41:41.867285 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3826/6011] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:41 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:42.026263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:42.027127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:42.044204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:42.049143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:42.051202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:42.054134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:42.055051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:42.056188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:42.259116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-666c8d54-9c49-4ebe-a08f-62576debba1a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Action: 'create', calling method: .version_select at 0x7f78dc8d73a0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1186440031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4qi3y1cSlRx5Wn7rpWO5+qksd/+h6U95j3xfAiIwTiZi+8VJ1My+Q+wRHXqYy+GhLReVMB+8wl0a6VZX1wfRNeEGorW6/KOAfx1nKwDKTqEwqAY9YN9UeoAesqt+A65g=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:42.282097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-666c8d54-9c49-4ebe-a08f-62576debba1a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Getting quotas for project 550388b231824fa598c7874ddea0f736. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:41:42.288706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-666c8d54-9c49-4ebe-a08f-62576debba1a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Getting quotas for user 3f07eff980e7453fac3aef7ba067a2ad and project 550388b231824fa598c7874ddea0f736. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:41:42.323144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-666c8d54-9c49-4ebe-a08f-62576debba1a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.068327 Oct 28 18:41:42.325274 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3827/6012] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:41:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:42.476866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:42.491126 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-56c262ff-0659-4234-a6ad-cb44811719bb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1317 microversion: 2.1 time: 0.470006 Oct 28 18:41:42.492600 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2186/6013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:42 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:42.731990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-af77d44d-a274-44a2-b8e5-71bce13183d4 req-af27544f-a06c-43b4-9eb9-a45d478bcf50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c668a51f-23af-4529-b61e-d9646e0675ef", "tag": "901a010a-c7cb-4db6-88c5-c4c5b9531c3f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:42.753666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af77d44d-a274-44a2-b8e5-71bce13183d4 req-af27544f-a06c-43b4-9eb9-a45d478bcf50 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:42.754353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af77d44d-a274-44a2-b8e5-71bce13183d4 req-af27544f-a06c-43b4-9eb9-a45d478bcf50 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:42.755097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af77d44d-a274-44a2-b8e5-71bce13183d4 req-af27544f-a06c-43b4-9eb9-a45d478bcf50 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:42.777182 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-af77d44d-a274-44a2-b8e5-71bce13183d4 req-af27544f-a06c-43b4-9eb9-a45d478bcf50 service nova] Creating event network-changed:901a010a-c7cb-4db6-88c5-c4c5b9531c3f for instance c668a51f-23af-4529-b61e-d9646e0675ef on n-h2-862404-2 Oct 28 18:41:42.789166 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-af77d44d-a274-44a2-b8e5-71bce13183d4 req-af27544f-a06c-43b4-9eb9-a45d478bcf50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060871 Oct 28 18:41:42.790456 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3828/6014] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:42.895574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:42.897078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:42.908846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:42.910045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:42.911552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:42.913819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:42.914759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:42.916070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:42.944244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:43.210790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:43.220079 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ce7a216-2e46-4fef-abbc-b15138de8488 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.333191 Oct 28 18:41:43.222989 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2187/6015] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:42 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:43.518209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:43.519087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:43.539226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:43.541905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:43.542692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:43.544837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:43.546053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:43.548545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:43.910810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:43.921229 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-89a8280f-5173-4eee-bcc9-3258dee8b340 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1317 microversion: 2.1 time: 0.409957 Oct 28 18:41:43.926278 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3829/6016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:43 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:44.250559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:44.251945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:44.269319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:44.270020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:44.272646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:44.273598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:44.275864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:44.276483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:44.558015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:44.572341 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e511eef-2d1e-4577-8897-26d7a33369dd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1694 microversion: 2.1 time: 0.325113 Oct 28 18:41:44.573009 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2188/6017] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:44 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1694 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:44.872368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1689839629", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ec860ef1-e267-42df-bf9f-4f9ba0ba2fc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1186440031", "security_groups": [{"name": "tempest-secgroup-smoke-512166903"}], "networks": [{"uuid": "63abc95d-5f25-4261-8614-6a5b33309b7d"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:44.945446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:44.946429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:44.948760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:44.958528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:44.959513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:44.960211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:44.967972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:44.968691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:44.969374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:45.206497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] validate_networks() for [('63abc95d-5f25-4261-8614-6a5b33309b7d', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:41:45.235031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:45.243062 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7ba3b75f-3272-407c-8535-91a1cc27290b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1317 microversion: 2.1 time: 0.301724 Oct 28 18:41:45.244011 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2189/6018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:44 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:41:45.599028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:45.600398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:45.611996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:45.614853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:45.615434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:45.616265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:45.619706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:45.620325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:46.066417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:46.085101 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-920709e2-eb87-4b78-b9b3-f19f710c4787 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1684 microversion: 2.1 time: 0.489888 Oct 28 18:41:46.087013 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2190/6019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:45 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1684 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:46.114438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:46.115188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:46.127000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:46.127511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:46.127998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:46.137178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:46.142403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:46.143122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:46.424320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:41:46.425556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:41:46.425990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:41:46.426388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:41:46.426816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:41:46.446590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:46.447301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:46.450088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:46.452168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:46.454055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:46.455475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:46.513169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Getting quotas for project 550388b231824fa598c7874ddea0f736. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:41:46.530936 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-97a99185-0187-46de-ad2e-7ea17143b78b tempest-TestNetworkAdvancedServerOps-907512639 tempest-TestNetworkAdvancedServerOps-907512639-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1835 microversion: 2.1 time: 0.420434 Oct 28 18:41:46.531306 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2191/6020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:46 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1835 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:46.538158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Getting quotas for user 3f07eff980e7453fac3aef7ba067a2ad and project 550388b231824fa598c7874ddea0f736. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:41:46.541019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:46.541778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:46.554782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:46.571685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:46.577179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:46.584130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:46.584717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:46.585179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:46.669931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:41:46.672967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec860ef1-e267-42df-bf9f-4f9ba0ba2fc0',volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:41:46.999120 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca20c25b-450b-4066-b544-6548512cd519 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.130958 Oct 28 18:41:46.999839 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3830/6021] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:41:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:41:47.010188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:47.010824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:47.024956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:47.025468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:47.025917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:47.026638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:47.027091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:47.027523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:47.175321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:47.255514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:47.270562 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0687e958-b062-4a73-876f-fc83ab31316e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1684 microversion: 2.1 time: 0.269614 Oct 28 18:41:47.281090 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3831/6022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:46 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1684 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:47.285748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba0f4977-0b63-401d-92b0-42f50e290889 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:47.304344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba0f4977-0b63-401d-92b0-42f50e290889 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:47.347495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:47.375595 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-422e61bd-ec46-4185-ad4a-deef29eb1909 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1317 microversion: 2.1 time: 0.838193 Oct 28 18:41:47.380848 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2192/6023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:46 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1317 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:47.493077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba0f4977-0b63-401d-92b0-42f50e290889 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:47.502781 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba0f4977-0b63-401d-92b0-42f50e290889 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1099 microversion: 2.1 time: 0.220272 Oct 28 18:41:47.504943 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3832/6024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:47 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1099 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:47.561026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:47.564124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:47.575788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:47.580278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:47.582468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:47.583275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:47.585665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:47.586250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:47.587979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:47.664147 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d1182b8-f063-4ed8-be4c-b94a09f2b9f9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b/action" status: 200 len: 38615 microversion: 2.1 time: 0.122408 Oct 28 18:41:47.666137 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2193/6025] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:41:47 2022] POST /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b/action => generated 38615 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:41:48.415745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:48.416763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:48.435368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:48.438109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:48.438768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:48.442913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:48.446851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:48.461568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:48.531298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:48.532151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:48.546676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:48.547840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:48.549925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:48.551853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:48.552454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:48.555805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:48.749405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:48.762356 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e94facc7-a615-479e-9084-6434a600a3e6 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1197 microversion: 2.1 time: 0.238992 Oct 28 18:41:48.768674 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2194/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:48 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:49.009316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:49.048147 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5de6f32b-0b62-4ac8-8a3c-d3924dfab499 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1317 microversion: 2.1 time: 0.633141 Oct 28 18:41:49.050120 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3833/6027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:48 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:49.736770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-cb15caee-3dbd-4576-94bc-c7609a5a7975 req-575f5ee6-087c-4e98-9204-77240dbbb1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c668a51f-23af-4529-b61e-d9646e0675ef", "name": "network-vif-plugged", "status": "completed", "tag": "901a010a-c7cb-4db6-88c5-c4c5b9531c3f"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:49.771202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cb15caee-3dbd-4576-94bc-c7609a5a7975 req-575f5ee6-087c-4e98-9204-77240dbbb1fe service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:49.771687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cb15caee-3dbd-4576-94bc-c7609a5a7975 req-575f5ee6-087c-4e98-9204-77240dbbb1fe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:49.772352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cb15caee-3dbd-4576-94bc-c7609a5a7975 req-575f5ee6-087c-4e98-9204-77240dbbb1fe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:49.798304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:49.799135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:49.809509 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-cb15caee-3dbd-4576-94bc-c7609a5a7975 req-575f5ee6-087c-4e98-9204-77240dbbb1fe service nova] Creating event network-vif-plugged:901a010a-c7cb-4db6-88c5-c4c5b9531c3f for instance c668a51f-23af-4529-b61e-d9646e0675ef on n-h2-862404-2 Oct 28 18:41:49.825625 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-cb15caee-3dbd-4576-94bc-c7609a5a7975 req-575f5ee6-087c-4e98-9204-77240dbbb1fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092951 Oct 28 18:41:49.830593 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2195/6028] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:49.849087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:49.851764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:49.854766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:49.857556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:49.861080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:49.862332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:50.090092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:50.091117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:50.118798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:50.120116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:50.121342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:50.122294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:50.126747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:50.128826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:50.213903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:50.230135 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a42d899b-6206-4b3e-9f34-f9602fac1880 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1215 microversion: 2.1 time: 0.435537 Oct 28 18:41:50.231331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3834/6029] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:49 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1215 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:50.778638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:50.804969 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5fab0059-7336-4d18-ad4a-07e6d325ba87 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1317 microversion: 2.1 time: 0.724106 Oct 28 18:41:50.807208 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2196/6030] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:50 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:51.262083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:51.263162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:51.277568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:51.281117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:51.283869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:51.285225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:51.285724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:51.287754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:51.362065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:51.362645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:51.379524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:51.384373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:51.384875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:51.387795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:51.394335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:51.395137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:51.453644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:51.468450 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d914efb-5c1c-442b-94fd-a54fcc614ade tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1215 microversion: 2.1 time: 0.211051 Oct 28 18:41:51.469338 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3835/6031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:51 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:51.501732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:41:51.736985 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8545a1c1-8df9-489f-9360-a5be03e91c9f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 204 len: 0 microversion: 2.1 time: 0.379183 Oct 28 18:41:51.737965 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2197/6032] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:41:51 2022] DELETE /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:41:51.755106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:51.756939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:51.768936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:51.769941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:51.770541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:51.771802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:51.772968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:51.773777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:51.905794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f1ea71b1-5e68-4e76-9b8b-ec2c0df121ff req-57826d4e-7d3b-47bc-b841-9a45d7882719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e63405d-08e7-4cb9-a5e7-3062422d4b5b", "tag": "3f7bd752-ef85-43dc-a585-23a64d74dc83"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:51.932113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1ea71b1-5e68-4e76-9b8b-ec2c0df121ff req-57826d4e-7d3b-47bc-b841-9a45d7882719 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:51.933038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1ea71b1-5e68-4e76-9b8b-ec2c0df121ff req-57826d4e-7d3b-47bc-b841-9a45d7882719 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:51.933568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f1ea71b1-5e68-4e76-9b8b-ec2c0df121ff req-57826d4e-7d3b-47bc-b841-9a45d7882719 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:51.953816 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f1ea71b1-5e68-4e76-9b8b-ec2c0df121ff req-57826d4e-7d3b-47bc-b841-9a45d7882719 service nova] Creating event network-changed:3f7bd752-ef85-43dc-a585-23a64d74dc83 for instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b on n-h1-862404-2 Oct 28 18:41:51.965396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f1ea71b1-5e68-4e76-9b8b-ec2c0df121ff req-57826d4e-7d3b-47bc-b841-9a45d7882719 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.492806 Oct 28 18:41:51.968138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3836/6033] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:52.001865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:52.008392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:52.026094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:52.026890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:52.028610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:52.030330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:52.034691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:52.035373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:52.531503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:52.545889 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b791584-9994-4a93-bd06-376af196bfed tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1506 microversion: 2.1 time: 0.558479 Oct 28 18:41:52.546754 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3837/6034] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:51 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:52.560147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:52.561592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:52.583745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:52.584284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:52.584730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:52.585466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:52.591201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:52.591796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:52.645069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:53.041173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:53.078851 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-403bb0bd-1af2-4a9b-8465-28b925f213c6 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1690 microversion: 2.1 time: 1.335520 Oct 28 18:41:53.080637 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2198/6035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:51 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1690 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:41:53.097681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:53.099886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:53.112993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:53.114386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:53.115049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:53.116203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:53.116917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:53.117749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:53.217594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:41:53.275438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:53.284978 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f247237-a544-4139-bd49-b92bb28a0f83 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1282 microversion: 2.1 time: 0.732053 Oct 28 18:41:53.285586 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3838/6036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:52 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1282 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:53.402892 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f1248d35-1f94-4daf-af5d-6bb9965c21fb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 204 len: 0 microversion: 2.1 time: 0.318422 Oct 28 18:41:53.404522 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2199/6037] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:41:53 2022] DELETE /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:41:53.415996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:53.416655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:53.428040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:53.428556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:53.430139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:53.433513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:53.437466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:53.440713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:54.118763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:54.120146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:54.148239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:54.149064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:54.149766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:54.150819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:54.151544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:54.152201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:54.276503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:54.294315 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-878fa550-2f08-4218-95e8-06b25295b7fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1512 microversion: 2.1 time: 0.884179 Oct 28 18:41:54.296238 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3839/6038] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:53 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1512 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:54.313393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:54.314612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:54.334854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:54.335625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:54.336484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:54.338945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:54.339764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:54.340396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:54.830486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:54.841217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2fae949c-5b83-43f3-b983-c2820719f966 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1282 microversion: 2.1 time: 0.534496 Oct 28 18:41:54.844198 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3840/6039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:54 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1282 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:41:54.993627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-058cc0fc-138c-496b-9bd3-a20c0cea4bc3 req-cb4cea7e-e6e5-492e-91f5-b47b2ad536cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5", "tag": "da972123-6b77-47c7-950e-7cf0ae635374"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:55.023212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-058cc0fc-138c-496b-9bd3-a20c0cea4bc3 req-cb4cea7e-e6e5-492e-91f5-b47b2ad536cf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.027404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-058cc0fc-138c-496b-9bd3-a20c0cea4bc3 req-cb4cea7e-e6e5-492e-91f5-b47b2ad536cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.028886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-058cc0fc-138c-496b-9bd3-a20c0cea4bc3 req-cb4cea7e-e6e5-492e-91f5-b47b2ad536cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.058914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:55.061151 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-058cc0fc-138c-496b-9bd3-a20c0cea4bc3 req-cb4cea7e-e6e5-492e-91f5-b47b2ad536cf service nova] Creating event network-changed:da972123-6b77-47c7-950e-7cf0ae635374 for instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 on n-h2-862404-2 Oct 28 18:41:55.073474 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-058cc0fc-138c-496b-9bd3-a20c0cea4bc3 req-cb4cea7e-e6e5-492e-91f5-b47b2ad536cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084793 Oct 28 18:41:55.074260 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f1cccf1-5332-440a-9530-19bad607c13d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 200 len: 1690 microversion: 2.1 time: 0.965455 Oct 28 18:41:55.075635 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3841/6040] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:41:55.097234 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2200/6041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:54 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 1690 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:55.321098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:55.327724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:55.367352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.368626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.369928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.374588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.375389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.376109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.512121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6a557046-c9fe-4f20-9f35-9e6c4bf13b5f req-7afaf5bd-bb5f-4cf7-ab90-547c20594115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e63405d-08e7-4cb9-a5e7-3062422d4b5b", "name": "network-vif-deleted", "tag": "3f7bd752-ef85-43dc-a585-23a64d74dc83"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:55.539279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a557046-c9fe-4f20-9f35-9e6c4bf13b5f req-7afaf5bd-bb5f-4cf7-ab90-547c20594115 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.540261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a557046-c9fe-4f20-9f35-9e6c4bf13b5f req-7afaf5bd-bb5f-4cf7-ab90-547c20594115 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.542063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a557046-c9fe-4f20-9f35-9e6c4bf13b5f req-7afaf5bd-bb5f-4cf7-ab90-547c20594115 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.597658 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6a557046-c9fe-4f20-9f35-9e6c4bf13b5f req-7afaf5bd-bb5f-4cf7-ab90-547c20594115 service nova] Creating event network-vif-deleted:3f7bd752-ef85-43dc-a585-23a64d74dc83 for instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b on n-h1-862404-2 Oct 28 18:41:55.630306 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6a557046-c9fe-4f20-9f35-9e6c4bf13b5f req-7afaf5bd-bb5f-4cf7-ab90-547c20594115 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122958 Oct 28 18:41:55.634573 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2201/6042] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:55.892642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:55.894069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:55.906860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.909158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.910411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.911368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.912074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.913577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.966019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:56.050021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:56.065367 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f871e106-6128-4974-ba4b-54cce98b2300 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1512 microversion: 2.1 time: 0.750065 Oct 28 18:41:56.084373 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3842/6043] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:55 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1512 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:56.105975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:56.106612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 5e63405d-08e7-4cb9-a5e7-3062422d4b5b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:56.129147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:56.129759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:56.130243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:56.130982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:56.131452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:56.131914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:56.162326 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] HTTP exception thrown: Instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b could not be found. Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Request method failure captured: Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b HTTP/1.1 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCBvc0YflF8rdCSJK9k6feqbsVmfTyN8LB8kG2K52dnwbeAWDEga0e3Qk_53zZR-oQU21yf38NMhPvsSxFlBHCPi4wNEgvRNviGdQHu6PLLHjTzAKlw5vk1MAxvpDp7nGyF8QRnha0Rkwy6iP9lJeZbWLld9X9TIIcL8SHJYIWKaQ74 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 946b8055a69f4f979036482e1fd37f67 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_946b8055a69f4f979036482e1fd37f67", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 946b8055a69f4f979036482e1fd37f67 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestNetworkAdvancedServerOps-156931648-project Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 379680f3dd0542389b53a8a4f20ae800 Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestNetworkAdvancedServerOps-156931648-project Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b could not be found. Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '5e63405d-08e7-4cb9-a5e7-3062422d4b5b'} Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b could not be found. Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b could not be found. Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:56.164101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b could not be found. Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Returning 404 to user: Instance 5e63405d-08e7-4cb9-a5e7-3062422d4b5b could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:41:56.167916 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a0182cc-a990-4eee-af92-baec2b0d6d77 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b" status: 404 len: 111 microversion: 2.1 time: 0.065090 Oct 28 18:41:56.172041 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3843/6044] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:56 2022] GET /compute/v2.1/servers/5e63405d-08e7-4cb9-a5e7-3062422d4b5b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:41:57.089965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:57.090713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:57.104294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:57.118277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:57.118816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:57.124139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:57.125009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:57.125555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:57.125950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:57.334320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:57.350561 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c64bbee-b1d7-4f14-8f34-a031b6d42315 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 200 len: 1470 microversion: 2.1 time: 0.263802 Oct 28 18:41:57.377108 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3844/6045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:57 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:41:57.446544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:57.462286 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-629a1dbf-2b63-403d-9d85-ebc5f2158176 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1282 microversion: 2.1 time: 1.588832 Oct 28 18:41:57.463692 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2202/6046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:55 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1282 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:57.680395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-905eb9ed-4ee2-428f-aeb6-bd0c47d879a8 req-8d377409-6508-4c06-be22-2f5bad6be62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c668a51f-23af-4529-b61e-d9646e0675ef", "name": "network-vif-deleted", "tag": "901a010a-c7cb-4db6-88c5-c4c5b9531c3f"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:57.699613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:57.704860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-905eb9ed-4ee2-428f-aeb6-bd0c47d879a8 req-8d377409-6508-4c06-be22-2f5bad6be62a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:57.709155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-905eb9ed-4ee2-428f-aeb6-bd0c47d879a8 req-8d377409-6508-4c06-be22-2f5bad6be62a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:57.709984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-905eb9ed-4ee2-428f-aeb6-bd0c47d879a8 req-8d377409-6508-4c06-be22-2f5bad6be62a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:57.752912 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-905eb9ed-4ee2-428f-aeb6-bd0c47d879a8 req-8d377409-6508-4c06-be22-2f5bad6be62a service nova] Creating event network-vif-deleted:901a010a-c7cb-4db6-88c5-c4c5b9531c3f for instance c668a51f-23af-4529-b61e-d9646e0675ef on n-h2-862404-2 Oct 28 18:41:57.766732 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-905eb9ed-4ee2-428f-aeb6-bd0c47d879a8 req-8d377409-6508-4c06-be22-2f5bad6be62a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090713 Oct 28 18:41:57.767615 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3845/6047] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:41:58.385502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:58.389139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:58.414671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:58.417881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:58.420782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:58.421971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:58.424187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:58.425304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:58.476041 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef HTTP/1.1 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'c668a51f-23af-4529-b61e-d9646e0675ef'} Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:41:58.477816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:41:58.483877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:58.483877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:41:58.483877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:41:58.483877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:41:58.483877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:41:58.483877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:41:58.483877 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:41:58.488695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:58.489406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:58.494859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:41:58.496251 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad8cae7b-9b08-4c56-a1a2-c8794830c640 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 404 len: 111 microversion: 2.1 time: 0.122358 Oct 28 18:41:58.499176 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2203/6048] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:58 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:41:58.508219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:58.508732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:58.509471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:58.510254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:58.510712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:58.511134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:58.514299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:58.518512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:58.535686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:58.538492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:58.539179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:58.546386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:58.547215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:58.548618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:59.191908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:59.241448 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f912bd3e-d298-4777-867c-fc3765bd4b34 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1282 microversion: 2.1 time: 0.757900 Oct 28 18:41:59.251908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3846/6049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:58 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1282 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:59.539757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:59.556493 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc4c9b2a-feb8-4812-9142-af02bc935e55 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 1.052911 Oct 28 18:41:59.563502 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2204/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:58 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:41:59.800002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78de63d7-4f7e-4a18-b78d-2d04c21b2df5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78de63d7-4f7e-4a18-b78d-2d04c21b2df5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 163 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": 12345, "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 12345 Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:41:59.804232 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78de63d7-4f7e-4a18-b78d-2d04c21b2df5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78de63d7-4f7e-4a18-b78d-2d04c21b2df5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.011227 Oct 28 18:41:59.809101 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3847/6051] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:41:59 2022] POST /compute/v2.1/servers => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:41:59.820894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:59.821688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:41:59.834151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:59.834813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:59.837190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:59.838073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:59.842538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:59.844623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:00.279306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:00.280166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:00.312765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:00.316366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:00.317680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:00.319085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:00.324302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:00.325037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:00.452724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:00.468942 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-58f12399-91dd-4b0f-a3f2-13fb19ad4df8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.653320 Oct 28 18:42:00.471529 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2205/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:59 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:00.499993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:00.500918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:00.507638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:00.513627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:00.514274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:00.515474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:00.525797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:00.526479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:01.002835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:01.011743 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3c3b8a33-f269-4452-b1cd-8d3af8642195 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.516237 Oct 28 18:42:01.019684 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2206/6053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:00 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:01.319706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:01.337098 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e3fecc18-e82c-4006-ab95-08cfcd2fd58d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1282 microversion: 2.1 time: 1.057556 Oct 28 18:42:01.339376 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3848/6054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:00 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1282 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:02.368616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:02.375517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:02.391133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:02.393577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:02.400141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:02.402314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:02.407989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:02.408727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:03.049144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:03.058748 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0596d0e9-d00f-47e8-82bd-5a94e75fdef8 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1282 microversion: 2.1 time: 0.693962 Oct 28 18:42:03.077397 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2207/6055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:02 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1282 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:04.088663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:04.089346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:04.114284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:04.114811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:04.115269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:04.116039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:04.116512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:04.134949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:04.583446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:04.608819 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-718f341f-4d43-4a07-93c4-0d6fc358fb9b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1282 microversion: 2.1 time: 0.524563 Oct 28 18:42:04.612085 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3849/6056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:04 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1282 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:05.637116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:05.637729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:05.657914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:05.669033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:05.669683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:05.679082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:05.679929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:05.681142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:05.732207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40e7676e-3c55-458c-b887-f3a80e89b627 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-836924907", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "05ecd301-8860-4aef-9680-0388847923c6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:05.911427 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-40e7676e-3c55-458c-b887-f3a80e89b627 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Block Device 05ecd301-8860-4aef-9680-0388847923c6 is not bootable. Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40e7676e-3c55-458c-b887-f3a80e89b627 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 357 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-836924907", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "05ecd301-8860-4aef-9680-0388847923c6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: exception: Block Device 05ecd301-8860-4aef-9680-0388847923c6 is not bootable. Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-836924907', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '05ecd301-8860-4aef-9680-0388847923c6'}], 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 05ecd301-8860-4aef-9680-0388847923c6 is not bootable. Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:05.923186 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 05ecd301-8860-4aef-9680-0388847923c6 is not bootable. Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 05ecd301-8860-4aef-9680-0388847923c6 is not bootable. Oct 28 18:42:05.926861 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:05.936398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40e7676e-3c55-458c-b887-f3a80e89b627 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Block Device 05ecd301-8860-4aef-9680-0388847923c6 is not bootable. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:05.937540 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40e7676e-3c55-458c-b887-f3a80e89b627 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.211636 Oct 28 18:42:05.944245 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3850/6057] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:05 2022] POST /compute/v2.1/servers => generated 110 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:42:05.956657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:05.957663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:05.965437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:05.966899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:05.967768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:05.968875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:05.970891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:05.972838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:06.283231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:06.293137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0047eb78-05be-4ae2-92c9-d154268c7986 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.345198 Oct 28 18:42:06.294011 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3851/6058] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:05 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:06.325470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:06.327888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:06.386728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:06.387267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:06.388584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:06.389982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:06.421655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:06.422307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:06.678198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:06.711206 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb24f6a6-03a3-44d2-b9b0-b4c75fdae731 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1282 microversion: 2.1 time: 1.075428 Oct 28 18:42:06.714421 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2208/6059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:05 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1282 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:06.788800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:06.797842 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50341222-b960-4284-873f-1f88f888d254 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.478658 Oct 28 18:42:06.812273 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3852/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:06 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:07.738561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:07.739094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:07.767426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:07.768322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:07.772123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:07.776495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:07.777067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:07.779655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:07.975422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99533da8-9aff-4beb-ad0e-8c8ed2678e02 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '.version_select at 0x7f78dc79a430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:08.075347 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99533da8-9aff-4beb-ad0e-8c8ed2678e02 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-860836138" status: 202 len: 0 microversion: 2.1 time: 0.113946 Oct 28 18:42:08.114820 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3853/6061] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 18:42:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-860836138 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:42:08.133106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41cb77d5-bb19-48b1-8794-7878e6219654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'create', calling method: .version_select at 0x7f78dc7503a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2009277915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3ILeqrIa0lwadig/NdHHykzhAcGoNYUCbdp9umCkAiydHdJZYSlQN8rSCwWtG1rqLRx+g+ISAeu8Q2Rx+TEQeAdkqNFBbkynWHqaocIjucdsHXktsBwF0c6OWjkd3LBw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:08.177146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-41cb77d5-bb19-48b1-8794-7878e6219654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for project 946b8055a69f4f979036482e1fd37f67. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:42:08.192714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-41cb77d5-bb19-48b1-8794-7878e6219654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for user 379680f3dd0542389b53a8a4f20ae800 and project 946b8055a69f4f979036482e1fd37f67. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:42:08.307653 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41cb77d5-bb19-48b1-8794-7878e6219654 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.179832 Oct 28 18:42:08.308860 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3854/6062] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:42:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:08.355665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1561360372", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9ec285c8-4667-452d-b81a-bc847383c7d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca633313-4d95-4fc0-8f7a-c33539b3174e"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:08.383548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:08.420270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:08.441619 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-180d8800-910d-41a8-af46-00d7f9c48b5e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.708563 Oct 28 18:42:08.447460 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2209/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:07 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:08.496273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] validate_networks() for [('ca633313-4d95-4fc0-8f7a-c33539b3174e', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:42:09.471996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:09.473242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:09.486068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:42:09.486593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:42:09.486977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:42:09.487397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:42:09.487831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:42:09.504331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:09.505411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:09.506812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:09.509265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:09.511132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:09.512210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:09.514887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:09.515496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:09.515795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:09.516623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:09.517093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:09.517530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:09.582968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:42:09.591969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:42:09.702342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:42:09.704526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ec285c8-4667-452d-b81a-bc847383c7d1',volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:42:09.985224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:09.992851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e01b59ac-4dfd-4b50-9e28-51652fe1417f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648739 Oct 28 18:42:10.001244 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3855/6064] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:42:10.003671 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-523f9788-febf-413e-9a22-4eaf24687d2d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.537894 Oct 28 18:42:10.006847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40b02a98-14cf-4294-9025-0fd81b427858 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-719069879", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f17ba65f-a473-4179-8631-ca52e11cfd46", "destination_type": "local"}, {"source_type": "volume", "uuid": "da3fdf93-df60-4673-bd2e-98e5e3b677f1", "destination_type": "invalid"}], "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:10.020687 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2210/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:09 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:10.033474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-55bc01c1-1898-48c8-afc5-94b5982df3b0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:10.035354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-55bc01c1-1898-48c8-afc5-94b5982df3b0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40b02a98-14cf-4294-9025-0fd81b427858 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 494 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-719069879", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f17ba65f-a473-4179-8631-ca52e11cfd46", "destination_type": "local"}, {"source_type": "volume", "uuid": "da3fdf93-df60-4673-bd2e-98e5e3b677f1", "destination_type": "invalid"}], "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-719069879', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'da3fdf93-df60-4673-bd2e-98e5e3b677f1', 'destination_type': 'invalid'}], 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:10.050558 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.054699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40b02a98-14cf-4294-9025-0fd81b427858 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:10.057041 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40b02a98-14cf-4294-9025-0fd81b427858 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.060640 Oct 28 18:42:10.059048 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3856/6066] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:09 2022] POST /compute/v2.1/servers => generated 155 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:42:10.081752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:10.082707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:10.099257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:10.099770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:10.100258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:10.100994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:10.101556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:10.101907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:10.151945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-55bc01c1-1898-48c8-afc5-94b5982df3b0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:10.165267 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-55bc01c1-1898-48c8-afc5-94b5982df3b0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1057 microversion: 2.1 time: 0.139873 Oct 28 18:42:10.166625 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2211/6067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:10 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1057 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:10.438696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:10.453639 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e5a0b5fa-71f7-4d92-99e8-8e6cbe3d4b62 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.387119 Oct 28 18:42:10.455504 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3857/6068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:10 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:10.480337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:10.482003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:10.495253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:10.496065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:10.496767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:10.498114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:10.499082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:10.499711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:10.814609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:10.829844 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a9b0798-f77b-4ec6-b1af-9296a9517312 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.354134 Oct 28 18:42:10.832210 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2212/6069] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:10 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:10.950269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1646ca7d-f49d-4ff9-bde8-c23e9673921b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-729332682", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1646ca7d-f49d-4ff9-bde8-c23e9673921b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 491 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-729332682", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-729332682', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.970214 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 18:42:10.973744 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:10.977699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1646ca7d-f49d-4ff9-bde8-c23e9673921b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:10.977699 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1646ca7d-f49d-4ff9-bde8-c23e9673921b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.030875 Oct 28 18:42:10.978273 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3858/6070] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:10 2022] POST /compute/v2.1/servers => generated 624 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:42:10.987592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:10.988816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:10.997444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:10.998683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.000039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.001384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.002014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.002718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.046058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:11.046828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:11.062425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.063699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.066115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.069042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.070582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.072949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.250737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:11.275605 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4344ea76-4808-4d1d-bd86-cd1702ff285e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.293169 Oct 28 18:42:11.285924 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2213/6071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:10 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:11.305598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:11.306245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:11.319795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.320326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.323419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.324181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.326259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.327726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.463248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:11.473067 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65d55de0-85b2-4bd7-a6dd-3eded3b68f9b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1155 microversion: 2.1 time: 0.185952 Oct 28 18:42:11.481763 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2214/6072] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:11 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1155 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:11.490203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:11.490827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:11.499763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.500700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.501325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.502354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.502994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.503601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.526826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:11.540040 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-00252f72-6da8-4a23-b0c8-fc92723b159a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.499038 Oct 28 18:42:11.541624 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3859/6073] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:11 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:11.717423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:11.728512 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-efe323cd-2ac9-47aa-b3cf-fbf20d89df6f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.245549 Oct 28 18:42:11.729722 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2215/6074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:11 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:11.853070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba5aa869-597c-400e-a1c9-3f3dde898d51 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba5aa869-597c-400e-a1c9-3f3dde898d51 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 416 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:11.858680 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:11.861795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba5aa869-597c-400e-a1c9-3f3dde898d51 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:11.881152 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba5aa869-597c-400e-a1c9-3f3dde898d51 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.014459 Oct 28 18:42:11.882112 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3860/6075] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:11 2022] POST /compute/v2.1/servers => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:42:11.891113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:11.900170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:11.948391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.949197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.949641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.950437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.956329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.956833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.314983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:12.327767 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c36bbb00-7eef-4db9-87e0-abb6f8538077 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.441389 Oct 28 18:42:12.328525 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2216/6076] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:11 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:12.353640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:12.356520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:12.369550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.375285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.375999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.376948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.377607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.378251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.497193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:12.499023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:12.508406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.509359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.510023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.512006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.512733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.515188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.676989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:12.690755 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44ab01d3-9b1b-4684-87d6-1660b5a766dc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.339796 Oct 28 18:42:12.691907 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3861/6077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:12 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:12.707967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:12.708849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:12.718521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.727974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.728708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.729685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.730350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.730963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.878052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:12.893635 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-858794d5-e56c-4fef-b91a-9f67efdc7e6b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1173 microversion: 2.1 time: 0.400208 Oct 28 18:42:12.894398 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2217/6078] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:12 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1173 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:12.899875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-444f2938-b123-45f0-a0f3-ab52ca558dde tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-905443151", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": -1, "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:12.913146 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-444f2938-b123-45f0-a0f3-ab52ca558dde tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Flavor -1 could not be found. Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-444f2938-b123-45f0-a0f3-ab52ca558dde tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 205 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-905443151", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": -1, "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: exception: Flavor -1 could not be found. Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-905443151', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': -1, 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:12.930811 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 28 18:42:12.934623 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:12.940396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-444f2938-b123-45f0-a0f3-ab52ca558dde tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:12.942376 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-444f2938-b123-45f0-a0f3-ab52ca558dde tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.046072 Oct 28 18:42:12.943616 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2218/6079] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:12 2022] POST /compute/v2.1/servers => generated 73 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:42:12.961658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:12.975992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:12.987700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.990019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.991039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.994880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.995460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.996042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:13.088663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:13.100614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25386283-3621-49d6-bb3f-403f054bf58b tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.407382 Oct 28 18:42:13.101499 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3862/6080] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:12 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:13.364366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:13.380743 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-501a4a81-4125-4ce1-8d35-e93d5fb2bad3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.425442 Oct 28 18:42:13.399374 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2219/6081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:12 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:13.411138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:13.412209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:13.430838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:13.431409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:13.432314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:13.437036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:13.437885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:13.439293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:13.921628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:13.922628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:13.951808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:13.957186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:13.957709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:13.958308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:13.963205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:13.963923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:13.965656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:13.972501 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f5c86df-6388-401b-acb6-c245b011bfe0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.569622 Oct 28 18:42:13.989626 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3863/6082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:13 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:14.130728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:14.132100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:14.144248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:14.147221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:14.148165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:14.158046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:14.158807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:14.159657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:14.556161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:14.565353 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f7cea8c-2141-4261-a373-471fa0ff0830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1215 microversion: 2.1 time: 0.650875 Oct 28 18:42:14.565948 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2220/6083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:13 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1215 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:14.583395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fde99c01-c83e-474d-9035-b77106057885 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-716452377", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:14.584031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fde99c01-c83e-474d-9035-b77106057885 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 172 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-716452377", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-716452377', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi -1 Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:42:14.592985 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 18:42:14.599663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:14.601640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:14.601793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fde99c01-c83e-474d-9035-b77106057885 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:14.602595 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fde99c01-c83e-474d-9035-b77106057885 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.032143 Oct 28 18:42:14.604164 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-107a5b83-823a-461b-8f25-02f9b9bbac4a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.470506 Oct 28 18:42:14.604532 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2221/6084] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:14 2022] POST /compute/v2.1/servers => generated 145 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:42:14.621885 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3864/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:14 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:14.630145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:14.631063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:14.647952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:14.653437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:14.654897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:14.655860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:14.656640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:14.657264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.086220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f6635add-f65c-489b-9e9c-3e167b0b1eed req-2634409e-9b22-4800-a4b6-4710befc5757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ec2fbe-3372-4320-ad29-a4431ecb7fb5", "tag": "3b193318-7177-4856-9d81-7655f4dc857e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:15.119514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f6635add-f65c-489b-9e9c-3e167b0b1eed req-2634409e-9b22-4800-a4b6-4710befc5757 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.121106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f6635add-f65c-489b-9e9c-3e167b0b1eed req-2634409e-9b22-4800-a4b6-4710befc5757 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.121801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f6635add-f65c-489b-9e9c-3e167b0b1eed req-2634409e-9b22-4800-a4b6-4710befc5757 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.135885 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f6635add-f65c-489b-9e9c-3e167b0b1eed req-2634409e-9b22-4800-a4b6-4710befc5757 service nova] Creating event network-changed:3b193318-7177-4856-9d81-7655f4dc857e for instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 on n-h1-862404-2 Oct 28 18:42:15.142880 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f6635add-f65c-489b-9e9c-3e167b0b1eed req-2634409e-9b22-4800-a4b6-4710befc5757 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061074 Oct 28 18:42:15.143929 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3865/6086] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:42:15.401875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:15.405234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:15.415282 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e5cf94c-7f1f-4cac-baa9-a5b7e2f290f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.796590 Oct 28 18:42:15.417730 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2222/6087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:14 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:15.447530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:15.448713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:15.479715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.479715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.479715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.479715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.480797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.481280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.593784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:15.594560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:15.609137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:15.615205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.619618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.620288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.621053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.624862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.625517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.941329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:15.960893 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c54b5bf5-8338-4f9c-9935-e9f635e8b849 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.520132 Oct 28 18:42:15.961837 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3866/6088] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:15 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:15.968057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:15.969032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:15.987451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.988469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.989142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.989867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.990406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.990863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:16.454453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:16.471165 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1382ddd6-310d-4c5f-92d5-1283c3a6d249 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.507821 Oct 28 18:42:16.471779 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3867/6089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:15 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:16.487849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e36670dc-4cfe-48b5-8221-39804ff25131 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1789150707", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:16.518947 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e36670dc-4cfe-48b5-8221-39804ff25131 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e36670dc-4cfe-48b5-8221-39804ff25131 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 216 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1789150707", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1789150707', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:16.532568 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:16.537071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:16.537071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:16.537071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:16.537071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:16.537071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:16.537071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 18:42:16.537071 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:16.537071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e36670dc-4cfe-48b5-8221-39804ff25131 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:16.540862 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e36670dc-4cfe-48b5-8221-39804ff25131 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.068080 Oct 28 18:42:16.542568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3868/6090] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:16 2022] POST /compute/v2.1/servers => generated 123 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:42:16.578682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:16.579312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:16.611214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:16.611855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:16.612812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:16.614147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:16.614630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:16.615060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:16.982993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:17.001891 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b73aa161-d5ba-489c-beb1-3e91c08eb198 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1215 microversion: 2.1 time: 1.412122 Oct 28 18:42:17.003627 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2223/6091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:15 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1215 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:17.321972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:17.335283 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97ce9605-b0b7-4a02-b28e-6175d78833f4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.783177 Oct 28 18:42:17.339907 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3869/6092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:16 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:17.363639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:17.364548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:17.374393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:17.375140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:17.377614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:17.379907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:17.382833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:17.383333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:17.502440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:17.503539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:17.517363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:17.525173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:17.525936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:17.526863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:17.527601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:17.528229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:17.876180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:17.885283 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34683111-7bd6-4605-ab2e-2974b4803cfe tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.387590 Oct 28 18:42:17.889757 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3870/6093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:17 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:17.929687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:17.942472 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-013653cb-8977-45fb-8e79-dbd99d5df464 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.582417 Oct 28 18:42:17.943806 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2224/6094] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:17 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:18.027597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:18.028373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:18.041469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:18.042840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:18.046295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:18.047452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:18.051076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:18.062380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:18.135758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a12e2b6b-ea3f-484f-928e-ec7a8d1f7365 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1468987386", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-key-283907809", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:18.267384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-a12e2b6b-ea3f-484f-928e-ec7a8d1f7365 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] validate_networks() for [('384418cc-86cf-4a13-b7a1-6bd7b463bb92', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:42:18.437273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:18.454368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25dbc976-6734-41e1-9298-d524231eb82d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1215 microversion: 2.1 time: 0.427350 Oct 28 18:42:18.459901 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3871/6095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:18 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:18.769314 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-a12e2b6b-ea3f-484f-928e-ec7a8d1f7365 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Invalid key_name provided. Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a12e2b6b-ea3f-484f-928e-ec7a8d1f7365 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 246 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1468987386", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-key-283907809", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid key_name provided. Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1468987386', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'key_name': 'tempest-key-283907809', 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-283907809 not found for user aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:18.790040 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 28 18:42:18.795019 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:18.798821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a12e2b6b-ea3f-484f-928e-ec7a8d1f7365 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid key_name provided. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:18.799930 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a12e2b6b-ea3f-484f-928e-ec7a8d1f7365 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.669521 Oct 28 18:42:18.804053 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2225/6096] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:18 2022] POST /compute/v2.1/servers => generated 70 bytes in 674 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 18:42:18.809077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:18.809751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:18.821713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:18.822217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:18.822659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:18.823372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:18.823898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:18.824279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:18.916060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:18.916929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:18.930018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:18.933770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:18.936449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:18.937362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:18.937988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:18.938925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:19.261935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:19.272185 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f97257bd-dd8a-4a84-b6c1-949839485131 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.361068 Oct 28 18:42:19.276661 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2226/6097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:18 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:19.423304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:19.444422 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ecc4cc9-e708-4a0a-b6f9-c48d1548a3f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.639226 Oct 28 18:42:19.451737 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3872/6098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:18 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:19.482567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:19.482714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:19.483202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:19.483618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:19.498692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:19.499427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:19.500056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:19.501000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:19.506058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:19.506562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:19.506969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:19.507109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:19.508345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:19.510044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:19.511524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:19.513809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:19.552109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:19.609357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=10 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:19.811203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:19.823766 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a49ce5bb-889f-4bcc-9fc5-23c0433eae86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1215 microversion: 2.1 time: 0.346563 Oct 28 18:42:19.839843 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2227/6099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:19 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1215 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:19.839843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-deb599ff-6d37-446d-971c-3eb5f8690305 req-3904a741-2616-4ece-ad9c-e741ed6a4015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5", "name": "network-vif-plugged", "status": "completed", "tag": "da972123-6b77-47c7-950e-7cf0ae635374"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:19.868130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-deb599ff-6d37-446d-971c-3eb5f8690305 req-3904a741-2616-4ece-ad9c-e741ed6a4015 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:19.871922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-deb599ff-6d37-446d-971c-3eb5f8690305 req-3904a741-2616-4ece-ad9c-e741ed6a4015 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:19.891689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-deb599ff-6d37-446d-971c-3eb5f8690305 req-3904a741-2616-4ece-ad9c-e741ed6a4015 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:19.926430 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-deb599ff-6d37-446d-971c-3eb5f8690305 req-3904a741-2616-4ece-ad9c-e741ed6a4015 service nova] Creating event network-vif-plugged:da972123-6b77-47c7-950e-7cf0ae635374 for instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 on n-h2-862404-2 Oct 28 18:42:19.947915 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-deb599ff-6d37-446d-971c-3eb5f8690305 req-3904a741-2616-4ece-ad9c-e741ed6a4015 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114143 Oct 28 18:42:19.951764 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2228/6100] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:20.174700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:20.218249 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a7000cc-da57-4e51-8e0a-5f6772c1877d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.740885 Oct 28 18:42:20.233240 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3873/6101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:19 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:20.306364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:20.307084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:20.316901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:20.326682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:20.331150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:20.331150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:20.331150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:20.337881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2d02788-13ad-4cbd-88bd-8ff2d950cbac tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1888529478", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:20.340554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:20.341137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:20.629168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.security_group_api [None req-d2d02788-13ad-4cbd-88bd-8ff2d950cbac tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Neutron security group does_not_exist not found {{(pid=120680) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 28 18:42:20.629632 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d2d02788-13ad-4cbd-88bd-8ff2d950cbac tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2d02788-13ad-4cbd-88bd-8ff2d950cbac tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 258 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1888529478", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1888529478', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 28 18:42:20.632572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:20.640627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2d02788-13ad-4cbd-88bd-8ff2d950cbac tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:20.644645 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2d02788-13ad-4cbd-88bd-8ff2d950cbac tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.302635 Oct 28 18:42:20.644645 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3874/6102] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:20 2022] POST /compute/v2.1/servers => generated 106 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:42:20.651233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:20.652058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:20.660868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:20.661499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:20.662053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:20.662888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:20.663455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:20.664229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:20.782555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:20.791957 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ddf204bf-513f-4f7c-b74b-345772ac448d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1270 microversion: 2.1 time: 0.491251 Oct 28 18:42:20.797553 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2229/6103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:20 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1270 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:20.854912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:20.855541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:20.868989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:20.881097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:20.882641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:20.884089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:20.884846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:20.885699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:21.302897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:21.329185 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-663555d8-0bb0-40f2-bbe3-2b2e5b837c9f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.681678 Oct 28 18:42:21.332632 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3875/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:20 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:21.359720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:21.369573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:21.385023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:21.390143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:21.390893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:21.391902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:21.392620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:21.393271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:21.474121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:21.494813 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f74c83a0-2c60-46f6-a6b5-854fbfaefa20 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1215 microversion: 2.1 time: 0.644021 Oct 28 18:42:21.498809 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2230/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:20 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1215 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:21.827584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:21.828408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:21.847171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:21.848147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:21.848741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:21.849619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:21.850518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:21.853402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:21.875462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:21.884415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-93b32436-80fb-47bf-b1f0-652c0ec17c59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.529073 Oct 28 18:42:21.888337 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3876/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:21 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:21.914475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-291e8d95-732d-41be-ace1-4e7556383d69 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:21.915321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-291e8d95-732d-41be-ace1-4e7556383d69 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 04fc712d-05a2-4a80-9c63-af919cf39fc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:21.926635 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-291e8d95-732d-41be-ace1-4e7556383d69 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 04fc712d-05a2-4a80-9c63-af919cf39fc3 could not be found. Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-291e8d95-732d-41be-ace1-4e7556383d69 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/04fc712d-05a2-4a80-9c63-af919cf39fc3 HTTP/1.1 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 04fc712d-05a2-4a80-9c63-af919cf39fc3 could not be found. Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '04fc712d-05a2-4a80-9c63-af919cf39fc3'} Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04fc712d-05a2-4a80-9c63-af919cf39fc3 could not be found. Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04fc712d-05a2-4a80-9c63-af919cf39fc3 could not be found. Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:21.931456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:21.936364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:21.936364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:21.936364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:21.936364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:21.936364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:21.936364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:21.936364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04fc712d-05a2-4a80-9c63-af919cf39fc3 could not be found. Oct 28 18:42:21.936364 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:21.941439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-291e8d95-732d-41be-ace1-4e7556383d69 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 04fc712d-05a2-4a80-9c63-af919cf39fc3 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:21.942584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-291e8d95-732d-41be-ace1-4e7556383d69 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/04fc712d-05a2-4a80-9c63-af919cf39fc3" status: 404 len: 111 microversion: 2.1 time: 0.033678 Oct 28 18:42:21.950798 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3877/6107] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:42:21 2022] DELETE /compute/v2.1/servers/04fc712d-05a2-4a80-9c63-af919cf39fc3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:21.961171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:21.964348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:21.975403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:21.976248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:21.976850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:21.984962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:21.985750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:21.989920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:22.201975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:22.214739 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a112210-2519-422c-b36d-383160a0cebc tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1460 microversion: 2.1 time: 0.392023 Oct 28 18:42:22.232927 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2231/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:21 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1460 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:22.246703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:22.247889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:22.255383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:22.256508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:22.257942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:22.259090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:22.259692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:22.260303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:22.578834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:22.591584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-681c6aa4-499a-40c1-b6a6-d0a390ee8307 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.638587 Oct 28 18:42:22.592233 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3878/6109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:21 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:22.613952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:22.614901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:22.632061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:22.633375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:22.635711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:22.636661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:22.637331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:22.639163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:22.648702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:22.658396 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3832a8d6-7da3-4783-a262-95d7d7d72b3a tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1460 microversion: 2.1 time: 0.419603 Oct 28 18:42:22.664630 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2232/6110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:22 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1460 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:22.675709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:22.676621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:22.739179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:22.739848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:22.740312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:22.768256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:22.768855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:22.769301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:23.187561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:23.199546 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d88a247-e40c-4432-bbc3-8ca71ecdd787 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.533535 Oct 28 18:42:23.200608 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2233/6111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:22 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:23.224858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7ea7b119-2898-4c04-a182-2dbf9ea25e88 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:23.225630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7ea7b119-2898-4c04-a182-2dbf9ea25e88 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2983}} Oct 28 18:42:23.226370 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-7ea7b119-2898-4c04-a182-2dbf9ea25e88 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7ea7b119-2898-4c04-a182-2dbf9ea25e88 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 9223372036854775808 could not be found. Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '9223372036854775808'} Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2984, in get Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:23.228618 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:23.233257 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:23.233257 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:23.233257 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:23.233257 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 28 18:42:23.233257 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:23.234834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7ea7b119-2898-4c04-a182-2dbf9ea25e88 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:23.236038 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7ea7b119-2898-4c04-a182-2dbf9ea25e88 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.016708 Oct 28 18:42:23.237065 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2234/6112] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Oct 28 18:42:23 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:42:23.249037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:23.250450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:23.258222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:23.259075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:23.259662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:23.260674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:23.261276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:23.261850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:23.656642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:23.667031 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-355bed5a-d71a-4fd3-a8b0-9439e6e255a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1215 microversion: 2.1 time: 1.070782 Oct 28 18:42:23.670315 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3879/6113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:22 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1215 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:23.866061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:23.876059 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d6740cf1-3c77-4ae3-a838-a98a0e1ea8ae tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.633073 Oct 28 18:42:23.880081 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2235/6114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:23 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:23.908610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:23.909358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:23.936658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:23.942684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:23.949096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:23.950262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:23.960324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:23.961020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:24.352650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:24.366465 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-796c3090-f900-4a2a-93e6-cb480b174a15 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.463446 Oct 28 18:42:24.367957 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3880/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:23 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:24.394333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f577f9a0-e76c-4046-8476-60e74c0d98f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:24.396957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f577f9a0-e76c-4046-8476-60e74c0d98f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Failed to fetch instance by id -1 {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2983}} Oct 28 18:42:24.399166 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f577f9a0-e76c-4046-8476-60e74c0d98f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance -1 could not be found. Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f577f9a0-e76c-4046-8476-60e74c0d98f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance -1 could not be found. Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '-1'} Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2984, in get Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:24.402663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:24.409371 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:24.409371 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:24.409371 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 28 18:42:24.409371 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:24.413076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f577f9a0-e76c-4046-8476-60e74c0d98f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:24.422480 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f577f9a0-e76c-4046-8476-60e74c0d98f8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.032702 Oct 28 18:42:24.423430 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2236/6116] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 18:42:24 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:42:24.440967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:24.442431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:24.454268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:24.454878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:24.455421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:24.457232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:24.472746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:24.473447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:24.697540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:24.698349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:24.717810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:24.721318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:24.722717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:24.728112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:24.728948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:24.733854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:25.156213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:25.171626 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0ae4269d-e0dc-40be-82ca-6b4622cfe32f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1203 microversion: 2.1 time: 0.478632 Oct 28 18:42:25.177103 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2237/6117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:24 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1203 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:25.267498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:25.279673 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0351d32-0517-40ce-93b9-7996caff7386 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.850070 Oct 28 18:42:25.291952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1678204848", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "6bd10d08-d9c7-4086-8108-83d7b64604d3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2009277915", "security_groups": [{"name": "tempest-secgroup-smoke-263921937"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:25.293137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3881/6118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:24 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:25.306941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:25.307830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:25.315216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:25.316045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:25.316790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:25.317688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:25.318305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:25.318890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:25.516888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:25.532659 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9236af89-bf44-4468-b60b-4b3959e2eadb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.229481 Oct 28 18:42:25.548506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3882/6119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:25 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:25.560818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25b64299-a091-41aa-8980-4bd43de4a592 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:25.565988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25b64299-a091-41aa-8980-4bd43de4a592 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 29e37b9a-9e31-4960-ab30-4570c8757680] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:25.574307 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-25b64299-a091-41aa-8980-4bd43de4a592 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 29e37b9a-9e31-4960-ab30-4570c8757680 could not be found. Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25b64299-a091-41aa-8980-4bd43de4a592 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/29e37b9a-9e31-4960-ab30-4570c8757680/action HTTP/1.1 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 19 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: {"forceDelete": {}} Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 29e37b9a-9e31-4960-ab30-4570c8757680 could not be found. Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '29e37b9a-9e31-4960-ab30-4570c8757680', 'body': {'forceDelete': {}}} Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e37b9a-9e31-4960-ab30-4570c8757680 could not be found. Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e37b9a-9e31-4960-ab30-4570c8757680 could not be found. Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:25.585837 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:25.590315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:25.590315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:25.590315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e37b9a-9e31-4960-ab30-4570c8757680 could not be found. Oct 28 18:42:25.590315 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:25.592181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25b64299-a091-41aa-8980-4bd43de4a592 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 29e37b9a-9e31-4960-ab30-4570c8757680 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:25.593208 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25b64299-a091-41aa-8980-4bd43de4a592 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/29e37b9a-9e31-4960-ab30-4570c8757680/action" status: 404 len: 111 microversion: 2.1 time: 0.037912 Oct 28 18:42:25.593956 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3883/6120] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:25 2022] POST /compute/v2.1/servers/29e37b9a-9e31-4960-ab30-4570c8757680/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:42:25.597615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] validate_networks() for [('6bd10d08-d9c7-4086-8108-83d7b64604d3', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:42:25.603099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:25.603719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:25.624063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:25.624642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:25.625075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:25.626953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:25.627419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:25.628921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:25.846485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:25.857484 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0f1e096-1bd2-4f17-ab47-e4cb4a3406fd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.258916 Oct 28 18:42:25.876421 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3884/6121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:25 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:25.898206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:25.898846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:25.911778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:25.912310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:25.912757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:25.913473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:25.913933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:25.914364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.154360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:26.164468 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0cca58f-1f69-42f5-8157-1fba931464c9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.283708 Oct 28 18:42:26.165954 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3885/6122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:25 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:26.190258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e794b411-9321-4348-ae70-febcd4758a6a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:26.193384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e794b411-9321-4348-ae70-febcd4758a6a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 8668c378-3989-44bb-a5e9-05a9f1b2f56f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:26.201944 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e794b411-9321-4348-ae70-febcd4758a6a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 8668c378-3989-44bb-a5e9-05a9f1b2f56f could not be found. Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e794b411-9321-4348-ae70-febcd4758a6a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/8668c378-3989-44bb-a5e9-05a9f1b2f56f/action HTTP/1.1 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 39 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: {"os-getConsoleOutput": {"length": 10}} Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 8668c378-3989-44bb-a5e9-05a9f1b2f56f could not be found. Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8668c378-3989-44bb-a5e9-05a9f1b2f56f', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8668c378-3989-44bb-a5e9-05a9f1b2f56f could not be found. Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8668c378-3989-44bb-a5e9-05a9f1b2f56f could not be found. Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:26.207795 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8668c378-3989-44bb-a5e9-05a9f1b2f56f could not be found. Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e794b411-9321-4348-ae70-febcd4758a6a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 8668c378-3989-44bb-a5e9-05a9f1b2f56f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e794b411-9321-4348-ae70-febcd4758a6a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/8668c378-3989-44bb-a5e9-05a9f1b2f56f/action" status: 404 len: 111 microversion: 2.1 time: 0.025049 Oct 28 18:42:26.214578 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3886/6123] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:26 2022] POST /compute/v2.1/servers/8668c378-3989-44bb-a5e9-05a9f1b2f56f/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:26.237183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:26.238075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:26.262041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.262538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.263692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.264536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.265217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.266007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.271318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:26.536278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:26.552130 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32f5278c-c175-4f37-90e5-090a97b32d50 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1203 microversion: 2.1 time: 0.339616 Oct 28 18:42:26.554066 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3887/6124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:26 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1203 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:26.561284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:26.562187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:26.569984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.570992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.571657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.572561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.573169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.574137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.806537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:42:26.807678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:42:26.808334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:42:26.809233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:42:26.810469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:42:26.830212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.830970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.832921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.833915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.836565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.837408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.846170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:26.854928 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30c80789-a598-4c9f-bf55-fb60f6afabb6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.299579 Oct 28 18:42:26.860738 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3888/6125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:26 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:26.891522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:26.896966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:26.902331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for project 946b8055a69f4f979036482e1fd37f67. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:42:26.912744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.913484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.914118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.915003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.915628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.917432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.923929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Getting quotas for user 379680f3dd0542389b53a8a4f20ae800 and project 946b8055a69f4f979036482e1fd37f67. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:42:26.947007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:42:26.975025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:42:27.130771 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-53bb7aef-0376-4722-a737-07f170841b8f tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.853382 Oct 28 18:42:27.132121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2238/6126] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:42:27.147178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ecd9b659-7544-4b69-918f-11575ae6a5b0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:27.148555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ecd9b659-7544-4b69-918f-11575ae6a5b0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:27.250712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:27.261974 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5499e5bc-5d72-4b67-95cf-d3fe9365395b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.375144 Oct 28 18:42:27.264120 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3889/6127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:26 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:27.289622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ff49566-9d1e-4be4-8cc0-aeb0a5fc83e5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:27.290920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ff49566-9d1e-4be4-8cc0-aeb0a5fc83e5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: e48ec84f-f41b-4bde-bf61-7b843dcd7964] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:27.301609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-3ff49566-9d1e-4be4-8cc0-aeb0a5fc83e5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance e48ec84f-f41b-4bde-bf61-7b843dcd7964 could not be found. Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ff49566-9d1e-4be4-8cc0-aeb0a5fc83e5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e48ec84f-f41b-4bde-bf61-7b843dcd7964 HTTP/1.1 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance e48ec84f-f41b-4bde-bf61-7b843dcd7964 could not be found. Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'e48ec84f-f41b-4bde-bf61-7b843dcd7964'} Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48ec84f-f41b-4bde-bf61-7b843dcd7964 could not be found. Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48ec84f-f41b-4bde-bf61-7b843dcd7964 could not be found. Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:27.303461 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:27.308293 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:27.308293 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:27.308293 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:27.308293 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48ec84f-f41b-4bde-bf61-7b843dcd7964 could not be found. Oct 28 18:42:27.308293 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:27.310229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ff49566-9d1e-4be4-8cc0-aeb0a5fc83e5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance e48ec84f-f41b-4bde-bf61-7b843dcd7964 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:27.311354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ff49566-9d1e-4be4-8cc0-aeb0a5fc83e5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/e48ec84f-f41b-4bde-bf61-7b843dcd7964" status: 404 len: 111 microversion: 2.1 time: 0.025841 Oct 28 18:42:27.312608 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3890/6128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:27 2022] GET /compute/v2.1/servers/e48ec84f-f41b-4bde-bf61-7b843dcd7964 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:27.321510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:27.322607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:27.333109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:27.333822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:27.334429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:27.335401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:27.336151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:27.336793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:27.550003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:27.588647 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f216ab2-411e-4cda-b62c-2e6a0997420e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.269704 Oct 28 18:42:27.591509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3891/6129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:27 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:27.613932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:27.621640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:27.635992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:27.636748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:27.637347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:27.638581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:27.639233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:27.639848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:27.892758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ecd9b659-7544-4b69-918f-11575ae6a5b0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:27.902665 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ecd9b659-7544-4b69-918f-11575ae6a5b0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1267 microversion: 2.1 time: 0.762304 Oct 28 18:42:27.903329 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2239/6130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:27 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1267 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:27.912491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:27.913628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:27.937316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:27.937833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:27.938275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:27.939198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:27.939340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:27.940028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:27.940617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:27.954797 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8c37271-a149-4ae1-861b-78876ebdb83b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1203 microversion: 2.1 time: 0.358730 Oct 28 18:42:27.955964 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3892/6131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:27 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1203 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:28.317590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:28.338410 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae18f859-1ff2-4789-b9d0-34bbd1b9a37f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.433196 Oct 28 18:42:28.339018 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2240/6132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:27 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:28.456354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80d1a21f-db61-4079-9226-54c25238c845 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-511612565", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:28.519426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-862fea53-1098-4779-88b2-9a1947012b05 req-f09a3c6f-0e2b-42f0-921f-e2acee8c745b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5", "tag": "da972123-6b77-47c7-950e-7cf0ae635374"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80d1a21f-db61-4079-9226-54c25238c845 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 237 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-511612565", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-511612565', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.521340 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80d1a21f-db61-4079-9226-54c25238c845 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:28.526357 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80d1a21f-db61-4079-9226-54c25238c845 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.077440 Oct 28 18:42:28.531064 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3893/6133] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:28 2022] POST /compute/v2.1/servers => generated 139 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:42:28.547941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-862fea53-1098-4779-88b2-9a1947012b05 req-f09a3c6f-0e2b-42f0-921f-e2acee8c745b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:28.548738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-862fea53-1098-4779-88b2-9a1947012b05 req-f09a3c6f-0e2b-42f0-921f-e2acee8c745b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:28.549329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-862fea53-1098-4779-88b2-9a1947012b05 req-f09a3c6f-0e2b-42f0-921f-e2acee8c745b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:28.554256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:28.554946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:28.566050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:28.570050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:28.570747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:28.572010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:28.574108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:28.574798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:28.593748 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-862fea53-1098-4779-88b2-9a1947012b05 req-f09a3c6f-0e2b-42f0-921f-e2acee8c745b service nova] Creating event network-changed:da972123-6b77-47c7-950e-7cf0ae635374 for instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 on n-h2-862404-2 Oct 28 18:42:28.608594 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-862fea53-1098-4779-88b2-9a1947012b05 req-f09a3c6f-0e2b-42f0-921f-e2acee8c745b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092615 Oct 28 18:42:28.619804 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2241/6134] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:42:28.929766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:28.930468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:28.945322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:28.945836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:28.946286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:28.947009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:28.952326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:28.952843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:28.986361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:29.000189 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-888a6958-4223-4870-8236-ff4be45ac9e6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.462998 Oct 28 18:42:29.021417 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3894/6135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:28 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:29.030816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:29.037372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:29.047630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:29.048283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:29.048823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:29.049561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:29.050001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:29.050413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:29.146242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:29.168679 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-69ddc167-50e8-4b8e-a283-c3dc9c0fbff8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1319 microversion: 2.1 time: 0.242927 Oct 28 18:42:29.171028 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2242/6136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:28 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:29.189092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:29.203084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:29.226046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:29.227378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:29.228357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:29.229313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:29.230007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:29.230676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:29.449641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:29.462748 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86309115-cb63-4454-88f7-b3669864d1de tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1203 microversion: 2.1 time: 0.439788 Oct 28 18:42:29.464747 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3895/6137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:29 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1203 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:30.052303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:30.068409 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-02152a97-499f-4f6d-a5e8-206f2c2253b4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.893391 Oct 28 18:42:30.069447 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2243/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:29 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:30.168090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63739757-bd5d-4066-998d-afffa8e75399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-549874820", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63739757-bd5d-4066-998d-afffa8e75399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 234 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-549874820", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-549874820', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.174031 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 18:42:30.178414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.182872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63739757-bd5d-4066-998d-afffa8e75399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:30.188301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-63739757-bd5d-4066-998d-afffa8e75399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.024158 Oct 28 18:42:30.189287 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3896/6139] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:30 2022] POST /compute/v2.1/servers => generated 133 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:42:30.198148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:30.198997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:30.203657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:30.204605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:30.212118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.212919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.214413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.217289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.218058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.218653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.222988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.223780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.226286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.227280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.229472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.230309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.522822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:30.534975 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eedb0d35-f82d-47d4-81d4-a49bf8acde3c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1325 microversion: 2.1 time: 0.342754 Oct 28 18:42:30.552018 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2244/6140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:30 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1325 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:30.558551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:30.559779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:30.569755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.570610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.571293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.572946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.573777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.574676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.587726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:30.597429 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f301fe1-6994-4dcc-8923-d8b9a48be3dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.399897 Oct 28 18:42:30.598031 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3897/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:30 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:30.626580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:30.627210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:30.638976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:30.639175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.640051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.642230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.645820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.646836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.647172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.875559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:30.888003 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39977204-3288-4d45-8135-e58e7dd7d9da tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.267056 Oct 28 18:42:30.888917 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3898/6142] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:30 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:30.920928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88450974-0637-4ef8-93b2-3f04a421e799 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:30.922405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-88450974-0637-4ef8-93b2-3f04a421e799 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: b2343be9-d50a-46f2-bc2e-912b1b5f129d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:30.963865 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-88450974-0637-4ef8-93b2-3f04a421e799 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance b2343be9-d50a-46f2-bc2e-912b1b5f129d could not be found. Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88450974-0637-4ef8-93b2-3f04a421e799 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/b2343be9-d50a-46f2-bc2e-912b1b5f129d/action HTTP/1.1 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 13 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: {"pause": {}} Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance b2343be9-d50a-46f2-bc2e-912b1b5f129d could not be found. Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'b2343be9-d50a-46f2-bc2e-912b1b5f129d', 'body': {'pause': {}}} Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2343be9-d50a-46f2-bc2e-912b1b5f129d could not be found. Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2343be9-d50a-46f2-bc2e-912b1b5f129d could not be found. Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:30.980668 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:30.985394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:30.985394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:30.985394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2343be9-d50a-46f2-bc2e-912b1b5f129d could not be found. Oct 28 18:42:30.985394 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:30.985394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88450974-0637-4ef8-93b2-3f04a421e799 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance b2343be9-d50a-46f2-bc2e-912b1b5f129d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:30.985394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-88450974-0637-4ef8-93b2-3f04a421e799 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/b2343be9-d50a-46f2-bc2e-912b1b5f129d/action" status: 404 len: 111 microversion: 2.1 time: 0.069791 Oct 28 18:42:30.986586 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3899/6143] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:30 2022] POST /compute/v2.1/servers/b2343be9-d50a-46f2-bc2e-912b1b5f129d/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:31.002123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:31.002123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:31.045090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.045524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.050963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.052095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.056132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.059070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.265746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:31.275834 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cea18493-93f8-4e9d-b2c7-f6276ce597a2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.287390 Oct 28 18:42:31.277321 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3900/6144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:30 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:31.303241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:31.303963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:31.311690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.312214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.314696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.314696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.314696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.314696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.510975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:31.520364 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90fae1c4-793d-4ff7-96db-5d205ce653f9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.222915 Oct 28 18:42:31.522091 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3901/6145] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:31 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:31.545324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:31.546107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:31.550571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:31.555600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.556388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.557794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.558684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.559428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.560064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.563018 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-188c63c7-5f5c-4cad-8509-a359a784b9c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1203 microversion: 2.1 time: 1.009492 Oct 28 18:42:31.567966 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2245/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:30 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1203 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:31.573296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:31.579294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:31.596244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.597066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.599111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.600104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.602902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.603547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.654484 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-587feace-6f30-4b20-a376-8379a40619aa tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 202 len: 0 microversion: 2.1 time: 0.113030 Oct 28 18:42:31.659750 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3902/6147] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:31 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:42:31.666866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:31.667948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:31.677128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.678130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.678848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.679957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.680996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.681597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.743386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:31.756190 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7f6a7e50-2a8b-4792-a58b-221bc8e20d6e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1325 microversion: 2.1 time: 0.184582 Oct 28 18:42:31.760642 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2246/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:31 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:31.897977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:31.908309 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf1c1fa2-6446-4e8a-b20f-8158da95f771 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1509 microversion: 2.1 time: 0.246459 Oct 28 18:42:31.925451 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3903/6149] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:31 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:32.486718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-894680b7-92e9-4a45-b6df-b2fe6033a133 req-c0c76bd2-6849-41e6-ac17-7bcc34bf2531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5", "tag": "da972123-6b77-47c7-950e-7cf0ae635374"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:32.527332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-894680b7-92e9-4a45-b6df-b2fe6033a133 req-c0c76bd2-6849-41e6-ac17-7bcc34bf2531 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:32.528449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-894680b7-92e9-4a45-b6df-b2fe6033a133 req-c0c76bd2-6849-41e6-ac17-7bcc34bf2531 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:32.528882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-894680b7-92e9-4a45-b6df-b2fe6033a133 req-c0c76bd2-6849-41e6-ac17-7bcc34bf2531 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:32.587311 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-894680b7-92e9-4a45-b6df-b2fe6033a133 req-c0c76bd2-6849-41e6-ac17-7bcc34bf2531 service nova] Creating event network-changed:da972123-6b77-47c7-950e-7cf0ae635374 for instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 on n-h2-862404-2 Oct 28 18:42:32.591857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:32.592599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:32.595115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:32.600583 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-894680b7-92e9-4a45-b6df-b2fe6033a133 req-c0c76bd2-6849-41e6-ac17-7bcc34bf2531 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117971 Oct 28 18:42:32.601626 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2247/6150] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:42:32.616971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:32.618608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:32.619216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:32.620084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:32.626731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:32.627527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:32.786846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:32.787608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:32.801719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:32.802381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:32.803040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:32.803983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:32.805459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:32.807557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:32.965235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:32.988157 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c31eb4fd-cc0e-4914-80a6-c7c733e23991 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1203 microversion: 2.1 time: 0.391042 Oct 28 18:42:32.989895 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3904/6151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:32 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1203 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:32.999176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:33.001041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:33.022922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.028206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.029015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.032549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.034347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.037444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.411179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:33.454252 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-93c1bc45-1246-4409-afa2-67a1cff66f33 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1392 microversion: 2.1 time: 0.672311 Oct 28 18:42:33.457209 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2248/6152] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:32 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1392 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:33.493432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:33.507380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3b95b1b-9f22-459f-b960-74a46e125f04 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1489 microversion: 2.1 time: 0.515864 Oct 28 18:42:33.517298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3905/6153] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:32 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1489 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:33.545802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:33.546893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:33.557890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.558839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.559686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.561314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.562105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.564184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.598641 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Cannot 'pause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state paused Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action HTTP/1.1 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 13 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: {"pause": {}} Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: exception: Cannot 'pause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state paused Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'pause': {}}} Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d in vm_state paused. Cannot pause while the instance is in this state. Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state paused Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:33.602111 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:33.608654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:33.608654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:33.608654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:33.608654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state paused Oct 28 18:42:33.608654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:33.610753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 409 to user: Cannot 'pause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state paused {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:33.612432 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c7faac6-607c-439d-a826-fa155a03b8c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 409 len: 143 microversion: 2.1 time: 0.073977 Oct 28 18:42:33.641354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:33.645805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:33.661099 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2249/6154] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:33 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 143 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:42:33.683130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.683636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.684189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.685451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.686722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.687455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.724172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:33.788478 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e73a47f2-4181-4c0f-8080-d99166d8f531 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 202 len: 0 microversion: 2.1 time: 0.170125 Oct 28 18:42:33.792658 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3906/6155] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:33 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:42:33.800636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:33.801354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:33.815773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.818582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.819143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.820934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.821016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.821546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:34.031798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:34.038639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:34.075696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:34.083681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:34.086412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:34.089034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:34.092473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:34.096320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:34.240038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:34.255995 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed15c6e9-440b-4d81-99e8-000c8569901c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1496 microversion: 2.1 time: 0.460191 Oct 28 18:42:34.258916 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2250/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:33 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1496 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:34.468216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:34.488741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:34.491643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:34.493222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2a9fb28-f0ee-49c5-a64a-ba0359aa9c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1203 microversion: 2.1 time: 0.482270 Oct 28 18:42:34.501654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3907/6157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:34 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1203 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:34.503136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:34.503136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:34.509470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:34.518406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:34.519166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:34.520422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:34.647540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e12e0f68-fd74-4695-a2b4-93f2069b5f05 req-e1a0072a-d745-4e50-9aef-ecac6b34c3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5", "tag": "da972123-6b77-47c7-950e-7cf0ae635374"}, {"name": "network-changed", "server_uuid": "6faaa157-2333-4347-8fd8-9deab1b4fbca", "tag": "ae95d69c-ed79-4a16-aa64-0c47e981d9e1"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:34.680202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e12e0f68-fd74-4695-a2b4-93f2069b5f05 req-e1a0072a-d745-4e50-9aef-ecac6b34c3ed service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:34.680718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e12e0f68-fd74-4695-a2b4-93f2069b5f05 req-e1a0072a-d745-4e50-9aef-ecac6b34c3ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:34.684093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e12e0f68-fd74-4695-a2b4-93f2069b5f05 req-e1a0072a-d745-4e50-9aef-ecac6b34c3ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:34.736422 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e12e0f68-fd74-4695-a2b4-93f2069b5f05 req-e1a0072a-d745-4e50-9aef-ecac6b34c3ed service nova] Creating event network-changed:da972123-6b77-47c7-950e-7cf0ae635374 for instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 on n-h2-862404-2 Oct 28 18:42:34.737203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e12e0f68-fd74-4695-a2b4-93f2069b5f05 req-e1a0072a-d745-4e50-9aef-ecac6b34c3ed service nova] Creating event network-changed:ae95d69c-ed79-4a16-aa64-0c47e981d9e1 for instance 6faaa157-2333-4347-8fd8-9deab1b4fbca on n-h2-862404-2 Oct 28 18:42:34.754258 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e12e0f68-fd74-4695-a2b4-93f2069b5f05 req-e1a0072a-d745-4e50-9aef-ecac6b34c3ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.111014 Oct 28 18:42:34.755402 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3908/6158] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:42:34.952273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:34.972821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b04b1d6c-61ed-4f1b-8ab3-479ed1146e1c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1392 microversion: 2.1 time: 0.480769 Oct 28 18:42:34.975788 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2251/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:34 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1392 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:34.994794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-399176f9-8c94-4267-84aa-ca1238fd6a42 req-99e62208-4138-4b7a-8d53-a17416c24cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ec2fbe-3372-4320-ad29-a4431ecb7fb5", "name": "network-vif-plugged", "status": "completed", "tag": "3b193318-7177-4856-9d81-7655f4dc857e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:35.024169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-399176f9-8c94-4267-84aa-ca1238fd6a42 req-99e62208-4138-4b7a-8d53-a17416c24cd6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.025980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-399176f9-8c94-4267-84aa-ca1238fd6a42 req-99e62208-4138-4b7a-8d53-a17416c24cd6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.026620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-399176f9-8c94-4267-84aa-ca1238fd6a42 req-99e62208-4138-4b7a-8d53-a17416c24cd6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.063841 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-399176f9-8c94-4267-84aa-ca1238fd6a42 req-99e62208-4138-4b7a-8d53-a17416c24cd6 service nova] Creating event network-vif-plugged:3b193318-7177-4856-9d81-7655f4dc857e for instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 on n-h1-862404-2 Oct 28 18:42:35.078026 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-399176f9-8c94-4267-84aa-ca1238fd6a42 req-99e62208-4138-4b7a-8d53-a17416c24cd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095465 Oct 28 18:42:35.079075 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3909/6160] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:35.298867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:35.299507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:35.306260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.307033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.307651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.308561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.309027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.309513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.453811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:35.463956 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5bd1015-cdef-4061-be6a-27617fb3e1df tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.181412 Oct 28 18:42:35.471564 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2252/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:35 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:35.496290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:35.501073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:35.509582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.510033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.510468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.511187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.511648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.512080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.532385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:35.533254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:35.540059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.540794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.541593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.543266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.544728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.545604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.705204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:35.717187 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db6f6056-9e89-4b11-8ad4-da39c0fb5235 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.227913 Oct 28 18:42:35.718093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3910/6162] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:35 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:35.741266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:35.743571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:35.751695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.752559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.753201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.754111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.754725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.755306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.770718 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef/action HTTP/1.1 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 28 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: {"reboot": {"type": "SOFT"}} Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'c668a51f-23af-4529-b61e-d9646e0675ef', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:35.772822 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:35.776639 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:35.778991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:35.779944 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cfb75043-567d-472b-9164-df6a74cfeb2d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef/action" status: 404 len: 111 microversion: 2.1 time: 0.043279 Oct 28 18:42:35.780849 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3911/6163] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:35 2022] POST /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:42:35.791109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:35.791728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:35.804153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.804663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.805110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.805874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:35.806424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:35.806868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.868222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:35.883789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13323576-153c-41f0-b301-31309fffc7db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1203 microversion: 2.1 time: 0.355566 Oct 28 18:42:35.884546 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2253/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:35 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1203 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:35.977265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:35.986322 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33ecbaf1-336c-4354-91e1-6bf1460d9e84 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.198895 Oct 28 18:42:35.986908 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3912/6165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:35 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:36.005399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:36.006666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:36.011939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:36.013372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:36.016780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.017556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.019238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.019938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.020436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.020836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.020950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.021576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.021910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.022023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.022454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.022887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.190537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:36.204286 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65503452-c960-4d4d-8728-b900f0f76657 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1392 microversion: 2.1 time: 0.202971 Oct 28 18:42:36.208174 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2254/6166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:36 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1392 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:36.228183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:36.237598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b593a70-7082-4573-a8de-fc81fb139f3d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.229497 Oct 28 18:42:36.249815 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3913/6167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:36 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:36.261649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a5e2ae3b-898f-4db3-9998-7f66e683f29e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:36.264804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a5e2ae3b-898f-4db3-9998-7f66e683f29e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 11b0bda6-e5de-4c15-ac99-b9c98da29809] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:36.270464 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-a5e2ae3b-898f-4db3-9998-7f66e683f29e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 11b0bda6-e5de-4c15-ac99-b9c98da29809 could not be found. Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a5e2ae3b-898f-4db3-9998-7f66e683f29e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/11b0bda6-e5de-4c15-ac99-b9c98da29809/action HTTP/1.1 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 28 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: {"reboot": {"type": "SOFT"}} Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 11b0bda6-e5de-4c15-ac99-b9c98da29809 could not be found. Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '11b0bda6-e5de-4c15-ac99-b9c98da29809', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b0bda6-e5de-4c15-ac99-b9c98da29809 could not be found. Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b0bda6-e5de-4c15-ac99-b9c98da29809 could not be found. Oct 28 18:42:36.272305 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b0bda6-e5de-4c15-ac99-b9c98da29809 could not be found. Oct 28 18:42:36.277373 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.278994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a5e2ae3b-898f-4db3-9998-7f66e683f29e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 11b0bda6-e5de-4c15-ac99-b9c98da29809 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:36.280049 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a5e2ae3b-898f-4db3-9998-7f66e683f29e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/11b0bda6-e5de-4c15-ac99-b9c98da29809/action" status: 404 len: 111 microversion: 2.1 time: 0.022518 Oct 28 18:42:36.289249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:36.289972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:36.292547 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2255/6168] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:36 2022] POST /compute/v2.1/servers/11b0bda6-e5de-4c15-ac99-b9c98da29809/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:36.297086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.297577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.298189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.299158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.299775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.300389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.551173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:36.570803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-999aeacf-54a4-4118-a0d2-2c792cdbcb0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.285300 Oct 28 18:42:36.571413 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3914/6169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:36 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:36.610264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:36.611589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:36.629050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.629549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.629986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.632224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.634231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.634705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.808739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:36.819068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb9f9ef9-3471-4afa-a352-756320e91bfe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.212760 Oct 28 18:42:36.820750 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2256/6170] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:36 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:36.847836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:36.850941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:36.860168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.861117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.861715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.862605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.863217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.863899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.882050 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef/action HTTP/1.1 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 65 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'c668a51f-23af-4529-b61e-d9646e0675ef', 'body': {'rebuild': {'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46'}}} Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 18:42:36.884074 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:42:36.888715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:36.891316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:36.892538 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a870206c-f5c3-4edc-8e66-b292504ebcba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef/action" status: 404 len: 111 microversion: 2.1 time: 0.049481 Oct 28 18:42:36.902155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:36.905357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:36.909239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:36.909454 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3915/6171] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:36 2022] POST /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:42:36.919504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.920119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:36.921321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.922418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.922727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:36.925080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.925696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.926566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.932456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.932964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.933416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.934129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.934783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.935374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.141938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:37.150672 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3e1e90ce-664a-499b-805c-09594026f5c5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.252744 Oct 28 18:42:37.165194 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2257/6172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:36 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:37.178472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:37.179085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:37.186428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.186920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.187351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.188099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.188551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.188971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.366760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:37.382089 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9564d202-925e-46a5-8b9e-dc7cc7441921 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1389 microversion: 2.1 time: 0.471278 Oct 28 18:42:37.392208 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3916/6173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:36 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1389 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:37.397639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:37.399110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:37.407121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.408133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.409505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:37.410065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.411264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.411993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.413189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.422563 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad0160f7-2f25-4d22-9ba7-277adb523dc3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.247951 Oct 28 18:42:37.433160 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2258/6174] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:37 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:37.455488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:37.460339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:37.474166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.474969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.475950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.476689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.477156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.477852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.723896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:37.728499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:37.739925 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d89e2d63-30d9-4a2c-8618-157f24bbcae1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1392 microversion: 2.1 time: 0.345876 Oct 28 18:42:37.755612 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9e171a5-660b-4e9d-811b-61c41b8faf5f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1389 microversion: 2.1 time: 0.321006 Oct 28 18:42:37.769512 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2259/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:37 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1389 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:37.769712 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3917/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:37 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1392 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:37.769824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4eb36cf1-1865-4418-9c74-2959642f450d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:37.771398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4eb36cf1-1865-4418-9c74-2959642f450d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 1fb56db2-0125-44fa-b964-59f8fb5a34f2] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:37.777429 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4eb36cf1-1865-4418-9c74-2959642f450d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 1fb56db2-0125-44fa-b964-59f8fb5a34f2 could not be found. Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4eb36cf1-1865-4418-9c74-2959642f450d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/1fb56db2-0125-44fa-b964-59f8fb5a34f2/action HTTP/1.1 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 65 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 1fb56db2-0125-44fa-b964-59f8fb5a34f2 could not be found. Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1fb56db2-0125-44fa-b964-59f8fb5a34f2', 'body': {'rebuild': {'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46'}}} Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb56db2-0125-44fa-b964-59f8fb5a34f2 could not be found. Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 18:42:37.782596 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb56db2-0125-44fa-b964-59f8fb5a34f2 could not be found. Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb56db2-0125-44fa-b964-59f8fb5a34f2 could not be found. Oct 28 18:42:37.787193 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:37.789837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:37.790470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:37.791412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4eb36cf1-1865-4418-9c74-2959642f450d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 1fb56db2-0125-44fa-b964-59f8fb5a34f2 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:37.796093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4eb36cf1-1865-4418-9c74-2959642f450d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb56db2-0125-44fa-b964-59f8fb5a34f2/action" status: 404 len: 111 microversion: 2.1 time: 0.033444 Oct 28 18:42:37.797224 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2260/6177] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:37 2022] POST /compute/v2.1/servers/1fb56db2-0125-44fa-b964-59f8fb5a34f2/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:37.800187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.804292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.804763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.805549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.806028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.806467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.806597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:37.807192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:37.815381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.815887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.816326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.817029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.817482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.817932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.897115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:38.008289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:38.021439 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bc9a227f-bc1f-4148-99bb-65ec8138596a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.219661 Oct 28 18:42:38.022446 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2261/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:37 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:38.073104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:38.074111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:38.082512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.083192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.083988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.084864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.085482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.086070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.124716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:38.144194 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84db7bc9-1041-4a48-ac8b-f2eddbb60eb4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1389 microversion: 2.1 time: 0.354713 Oct 28 18:42:38.145659 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3918/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:37 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1389 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:38.169930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:38.170535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:38.179102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.179684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.180370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.181412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.182339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.182339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.230680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:42:38.288894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:38.305255 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-950327c8-68fd-482b-806f-8d7fc9dd1fbf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.234804 Oct 28 18:42:38.306147 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2262/6180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:38 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:38.333342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20addff0-9de1-42c7-86a0-7faab22d8a85 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:38.341034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20addff0-9de1-42c7-86a0-7faab22d8a85 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 406f9207-ae04-4dda-97f2-da831169d9ab] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:38.347164 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-20addff0-9de1-42c7-86a0-7faab22d8a85 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 406f9207-ae04-4dda-97f2-da831169d9ab could not be found. Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20addff0-9de1-42c7-86a0-7faab22d8a85 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/406f9207-ae04-4dda-97f2-da831169d9ab/action HTTP/1.1 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 15 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: {"restore": {}} Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 406f9207-ae04-4dda-97f2-da831169d9ab could not be found. Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '406f9207-ae04-4dda-97f2-da831169d9ab', 'body': {'restore': {}}} Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406f9207-ae04-4dda-97f2-da831169d9ab could not be found. Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406f9207-ae04-4dda-97f2-da831169d9ab could not be found. Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:38.349076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:38.353352 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:38.353352 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:38.353352 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406f9207-ae04-4dda-97f2-da831169d9ab could not be found. Oct 28 18:42:38.353352 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:38.353352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20addff0-9de1-42c7-86a0-7faab22d8a85 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 406f9207-ae04-4dda-97f2-da831169d9ab could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:38.353352 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20addff0-9de1-42c7-86a0-7faab22d8a85 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/406f9207-ae04-4dda-97f2-da831169d9ab/action" status: 404 len: 111 microversion: 2.1 time: 0.024878 Oct 28 18:42:38.353352 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2263/6181] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:38 2022] POST /compute/v2.1/servers/406f9207-ae04-4dda-97f2-da831169d9ab/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:38.361334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:38.363389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:38.385150 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df6cd874-114f-4a2c-8c9e-994a3795828f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 204 len: 0 microversion: 2.1 time: 0.220482 Oct 28 18:42:38.386421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.388321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.389127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.390465 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3919/6182] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:42:38 2022] DELETE /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:42:38.390804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.391489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.392205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.398908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:38.400086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:38.407446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.408434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.409222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.410395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.411073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.411658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.598512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:38.608321 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f663d98-b795-4696-b1e5-1a6c97cfb57e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.250744 Oct 28 18:42:38.609078 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2264/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:38 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:38.615902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:38.626328 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-63267397-d766-4d8e-a716-f172d8aa638b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1395 microversion: 2.1 time: 0.234599 Oct 28 18:42:38.633186 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3920/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:38 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1395 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:38.638774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:38.639592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:38.643105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:38.649255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.650269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.650872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.651714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.652335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.652995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.767919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:38.768773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:38.783964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.784490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.785019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.785654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.786117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.786552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.916672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:38.937782 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffa0e8ca-7545-4c76-ad5e-63f705db1927 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.302998 Oct 28 18:42:38.947874 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2265/6185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:38 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:38.966461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:38.969293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:38.992099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.992931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.994401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.996228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.997400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.998308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.025235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:39.030289 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Cannot 'restore' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action HTTP/1.1 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 15 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: {"restore": {}} Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: exception: Cannot 'restore' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'restore': {}}} Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d in vm_state active. Cannot restore while the instance is in this state. Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:39.032551 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:39.036767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:39.036767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:39.036767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:39.036767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:42:39.036767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.038254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 409 to user: Cannot 'restore' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:39.039454 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f7bc2446-4b4e-4223-965b-e745422781a9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 409 len: 145 microversion: 2.1 time: 0.079404 Oct 28 18:42:39.048725 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2266/6186] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:38 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 145 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:42:39.055501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:39.056077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:39.063512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.063616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.064426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.065152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.065616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.066052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.066238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:39.079882 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1cee5753-6024-4a06-a30a-6a7627c4cec3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1392 microversion: 2.1 time: 0.316353 Oct 28 18:42:39.081426 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3921/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:38 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1392 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:39.122211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cf2d0c2d-418e-46f2-b105-d4a03f782a49 req-544a94f7-fcf9-49cf-a18e-a9748c032bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faaa157-2333-4347-8fd8-9deab1b4fbca", "name": "network-vif-plugged", "status": "completed", "tag": "ae95d69c-ed79-4a16-aa64-0c47e981d9e1"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:39.144651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf2d0c2d-418e-46f2-b105-d4a03f782a49 req-544a94f7-fcf9-49cf-a18e-a9748c032bdf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.146420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf2d0c2d-418e-46f2-b105-d4a03f782a49 req-544a94f7-fcf9-49cf-a18e-a9748c032bdf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.147179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf2d0c2d-418e-46f2-b105-d4a03f782a49 req-544a94f7-fcf9-49cf-a18e-a9748c032bdf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.163525 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cf2d0c2d-418e-46f2-b105-d4a03f782a49 req-544a94f7-fcf9-49cf-a18e-a9748c032bdf service nova] Creating event network-vif-plugged:ae95d69c-ed79-4a16-aa64-0c47e981d9e1 for instance 6faaa157-2333-4347-8fd8-9deab1b4fbca on n-h2-862404-2 Oct 28 18:42:39.170879 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cf2d0c2d-418e-46f2-b105-d4a03f782a49 req-544a94f7-fcf9-49cf-a18e-a9748c032bdf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052890 Oct 28 18:42:39.171650 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3922/6188] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:42:39.291595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:39.303439 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-33c4d801-7290-4505-8f12-4ea89d427d9a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.252734 Oct 28 18:42:39.304921 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2267/6189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:39 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:39.329912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:39.330842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:39.338082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.338864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.339636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.340349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.341177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.341882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.577949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:39.594357 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99db7fbb-7aea-4cf0-8984-b4fd91e3cfc0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.269621 Oct 28 18:42:39.597310 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3923/6190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:39 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:39.621202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd31f6fe-b738-4bdf-889c-b23dc7f07e22 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:39.621824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cd31f6fe-b738-4bdf-889c-b23dc7f07e22 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c1f50023-939a-46ad-88a9-e5722b028b11] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:39.628804 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-cd31f6fe-b738-4bdf-889c-b23dc7f07e22 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance c1f50023-939a-46ad-88a9-e5722b028b11 could not be found. Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd31f6fe-b738-4bdf-889c-b23dc7f07e22 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/c1f50023-939a-46ad-88a9-e5722b028b11/action HTTP/1.1 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 14 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: {"resume": {}} Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance c1f50023-939a-46ad-88a9-e5722b028b11 could not be found. Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'c1f50023-939a-46ad-88a9-e5722b028b11', 'body': {'resume': {}}} Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1f50023-939a-46ad-88a9-e5722b028b11 could not be found. Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1f50023-939a-46ad-88a9-e5722b028b11 could not be found. Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:39.638036 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:39.661319 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:39.661319 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:39.661319 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1f50023-939a-46ad-88a9-e5722b028b11 could not be found. Oct 28 18:42:39.661319 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:39.661319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd31f6fe-b738-4bdf-889c-b23dc7f07e22 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance c1f50023-939a-46ad-88a9-e5722b028b11 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:39.661319 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cd31f6fe-b738-4bdf-889c-b23dc7f07e22 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/c1f50023-939a-46ad-88a9-e5722b028b11/action" status: 404 len: 111 microversion: 2.1 time: 0.022382 Oct 28 18:42:39.661319 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2268/6191] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:39 2022] POST /compute/v2.1/servers/c1f50023-939a-46ad-88a9-e5722b028b11/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:39.662580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:39.662580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:39.662869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:39.662869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:39.663686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.664213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.664657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.665378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.666650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.666650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.669361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.670424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.671093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.672045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.672943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.673667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.685372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:39.879188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:39.898626 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5b346d05-1fbb-4b3e-bb7d-8d5a14d200ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.253989 Oct 28 18:42:39.899232 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3924/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:39 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:39.905382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:39.920586 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a680650-d1e3-446b-a6d5-bdf752968aa9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1395 microversion: 2.1 time: 0.266695 Oct 28 18:42:39.923149 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2269/6193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:39 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1395 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:39.926051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:39.926759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:39.933485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.933979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.934592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.935466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.935989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.936439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.106217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:40.107179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:40.118555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.120864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.121429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.122465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.125834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.126512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.129667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:40.139978 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f178fc76-230e-4d57-97f1-a641a0d2364b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.217722 Oct 28 18:42:40.141248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3925/6194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:39 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:40.163482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:40.164301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:40.170982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.171714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.172327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.173182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.173784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.174371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.200640 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Cannot 'resume' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action HTTP/1.1 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 14 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: {"resume": {}} Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot 'resume' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'resume': {}}} Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d in vm_state active. Cannot resume while the instance is in this state. Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:40.202798 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:40.208016 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:40.208016 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:40.208016 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:40.208016 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:40.208016 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:40.208016 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:42:40.208016 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:40.209719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 409 to user: Cannot 'resume' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:40.210340 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-10c129cf-78f3-40f4-b175-56f05258183a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 409 len: 144 microversion: 2.1 time: 0.050790 Oct 28 18:42:40.214794 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3926/6195] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:40 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 144 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 18:42:40.220864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:40.221775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:40.248143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.248776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.249226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.251912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.252384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.252813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.359664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:40.368936 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b8b5b0b8-0d26-4499-aeba-2c430b5048f0 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1392 microversion: 2.1 time: 0.267064 Oct 28 18:42:40.381057 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2270/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:40 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1392 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:40.517206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:40.568491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45ac0304-e34b-409e-987b-d29630f0e303 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.351635 Oct 28 18:42:40.580696 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3927/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:40 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:40.600271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:40.601040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:40.612294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.614865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.615758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.617651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.618399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.619024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.946566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:40.947191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:40.957614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.958114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.958580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.959277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.959739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.960198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.977990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:40.996280 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20d0eeab-0e74-45f7-9383-8d0bd27c0241 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.399942 Oct 28 18:42:40.997529 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2271/6198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:40 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:41.074493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:41.084684 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65d769d8-67de-4789-829b-b1dd7634fdcd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1353 microversion: 2.1 time: 0.141906 Oct 28 18:42:41.101374 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3928/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:40 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:41.120670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a30707ef-41e2-45c1-bbb4-6d280df99e37 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:41.131427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3cde39c6-a665-4db2-b4b4-351bf8e11eed req-9b042017-4161-44cd-9618-12a82202eba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ec2fbe-3372-4320-ad29-a4431ecb7fb5", "name": "network-vif-deleted", "tag": "3b193318-7177-4856-9d81-7655f4dc857e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a30707ef-41e2-45c1-bbb4-6d280df99e37 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 160 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "384418cc-86cf-4a13-b7a1-6bd7b463bb92"}]}} Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f17ba65f-a473-4179-8631-ca52e11cfd46', 'flavorRef': '452', 'networks': [{'uuid': '384418cc-86cf-4a13-b7a1-6bd7b463bb92'}]}}} Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi '' Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:42:41.138078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:42:41.142536 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.145586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a30707ef-41e2-45c1-bbb4-6d280df99e37 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:41.149940 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a30707ef-41e2-45c1-bbb4-6d280df99e37 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.034449 Oct 28 18:42:41.155796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3cde39c6-a665-4db2-b4b4-351bf8e11eed req-9b042017-4161-44cd-9618-12a82202eba3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.156017 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2272/6200] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:41 2022] POST /compute/v2.1/servers => generated 108 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:42:41.156768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3cde39c6-a665-4db2-b4b4-351bf8e11eed req-9b042017-4161-44cd-9618-12a82202eba3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.157379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3cde39c6-a665-4db2-b4b4-351bf8e11eed req-9b042017-4161-44cd-9618-12a82202eba3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.177695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:41.180316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:41.189709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3cde39c6-a665-4db2-b4b4-351bf8e11eed req-9b042017-4161-44cd-9618-12a82202eba3 service nova] Creating event network-vif-deleted:3b193318-7177-4856-9d81-7655f4dc857e for instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 on n-h1-862404-2 Oct 28 18:42:41.193222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.194793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.196443 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3cde39c6-a665-4db2-b4b4-351bf8e11eed req-9b042017-4161-44cd-9618-12a82202eba3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076303 Oct 28 18:42:41.198161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3929/6201] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:41.200822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.203859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.204593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.205264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.395298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:41.396126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:41.409902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.410489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.410947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.413931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.419922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.420481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.454783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:41.464284 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-46ce83bc-5a5f-41ba-b4b1-b0f2af298b2b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.296432 Oct 28 18:42:41.479844 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2273/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:41 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:41.499346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:41.500174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:41.516499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.522098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.526986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.527839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.528861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.529302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.695462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:41.723046 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31116630-4a73-4665-a213-bc2a4ca65250 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1564 microversion: 2.1 time: 0.332028 Oct 28 18:42:41.723715 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3930/6203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:41 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1564 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:41.750294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:41.750926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:41.765780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.766222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.766660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.767388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.767930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.768282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.845213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:41.854294 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e91ec65f-39ad-46fa-b846-c34475007a56 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.360365 Oct 28 18:42:41.865498 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2274/6204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:41 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:41.878958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30d090d6-8584-40d2-bd5f-c19a6cd9382a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:41.879613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-30d090d6-8584-40d2-bd5f-c19a6cd9382a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 9444019b-269c-4714-a049-6608b06b6df3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:41.885870 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-30d090d6-8584-40d2-bd5f-c19a6cd9382a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 9444019b-269c-4714-a049-6608b06b6df3 could not be found. Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30d090d6-8584-40d2-bd5f-c19a6cd9382a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/9444019b-269c-4714-a049-6608b06b6df3/action HTTP/1.1 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 14 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: {"shelve": {}} Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 9444019b-269c-4714-a049-6608b06b6df3 could not be found. Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '9444019b-269c-4714-a049-6608b06b6df3', 'body': {'shelve': {}}} Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9444019b-269c-4714-a049-6608b06b6df3 could not be found. Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9444019b-269c-4714-a049-6608b06b6df3 could not be found. Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:41.889115 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9444019b-269c-4714-a049-6608b06b6df3 could not be found. Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30d090d6-8584-40d2-bd5f-c19a6cd9382a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 9444019b-269c-4714-a049-6608b06b6df3 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-30d090d6-8584-40d2-bd5f-c19a6cd9382a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/9444019b-269c-4714-a049-6608b06b6df3/action" status: 404 len: 111 microversion: 2.1 time: 0.015913 Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2275/6205] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:41 2022] POST /compute/v2.1/servers/9444019b-269c-4714-a049-6608b06b6df3/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:41.907143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:41.915658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.915658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.915658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.915658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.915658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.915658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:42.133710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:42.133927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:42.143252 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3340e912-565e-45b1-88e9-a41ed38fcbea tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1564 microversion: 2.1 time: 0.397614 Oct 28 18:42:42.147909 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f51eeb7d-c6aa-419e-9783-e313265f2586 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.251886 Oct 28 18:42:42.148664 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2276/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:41 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:42.149547 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3931/6207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:41 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1564 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:42.154443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:42.155284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:42.177906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:42.178982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:42.179701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:42.181003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:42.181003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:42.191784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:42.192641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:42.195036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:42.196212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:42.196350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:42.196776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:42.197214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:42.197488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:42.198138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:42.308976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:42.327276 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-275829d4-2bcc-49b9-b16d-3003c48aae88 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1188 microversion: 2.1 time: 0.177363 Oct 28 18:42:42.328940 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2277/6208] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:42 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1188 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:42.667650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:42.682598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06a66347-4326-4874-a897-9d2453c09dd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.505951 Oct 28 18:42:42.683865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3932/6209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:42 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:42.716953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:42.717535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:42.772027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:42.772714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:42.773791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:42.774556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:42.775073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:42.775510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:42.866409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lazy-loading 'flavor' on Instance uuid 614a9ab9-91a1-4941-96d6-3d2837c9993d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:42:43.236215 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f83d6b3d-acfa-4e60-83b7-5c6efa00056e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 202 len: 0 microversion: 2.1 time: 0.523464 Oct 28 18:42:43.237429 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2278/6210] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:42 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:42:43.248354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:43.249126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:43.264274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:43.265956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:43.267729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:43.283882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:43.288151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:43.288779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:43.354502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:43.356873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:43.366461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:43.369024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:43.372843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:43.373861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:43.375784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:43.376469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:43.521453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:43.530885 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9542b246-26bf-4d45-8ca9-8ad13c2f576c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1188 microversion: 2.1 time: 0.181496 Oct 28 18:42:43.547079 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2279/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:43 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1188 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:44.563591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:44.564311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:44.572597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.573116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.573530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.574237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.574704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.575926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.698494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:44.709100 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40f9ba0b-73ad-4f56-8ff4-156683c7ef03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1188 microversion: 2.1 time: 0.153466 Oct 28 18:42:44.725635 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2280/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:44 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1188 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:44.763214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:44.786792 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bfa5b07b-5ca1-448d-8f31-15e7c7960ff8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 1.545087 Oct 28 18:42:44.787910 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3933/6213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:43 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:45.738587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:45.739731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:45.757148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:45.758704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:45.759341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:45.761386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:45.765196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:45.768490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:45.815648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:45.817735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:45.829023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:45.831867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:45.838482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:45.839461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:45.842608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:45.845778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:45.910860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:45.921944 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c0147690-694f-4e31-8019-17529ff2a3dd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1188 microversion: 2.1 time: 0.189819 Oct 28 18:42:45.937904 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2281/6214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:45 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1188 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:46.092046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:46.092743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:46.113343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:46.116010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:46.118708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:46.121343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:46.123274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:46.125139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:46.223942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:46.250536 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fbb01f4d-562e-4690-a62f-3c4b8fb0d8c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.433514 Oct 28 18:42:46.252598 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3934/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:45 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:46.259205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9f068170-0271-40f5-9443-755ba80ea6b2 req-01aaace0-7255-4fc5-9b4a-bf550a007b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6faaa157-2333-4347-8fd8-9deab1b4fbca", "tag": "ae95d69c-ed79-4a16-aa64-0c47e981d9e1"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:46.270789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9f068170-0271-40f5-9443-755ba80ea6b2 req-01aaace0-7255-4fc5-9b4a-bf550a007b10 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:46.271555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9f068170-0271-40f5-9443-755ba80ea6b2 req-01aaace0-7255-4fc5-9b4a-bf550a007b10 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:46.272397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9f068170-0271-40f5-9443-755ba80ea6b2 req-01aaace0-7255-4fc5-9b4a-bf550a007b10 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:46.286996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9f068170-0271-40f5-9443-755ba80ea6b2 req-01aaace0-7255-4fc5-9b4a-bf550a007b10 service nova] Creating event network-changed:ae95d69c-ed79-4a16-aa64-0c47e981d9e1 for instance 6faaa157-2333-4347-8fd8-9deab1b4fbca on n-h2-862404-2 Oct 28 18:42:46.298639 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9f068170-0271-40f5-9443-755ba80ea6b2 req-01aaace0-7255-4fc5-9b4a-bf550a007b10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044478 Oct 28 18:42:46.299382 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3935/6216] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:46.395840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:46.410752 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-adb93d48-e506-4107-81dd-e3a90a82f7a8 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1564 microversion: 2.1 time: 0.320958 Oct 28 18:42:46.411412 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2282/6217] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:46 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1564 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:46.948366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:46.950341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:46.957618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:46.958468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:46.958961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:46.959934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:46.960919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:46.961591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:47.079394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:47.090455 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed88ce9b-66f8-4201-9a7e-d3b58fd12e3c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 200 len: 1188 microversion: 2.1 time: 0.147427 Oct 28 18:42:47.091547 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3936/6218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:46 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 1188 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:47.276603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:47.277296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:47.284848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:47.285572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:47.286485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:47.287801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:47.288474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:47.289095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:47.461969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:47.473645 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e6d3e74-9769-4162-a3c0-f38b8350e53e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.200853 Oct 28 18:42:47.474628 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2283/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:47 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:48.118865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:48.119562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: e1ec2fbe-3372-4320-ad29-a4431ecb7fb5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:48.127225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:48.128026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:48.128650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:48.129609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:48.130224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:48.130803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:48.149030 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 could not be found. Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 HTTP/1.1 Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 could not be found. Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'e1ec2fbe-3372-4320-ad29-a4431ecb7fb5'} Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 could not be found. Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 could not be found. Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:42:48.151715 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:48.157284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:42:48.157284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:42:48.157284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:42:48.157284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:42:48.157284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:42:48.157284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 could not be found. Oct 28 18:42:48.157284 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:42:48.159129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:42:48.160368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99011f25-3d54-4be2-9f33-9bd04f77f66d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5" status: 404 len: 111 microversion: 2.1 time: 0.046222 Oct 28 18:42:48.164501 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3937/6220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:48 2022] GET /compute/v2.1/servers/e1ec2fbe-3372-4320-ad29-a4431ecb7fb5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:42:48.501365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:48.501974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:48.510280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:48.510812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:48.511252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:48.512694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:48.513199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:48.513834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:48.517219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:48.681983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:48.691523 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4dda0a3f-b528-46fe-adf7-912a91e4de16 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.195025 Oct 28 18:42:48.692180 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2284/6221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:48 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:49.716972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:49.717596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:49.726385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:49.727487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:49.728481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:49.729446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:49.730087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:49.730612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:49.893335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:49.902149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-011dd788-e1fd-4269-b5c9-f2f4c8e9d6f2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.189892 Oct 28 18:42:49.902814 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3938/6222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:49 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:50.927652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:50.930301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:50.942967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:50.944395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:50.944844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:50.945564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:50.950618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:50.951116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:51.108707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:51.117226 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79b6f01b-29b5-48c6-b453-b6345f1c6c50 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.194341 Oct 28 18:42:51.127968 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2285/6223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:50 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:52.143166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:52.145176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:52.160887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:52.161481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:52.161970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:52.162703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:52.165358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:52.165818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:52.442857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:52.453273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd15061d-1d88-4545-9e49-50d33bc2b0c7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.313940 Oct 28 18:42:52.453906 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3939/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:52 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:53.478948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:53.479579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:53.492509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:53.493034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:53.494510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:53.495258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:53.495727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:53.496197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:53.799361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:53.815956 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-889d7109-4106-449e-a198-7b04229794a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.341168 Oct 28 18:42:53.817375 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2286/6225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:53 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:54.848527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:54.849575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:54.859534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:54.860224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:54.860917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:54.861852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:54.862531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:54.863901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:55.081017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:55.091420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e44b9020-87d8-4e0c-8150-9060ee906104 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1531 microversion: 2.1 time: 0.248849 Oct 28 18:42:55.108883 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3940/6226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:54 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1531 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:56.040713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-777777898", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5a316a35-ba68-4367-8ca9-41cd2baa8d19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca633313-4d95-4fc0-8f7a-c33539b3174e"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:56.115686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:56.117516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:56.139860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:56.142941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:56.143846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:56.144916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:56.148575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:56.149447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:56.190828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] validate_networks() for [('ca633313-4d95-4fc0-8f7a-c33539b3174e', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:42:56.401972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:56.416190 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eadf92a2-428a-47dd-8ba0-c136f2c83bad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1531 microversion: 2.1 time: 0.300930 Oct 28 18:42:56.417132 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3941/6227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:56 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1531 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:56.884652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:42:56.885082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:42:56.885570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:42:56.886000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:42:56.886510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:42:56.915667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:56.916221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:56.916765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:56.920927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:56.922974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:56.923391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:56.950306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:42:56.958139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:42:57.075001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:42:57.078667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a316a35-ba68-4367-8ca9-41cd2baa8d19',volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:42:57.314090 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a371d4c2-eb72-4c9b-af8d-8f19a5f6e101 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.279555 Oct 28 18:42:57.314987 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2287/6228] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:42:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:42:57.330655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33df2616-6449-4d8f-aab2-6ea2c4d99f0e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:57.331939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33df2616-6449-4d8f-aab2-6ea2c4d99f0e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:57.435213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-33df2616-6449-4d8f-aab2-6ea2c4d99f0e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:57.443865 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33df2616-6449-4d8f-aab2-6ea2c4d99f0e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1056 microversion: 2.1 time: 0.120132 Oct 28 18:42:57.445052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:57.445697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:57.446840 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3942/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:57 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1056 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:57.464045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:57.464694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:57.465738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:57.466783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:57.467193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:57.468675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:57.655862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:57.673606 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb7f5e5f-3bf5-4a00-8900-cbd8acb6fbc9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1531 microversion: 2.1 time: 0.232258 Oct 28 18:42:57.674427 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2288/6230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:57 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1531 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:58.471729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:58.472294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:58.482409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:58.482926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:58.483393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:58.484371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:58.485272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:58.485999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:58.683658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:58.700635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:58.701214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:58.714028 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41b3322c-a120-4848-8d09-87f44db58acd tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1154 microversion: 2.1 time: 0.246163 Oct 28 18:42:58.717215 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3943/6231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:58 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1154 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:58.719268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:58.719982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:58.721489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:58.741335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:58.742112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:58.744361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:58.885641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:58.886459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:58.898868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:58.899758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:58.900251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:58.900989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:58.901460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:58.902080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:58.914301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:59.057310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lazy-loading 'services' on Instance uuid 6233d002-520e-4789-bdbe-6cd545986651 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:42:59.243381 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffb69b77-7383-4180-904b-5f9b67ee3a1e tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651/os-volume_attachments/7f4b4106-ba25-439a-9e40-fae4b25f2b06" status: 202 len: 0 microversion: 2.1 time: 0.361892 Oct 28 18:42:59.244769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3944/6232] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 18:42:58 2022] DELETE /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651/os-volume_attachments/7f4b4106-ba25-439a-9e40-fae4b25f2b06 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:42:59.266524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e13b3f30-1ac2-419b-876c-1d59baf1ff71 req-e1fd00d4-9149-429d-b6ea-6318821c257b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614a9ab9-91a1-4941-96d6-3d2837c9993d", "name": "network-vif-plugged", "status": "completed", "tag": "dc97c4e6-2ee1-49ff-988b-49ca90baefa7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:59.276141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:59.287774 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2de0efa9-c125-47ab-b6cb-7ef277570118 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1531 microversion: 2.1 time: 0.592995 Oct 28 18:42:59.291062 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2289/6233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:58 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1531 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:59.312863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e13b3f30-1ac2-419b-876c-1d59baf1ff71 req-e1fd00d4-9149-429d-b6ea-6318821c257b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:59.313710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e13b3f30-1ac2-419b-876c-1d59baf1ff71 req-e1fd00d4-9149-429d-b6ea-6318821c257b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:59.314455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e13b3f30-1ac2-419b-876c-1d59baf1ff71 req-e1fd00d4-9149-429d-b6ea-6318821c257b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:59.361774 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e13b3f30-1ac2-419b-876c-1d59baf1ff71 req-e1fd00d4-9149-429d-b6ea-6318821c257b service nova] Creating event network-vif-plugged:dc97c4e6-2ee1-49ff-988b-49ca90baefa7 for instance 614a9ab9-91a1-4941-96d6-3d2837c9993d on n-h1-862404-2 Oct 28 18:42:59.378863 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e13b3f30-1ac2-419b-876c-1d59baf1ff71 req-e1fd00d4-9149-429d-b6ea-6318821c257b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132281 Oct 28 18:42:59.379494 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3945/6234] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:59.749943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:59.751190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:42:59.758972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:59.759467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:59.765827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:59.766724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:59.767214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:59.767662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:59.979326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:59.992627 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a25d7e46-4a7b-41cd-b76c-d13bd80bae25 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.246774 Oct 28 18:42:59.993231 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2290/6235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:59 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:00.323361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:00.325696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:00.333968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:00.334725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:00.335533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:00.336679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:00.337214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:00.337845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:00.497531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:00.509429 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-268e1b86-a211-40f2-87b7-791ab72d5e58 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1531 microversion: 2.1 time: 0.190308 Oct 28 18:43:00.511034 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3946/6236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:00 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1531 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:00.826879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-636bfeb4-316f-4f14-abe7-ed1ade5b01cc req-8cece699-ab7f-4ba8-8aea-22a623f692dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9cd16f-87a6-440f-b584-11b0c3811412", "tag": "550732b1-f149-4496-bc6d-f7b9f5be9e72"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:00.839078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-636bfeb4-316f-4f14-abe7-ed1ade5b01cc req-8cece699-ab7f-4ba8-8aea-22a623f692dd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:00.840473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-636bfeb4-316f-4f14-abe7-ed1ade5b01cc req-8cece699-ab7f-4ba8-8aea-22a623f692dd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:00.841270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-636bfeb4-316f-4f14-abe7-ed1ade5b01cc req-8cece699-ab7f-4ba8-8aea-22a623f692dd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:00.858201 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-636bfeb4-316f-4f14-abe7-ed1ade5b01cc req-8cece699-ab7f-4ba8-8aea-22a623f692dd service nova] Creating event network-changed:550732b1-f149-4496-bc6d-f7b9f5be9e72 for instance 8e9cd16f-87a6-440f-b584-11b0c3811412 on n-h1-862404-2 Oct 28 18:43:00.865551 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-636bfeb4-316f-4f14-abe7-ed1ade5b01cc req-8cece699-ab7f-4ba8-8aea-22a623f692dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042994 Oct 28 18:43:00.866723 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2291/6237] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:01.017054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:01.017780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:01.024217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:01.024780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:01.025285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:01.026162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:01.026778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:01.027361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:01.214151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:01.223898 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-19d43e9e-cb86-4031-8092-240f181175c2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.210837 Oct 28 18:43:01.224957 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3947/6238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:01 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:01.540268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:01.544128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:01.576127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:01.576504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:01.577017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:01.577825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:01.578292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:01.578952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:02.135355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:02.150231 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e34e2ddf-62a3-41a3-984d-dec4d52dcd8c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.618681 Oct 28 18:43:02.157693 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2292/6239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:01 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:02.250796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:02.252580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:02.276853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:02.277944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:02.288596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:02.290593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:02.292057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:02.294429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:02.608207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:02.620510 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-170f1f71-930f-44be-8844-d1d8a5f629ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.375039 Oct 28 18:43:02.622337 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3948/6240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:02 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:03.180579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:03.181209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:03.203265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:03.204172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:03.205160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:03.206112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:03.206789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:03.207447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:03.473516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:03.485009 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a4c2c39f-60be-4b4c-92b7-30c075856f0a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.308444 Oct 28 18:43:03.503019 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2293/6241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:03 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:03.656068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:03.657971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:03.661241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:03.675158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:03.676165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:03.676881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:03.680843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:03.681647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:03.682895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:03.994844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:04.018190 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78286021-bcac-402e-b2ce-995ab3f0ab18 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.366594 Oct 28 18:43:04.021984 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3949/6242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:03 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:04.514374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:04.515168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:04.526757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:04.536665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:04.537246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:04.539653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:04.540835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:04.541285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:04.920196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:04.936613 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a670036-4e95-4d75-9a6c-591af33942ad tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.426061 Oct 28 18:43:04.941451 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2294/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:04 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:05.081584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:05.083640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:05.110215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.111010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.113708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.114694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.115366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.117153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.318317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:05.328186 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c796ef8-5755-40b8-928e-ea4d920857cc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.275414 Oct 28 18:43:05.344620 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3950/6244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:05 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:05.482946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:05.483549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:05.494980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-de38f413-01c6-4c35-9d05-c1a0acba19b5 req-6d71cbfd-8777-4d0e-b356-854baa393d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5", "tag": "da972123-6b77-47c7-950e-7cf0ae635374"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:05.497172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.505360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.506559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-de38f413-01c6-4c35-9d05-c1a0acba19b5 req-6d71cbfd-8777-4d0e-b356-854baa393d5c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.506817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.507054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-de38f413-01c6-4c35-9d05-c1a0acba19b5 req-6d71cbfd-8777-4d0e-b356-854baa393d5c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.507497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-de38f413-01c6-4c35-9d05-c1a0acba19b5 req-6d71cbfd-8777-4d0e-b356-854baa393d5c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.507629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.508056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.512929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.533023 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-de38f413-01c6-4c35-9d05-c1a0acba19b5 req-6d71cbfd-8777-4d0e-b356-854baa393d5c service nova] Creating event network-changed:da972123-6b77-47c7-950e-7cf0ae635374 for instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 on n-h2-862404-2 Oct 28 18:43:05.549810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:43:05.552840 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-de38f413-01c6-4c35-9d05-c1a0acba19b5 req-6d71cbfd-8777-4d0e-b356-854baa393d5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061806 Oct 28 18:43:05.555679 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3951/6245] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:43:05.687806 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72df97cf-5382-4cc6-b6e5-f5ecaa65e532 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "DELETE /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 204 len: 0 microversion: 2.1 time: 0.209464 Oct 28 18:43:05.690675 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2295/6246] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:05 2022] DELETE /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:43:05.702158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:05.702695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:05.720856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.723458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.723957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.724716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.725182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.725612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.965649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:05.966616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:05.977482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.983444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.984227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.985097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.985693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.986230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:06.013592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:06.026171 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f953d042-1fa5-4938-aecf-986f4b73030e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1585 microversion: 2.1 time: 0.329469 Oct 28 18:43:06.037522 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3952/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:05 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1585 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:06.269613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:06.280456 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de8b3fe5-e93c-4464-8e4e-30d59ba0be9e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.317280 Oct 28 18:43:06.281185 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2296/6248] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:05 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:06.351311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:06.352006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:06.361209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:06.361799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:06.362164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:06.363354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:06.363354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:06.363866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:06.687570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:06.703027 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbf9eaa4-ccab-409e-bdc1-ffc052917d91 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.355045 Oct 28 18:43:06.707153 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3953/6249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:06 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:07.063329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:07.064612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:07.071841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:07.076517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:07.084112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.084836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.085769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.086689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.087907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.088509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.305669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:07.306298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:07.321624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.321838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.322427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.323017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.323491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.323959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.351018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:07.360912 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2c5ecb52-4b72-4eda-8cd1-888ab982c029 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1585 microversion: 2.1 time: 0.310945 Oct 28 18:43:07.361897 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2297/6250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:07 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1585 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:07.439917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:07.710564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:07.740930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3df1742-6ec6-4663-a121-29f1778c617d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.438840 Oct 28 18:43:07.741691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:07.742402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:07.744602 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3954/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:07 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:07.769901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.770398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.770837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.771548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.772036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.772464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.794995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:07.798597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:07.821023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.822079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.822962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.824949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.825831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.826717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.955382 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c34062a1-ff3d-45a9-bb68-def9217e1620 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca/action" status: 200 len: 24567 microversion: 2.1 time: 0.164977 Oct 28 18:43:07.959118 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3955/6252] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:43:07 2022] POST /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca/action => generated 24567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:43:08.135745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:08.147457 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e98531b5-c5d7-49fe-a417-00ec19659e1d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.409889 Oct 28 18:43:08.148913 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2298/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:07 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:08.385348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:08.386430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:08.404574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:08.412687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:08.413162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:08.414118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:08.414755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:08.415358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:08.476258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c4dd4ab1-f671-44c7-9d91-b03708b6331f req-df569e91-63e2-44fd-948b-79165f7e9e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5", "name": "network-vif-deleted", "tag": "da972123-6b77-47c7-950e-7cf0ae635374"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:08.505407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4dd4ab1-f671-44c7-9d91-b03708b6331f req-df569e91-63e2-44fd-948b-79165f7e9e34 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:08.506726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4dd4ab1-f671-44c7-9d91-b03708b6331f req-df569e91-63e2-44fd-948b-79165f7e9e34 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:08.509267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4dd4ab1-f671-44c7-9d91-b03708b6331f req-df569e91-63e2-44fd-948b-79165f7e9e34 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:08.536009 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c4dd4ab1-f671-44c7-9d91-b03708b6331f req-df569e91-63e2-44fd-948b-79165f7e9e34 service nova] Creating event network-vif-deleted:da972123-6b77-47c7-950e-7cf0ae635374 for instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 on n-h2-862404-2 Oct 28 18:43:08.544064 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c4dd4ab1-f671-44c7-9d91-b03708b6331f req-df569e91-63e2-44fd-948b-79165f7e9e34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071396 Oct 28 18:43:08.546472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:08.549943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2299/6254] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:43:08.558191 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce15e04d-bba4-49f0-8eb6-eea2d59bc688 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1399 microversion: 2.1 time: 0.177082 Oct 28 18:43:08.563526 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3956/6255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:08 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1399 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:08.771523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:08.772380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:08.774930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:08.788996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:08.794766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:08.797176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:08.798771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:08.800112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:08.800750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:09.036373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:09.045539 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a94165ec-256e-4181-bf98-cfad7e304ae8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.278363 Oct 28 18:43:09.067737 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2300/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:08 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:09.176832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:09.177766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:09.195413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:09.197332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:09.200078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:09.201904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:09.203205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:09.204491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:09.407835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:09.407835 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d0599e87-37f4-4d83-b431-9fa21bacf7a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.217746 Oct 28 18:43:09.407835 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3957/6257] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:09 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:09.599030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:09.601178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:09.643342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:09.647016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:09.650744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:09.658944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:09.661180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:09.663723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:09.687978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:09.739546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:09.740144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:09.762868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:09.763366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:09.769751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:09.770534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:09.771023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:09.771463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:09.822342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:43:09.848867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:09.866920 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a5c7ca1-bbec-4873-9c24-744f0a843f2e tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1230 microversion: 2.1 time: 0.272635 Oct 28 18:43:09.868277 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2301/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:09 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1230 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:09.982444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0d0af11-0371-4eb4-9596-87becc6c2ec7 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 204 len: 0 microversion: 2.1 time: 0.249950 Oct 28 18:43:09.992367 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3958/6259] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:09 2022] DELETE /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:43:09.992740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:09.993539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:10.006059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.006842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.007466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.008415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.009743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.010339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.087746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:10.088758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:10.096447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.097167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.097778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.098683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.099406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.100073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.239352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:10.252788 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f59e9cf7-b481-44cc-8f83-4b728ed35805 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1469 microversion: 2.1 time: 0.262829 Oct 28 18:43:10.275347 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2302/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:09 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1469 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:10.354379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:10.366797 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40c4dbd9-4bd3-47a1-84c4-eac457a047ef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.286532 Oct 28 18:43:10.377925 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3959/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:10 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:10.414974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:10.415890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:10.425643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.426495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.427610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.429085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.430038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.430623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.632839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:10.647400 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04e10b22-a0e1-46cb-935f-be7e0ecdf8c3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.237067 Oct 28 18:43:10.648267 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2303/6262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:10 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:10.900381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:10.901528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:10.926592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.927369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.927969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.929169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.929867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.931950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.938851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:11.077438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:11.087072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-efd46ead-4bcd-4b6e-a789-9e9a7698ddff tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1230 microversion: 2.1 time: 0.194471 Oct 28 18:43:11.089002 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3960/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:10 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1230 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:11.284280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:11.285657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:11.305978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:11.306556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:11.306995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:11.307702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:11.308181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:11.309335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:11.396220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:11.396909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:11.408963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:11.408963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:11.409457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:11.410200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:11.411674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:11.412171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:11.565148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:11.579283 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c65c6e7d-b99b-471b-b3a8-0190b67e4fc0 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1469 microversion: 2.1 time: 0.296206 Oct 28 18:43:11.581705 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2304/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:11 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1469 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:11.667000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:11.673033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:11.676772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:11.680269 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2745392d-8804-4046-9d13-478fb4ad6eee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.288777 Oct 28 18:43:11.695901 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3961/6265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:11 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:11.709256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:11.710739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:11.717554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:11.719648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:11.725556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:11.726029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.046791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:12.057194 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eb40cc5f-915d-40b2-9418-c052d95f3731 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1214 microversion: 2.1 time: 0.387307 Oct 28 18:43:12.059445 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2305/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:11 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1214 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:12.126736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:12.127421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:12.150450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.151250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.154349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.155778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.159768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.160541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.279868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:12.290356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f68964da-cb2e-4fea-80a3-1d123758a21c tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1230 microversion: 2.1 time: 0.177657 Oct 28 18:43:12.306759 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3962/6267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:12 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1230 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:12.544192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8ad14cfa-9fcb-4165-af80-74c06359f1b5 req-f7f954ff-e9f4-4357-b38c-4a50fc3aeae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6233d002-520e-4789-bdbe-6cd545986651", "name": "network-vif-deleted", "tag": "886f131a-6513-4d95-b68c-53edfb66c014"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:12.557213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ad14cfa-9fcb-4165-af80-74c06359f1b5 req-f7f954ff-e9f4-4357-b38c-4a50fc3aeae0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.557846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ad14cfa-9fcb-4165-af80-74c06359f1b5 req-f7f954ff-e9f4-4357-b38c-4a50fc3aeae0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.558355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ad14cfa-9fcb-4165-af80-74c06359f1b5 req-f7f954ff-e9f4-4357-b38c-4a50fc3aeae0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.576984 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8ad14cfa-9fcb-4165-af80-74c06359f1b5 req-f7f954ff-e9f4-4357-b38c-4a50fc3aeae0 service nova] Creating event network-vif-deleted:886f131a-6513-4d95-b68c-53edfb66c014 for instance 6233d002-520e-4789-bdbe-6cd545986651 on n-h1-862404-2 Oct 28 18:43:12.586516 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8ad14cfa-9fcb-4165-af80-74c06359f1b5 req-f7f954ff-e9f4-4357-b38c-4a50fc3aeae0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049826 Oct 28 18:43:12.587741 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2306/6268] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:12.607214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:12.611888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:12.614890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.615396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.615875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.616610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.617074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.617506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.698536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:12.713822 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07c94c84-76ca-478c-bdd3-7a7ce64f2d39 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1427 microversion: 2.1 time: 0.110987 Oct 28 18:43:12.715352 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3963/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:12 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:12.736170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:12.737073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:12.744512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.745009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.745457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.746853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.747319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.747954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.981029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:12.990704 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42959ed5-5d24-4726-8397-10fc051a5766 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.278544 Oct 28 18:43:12.991325 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2307/6270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:12 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:13.088192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:13.088845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:13.100744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.101049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.101503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.102226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.102974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.103415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.276932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:13.291429 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3cdae42-b988-4d18-9255-8c34f7cab8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.207065 Oct 28 18:43:13.293732 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3964/6271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:13 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:13.322522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:13.323413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:13.335224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.336826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.337450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.338359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.338984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.339575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.425911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:13.440660 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-81ee8236-e00a-45d4-b271-8d9738e6892f tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1230 microversion: 2.1 time: 0.119581 Oct 28 18:43:13.457996 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2308/6272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:13 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1230 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:13.744762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:13.745400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:13.755346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.755881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.758863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.764400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.765680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.767762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.817009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.817519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.817968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.818433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lazy-loading 'fault' on Instance uuid 6233d002-520e-4789-bdbe-6cd545986651 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:43:13.874738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd1002a0280407382a0558e3c789b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3711fbde528d4abbb7c8a573a9087561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:13.883986 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-62a40345-6427-40d9-b0ac-5dd359e06dac tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 200 len: 1304 microversion: 2.1 time: 0.142994 Oct 28 18:43:13.885394 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3965/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:13 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:14.016079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:14.018361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:14.031285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:14.040117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:14.040689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:14.041537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:14.042115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:14.042674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:14.278271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:14.288121 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86c8a5d4-a98a-400b-86b2-25d2ae2b0aa1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.277312 Oct 28 18:43:14.289218 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2309/6274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:14 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:14.324297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:14.326274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:14.382048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:14.382697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:14.383640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:14.384494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:14.385038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:14.385551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:14.476105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:14.477158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:14.498770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:14.501631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:14.502714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:14.504142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:14.505504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:14.507448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:14.604172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:14.613064 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c3bb3109-c8ab-4912-8357-394e1ddf30c7 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1230 microversion: 2.1 time: 0.149399 Oct 28 18:43:14.627950 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2310/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:14 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1230 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:14.646930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:14.659323 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ddfb01fe-ba93-4bd6-8440-ed53ee6314e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.343333 Oct 28 18:43:14.660544 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3966/6276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:14 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:14.909527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:14.914825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] [instance: 6233d002-520e-4789-bdbe-6cd545986651] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:14.936431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:14.938394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:14.939134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:14.945093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:14.946020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:14.947010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:14.988989 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] HTTP exception thrown: Instance 6233d002-520e-4789-bdbe-6cd545986651 could not be found. Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Request method failure captured: Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 HTTP/1.1 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCIiFDvNYdCiDmCNfHYpvdguC22ZcRARAEkPtKkb0Yl2S0DCMAFxsjzEeegNwhNCDSBRT7bvXCsWOJXh3iQb0qa5EMyIrnUAbeTK8NWTB88V0MmibLY1npeO8Uu6wFJACRR0BkyO10DdI52VbYviktBW2oncMP4MkHlCdsQ65SF_YuU Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 3711fbde528d4abbb7c8a573a9087561 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesBackupsTest-1983421082 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3711fbde528d4abbb7c8a573a9087561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3711fbde528d4abbb7c8a573a9087561"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3711fbde528d4abbb7c8a573a9087561", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3711fbde528d4abbb7c8a573a9087561"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-VolumesBackupsTest-1983421082 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 3711fbde528d4abbb7c8a573a9087561 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesBackupsTest-1983421082 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-VolumesBackupsTest-1983421082-project Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: bdd1002a0280407382a0558e3c789b61 Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-VolumesBackupsTest-1983421082-project Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 6233d002-520e-4789-bdbe-6cd545986651 could not be found. Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '6233d002-520e-4789-bdbe-6cd545986651'} Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6233d002-520e-4789-bdbe-6cd545986651 could not be found. Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6233d002-520e-4789-bdbe-6cd545986651 could not be found. Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:14.990580 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6233d002-520e-4789-bdbe-6cd545986651 could not be found. Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] Returning 404 to user: Instance 6233d002-520e-4789-bdbe-6cd545986651 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:14.994743 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3f81a749-4f92-43ab-81ee-3d7bd0973d38 tempest-VolumesBackupsTest-1983421082 tempest-VolumesBackupsTest-1983421082-project] 10.222.0.16 "GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651" status: 404 len: 111 microversion: 2.1 time: 0.086400 Oct 28 18:43:15.014240 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2311/6277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:14 2022] GET /compute/v2.1/servers/6233d002-520e-4789-bdbe-6cd545986651 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:15.317726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:15.318640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:15.334332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:15.335518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:15.336184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:15.337078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:15.337713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:15.338347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:15.558641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:15.570077 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50504f22-ba45-4b81-9970-125f54a64fc8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.256436 Oct 28 18:43:15.571176 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3967/6278] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:15 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:15.634700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:15.635314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:15.643669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:15.644423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:15.645064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:15.645936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:15.646549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:15.647185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:15.682897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:15.684333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:15.693616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:15.700488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:15.701326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:15.702288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:15.702778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:15.703225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:15.729129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:15.739208 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed2f84a1-e570-4d66-b85b-d3863a96cc0d tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1230 microversion: 2.1 time: 0.107985 Oct 28 18:43:15.740055 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2312/6279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:15 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:15.919392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:15.934563 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-27ddf015-bebb-4260-8fda-cfa641f5c493 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.255662 Oct 28 18:43:15.935160 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3968/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:15 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:16.597067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:16.598099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:16.617592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.618088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.618529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.626611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.626611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.626611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.768193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:16.769122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:16.783702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.784239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.798633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.799647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.800184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.800636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.901122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:16.912464 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-adba6e80-a1a6-47c7-878c-79ec14099818 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1230 microversion: 2.1 time: 0.149560 Oct 28 18:43:16.930338 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3969/6281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:16 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1230 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:16.963036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:16.970516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:16.984080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:16.992894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.993403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.993843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.995712 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d9023c5-dd9c-4462-970f-2bb9023f8488 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.404077 Oct 28 18:43:16.995885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.996298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.996711 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2313/6282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:16 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:16.996817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.221566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:17.235321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f317465d-5476-4e8e-ac32-8a885ddf35a7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.280398 Oct 28 18:43:17.235956 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3970/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:16 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:17.942759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:17.951263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:17.959195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.960059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.960847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.961849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.962587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.963245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:18.029855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:18.032359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:18.048103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:18.049010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:18.050317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:18.053160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:18.055266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:18.056059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:18.108220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f07eff980e7453fac3aef7ba067a2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550388b231824fa598c7874ddea0f736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:18.116669 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-54fe1495-52ac-4dbc-b1ec-ad9d462a2908 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 200 len: 1230 microversion: 2.1 time: 0.177959 Oct 28 18:43:18.118197 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2314/6284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:17 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 1230 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:18.258304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:18.259494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:18.269957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:18.270767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:18.274432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:18.275420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:18.276359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:18.277158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:18.322440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:18.334001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-429d8db8-5b1d-4919-9c54-ffc02d69a18e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.308662 Oct 28 18:43:18.335877 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3971/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:18 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:18.507030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:18.517923 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3ae8db19-563c-4530-91e1-29220792ec9a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.263047 Oct 28 18:43:18.529044 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2315/6286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:18 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:18.892940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:18.896260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:18.903534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:18.904256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:18.904708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:18.905434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:18.905895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:18.906333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.023997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:43:19.024676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:43:19.025318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:43:19.025925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:43:19.026522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:43:19.124985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:19.132842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.133368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.133828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.134564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.135034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.135472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.143362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:19.144030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] [instance: 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:19.157390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.157891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.158335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.159058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.170086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.170665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.209555 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] HTTP exception thrown: Instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 could not be found. Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Request method failure captured: Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 HTTP/1.1 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCGVlRrkN5fqy_8zpBos8mhCF2ykDiCb4J8a9zmxDzKoffGYs2nOOk7P_DXP4CG6YhhvOyKm6p71Dz9wMoTmUxwgkaChnOCE5r0E2A_e6e0Lyvrdox9tp4pXvU38oCAr5ucgDtEtdY3N7S9Y76xnfJnrfRJmB5BRjU8bVuZ3LfEKn2U Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 550388b231824fa598c7874ddea0f736 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBackupRestore-706150400 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/550388b231824fa598c7874ddea0f736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/550388b231824fa598c7874ddea0f736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_550388b231824fa598c7874ddea0f736", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/550388b231824fa598c7874ddea0f736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBackupRestore-706150400 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 550388b231824fa598c7874ddea0f736 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBackupRestore-706150400 Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestVolumeBackupRestore-706150400-project Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 3f07eff980e7453fac3aef7ba067a2ad Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBackupRestore-706150400-project Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 could not be found. Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5'} Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 could not be found. Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 could not be found. Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:19.211697 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 could not be found. Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Returning 404 to user: Instance 55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-83068604-e611-4a0e-a496-dae7ba4ade43 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5" status: 404 len: 111 microversion: 2.1 time: 0.074600 Oct 28 18:43:19.216121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2316/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:19 2022] GET /compute/v2.1/servers/55e4ae3e-718c-4e5d-af7c-0bd64ec6e4d5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:43:19.216778 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30979ea1-b377-45e3-b2f8-475cd6c2b410 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca/action" status: 202 len: 1138 microversion: 2.1 time: 0.319391 Oct 28 18:43:19.230652 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3972/6288] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:43:18 2022] POST /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca/action => generated 1138 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 18:43:19.234799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:19.235693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:19.242245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.243027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.243676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.244648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.245324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.246026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.367773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:19.370372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:19.402825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.404047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.406365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.407367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.410379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.419201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.622997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:19.639531 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28f0c99f-64fa-4f2a-be56-5dcaa76d480a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.408530 Oct 28 18:43:19.658380 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2317/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:19 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:19.675102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:19.675935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:19.693364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.706153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.706701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.707882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:19.708664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:19.709108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:19.733333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:19.749888 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44e79069-2a26-4e38-a6ad-c16299af2dee tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1526 microversion: 2.1 time: 0.391330 Oct 28 18:43:19.764433 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3973/6290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:19 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1526 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:19.772707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fc392e98-bd8d-495b-9dd2-0949b0e444f3 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] Calling method '.version_select at 0x7f78dc7ce160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:19.822946 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fc392e98-bd8d-495b-9dd2-0949b0e444f3 tempest-TestVolumeBackupRestore-706150400 tempest-TestVolumeBackupRestore-706150400-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1186440031" status: 202 len: 0 microversion: 2.1 time: 0.057308 Oct 28 18:43:19.823901 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3974/6291] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 18:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1186440031 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:43:19.969832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:19.979453 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04a6a7c7-da77-49d6-9111-de9d9e980c23 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.319789 Oct 28 18:43:19.980418 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2318/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:19 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:20.677752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:20.679273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:20.707454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:20.709897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:20.712020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:20.713008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:20.713502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:20.715488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:20.743655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:20.782170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:20.785481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:20.804384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:20.804893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:20.805336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:20.806195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:20.806895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:20.807336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:20.928912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:20.939527 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2a3cec2-b289-49ed-89bc-a0ff45a08046 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.271656 Oct 28 18:43:20.940193 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3975/6293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:20 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:21.007705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:21.008654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:21.026319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:21.026757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:21.027349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:21.028298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:21.028802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:21.029388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:21.478257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:21.501778 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ace6e59c-cbcc-46bf-ac15-be66d3c41c74 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.497132 Oct 28 18:43:21.504558 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3976/6294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:21 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:21.955504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:21.959299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:21.999209 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5432d843-0f20-4681-9b0b-d493c27a753b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1508 microversion: 2.1 time: 1.224506 Oct 28 18:43:22.004808 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2319/6295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:20 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1508 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:22.198419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:22.199700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:22.210308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:22.210821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:22.211281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:22.212048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:22.212518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:22.212959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:22.532289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:22.533204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:22.548129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:22.552865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:22.553622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:22.555109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:22.555727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:22.556222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:22.566676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:22.580733 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b027b8cc-4e0e-48c3-a43f-a2a8840d9186 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.611956 Oct 28 18:43:22.581666 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3977/6296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:21 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:22.909861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:22.920939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ddde63b9-0540-4143-a54f-6ba6afcd55ff tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.394030 Oct 28 18:43:22.936721 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2320/6297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:22 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:23.034933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:23.036098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:23.054134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:23.058203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:23.058751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:23.059618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:23.060137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:23.060746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:23.300140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d60bd45b-0762-496f-887e-fa3445c6f949 req-355fadde-da10-4d1b-ba21-ec3bb37512cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9cd16f-87a6-440f-b584-11b0c3811412", "name": "network-vif-plugged", "status": "completed", "tag": "550732b1-f149-4496-bc6d-f7b9f5be9e72"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:23.322478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d60bd45b-0762-496f-887e-fa3445c6f949 req-355fadde-da10-4d1b-ba21-ec3bb37512cf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:23.322952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d60bd45b-0762-496f-887e-fa3445c6f949 req-355fadde-da10-4d1b-ba21-ec3bb37512cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:23.323397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d60bd45b-0762-496f-887e-fa3445c6f949 req-355fadde-da10-4d1b-ba21-ec3bb37512cf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:23.366107 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d60bd45b-0762-496f-887e-fa3445c6f949 req-355fadde-da10-4d1b-ba21-ec3bb37512cf service nova] Creating event network-vif-plugged:550732b1-f149-4496-bc6d-f7b9f5be9e72 for instance 8e9cd16f-87a6-440f-b584-11b0c3811412 on n-h1-862404-2 Oct 28 18:43:23.377035 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d60bd45b-0762-496f-887e-fa3445c6f949 req-355fadde-da10-4d1b-ba21-ec3bb37512cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081764 Oct 28 18:43:23.380646 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2321/6298] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:43:23.441873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:23.472334 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a11ef85-2f41-4875-aeba-d9685acb9c26 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1508 microversion: 2.1 time: 0.440684 Oct 28 18:43:23.474251 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3978/6299] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:23 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:23.609896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:23.610813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:23.631645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:23.632600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:23.633216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:23.637778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:23.639056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:23.645187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:23.961403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:23.965835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:23.990663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:23.994367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:23.994856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:24.000922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:24.003256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:24.003605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:24.047594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:24.058645 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c8f75726-40fe-4b42-884e-c8fb041e79de tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.455165 Oct 28 18:43:24.059251 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2322/6300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:23 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:24.285987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:24.295491 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae94f6ad-29fb-473e-9eb4-dee846311fe8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.352224 Oct 28 18:43:24.297839 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3979/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:23 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:24.500739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:24.502772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:24.531093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:24.532544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:24.532979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:24.534187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:24.534684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:24.535109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:25.095321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:25.095979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:25.109688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:25.112923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:25.113420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:25.116332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:25.118519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:25.118988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:25.161148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:25.172939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a81121d9-0b5b-4dc1-a106-ce37301a7cbb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1508 microversion: 2.1 time: 0.676634 Oct 28 18:43:25.196067 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2323/6302] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:24 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1508 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:25.320483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:25.321525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:25.344482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:25.344991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:25.345442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:25.353313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:25.357890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:25.358395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:25.423636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:25.440782 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8b3844f-4f6c-459d-be1a-dd1da1e0021b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.351674 Oct 28 18:43:25.441506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3980/6303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:25 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:25.461384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-454f6e76-10a9-4a0e-b9cd-f715ff75c757 req-444749d6-1fb1-492d-a6cb-dc20c4f77453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614a9ab9-91a1-4941-96d6-3d2837c9993d", "name": "network-vif-unplugged", "status": "completed", "tag": "dc97c4e6-2ee1-49ff-988b-49ca90baefa7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:25.517105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-454f6e76-10a9-4a0e-b9cd-f715ff75c757 req-444749d6-1fb1-492d-a6cb-dc20c4f77453 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:25.517759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-454f6e76-10a9-4a0e-b9cd-f715ff75c757 req-444749d6-1fb1-492d-a6cb-dc20c4f77453 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:25.518365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-454f6e76-10a9-4a0e-b9cd-f715ff75c757 req-444749d6-1fb1-492d-a6cb-dc20c4f77453 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:25.535455 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-454f6e76-10a9-4a0e-b9cd-f715ff75c757 req-444749d6-1fb1-492d-a6cb-dc20c4f77453 service nova] Creating event network-vif-unplugged:dc97c4e6-2ee1-49ff-988b-49ca90baefa7 for instance 614a9ab9-91a1-4941-96d6-3d2837c9993d on n-h1-862404-2 Oct 28 18:43:25.549619 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-454f6e76-10a9-4a0e-b9cd-f715ff75c757 req-444749d6-1fb1-492d-a6cb-dc20c4f77453 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103456 Oct 28 18:43:25.552177 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3981/6304] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:25.680364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:25.689333 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7886ced2-551e-4c17-bc8e-a1f78cea7de2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1202 microversion: 2.1 time: 0.374011 Oct 28 18:43:25.690208 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2324/6305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:25 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1202 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:26.201503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:26.202880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:26.217826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.218581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.219221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.224926 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.225577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.226182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.465281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:26.466752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:26.478049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.482926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.483844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.484825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.485461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.486086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.502894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:26.524277 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d849bee-df1a-486b-b1b0-d39519cdbdd6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1451 microversion: 2.1 time: 0.327189 Oct 28 18:43:26.525489 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3982/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:26 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1451 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:26.555419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:26.556100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:26.585486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.587025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.591708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.592957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.594663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.595336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.797265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:26.806209 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dfb48ec7-604f-4b88-8eaf-bafcfbb9d13c tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.345316 Oct 28 18:43:26.806814 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2325/6307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:26 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:26.813592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:26.814613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:26.821976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.822775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.823387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.824823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.825583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.826183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.826820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:26.835498 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4d81336-c3c6-484c-99d1-d902fcd6d6fe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1451 microversion: 2.1 time: 0.286948 Oct 28 18:43:26.836634 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3983/6308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:26 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1451 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:26.892828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:26.893790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:26.904370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.906643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.907305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.908990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:26.909641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:26.911000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:26.948171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lazy-loading 'flavor' on Instance uuid 614a9ab9-91a1-4941-96d6-3d2837c9993d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:43:26.967883 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Cannot 'shelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state shelved_offloaded Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action HTTP/1.1 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 14 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: {"shelve": {}} Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: exception: Cannot 'shelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state shelved_offloaded Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'shelve': {}}} Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:43:26.972561 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state shelved_offloaded Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state shelved_offloaded Oct 28 18:43:26.979791 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:26.982200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 409 to user: Cannot 'shelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state shelved_offloaded {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:26.983197 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f817a140-dafa-4428-9860-e56384809dbe tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 409 len: 155 microversion: 2.1 time: 0.095560 Oct 28 18:43:26.984397 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3984/6309] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:43:26 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 155 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 18:43:26.997891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:27.001437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:27.015801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.016348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.016808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.017550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.018018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.018454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.041218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:27.096003 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40bc60f7-43e6-4465-a848-ce10ecb8e9a6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1389 microversion: 2.1 time: 0.285014 Oct 28 18:43:27.103417 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2326/6310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:26 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1389 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:27.110625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120680) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 28 18:43:27.137524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:27.138518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:27.149851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.153695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.154347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.155244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.157314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.158043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.256601 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec8b02ea-bf58-4eac-934e-690a868f9bef tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 202 len: 0 microversion: 2.1 time: 0.267817 Oct 28 18:43:27.258409 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3985/6311] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:43:26 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:43:27.268074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:27.274233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:27.290483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.291550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.293277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.295789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.296525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.297873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.488918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:27.499980 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43d8eac8-e5e0-44af-975b-38b06dab623e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1389 microversion: 2.1 time: 0.368173 Oct 28 18:43:27.508632 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2327/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:27 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1389 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:27.531636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:27.532323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:27.541668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.542172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.543301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.544478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.544942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.545373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.746327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:27.755101 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d1bac38c-d9e7-4ec0-befb-a09fb1c3ff25 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1459 microversion: 2.1 time: 0.492500 Oct 28 18:43:27.758608 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3986/6313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:27 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1459 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:27.771191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:27.783583 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2594da2a-7a4a-4d26-98b3-52c403e10bdc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1389 microversion: 2.1 time: 0.254327 Oct 28 18:43:27.785333 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2328/6314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:27 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1389 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:27.820630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:27.821715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:27.831178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:27.833682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.834060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:27.834189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.834620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.841401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.841904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.842572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.845744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.846448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.847077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.848074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:27.848707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:27.849580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:27.894002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:43:28.065170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:28.072872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:28.091080 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c6e29bc6-43c3-4880-845f-d6225e8cdcdd tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.263098 Oct 28 18:43:28.092205 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2329/6315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:27 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:28.094590 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-920379ce-0279-407c-a1b7-627bf85a407f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 204 len: 0 microversion: 2.1 time: 0.282844 Oct 28 18:43:28.101058 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3987/6316] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:27 2022] DELETE /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:43:28.110856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:28.116704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:28.135726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:28.137481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:28.151948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:28.153135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:28.154715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:28.155487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:28.415696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:28.430453 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eb340f38-86d1-4f1c-99c9-3c94a90ad191 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1395 microversion: 2.1 time: 0.327379 Oct 28 18:43:28.446730 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2330/6317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:28 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1395 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:28.789574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:28.790315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:28.806421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:28.808111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:28.809806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:28.811610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:28.812461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:28.813167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:29.122249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:29.123609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:29.131831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:29.132576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:29.133190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:29.134465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:29.135084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:29.135662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:29.352715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:29.365014 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ada4713a-942a-4fd5-86c9-05be3bb6109b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1459 microversion: 2.1 time: 0.583794 Oct 28 18:43:29.365648 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3988/6318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:28 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1459 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:29.460207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:29.460845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:29.475570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:29.476413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:29.476598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:29.482732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:29.487118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:29.487957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:29.493405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:29.495961 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7430c95d-3546-43d2-a327-5a28a47b5f2e tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.379654 Oct 28 18:43:29.497245 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2331/6319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:29 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:29.827870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:29.838003 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7b1f966f-6eb7-4ae4-b85e-1981abdc1f8c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1395 microversion: 2.1 time: 0.382476 Oct 28 18:43:29.839328 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3989/6320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:29 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1395 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:30.399707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:30.400369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:30.412898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:30.413641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:30.414272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:30.414992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:30.415455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:30.415933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:30.522633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:30.523279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:30.549672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:30.550190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:30.552059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:30.552810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:30.553280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:30.553724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:30.612994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:30.936912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:30.947699 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-667b7fbe-470c-42ca-96c4-ff7e7f2c4b7a tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1692 microversion: 2.1 time: 0.428903 Oct 28 18:43:30.960724 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3990/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:30 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1692 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:30.987168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:30.988781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:31.005567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:31.006565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:31.007195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:31.008228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:31.008838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:31.009423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:31.119899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:31.129225 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74836349-2a18-42b1-8c97-ceae6654b0e9 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.739687 Oct 28 18:43:31.146261 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2332/6322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:30 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:31.159760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-64dffcbf-0670-45ee-9935-35dd3e1c7f05 req-3e4dc529-5325-44c4-a59d-bb8de23d2de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9cd16f-87a6-440f-b584-11b0c3811412", "name": "network-vif-deleted", "tag": "550732b1-f149-4496-bc6d-f7b9f5be9e72"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:31.170006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:31.174474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64dffcbf-0670-45ee-9935-35dd3e1c7f05 req-3e4dc529-5325-44c4-a59d-bb8de23d2de5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:31.175266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64dffcbf-0670-45ee-9935-35dd3e1c7f05 req-3e4dc529-5325-44c4-a59d-bb8de23d2de5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:31.175975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64dffcbf-0670-45ee-9935-35dd3e1c7f05 req-3e4dc529-5325-44c4-a59d-bb8de23d2de5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:31.185137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6c11571-9717-4364-a607-ea53f24ba673 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1353 microversion: 2.1 time: 0.221274 Oct 28 18:43:31.185771 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3991/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:30 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:31.189602 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-64dffcbf-0670-45ee-9935-35dd3e1c7f05 req-3e4dc529-5325-44c4-a59d-bb8de23d2de5 service nova] Creating event network-vif-deleted:550732b1-f149-4496-bc6d-f7b9f5be9e72 for instance 8e9cd16f-87a6-440f-b584-11b0c3811412 on n-h1-862404-2 Oct 28 18:43:31.195133 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-64dffcbf-0670-45ee-9935-35dd3e1c7f05 req-3e4dc529-5325-44c4-a59d-bb8de23d2de5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044911 Oct 28 18:43:31.196315 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2333/6324] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:31.976790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:31.977473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:31.993498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:31.994008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:31.994462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:31.995184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:31.995686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:31.996288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:32.159078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:32.161277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:32.174442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:32.174951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:32.175393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:32.190265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:32.190778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:32.191228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:32.352229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:32.364099 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eafad1f2-d20d-4112-a3ad-53769526e024 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1698 microversion: 2.1 time: 0.391125 Oct 28 18:43:32.371255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3992/6325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:31 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1698 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:32.376536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:32.381385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:32.404334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:32.405019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:32.405632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:32.406559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:32.407191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:32.407791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:32.546086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:32.555227 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-33658167-a1f5-4b18-84cb-4cb9f8ce3575 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1187 microversion: 2.1 time: 0.182526 Oct 28 18:43:32.556353 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3993/6326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:32 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1187 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:32.964679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:32.976560 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-db5d74d8-4dc7-4ca8-a73b-8fe5547a709e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.822580 Oct 28 18:43:32.977537 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2334/6327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:32 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:33.399610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:33.401007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:33.417014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:33.418497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:33.419150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:33.420103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:33.420744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:33.422902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:33.581721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:33.583240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:33.597958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:33.598717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:33.599302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:33.600219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:33.603744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:33.604436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:33.731105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:33.741036 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7874b196-af77-46f9-9ca5-40c5409bc193 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1698 microversion: 2.1 time: 0.346115 Oct 28 18:43:33.757634 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3994/6328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:33 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1698 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:33.769646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:33.788817 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-413cd20e-3803-45f1-a86b-f0c8ac027402 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1187 microversion: 2.1 time: 0.210914 Oct 28 18:43:33.789933 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2335/6329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:33 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1187 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:34.001976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:34.002754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:34.009671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:34.010755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:34.011533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:34.012746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:34.013437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:34.014088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:34.338683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:34.354015 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f9d9406-a187-4f0b-b320-77420925be60 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.356033 Oct 28 18:43:34.355649 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3995/6330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:33 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:34.776540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:34.781791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:34.813858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:34.815362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:34.815847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:34.816617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:34.817088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:34.817526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:34.820363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:34.820999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:34.845546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:34.845988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:34.846434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:34.847174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:34.847623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:34.848108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:35.050877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:35.063042 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0dc0bfa0-d179-4809-892c-3e73fe09bf81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1187 microversion: 2.1 time: 0.247395 Oct 28 18:43:35.063997 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3996/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:34 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1187 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:35.075915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-98f1a3cf-0232-44e7-8689-4a413effa102 req-19142e51-cc07-4745-9753-ab1d386ddac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614a9ab9-91a1-4941-96d6-3d2837c9993d", "tag": "dc97c4e6-2ee1-49ff-988b-49ca90baefa7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:35.106407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-98f1a3cf-0232-44e7-8689-4a413effa102 req-19142e51-cc07-4745-9753-ab1d386ddac3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:35.110334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-98f1a3cf-0232-44e7-8689-4a413effa102 req-19142e51-cc07-4745-9753-ab1d386ddac3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:35.112385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-98f1a3cf-0232-44e7-8689-4a413effa102 req-19142e51-cc07-4745-9753-ab1d386ddac3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:35.150472 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-98f1a3cf-0232-44e7-8689-4a413effa102 req-19142e51-cc07-4745-9753-ab1d386ddac3 service nova] Creating event network-changed:dc97c4e6-2ee1-49ff-988b-49ca90baefa7 for instance 614a9ab9-91a1-4941-96d6-3d2837c9993d on n-h2-862404-2 Oct 28 18:43:35.168946 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-98f1a3cf-0232-44e7-8689-4a413effa102 req-19142e51-cc07-4745-9753-ab1d386ddac3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100454 Oct 28 18:43:35.169939 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3997/6332] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:35.379208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:35.380382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:35.389688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:35.392836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:35.396522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:35.397564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:35.398259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:35.398932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:35.478483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:35.496929 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-840160c7-f50b-4964-ad82-411fee827938 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1698 microversion: 2.1 time: 0.726660 Oct 28 18:43:35.497610 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2336/6333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:34 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1698 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:35.554204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-87c5653d-afcc-4622-ab54-d192148aa28b req-5bfdfaba-9e6e-4e61-b4fb-63388dee626e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faaa157-2333-4347-8fd8-9deab1b4fbca", "name": "network-vif-plugged", "status": "completed", "tag": "ae95d69c-ed79-4a16-aa64-0c47e981d9e1"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:35.577786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87c5653d-afcc-4622-ab54-d192148aa28b req-5bfdfaba-9e6e-4e61-b4fb-63388dee626e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:35.578527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87c5653d-afcc-4622-ab54-d192148aa28b req-5bfdfaba-9e6e-4e61-b4fb-63388dee626e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:35.582205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87c5653d-afcc-4622-ab54-d192148aa28b req-5bfdfaba-9e6e-4e61-b4fb-63388dee626e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:35.631206 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-87c5653d-afcc-4622-ab54-d192148aa28b req-5bfdfaba-9e6e-4e61-b4fb-63388dee626e service nova] Creating event network-vif-plugged:ae95d69c-ed79-4a16-aa64-0c47e981d9e1 for instance 6faaa157-2333-4347-8fd8-9deab1b4fbca on n-h2-862404-2 Oct 28 18:43:35.646948 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-87c5653d-afcc-4622-ab54-d192148aa28b req-5bfdfaba-9e6e-4e61-b4fb-63388dee626e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096582 Oct 28 18:43:35.647614 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2337/6334] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:43:35.722941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:35.767635 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f454d13-7133-4831-b2f5-7e61a5a6805f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.389580 Oct 28 18:43:35.770623 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3998/6335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:35 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:36.091573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:36.092317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:36.108984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:36.109834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:36.111538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:36.113653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:36.115096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:36.117158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:36.135318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:36.239630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:36.248073 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43f1139e-e5e1-4b80-a093-b2bd4efd6900 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1187 microversion: 2.1 time: 0.161252 Oct 28 18:43:36.252658 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2338/6336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:36 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1187 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:36.525901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:36.527412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:36.569168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:36.570489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:36.570948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:36.571692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:36.572197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:36.572635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:36.793646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:36.794197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:36.808046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:36.810753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:36.811366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:36.814427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:36.815076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:36.815700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:37.800938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:37.817148 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73f251ce-7000-44ad-a171-1848679eb73b tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1683 microversion: 2.1 time: 1.295865 Oct 28 18:43:37.831560 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3999/6337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:36 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1683 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:37.848415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:37.852554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:37.881205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:37.890611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:37.892253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:37.897790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:37.899080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:37.900403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:37.955167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:37.965611 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-30a30a08-196e-431a-a59d-c51a65c4e28d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 1.176096 Oct 28 18:43:37.968792 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2339/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:36 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:38.069736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:38.087380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84222da4-64ee-42ad-9786-17df54cc8b5d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1187 microversion: 2.1 time: 0.252854 Oct 28 18:43:38.088547 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4000/6339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:37 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1187 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:38.994866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:38.997475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:39.000704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=80 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:39.032822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:39.033330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:39.034240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:39.034989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:39.035458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:39.035951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:39.113969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:39.115218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:39.143943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:39.145466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:39.146101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:39.147014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:39.147640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:39.148310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:39.403971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:39.419441 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6fd40b0d-6f73-46bc-baab-26fb7a997689 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 200 len: 1187 microversion: 2.1 time: 0.309962 Oct 28 18:43:39.421267 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4001/6340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:39 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 1187 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:39.492793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:39.505225 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9a52a0b5-28ef-43c7-aa94-6708b04d16f5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.514410 Oct 28 18:43:39.506635 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2340/6341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:38 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:40.449204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:40.451079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 8e9cd16f-87a6-440f-b584-11b0c3811412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:40.475045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:40.478286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:40.480411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:40.481676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:40.482394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:40.483057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:40.516799 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 8e9cd16f-87a6-440f-b584-11b0c3811412 could not be found. Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 HTTP/1.1 Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 8e9cd16f-87a6-440f-b584-11b0c3811412 could not be found. Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '8e9cd16f-87a6-440f-b584-11b0c3811412'} Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9cd16f-87a6-440f-b584-11b0c3811412 could not be found. Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9cd16f-87a6-440f-b584-11b0c3811412 could not be found. Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:40.524229 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:40.528778 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:40.528778 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:40.528778 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:40.528778 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:40.528778 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:40.528778 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9cd16f-87a6-440f-b584-11b0c3811412 could not be found. Oct 28 18:43:40.528778 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:43:40.533468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 8e9cd16f-87a6-440f-b584-11b0c3811412 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:40.533719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:40.534363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:40.539683 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6e0b7c6-6f80-404d-aafd-54f4d866b5b3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412" status: 404 len: 111 microversion: 2.1 time: 0.093201 Oct 28 18:43:40.543237 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4002/6342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:40 2022] GET /compute/v2.1/servers/8e9cd16f-87a6-440f-b584-11b0c3811412 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:40.568584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:40.572223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:40.578606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:40.581034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:40.583100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:40.585187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:41.814218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:41.831519 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-77a4d240-fd89-4fc2-aa02-75cdf4558054 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 1.302589 Oct 28 18:43:41.834806 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2341/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:40 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:42.863794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:42.864447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:42.882340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:42.882340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:42.882340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:42.882340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:42.882340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:42.882340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:43.494297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:43.511462 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97f6c925-61e3-49c3-b871-489e68feea7b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.650808 Oct 28 18:43:43.520191 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4003/6344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:42 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:44.542884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:44.543520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:44.559505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:44.560383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:44.561138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:44.562146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:44.563561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:44.568177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:44.970338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:44.980410 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f19b912-5f87-4921-9a6a-6c79bd120941 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.442899 Oct 28 18:43:44.981083 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2342/6345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:44 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:46.009712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:46.012328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:46.035133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:46.036463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:46.036577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:46.037307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:46.037916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:46.040083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:46.445026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:46.470766 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3e36c8b7-001c-4ce8-a7e6-56a09e666721 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.464732 Oct 28 18:43:46.493683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4004/6346] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:46 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:47.504333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:47.505653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:47.528357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:47.533864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:47.534665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:47.540568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:47.541307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:47.543755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:47.937862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:47.954081 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a67d0bd4-538f-4bf1-8c20-a2866abe87d7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.453838 Oct 28 18:43:47.955105 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2343/6347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:47 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:48.986006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:48.987706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:49.049458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:49.051126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:49.052915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:49.056151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:49.066887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:49.070229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:50.543928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:50.558935 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-12bf46bd-27e6-4c44-93d6-28996fe3bf4b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 1.577150 Oct 28 18:43:50.561591 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4005/6348] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:48 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:51.584300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:51.584900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:51.600472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:51.602417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:51.603295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:51.604235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:51.605811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:51.606679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:52.049351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:52.057201 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9fb129cb-8096-419c-ba55-81a8b6a751ce tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.476961 Oct 28 18:43:52.072818 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2344/6349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:51 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:53.082438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:53.083757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:53.100568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:53.105522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:53.106033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:53.106989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:53.107634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:53.108524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:53.770255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:53.783022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cfd2647d-acb3-4977-a208-bcf00efd394f tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.705974 Oct 28 18:43:53.795809 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4006/6350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:53 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:54.832097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:54.833374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:54.844213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.844715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.845953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.847199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.847833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.848448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.071008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:55.092114 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1a6c5ab2-2fdf-4a76-af49-8a2d8da1e8a4 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.265481 Oct 28 18:43:55.099945 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2345/6351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:54 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:55.783942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-05110b93-30bf-4d30-845c-7e1adb89c8ac req-757383e9-43f9-48b4-9663-99e42bca978f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614a9ab9-91a1-4941-96d6-3d2837c9993d", "name": "network-vif-plugged", "status": "completed", "tag": "dc97c4e6-2ee1-49ff-988b-49ca90baefa7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:55.805366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-05110b93-30bf-4d30-845c-7e1adb89c8ac req-757383e9-43f9-48b4-9663-99e42bca978f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.811775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-05110b93-30bf-4d30-845c-7e1adb89c8ac req-757383e9-43f9-48b4-9663-99e42bca978f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.812477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-05110b93-30bf-4d30-845c-7e1adb89c8ac req-757383e9-43f9-48b4-9663-99e42bca978f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.832343 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-05110b93-30bf-4d30-845c-7e1adb89c8ac req-757383e9-43f9-48b4-9663-99e42bca978f service nova] Creating event network-vif-plugged:dc97c4e6-2ee1-49ff-988b-49ca90baefa7 for instance 614a9ab9-91a1-4941-96d6-3d2837c9993d on n-h2-862404-2 Oct 28 18:43:55.838331 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-05110b93-30bf-4d30-845c-7e1adb89c8ac req-757383e9-43f9-48b4-9663-99e42bca978f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057801 Oct 28 18:43:55.840070 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4007/6352] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:56.117236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:56.117886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:56.134451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:56.135188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:56.135432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:56.136243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:56.136715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:56.137179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:56.446914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:56.472538 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e3a6333e-0ee6-42d9-96a0-9ba0d0b119cb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.359653 Oct 28 18:43:56.473981 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2346/6353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:56 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:56.749369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae99e2e4-b93e-4e09-9ccf-0654a2fc422b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'create', calling method: .version_select at 0x7f78dc76a280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1764205223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAss+H01WKcs1Xk/+OQIci5GkpPmTcpExWf/vrOdwaK/yOVjssoc2/VOelFcl5AdJZ4V34HRs8WZdw0UIs7PvkmwEweW3y3OfScJVqf+gysgKCrEueF0MDvEbOI6b1huw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:56.784111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ae99e2e4-b93e-4e09-9ccf-0654a2fc422b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:43:56.797030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ae99e2e4-b93e-4e09-9ccf-0654a2fc422b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for user c1e3f916f6424ca4927b7499c797dbe7 and project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:43:56.851688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae99e2e4-b93e-4e09-9ccf-0654a2fc422b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.114269 Oct 28 18:43:56.852354 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4008/6354] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:43:56 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:57.505354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:57.506672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:57.529147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:57.529660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:57.530528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:57.531313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:57.531783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:57.532244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:57.902089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:57.919714 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-91370f71-0207-46c5-8ec5-843340906822 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1517 microversion: 2.1 time: 0.424769 Oct 28 18:43:57.928697 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2347/6355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:57 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1517 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:58.621445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1045982034", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "f253883e-92be-41b4-b3fc-f0803b61a83e"}], "key_name": "tempest-TestNetworkBasicOps-1764205223", "security_groups": [{"name": "tempest-secgroup-smoke-1309304585"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:58.781040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] validate_networks() for [('f253883e-92be-41b4-b3fc-f0803b61a83e', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:43:58.983802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:58.984671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:59.000130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:59.002476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.007001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.007945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.008891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.009569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.011463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.312258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:59.331163 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-15b5fc92-4068-40c5-bb8b-cc6e258481bc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.378710 Oct 28 18:43:59.332538 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2348/6356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:58 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:59.364142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:59.365199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:59.383167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.383721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.384422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.385493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.386424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.387256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.596927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:59.608492 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11fee74e-cd45-4069-b1e1-08dc4202f993 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.249439 Oct 28 18:43:59.609102 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2349/6357] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:59 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:59.637946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:59.638577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:59.662221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.662723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.663168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.664984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.665452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.665884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.734968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:43:59.735424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:43:59.735883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:43:59.736298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:43:59.736758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:43:59.766779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.767274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.767714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.769824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.770295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.770726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.794597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:43:59.801967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for user c1e3f916f6424ca4927b7499c797dbe7 and project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:43:59.825730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:43:59.829511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:43:59.884508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:59.906276 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-97645874-d1ee-4256-bb38-26dd1c773178 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.272114 Oct 28 18:43:59.917403 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-743d78ce-f149-4c9d-8fa7-ad98d6f81be8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.301609 Oct 28 18:43:59.919521 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4009/6359] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:43:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:43:59.919853 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2350/6359] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:59 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:59.930732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3847c8d1-07e1-49b8-a76b-d9d6c7e5269f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:59.934348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3847c8d1-07e1-49b8-a76b-d9d6c7e5269f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:43:59.939859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-71cc7bcb-d46e-4a32-8887-299e1bb155dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:59.952889 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-71cc7bcb-d46e-4a32-8887-299e1bb155dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance cbb9f2df-dafa-4b4c-9490-f48625ed518b has no mapping to a cell. Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-71cc7bcb-d46e-4a32-8887-299e1bb155dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/cbb9f2df-dafa-4b4c-9490-f48625ed518b/action HTTP/1.1 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 15 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: {"os-stop": {}} Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance cbb9f2df-dafa-4b4c-9490-f48625ed518b has no mapping to a cell. Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'cbb9f2df-dafa-4b4c-9490-f48625ed518b', 'body': {'os-stop': {}}} Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance cbb9f2df-dafa-4b4c-9490-f48625ed518b has no mapping to a cell. Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:59.963131 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb9f2df-dafa-4b4c-9490-f48625ed518b has no mapping to a cell. Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb9f2df-dafa-4b4c-9490-f48625ed518b has no mapping to a cell. Oct 28 18:43:59.968606 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.970923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-71cc7bcb-d46e-4a32-8887-299e1bb155dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance cbb9f2df-dafa-4b4c-9490-f48625ed518b has no mapping to a cell. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:59.972054 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-71cc7bcb-d46e-4a32-8887-299e1bb155dd tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/cbb9f2df-dafa-4b4c-9490-f48625ed518b/action" status: 404 len: 117 microversion: 2.1 time: 0.038346 Oct 28 18:43:59.973230 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2351/6360] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:43:59 2022] POST /compute/v2.1/servers/cbb9f2df-dafa-4b4c-9490-f48625ed518b/action => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:59.996901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:59.997643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:00.005398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3847c8d1-07e1-49b8-a76b-d9d6c7e5269f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:00.017196 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3847c8d1-07e1-49b8-a76b-d9d6c7e5269f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1249 microversion: 2.1 time: 0.090491 Oct 28 18:44:00.018460 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4010/6361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:59 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:00.021813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:00.023274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:00.024637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:00.026287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:00.028429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:00.029957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:00.266386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:00.303621 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17b8cef8-7bef-4098-a1bc-7fe6f6401e20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.325600 Oct 28 18:44:00.304309 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2352/6362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:59 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:00.346002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:00.347114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:00.358508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:00.359040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:00.359485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:00.361411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:00.362407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:00.373552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:00.417309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:00.659547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:00.675440 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56503e5f-7d52-4c22-aba7-8be8f33eefc6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.333696 Oct 28 18:44:00.679888 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4011/6363] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:00 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:00.708011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bfb8c5ba-6e54-4720-bd31-9fd3d7dd11d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:00.708626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bfb8c5ba-6e54-4720-bd31-9fd3d7dd11d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 579b2af3-4af5-4950-93a7-518b5e15abbd] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:00.717936 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-bfb8c5ba-6e54-4720-bd31-9fd3d7dd11d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 579b2af3-4af5-4950-93a7-518b5e15abbd could not be found. Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bfb8c5ba-6e54-4720-bd31-9fd3d7dd11d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/579b2af3-4af5-4950-93a7-518b5e15abbd/action HTTP/1.1 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 15 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: {"suspend": {}} Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 579b2af3-4af5-4950-93a7-518b5e15abbd could not be found. Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '579b2af3-4af5-4950-93a7-518b5e15abbd', 'body': {'suspend': {}}} Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579b2af3-4af5-4950-93a7-518b5e15abbd could not be found. Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579b2af3-4af5-4950-93a7-518b5e15abbd could not be found. Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:00.723144 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:00.737188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:00.737188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:00.737188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579b2af3-4af5-4950-93a7-518b5e15abbd could not be found. Oct 28 18:44:00.737188 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:00.737188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bfb8c5ba-6e54-4720-bd31-9fd3d7dd11d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 579b2af3-4af5-4950-93a7-518b5e15abbd could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:00.737188 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bfb8c5ba-6e54-4720-bd31-9fd3d7dd11d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/579b2af3-4af5-4950-93a7-518b5e15abbd/action" status: 404 len: 111 microversion: 2.1 time: 0.022762 Oct 28 18:44:00.737188 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2353/6364] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:00 2022] POST /compute/v2.1/servers/579b2af3-4af5-4950-93a7-518b5e15abbd/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:00.738719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:00.738719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:00.759356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:00.763067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:00.763887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:00.764885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:00.765571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:00.766237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.043704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:01.044630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:01.061895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:01.062432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:01.062888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.063650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:01.065878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:01.066553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.160378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:01.171946 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-49123520-6a75-4835-a75d-be3dfbb6c3be tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.440024 Oct 28 18:44:01.173174 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4012/6365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:00 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:01.206226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:01.207718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:01.220286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:01.221920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:01.222853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.223905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:01.224551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:01.225262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.250828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:01.265259 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b981087f-f45b-498a-8aba-1800b984018f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1245 microversion: 2.1 time: 0.228122 Oct 28 18:44:01.277479 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2354/6366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:01 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1245 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:01.508016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:01.518388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f8274076-5836-48b4-a648-bc2c05502961 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.319321 Oct 28 18:44:01.518995 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4013/6367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:01 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:01.541348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:01.541946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:01.548323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:01.548828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:01.549273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.549990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:01.550459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:01.550894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.577103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lazy-loading 'flavor' on Instance uuid 614a9ab9-91a1-4941-96d6-3d2837c9993d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:44:01.641812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:01.676624 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b245301e-95ce-4773-b767-e9dee8080297 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 202 len: 0 microversion: 2.1 time: 0.138300 Oct 28 18:44:01.678270 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2355/6368] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:01 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:44:01.688032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:01.688581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:01.699524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:01.700392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:01.701582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.702927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:01.703591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:01.704255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:01.907284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:01.915759 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7feb4892-80d3-4e54-baee-a7e25b0e97f1 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1512 microversion: 2.1 time: 0.232335 Oct 28 18:44:01.919136 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4014/6369] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:01 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:02.311310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:02.312087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:02.324433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:02.327365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:02.327804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:02.329335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:02.329800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:02.330223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:02.357617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:02.360953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:02.371364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:02.372692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:02.373322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:02.374214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:02.374835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:02.375424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:02.441767 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1e596f3c-63e6-4ee9-b94f-2dcaa6fad7bf tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "POST /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca/action" status: 200 len: 24561 microversion: 2.1 time: 0.088232 Oct 28 18:44:02.457684 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4015/6370] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:02 2022] POST /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca/action => generated 24561 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:44:02.459956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:02.477528 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cbadf707-bb3e-4826-9f32-283f56256d6e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1307 microversion: 2.1 time: 0.166883 Oct 28 18:44:02.479970 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2356/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:02 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:02.946003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:02.947403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:02.974505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:02.975270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:02.975909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:02.978995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:02.979675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:02.980343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.268311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:03.281902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-949eed5c-c770-4204-a9bb-0293963ab6ba tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1495 microversion: 2.1 time: 0.342800 Oct 28 18:44:03.284057 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4016/6372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:02 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1495 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:03.311411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:03.312010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:03.331135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:03.333367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:03.333849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.337080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:03.338171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:03.339509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.382450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lazy-loading 'flavor' on Instance uuid 614a9ab9-91a1-4941-96d6-3d2837c9993d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:44:03.399373 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Cannot 'suspend' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state suspended Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action HTTP/1.1 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 15 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: {"suspend": {}} Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: exception: Cannot 'suspend' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state suspended Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'suspend': {}}} Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d in vm_state suspended. Cannot suspend while the instance is in this state. Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 28 18:44:03.404393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state suspended Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state suspended Oct 28 18:44:03.412722 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:03.418344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 409 to user: Cannot 'suspend' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state suspended {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:03.419592 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e115e87-4469-400f-b79b-a638eeb6585d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 409 len: 148 microversion: 2.1 time: 0.114404 Oct 28 18:44:03.421266 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2357/6373] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:03 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 148 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:44:03.430499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:03.431313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:03.444170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:03.447025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:03.449499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.450490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:03.451890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:03.455276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.511646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:03.512911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:03.519356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:03.520106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:03.520730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.521638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:03.522266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:03.523088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.610085 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c00d868-c3cc-477d-8fe9-7946a4101396 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 202 len: 0 microversion: 2.1 time: 0.184039 Oct 28 18:44:03.613040 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4017/6374] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:03 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:44:03.620046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:03.621049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:03.629057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:03.629869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:03.630757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.632456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:03.633470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:03.634558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:03.831547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:03.841520 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ee929c9-8793-4749-9b50-fa0d6076b7ff tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1501 microversion: 2.1 time: 0.226076 Oct 28 18:44:03.842121 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4018/6375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:03 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1501 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:04.007249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:04.019771 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a31dd143-d9aa-4d1a-afa1-906570018bf1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1375 microversion: 2.1 time: 0.512792 Oct 28 18:44:04.035548 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2358/6376] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:03 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1375 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:04.519399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-bfb098c2-3c91-421d-af4b-277e98ab9629 req-877232a7-da47-4070-b65c-64790f3223f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8ae5bd-4826-4aaf-bc47-721cf4706af6", "tag": "bff23640-b4b7-42c5-a676-f91c70123df9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:04.539788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bfb098c2-3c91-421d-af4b-277e98ab9629 req-877232a7-da47-4070-b65c-64790f3223f9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:04.540595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bfb098c2-3c91-421d-af4b-277e98ab9629 req-877232a7-da47-4070-b65c-64790f3223f9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:04.541431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bfb098c2-3c91-421d-af4b-277e98ab9629 req-877232a7-da47-4070-b65c-64790f3223f9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:04.572425 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-bfb098c2-3c91-421d-af4b-277e98ab9629 req-877232a7-da47-4070-b65c-64790f3223f9 service nova] Creating event network-changed:bff23640-b4b7-42c5-a676-f91c70123df9 for instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 on n-h1-862404-2 Oct 28 18:44:04.578233 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-bfb098c2-3c91-421d-af4b-277e98ab9629 req-877232a7-da47-4070-b65c-64790f3223f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069300 Oct 28 18:44:04.578847 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4019/6377] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:04.867653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:04.868331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:04.876234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:04.876989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:04.877638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:04.878523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:04.879164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:04.879750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:05.043396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:05.044499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:05.064365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:05.065246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:05.065894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:05.067179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:05.067864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:05.068478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:05.090524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:05.100778 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ba432392-de4a-4aed-9775-9806c57af3b0 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1501 microversion: 2.1 time: 0.236275 Oct 28 18:44:05.101859 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2359/6378] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:04 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:05.278909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:05.302678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f7019986-23a8-42e5-bc77-8020b3aff01e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1375 microversion: 2.1 time: 0.263529 Oct 28 18:44:05.303381 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4020/6379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:05 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1375 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:06.128122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:06.128728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:06.138949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.139445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.139912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.140649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.142821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.143327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.315767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:06.325137 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bf04e579-640f-47e6-9ef9-15e10c100d21 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.200810 Oct 28 18:44:06.327472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:06.328314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:06.330039 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2360/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:06 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:06.337295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.337295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.337295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.337924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.339538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.340296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.354689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:06.355300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:06.370941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.372109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.373235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.374161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.375218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.375834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.515460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:06.525815 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-646e27fe-ca39-45d7-9654-34ef3f1c026a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1375 microversion: 2.1 time: 0.203152 Oct 28 18:44:06.526999 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4021/6381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:06 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:06.565612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:06.574212 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14691923-0fc7-4065-b50c-4ff88a96540c tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.223646 Oct 28 18:44:06.574807 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2361/6382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:06 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:06.596885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-019ee11f-1439-4afd-a3f2-5de8939d8700 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:06.597439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-019ee11f-1439-4afd-a3f2-5de8939d8700 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 012ed288-6177-4818-b9b1-3bec4706aa16] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:06.603795 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-019ee11f-1439-4afd-a3f2-5de8939d8700 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 012ed288-6177-4818-b9b1-3bec4706aa16 could not be found. Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-019ee11f-1439-4afd-a3f2-5de8939d8700 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/012ed288-6177-4818-b9b1-3bec4706aa16/action HTTP/1.1 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 15 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: {"unpause": {}} Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 012ed288-6177-4818-b9b1-3bec4706aa16 could not be found. Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '012ed288-6177-4818-b9b1-3bec4706aa16', 'body': {'unpause': {}}} Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012ed288-6177-4818-b9b1-3bec4706aa16 could not be found. Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012ed288-6177-4818-b9b1-3bec4706aa16 could not be found. Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:06.605542 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:06.609841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:06.609841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:06.609841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012ed288-6177-4818-b9b1-3bec4706aa16 could not be found. Oct 28 18:44:06.609841 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:06.609841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-019ee11f-1439-4afd-a3f2-5de8939d8700 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 012ed288-6177-4818-b9b1-3bec4706aa16 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:06.609841 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-019ee11f-1439-4afd-a3f2-5de8939d8700 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/012ed288-6177-4818-b9b1-3bec4706aa16/action" status: 404 len: 111 microversion: 2.1 time: 0.014169 Oct 28 18:44:06.611990 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4022/6383] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:06 2022] POST /compute/v2.1/servers/012ed288-6177-4818-b9b1-3bec4706aa16/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:06.616104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:06.616793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:06.623005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.623496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.623958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.624660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.625126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.625551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.759230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:06.767616 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bcdd3a24-5849-427a-975d-3758f12826c8 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.155419 Oct 28 18:44:06.768220 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2362/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:06 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:06.791006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:06.791757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:06.798908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.799955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.799955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.800571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.801039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.801467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.952756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:06.961020 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-195c190d-ad61-49f2-92c1-6876eca9e0fc tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.173866 Oct 28 18:44:06.961620 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4023/6385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:06 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:06.983620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:06.984280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:06.990320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.990904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.991417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:06.992210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:06.992739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:06.993238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:07.017621 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Cannot 'unpause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action HTTP/1.1 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 15 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: {"unpause": {}} Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: exception: Cannot 'unpause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'unpause': {}}} Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d in vm_state active. Cannot unpause while the instance is in this state. Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:07.019246 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:07.024366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:07.024366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:07.024366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:07.024366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:44:07.024366 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:07.024366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 409 to user: Cannot 'unpause' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:07.024366 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ff2589d-6147-4a37-8317-b4e6d5ba3baf tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 409 len: 145 microversion: 2.1 time: 0.042095 Oct 28 18:44:07.024366 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2363/6386] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:06 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 145 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:44:07.030769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:07.031498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:07.037723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:07.038311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:07.038829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:07.039610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:07.040188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:07.040699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:07.176713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:07.185262 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f23172b6-1c28-4236-8dbd-d35ba0d20c9d tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.158406 Oct 28 18:44:07.186000 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4024/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:07 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:07.208392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:07.209046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:07.217703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:07.218454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:07.218907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:07.219715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:07.220598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:07.221405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:07.549831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:07.551077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:07.559128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:07.559963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:07.560603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:07.561515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:07.562151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:07.562753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:07.720423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:07.729775 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51889f39-20f7-4480-a162-46e89032f2bc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1375 microversion: 2.1 time: 0.183328 Oct 28 18:44:07.731028 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4025/6388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:07 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:08.057248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:08.068316 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a6a1d9a4-16b9-4711-9de1-59ff3043a34e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.863604 Oct 28 18:44:08.084725 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2364/6389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:07 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:08.094386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6c7589e-d5f1-4e37-a19f-b91d4f4fbb1a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:08.095122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6c7589e-d5f1-4e37-a19f-b91d4f4fbb1a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: db1b0eaa-f3e7-445e-b70a-0bba01f37f57] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:08.101459 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-c6c7589e-d5f1-4e37-a19f-b91d4f4fbb1a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance db1b0eaa-f3e7-445e-b70a-0bba01f37f57 could not be found. Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6c7589e-d5f1-4e37-a19f-b91d4f4fbb1a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/db1b0eaa-f3e7-445e-b70a-0bba01f37f57/action HTTP/1.1 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 18 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: {"unshelve": null} Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance db1b0eaa-f3e7-445e-b70a-0bba01f37f57 could not be found. Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'db1b0eaa-f3e7-445e-b70a-0bba01f37f57', 'body': {'unshelve': None}} Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1b0eaa-f3e7-445e-b70a-0bba01f37f57 could not be found. Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1b0eaa-f3e7-445e-b70a-0bba01f37f57 could not be found. Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.103441 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1b0eaa-f3e7-445e-b70a-0bba01f37f57 could not be found. Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6c7589e-d5f1-4e37-a19f-b91d4f4fbb1a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance db1b0eaa-f3e7-445e-b70a-0bba01f37f57 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:08.109230 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6c7589e-d5f1-4e37-a19f-b91d4f4fbb1a tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/db1b0eaa-f3e7-445e-b70a-0bba01f37f57/action" status: 404 len: 111 microversion: 2.1 time: 0.018228 Oct 28 18:44:08.110587 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4026/6390] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:08 2022] POST /compute/v2.1/servers/db1b0eaa-f3e7-445e-b70a-0bba01f37f57/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:08.118784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:08.119402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:08.126926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.127780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.128400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.129552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.130190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.132850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.349620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:08.359042 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ec103b0-d4ac-49cd-9663-85c0d7bb42d6 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.244101 Oct 28 18:44:08.360041 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2365/6391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:08 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:08.384732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:08.386196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:08.393788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.394877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.395489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.396401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.397006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.397578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.559031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:08.568001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8cb45a9d-f1b4-4350-9fb2-75ad981ced47 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.187434 Oct 28 18:44:08.569107 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4027/6392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:08 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:08.591957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:08.592494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:08.598731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.599225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.599662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.600494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.600953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.601379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.638726 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Cannot 'unshelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action HTTP/1.1 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 18 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: {"unshelve": null} Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: exception: Cannot 'unshelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'unshelve': None}} Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d in vm_state active. Cannot unshelve while the instance is in this state. Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 18:44:08.640393 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 409 to user: Cannot 'unshelve' instance 614a9ab9-91a1-4941-96d6-3d2837c9993d while it is in vm_state active {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:08.645078 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c4c400f-d272-4249-9be3-ecd056b201c3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action" status: 409 len: 146 microversion: 2.1 time: 0.055027 Oct 28 18:44:08.646179 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2366/6393] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:08 2022] POST /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d/action => generated 146 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 18:44:08.650777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:08.652291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:08.658381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.658870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.659314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.660060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.660519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.660950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.753805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:08.754727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:08.761525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.762236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.762685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.763395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.763876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.764368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.858455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:08.867388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69cda5b1-b3e9-4b5b-8526-0a7cfec107ca tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.220376 Oct 28 18:44:08.868015 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4028/6394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:08 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:08.892466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:08.893095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:08.903201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.904827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.905451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.906179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:08.906880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:08.907316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:08.973485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:08.991222 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a5398bef-6a10-4945-9670-e5455469d82d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1375 microversion: 2.1 time: 0.238163 Oct 28 18:44:09.007085 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2367/6395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:08 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:09.098856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:09.109557 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47093426-7092-4fe1-b473-f0aef055045e tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.221833 Oct 28 18:44:09.110586 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4029/6396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:08 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:09.132771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-351775b5-96ea-4380-933d-9f922a3c9c20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1969744771_updated"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:09.137070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-351775b5-96ea-4380-933d-9f922a3c9c20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: adae7d0b-94cd-49bf-a480-3fb8b633dec6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:09.142632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=56 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:09.144559 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-351775b5-96ea-4380-933d-9f922a3c9c20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance adae7d0b-94cd-49bf-a480-3fb8b633dec6 could not be found. Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-351775b5-96ea-4380-933d-9f922a3c9c20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: request: PUT /compute/v2.1/servers/adae7d0b-94cd-49bf-a480-3fb8b633dec6 HTTP/1.1 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 81 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1969744771_updated"}} Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance adae7d0b-94cd-49bf-a480-3fb8b633dec6 could not be found. Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'adae7d0b-94cd-49bf-a480-3fb8b633dec6', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1969744771_updated'}}} Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adae7d0b-94cd-49bf-a480-3fb8b633dec6 could not be found. Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 18:44:09.147150 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adae7d0b-94cd-49bf-a480-3fb8b633dec6 could not be found. Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adae7d0b-94cd-49bf-a480-3fb8b633dec6 could not be found. Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.152779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-351775b5-96ea-4380-933d-9f922a3c9c20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance adae7d0b-94cd-49bf-a480-3fb8b633dec6 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:09.154478 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-351775b5-96ea-4380-933d-9f922a3c9c20 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "PUT /compute/v2.1/servers/adae7d0b-94cd-49bf-a480-3fb8b633dec6" status: 404 len: 111 microversion: 2.1 time: 0.025902 Oct 28 18:44:09.156026 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2368/6397] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:44:09 2022] PUT /compute/v2.1/servers/adae7d0b-94cd-49bf-a480-3fb8b633dec6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:09.164735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:09.172744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:09.183229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:09.184365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:09.184929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:09.185930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:09.186529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:09.187162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:09.195469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:09.376989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:09.385834 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59211388-3fcd-4df6-9c01-9a3dcd3ff46b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.224642 Oct 28 18:44:09.386989 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4030/6398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:09 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:09.408994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:09.409697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:09.419228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:09.419721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:09.420189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:09.420898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:09.421406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:09.421944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:09.610051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:09.621301 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c0a238e9-c6af-4c3b-8248-9e376b612a29 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.216318 Oct 28 18:44:09.623671 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2369/6399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:09 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:09.648728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-317eec4b-4103-40b8-b7e8-693e9cf98d92 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-317eec4b-4103-40b8-b7e8-693e9cf98d92 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d HTTP/1.1 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 280 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.654456 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 18:44:09.658564 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:09.661840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-317eec4b-4103-40b8-b7e8-693e9cf98d92 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:09.662897 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-317eec4b-4103-40b8-b7e8-693e9cf98d92 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "PUT /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 400 len: 619 microversion: 2.1 time: 0.018316 Oct 28 18:44:09.663647 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4031/6400] 10.222.0.16 () {60 vars in 1257 bytes} [Fri Oct 28 18:44:09 2022] PUT /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:44:09.672576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:09.673353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:09.679239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:09.679732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:09.680406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:09.681296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:09.681970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:09.682595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:09.833707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:09.844045 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9d90bb73-0c07-466e-bcaa-ca8961199c96 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.175063 Oct 28 18:44:09.845592 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2370/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:09 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:09.868476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:09.869491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:09.879650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:09.882363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:09.883155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:09.884634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:09.886329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:09.886958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:09.887512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:10.014940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:10.015707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:10.016048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:10.025441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:10.026489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:10.026942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:10.027663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:10.028150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:10.028585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:10.067356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:10.077994 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ffe07d9-b6b7-4aa0-af7c-c8f8f93aaa54 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.213394 Oct 28 18:44:10.078855 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4032/6402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:09 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:10.102441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac0694ed-7e5b-48e8-a309-85622fdbffd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac0694ed-7e5b-48e8-a309-85622fdbffd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: request: PUT /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d HTTP/1.1 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 24 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: {"server": {"name": ""}} Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d', 'body': {'server': {'name': ''}}} Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '' Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:44:10.107367 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 18:44:10.112529 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:44:10.114516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac0694ed-7e5b-48e8-a309-85622fdbffd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:10.115591 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac0694ed-7e5b-48e8-a309-85622fdbffd7 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "PUT /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 400 len: 108 microversion: 2.1 time: 0.018198 Oct 28 18:44:10.116700 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4033/6403] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:44:10 2022] PUT /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 18:44:10.126272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:10.127069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:10.134705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:10.135987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:10.136248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:10.137135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:10.138025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:10.138646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:10.189461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:10.198393 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2bebd404-8a97-4df5-9857-4428b997b04f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1375 microversion: 2.1 time: 0.187159 Oct 28 18:44:10.199566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2371/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:10 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:10.288428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:10.296921 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7989c33-a1c6-4171-a4ec-1d2a2031993b tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1504 microversion: 2.1 time: 0.176147 Oct 28 18:44:10.297570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4034/6405] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:10 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:11.222797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:11.223418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:11.241370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:11.242151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:11.242828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:11.243781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:11.244630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:11.245309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:11.261387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-829b3b92-9344-437b-be8a-5cce0f96063a req-0d7a10f9-e9f1-4a43-8edc-ad5c7459f969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8ae5bd-4826-4aaf-bc47-721cf4706af6", "name": "network-vif-plugged", "status": "completed", "tag": "bff23640-b4b7-42c5-a676-f91c70123df9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:11.283057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-829b3b92-9344-437b-be8a-5cce0f96063a req-0d7a10f9-e9f1-4a43-8edc-ad5c7459f969 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:11.283788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-829b3b92-9344-437b-be8a-5cce0f96063a req-0d7a10f9-e9f1-4a43-8edc-ad5c7459f969 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:11.284413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-829b3b92-9344-437b-be8a-5cce0f96063a req-0d7a10f9-e9f1-4a43-8edc-ad5c7459f969 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:11.314398 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-829b3b92-9344-437b-be8a-5cce0f96063a req-0d7a10f9-e9f1-4a43-8edc-ad5c7459f969 service nova] Creating event network-vif-plugged:bff23640-b4b7-42c5-a676-f91c70123df9 for instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 on n-h1-862404-2 Oct 28 18:44:11.321089 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-829b3b92-9344-437b-be8a-5cce0f96063a req-0d7a10f9-e9f1-4a43-8edc-ad5c7459f969 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064366 Oct 28 18:44:11.322461 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4035/6406] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:44:11.578054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:11.585809 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08c61a1d-f03e-4531-8056-73891db725fc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1375 microversion: 2.1 time: 0.367059 Oct 28 18:44:11.586381 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2372/6407] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:11 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1375 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:12.612577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:12.613921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:12.623323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:12.623883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:12.624380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:12.625566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:12.636351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:12.636941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:12.924842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:12.936267 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6a9e63f3-ec73-4f8c-8ee9-59f54d76eff9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1375 microversion: 2.1 time: 0.329581 Oct 28 18:44:12.937705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4036/6408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:12 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1375 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:13.967799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:13.969625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:13.983092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:13.985822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:13.986430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:13.992017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:14.000735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:14.002869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:14.331526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:14.335633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:14.345530 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f531b33-a720-46c6-9fa3-6b3a0dc29f02 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1547 microversion: 2.1 time: 0.383999 Oct 28 18:44:14.347738 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2373/6409] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:13 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1547 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:14.389759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:14.391158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:14.406136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:14.412034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:14.412856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:14.414335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:14.414886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:14.417633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:14.637493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:14.647972 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-28a479bd-4e59-473c-9f19-5c79c35241f0 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1547 microversion: 2.1 time: 0.268421 Oct 28 18:44:14.648572 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4037/6410] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:14 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1547 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:15.123521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-aeee6831-5784-4cf4-8482-4f26d10360f3 req-4b634bce-0021-434e-a9b8-eded4b11338e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6faaa157-2333-4347-8fd8-9deab1b4fbca", "tag": "ae95d69c-ed79-4a16-aa64-0c47e981d9e1"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:15.125248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:15.125804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:15.137793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:15.138279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:15.141060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:15.142066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:15.142708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:15.144248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:15.155435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aeee6831-5784-4cf4-8482-4f26d10360f3 req-4b634bce-0021-434e-a9b8-eded4b11338e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:15.156706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aeee6831-5784-4cf4-8482-4f26d10360f3 req-4b634bce-0021-434e-a9b8-eded4b11338e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:15.159844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aeee6831-5784-4cf4-8482-4f26d10360f3 req-4b634bce-0021-434e-a9b8-eded4b11338e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:15.189120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:44:15.200992 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-aeee6831-5784-4cf4-8482-4f26d10360f3 req-4b634bce-0021-434e-a9b8-eded4b11338e service nova] Creating event network-changed:ae95d69c-ed79-4a16-aa64-0c47e981d9e1 for instance 6faaa157-2333-4347-8fd8-9deab1b4fbca on n-h2-862404-2 Oct 28 18:44:15.252721 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-aeee6831-5784-4cf4-8482-4f26d10360f3 req-4b634bce-0021-434e-a9b8-eded4b11338e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128529 Oct 28 18:44:15.254600 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4038/6411] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:15.375708 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1cfaab9b-1019-4093-9e46-c62c7fbe84d3 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 204 len: 0 microversion: 2.1 time: 0.260746 Oct 28 18:44:15.376414 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2374/6412] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:44:15 2022] DELETE /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:44:15.386505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:15.387294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:15.406823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:15.407465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:15.413538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:15.414582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:15.417957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:15.418879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:15.934492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:15.935088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:15.951675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:15.956556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:15.957050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:15.958948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:15.959446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:15.959919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:15.990747 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef HTTP/1.1 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'c668a51f-23af-4529-b61e-d9646e0675ef'} Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:44:15.992478 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:15.996942 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b611e867-841c-4e4b-85c7-ffd63a85d8e2 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 404 len: 111 microversion: 2.1 time: 0.063726 Oct 28 18:44:16.005194 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2375/6413] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:44:15 2022] DELETE /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:16.011966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:16.012605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: c668a51f-23af-4529-b61e-d9646e0675ef] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:16.035288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:16.035800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:16.036270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:16.037001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:16.037466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:16.037901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:16.061686 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef HTTP/1.1 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'c668a51f-23af-4529-b61e-d9646e0675ef'} Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:16.074508 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:16.079177 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:16.079177 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:16.079177 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:16.079177 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:16.079177 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:16.079177 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. Oct 28 18:44:16.079177 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:16.086517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance c668a51f-23af-4529-b61e-d9646e0675ef could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:16.087626 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b4a906a3-ef08-4712-8e47-576bcb59fc33 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef" status: 404 len: 111 microversion: 2.1 time: 0.081408 Oct 28 18:44:16.089276 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2376/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:16 2022] GET /compute/v2.1/servers/c668a51f-23af-4529-b61e-d9646e0675ef => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:16.101436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:16.102231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:16.112813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:16.114144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:16.116764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:16.117685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:16.118311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:16.120712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:16.171243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:16.180371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:44:16.180916 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a36636df-ef81-448e-a40a-9ed53426a7b1 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1689 microversion: 2.1 time: 0.798902 Oct 28 18:44:16.207750 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4039/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:15 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1689 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:16.346747 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed428c8e-304f-42d5-a23e-86d837401e59 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "DELETE /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 204 len: 0 microversion: 2.1 time: 0.252889 Oct 28 18:44:16.356293 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2377/6416] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:44:16 2022] DELETE /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:44:16.365470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:16.366390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:16.388033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:16.391804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:16.395173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:16.396483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:16.399150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:16.399770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:16.845885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:16.855527 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af6ed3af-b9a1-4045-b29c-320c28fe76f3 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.494953 Oct 28 18:44:16.856822 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4040/6417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:16 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:17.214463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:17.215174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:17.229205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:17.229948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:17.230596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:17.231493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:17.236308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:17.236964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:17.570654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:17.584057 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1bf00251-98a6-482b-90bd-7aad48bad61d tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1689 microversion: 2.1 time: 0.373900 Oct 28 18:44:17.584672 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2378/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:17 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1689 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:17.810682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e9b0bb4c-7013-4c4d-b982-b4eaaec3cdaf req-a96bc544-c9ae-4d68-93c3-9e6cf2e3e41b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8ae5bd-4826-4aaf-bc47-721cf4706af6", "tag": "bff23640-b4b7-42c5-a676-f91c70123df9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:17.830713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e9b0bb4c-7013-4c4d-b982-b4eaaec3cdaf req-a96bc544-c9ae-4d68-93c3-9e6cf2e3e41b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:17.835132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e9b0bb4c-7013-4c4d-b982-b4eaaec3cdaf req-a96bc544-c9ae-4d68-93c3-9e6cf2e3e41b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:17.837180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e9b0bb4c-7013-4c4d-b982-b4eaaec3cdaf req-a96bc544-c9ae-4d68-93c3-9e6cf2e3e41b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:17.852432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1607972163", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d1351c7e-7099-4426-a5f3-8f6dc2feb4ca", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ca633313-4d95-4fc0-8f7a-c33539b3174e"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:17.883034 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e9b0bb4c-7013-4c4d-b982-b4eaaec3cdaf req-a96bc544-c9ae-4d68-93c3-9e6cf2e3e41b service nova] Creating event network-changed:bff23640-b4b7-42c5-a676-f91c70123df9 for instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 on n-h1-862404-2 Oct 28 18:44:17.893124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e9b0bb4c-7013-4c4d-b982-b4eaaec3cdaf req-a96bc544-c9ae-4d68-93c3-9e6cf2e3e41b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085866 Oct 28 18:44:17.894423 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4041/6419] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:17.918642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:17.919473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:17.934080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:17.935111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:17.935776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:17.937083 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:17.937564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:17.937996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:17.988629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] validate_networks() for [('ca633313-4d95-4fc0-8f7a-c33539b3174e', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:44:18.179943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:18.192938 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-85a3d39c-42de-4758-80d0-079f383b8399 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.283057 Oct 28 18:44:18.194223 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4042/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:17 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:18.611042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:18.611670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:18.620462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:18.621824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:18.622640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:18.625335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:18.626031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:18.626487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:19.335108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:44:19.336263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:44:19.337533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:44:19.338864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:44:19.339683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:44:19.356941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:19.357776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:19.358490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:19.360296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:19.361739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:19.362367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:19.395482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:44:19.402179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:44:19.418643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:44:19.421299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d1351c7e-7099-4426-a5f3-8f6dc2feb4ca',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:44:19.502476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:19.515996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96aa3944-4c6b-4641-a841-d9a67ad4a1d9 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1689 microversion: 2.1 time: 0.908768 Oct 28 18:44:19.517458 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4043/6421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:18 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1689 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:19.525490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:19.530334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:19.543189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:19.545481 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04fe3a57-afd1-46a5-858a-7b0c7d95f854 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697017 Oct 28 18:44:19.546187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:19.548076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:19.555744 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2379/6422] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:44:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:44:19.558690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:19.559363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:19.560372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:19.571777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9a0245e-5765-4ec3-bf26-5b84afb2d5e7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:19.573446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9a0245e-5765-4ec3-bf26-5b84afb2d5e7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:19.712263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c9a0245e-5765-4ec3-bf26-5b84afb2d5e7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:19.730745 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9a0245e-5765-4ec3-bf26-5b84afb2d5e7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1057 microversion: 2.1 time: 0.173363 Oct 28 18:44:19.733650 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2380/6423] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:19 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1057 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:19.957053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:19.970652 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f1f2b121-10b2-4fe7-9fec-b16a4653cbfb tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1510 microversion: 2.1 time: 0.450316 Oct 28 18:44:19.974220 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4044/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:19 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:20.217307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8e4ae0e4-2e04-4ea2-a020-d6905ee90f6f req-597e49d1-de93-49f0-9218-8727ae5834d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6faaa157-2333-4347-8fd8-9deab1b4fbca", "name": "network-vif-deleted", "tag": "ae95d69c-ed79-4a16-aa64-0c47e981d9e1"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:20.230538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8e4ae0e4-2e04-4ea2-a020-d6905ee90f6f req-597e49d1-de93-49f0-9218-8727ae5834d1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:20.231471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8e4ae0e4-2e04-4ea2-a020-d6905ee90f6f req-597e49d1-de93-49f0-9218-8727ae5834d1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:20.232176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8e4ae0e4-2e04-4ea2-a020-d6905ee90f6f req-597e49d1-de93-49f0-9218-8727ae5834d1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:20.248301 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8e4ae0e4-2e04-4ea2-a020-d6905ee90f6f req-597e49d1-de93-49f0-9218-8727ae5834d1 service nova] Creating event network-vif-deleted:ae95d69c-ed79-4a16-aa64-0c47e981d9e1 for instance 6faaa157-2333-4347-8fd8-9deab1b4fbca on n-h2-862404-2 Oct 28 18:44:20.255775 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8e4ae0e4-2e04-4ea2-a020-d6905ee90f6f req-597e49d1-de93-49f0-9218-8727ae5834d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042690 Oct 28 18:44:20.257191 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2381/6425] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:44:20.545164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:20.546707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:20.555609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:20.556538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:20.557211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:20.558118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:20.558867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:20.559479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:20.600947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:20.601479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:20.602176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:20.602806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lazy-loading 'fault' on Instance uuid 6faaa157-2333-4347-8fd8-9deab1b4fbca {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:44:20.654319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379680f3dd0542389b53a8a4f20ae800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b8055a69f4f979036482e1fd37f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:20.663776 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36f0ef6b-2f1f-4d5d-82ad-b017d6f9c392 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 200 len: 1357 microversion: 2.1 time: 0.126468 Oct 28 18:44:20.664589 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4045/6426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:20 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 1357 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:20.765585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:20.766407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:20.772678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:20.773244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:20.773757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:20.774532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:20.775078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:20.776279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:20.848652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:20.856859 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2444093c-1da8-45e9-b5bf-feb28a7de0d6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1053 microversion: 2.1 time: 0.095483 Oct 28 18:44:20.860630 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2382/6427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:20 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1053 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:20.996575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:20.997714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:21.011715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:21.012264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:21.012992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:21.013814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:21.015276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:21.015509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:21.093206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:21.093639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:21.094078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:21.094528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lazy-loading 'fault' on Instance uuid 614a9ab9-91a1-4941-96d6-3d2837c9993d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:44:21.148716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea5186334f04a09b3ba8496d6658a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072aaddceb9e44a7b5bb9234d6846a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:21.157841 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c871e15-b125-45ef-aa34-32d6bf3dabf5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 200 len: 1306 microversion: 2.1 time: 0.166891 Oct 28 18:44:21.158568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4046/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:20 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 1306 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:21.688884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:21.689493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] [instance: 6faaa157-2333-4347-8fd8-9deab1b4fbca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:21.695914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:21.696399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:21.696830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:21.698252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:21.698754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:21.699279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:21.712513 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] HTTP exception thrown: Instance 6faaa157-2333-4347-8fd8-9deab1b4fbca could not be found. Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Request method failure captured: Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca HTTP/1.1 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCBvc0YflF8rdCSJK9k6feqbsVmfTyN8LB8kG2K52dnwbeAWDEga0e3Qk_53zZR-oQU21yf38NMhPvsSxFlBHCPi4wNEgvRNviGdQHu6PLLHjTzAKlw5vk1MAxvpDp7nGyF8QRnha0Rkwy6iP9lJeZbWLld9X9TIIcL8SHJYIWKaQ74 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 946b8055a69f4f979036482e1fd37f67 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_946b8055a69f4f979036482e1fd37f67", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/946b8055a69f4f979036482e1fd37f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 946b8055a69f4f979036482e1fd37f67 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-156931648 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestNetworkAdvancedServerOps-156931648-project Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 379680f3dd0542389b53a8a4f20ae800 Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestNetworkAdvancedServerOps-156931648-project Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 6faaa157-2333-4347-8fd8-9deab1b4fbca could not be found. Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '6faaa157-2333-4347-8fd8-9deab1b4fbca'} Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6faaa157-2333-4347-8fd8-9deab1b4fbca could not be found. Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6faaa157-2333-4347-8fd8-9deab1b4fbca could not be found. Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:21.714187 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6faaa157-2333-4347-8fd8-9deab1b4fbca could not be found. Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Returning 404 to user: Instance 6faaa157-2333-4347-8fd8-9deab1b4fbca could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e1a52f4-d80d-408d-8b8d-044787671f03 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca" status: 404 len: 111 microversion: 2.1 time: 0.030795 Oct 28 18:44:21.718818 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2383/6429] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:21 2022] GET /compute/v2.1/servers/6faaa157-2333-4347-8fd8-9deab1b4fbca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:21.885615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:21.886658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:21.921505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:21.922018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:21.923851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:21.925600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:21.926095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:21.929232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:22.105513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:22.129328 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c628ad80-3256-413c-b8c4-6bf78fe86d0a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1127 microversion: 2.1 time: 0.250481 Oct 28 18:44:22.134833 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4047/6430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:21 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1127 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:22.184364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:22.186303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] [instance: 614a9ab9-91a1-4941-96d6-3d2837c9993d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:22.198915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:22.199872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:22.201402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:22.203751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:22.204266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:22.206812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:22.244939 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] HTTP exception thrown: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d could not be found. Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Request method failure captured: Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d HTTP/1.1 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJKbzb3QnLNHUSSr51A0PVRjRIQazqhPb6p96dcvkiSi7hrN1LxUAlLAFyzMJbBjiFyBz5pMRA-DzHlOiFeA_jo8JelBeiek3Zwi8g0VOsPiD1oRGnXAwj43QiYD236iYR2sm_D7nGcKBB6uIn2iBCtpta3CNGCZJ_TmSVvynLvnis Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_072aaddceb9e44a7b5bb9234d6846a70", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/072aaddceb9e44a7b5bb9234d6846a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 072aaddceb9e44a7b5bb9234d6846a70 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-282218869 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: aea5186334f04a09b3ba8496d6658a94 Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-282218869-project Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d could not be found. Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '614a9ab9-91a1-4941-96d6-3d2837c9993d'} Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d could not be found. Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d could not be found. Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:44:22.249445 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:22.254226 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:44:22.254226 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:44:22.254226 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:44:22.254226 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:44:22.254226 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:44:22.254226 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d could not be found. Oct 28 18:44:22.254226 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:44:22.257824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] Returning 404 to user: Instance 614a9ab9-91a1-4941-96d6-3d2837c9993d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:44:22.259396 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d7cd4934-fd09-4259-be98-9616d6f358d5 tempest-ServersNegativeTestJSON-282218869 tempest-ServersNegativeTestJSON-282218869-project] 10.222.0.16 "GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d" status: 404 len: 111 microversion: 2.1 time: 0.081780 Oct 28 18:44:22.261186 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2384/6431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:22 2022] GET /compute/v2.1/servers/614a9ab9-91a1-4941-96d6-3d2837c9993d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:22.295095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fec5d8ae-0811-427f-8a82-641914531cd7 req-686f6d0b-cb1d-4602-b8f0-cb6ff4713219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614a9ab9-91a1-4941-96d6-3d2837c9993d", "name": "network-vif-deleted", "tag": "dc97c4e6-2ee1-49ff-988b-49ca90baefa7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:22.315655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fec5d8ae-0811-427f-8a82-641914531cd7 req-686f6d0b-cb1d-4602-b8f0-cb6ff4713219 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:22.318520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fec5d8ae-0811-427f-8a82-641914531cd7 req-686f6d0b-cb1d-4602-b8f0-cb6ff4713219 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:22.319126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fec5d8ae-0811-427f-8a82-641914531cd7 req-686f6d0b-cb1d-4602-b8f0-cb6ff4713219 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:22.341322 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fec5d8ae-0811-427f-8a82-641914531cd7 req-686f6d0b-cb1d-4602-b8f0-cb6ff4713219 service nova] Creating event network-vif-deleted:dc97c4e6-2ee1-49ff-988b-49ca90baefa7 for instance 614a9ab9-91a1-4941-96d6-3d2837c9993d on n-h2-862404-2 Oct 28 18:44:22.346962 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fec5d8ae-0811-427f-8a82-641914531cd7 req-686f6d0b-cb1d-4602-b8f0-cb6ff4713219 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057302 Oct 28 18:44:22.348260 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4048/6432] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:44:23.155416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:23.156557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:23.167802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:23.168668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:23.169958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:23.171254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:23.172001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:23.172839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:23.527848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:23.542308 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-52261925-d7fe-40f5-91e7-c08dc85a132b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.390095 Oct 28 18:44:23.544569 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2385/6433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:23 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:24.426506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e0a3aed9-2628-4bf4-9bbf-b6de71e5c633 req-f5560721-5489-4bc4-94a5-f9f820c57c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c", "tag": "2a6585e9-e141-427e-9975-cee6fa4ba39b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:24.448516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0a3aed9-2628-4bf4-9bbf-b6de71e5c633 req-f5560721-5489-4bc4-94a5-f9f820c57c4f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:24.452831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0a3aed9-2628-4bf4-9bbf-b6de71e5c633 req-f5560721-5489-4bc4-94a5-f9f820c57c4f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:24.453672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e0a3aed9-2628-4bf4-9bbf-b6de71e5c633 req-f5560721-5489-4bc4-94a5-f9f820c57c4f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:24.476594 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e0a3aed9-2628-4bf4-9bbf-b6de71e5c633 req-f5560721-5489-4bc4-94a5-f9f820c57c4f service nova] Creating event network-changed:2a6585e9-e141-427e-9975-cee6fa4ba39b for instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c on n-h2-862404-2 Oct 28 18:44:24.484767 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e0a3aed9-2628-4bf4-9bbf-b6de71e5c633 req-f5560721-5489-4bc4-94a5-f9f820c57c4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063262 Oct 28 18:44:24.486283 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4049/6434] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:24.571542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:24.572905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:24.583458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:24.587742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:24.589059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:24.589946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:24.590522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:24.591060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:25.649936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:25.668812 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8cc72de4-daec-4cbe-b6a1-a0cbe13c7126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 1.101007 Oct 28 18:44:25.679840 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2386/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:24 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:26.697822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:26.701319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:26.721682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:26.728020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:26.729304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:26.730358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:26.733712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:26.734345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:27.285953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:27.297939 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1f6d6ec7-c12e-48e9-a1c6-d6a6ca507b81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.604942 Oct 28 18:44:27.300967 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4050/6436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:26 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:28.329845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:28.330506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:28.353412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:28.354539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:28.354975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:28.361089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:28.361936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:28.365921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:29.095479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:29.120395 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28783880-fddf-481f-aedd-25dfd2e2f830 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.788646 Oct 28 18:44:29.135958 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2387/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:28 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:30.156600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:30.157232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:30.176029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:30.181658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:30.184101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:30.184786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:30.187058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:30.188905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:30.189362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:30.238139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:30.444905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09a866fb-6b6b-4fcc-ac43-300d761d1c18 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '.version_select at 0x7f78dd5114c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:30.454723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:30.467690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:30.485065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:30.502074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-867d51a5-ff80-471c-8fca-fab2982d03ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.355429 Oct 28 18:44:30.503455 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4051/6438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:30 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:30.539779 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09a866fb-6b6b-4fcc-ac43-300d761d1c18 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2009277915" status: 202 len: 0 microversion: 2.1 time: 0.098188 Oct 28 18:44:30.549360 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2388/6439] 10.222.0.16 () {58 vars in 1284 bytes} [Fri Oct 28 18:44:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2009277915 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:44:31.566207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:31.567178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:31.594299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:31.594752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:31.602353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:31.603679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:31.605304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:31.605996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:31.806784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:31.821070 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.259553 Oct 28 18:44:31.823206 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4052/6440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:31 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:32.634218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09a866fb-6b6b-4fcc-ac43-300d761d1c18 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:32.635418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09a866fb-6b6b-4fcc-ac43-300d761d1c18 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001453 Oct 28 18:44:32.643072 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2389/6441] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 18:44:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 18:44:32.645125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:32.650421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002311 Oct 28 18:44:32.650887 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4053/6442] 10.222.0.16 () {54 vars in 1035 bytes} [Fri Oct 28 18:44:32 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 28 18:44:32.658717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09a866fb-6b6b-4fcc-ac43-300d761d1c18 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:32.660649 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09a866fb-6b6b-4fcc-ac43-300d761d1c18 tempest-TestNetworkAdvancedServerOps-156931648 tempest-TestNetworkAdvancedServerOps-156931648-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001857 Oct 28 18:44:32.661203 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2390/6443] 10.222.0.16 () {54 vars in 1041 bytes} [Fri Oct 28 18:44:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:44:32.671515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:32.675097 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04aeea60-d8d3-4d6a-a013-1dbcaef3f13b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003364 Oct 28 18:44:32.675643 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4054/6444] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 18:44:32 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 18:44:32.873117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:32.874420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:32.894368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:32.895746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:32.896599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:32.897334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:32.899095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:32.899840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:33.144650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:33.155968 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-581bfe2b-15b2-4610-9536-6bb18e875180 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.289761 Oct 28 18:44:33.167800 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2391/6445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:32 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:34.191794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:34.193106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:34.211273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:34.212132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:34.212740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:34.213616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:34.214381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:34.214966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:34.519165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:34.534662 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-276d6c0b-2c9c-4658-9937-691e7af774e3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.354965 Oct 28 18:44:34.538592 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4055/6446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:34 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:35.565006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:35.565636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:35.573743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:35.574588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:35.575305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:35.576285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:35.576973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:35.577734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:35.767615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:35.776366 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe16563b-ef43-4ddb-a359-3495449f9312 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.215940 Oct 28 18:44:35.777279 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2392/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:35 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:36.804180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:36.805556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:36.823688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:36.824496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:36.827246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:36.835167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:36.836227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:36.837630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:37.146432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:37.161134 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3109d6fb-0c6f-4733-b510-08139f324a2c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.360216 Oct 28 18:44:37.161871 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4056/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:36 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:38.184861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:38.185425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:38.200686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:38.201200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:38.201642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:38.202573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:38.203187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:38.204012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:38.613312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:38.625389 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20536dcb-04dd-44b1-b738-562bb04950c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.444629 Oct 28 18:44:38.626538 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2393/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:38 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:39.657496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:39.658552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:39.682449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:39.686386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:39.688193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:39.689077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:39.692650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:39.693628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:40.173719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:40.188376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c280c605-14b7-4317-8ba3-48ab8a4ec2d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.538302 Oct 28 18:44:40.190822 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4057/6450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:39 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:41.214840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:41.215292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:41.218146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:41.230767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:41.231265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:41.234280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:41.235031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:41.235499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:41.235959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:41.645920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:41.666228 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bc6af7dd-d11b-4b6f-840b-db5889dc4764 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.447881 Oct 28 18:44:41.668931 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2394/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:41 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:42.693126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:42.694324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:42.702462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:42.703148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:42.704033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:42.704911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:42.705527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:42.706115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:43.027122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:43.036203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-359743c1-36ba-4749-a9e2-7da2014510e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.346858 Oct 28 18:44:43.047837 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4058/6452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:42 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:44.063248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:44.063925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:44.082299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:44.085896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:44.086568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:44.089633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:44.090304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:44.091100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:44.105117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:44.389692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:44.403926 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d387090-76c9-4c6a-a82d-2d48be7232f3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.347057 Oct 28 18:44:44.404549 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2395/6453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:44 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:45.426803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:45.427430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:45.438529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:45.444538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:45.445218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:45.446184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:45.446850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:45.448105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:45.761746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:45.771724 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3397d5c0-d791-4183-ad30-cca857eacf55 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1169 microversion: 2.1 time: 0.348860 Oct 28 18:44:45.776008 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4059/6454] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:45 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1169 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:46.801833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:46.802490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:46.814300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:46.824188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:46.824780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:46.825564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:46.826053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:46.828058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:47.743760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:47.757983 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-95ce7d26-b746-4d4e-86c3-863ae6cab51d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1215 microversion: 2.1 time: 0.954673 Oct 28 18:44:47.761142 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2396/6455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:46 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1215 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:48.660853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:48.663447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:48.679713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:48.683985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:48.684574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:48.685451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:48.694615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:48.695270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:48.788836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:48.789812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:48.795651 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca195714-6a2b-4777-a6c3-893c134a934f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6/action" status: 200 len: 24570 microversion: 2.1 time: 0.140465 Oct 28 18:44:48.807261 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4060/6456] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:44:48 2022] POST /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6/action => generated 24570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:44:48.812267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:48.812970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:48.813600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:48.814529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:48.815473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:48.824478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:49.766379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:49.776956 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e2a6c49c-69d5-47d7-8d1b-cc39926946db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1203 microversion: 2.1 time: 0.992681 Oct 28 18:44:49.778042 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2397/6457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:48 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1203 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:50.560135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36272834-e4cd-4b49-b626-bec1a93dbcc5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Action: 'create', calling method: .version_select at 0x7f78dc8f0790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1522057187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAaXV2j6TT+I+msRoWdj9YBbhl7RkaVvBKXZDaBFW2PFmGerm/YW19j6yvG0faBoem6CLEf9cAT9p/obBSFG3XEwD0UWf4VOW+7La8hpBQ56pgze5M7rXWrcgobRYjidw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:50.588839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-36272834-e4cd-4b49-b626-bec1a93dbcc5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Getting quotas for project 053712da02cd4299a4beedaa35ee459c. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:44:50.598729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-36272834-e4cd-4b49-b626-bec1a93dbcc5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Getting quotas for user 886f784cd65a441b893409078b3ecb6d and project 053712da02cd4299a4beedaa35ee459c. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:44:50.637530 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36272834-e4cd-4b49-b626-bec1a93dbcc5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.322414 Oct 28 18:44:50.644519 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4061/6458] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:44:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:50.812523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:50.814488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:50.825628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:50.826551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:50.827607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:50.829240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:50.830891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:50.831919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:51.092155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:51.101642 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae86939f-876b-445c-81e3-93074da87200 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1203 microversion: 2.1 time: 0.295985 Oct 28 18:44:51.116418 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2398/6459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:50 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1203 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:52.126683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:52.140928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:52.142429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1555968734", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1522057187", "security_groups": [{"name": "tempest-secgroup-smoke-677717112"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "d0bb043d-0adb-43d6-9cce-f004f84f27cb"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:52.159196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:52.159843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:52.160591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:52.161487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:52.162151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:52.162766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:52.340792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] validate_networks() for [('d0bb043d-0adb-43d6-9cce-f004f84f27cb', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:44:52.781058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:52.793930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79db9829-839a-40a9-8ab8-8a9d4130ba2e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1203 microversion: 2.1 time: 0.671121 Oct 28 18:44:52.794562 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4062/6460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:52 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1203 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:53.007416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Getting quotas for project 053712da02cd4299a4beedaa35ee459c. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:44:53.021896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Getting quotas for user 886f784cd65a441b893409078b3ecb6d and project 053712da02cd4299a4beedaa35ee459c. Resources: dict_keys(['metadata_items']) {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:44:53.077738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:44:53.079603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:44:53.081342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:44:53.081844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:44:53.082355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:44:53.095376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:53.095996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:53.096559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:53.098683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:53.099630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:53.100342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:53.128527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Getting quotas for project 053712da02cd4299a4beedaa35ee459c. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:44:53.135511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Getting quotas for user 886f784cd65a441b893409078b3ecb6d and project 053712da02cd4299a4beedaa35ee459c. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:44:53.155883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:44:53.159974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:44:53.221819 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-00a0a658-0300-489f-adaa-333e59942d8e tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.083139 Oct 28 18:44:53.222985 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2399/6461] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:44:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:44:53.246250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5cfa7c41-817e-4b55-87c2-d1df925c3ca8 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:53.247540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5cfa7c41-817e-4b55-87c2-d1df925c3ca8 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:53.372227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5cfa7c41-817e-4b55-87c2-d1df925c3ca8 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:53.382004 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5cfa7c41-817e-4b55-87c2-d1df925c3ca8 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1303 microversion: 2.1 time: 0.151149 Oct 28 18:44:53.382791 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4063/6462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:53 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:53.825409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:53.827477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:53.835720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:53.838125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:53.838855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:53.839755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:53.840493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:53.841119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:54.041515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:54.050942 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22c1b0cc-f8eb-4926-b725-95d8c4eef895 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1203 microversion: 2.1 time: 0.231552 Oct 28 18:44:54.052986 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2400/6463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:53 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1203 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:54.406057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:54.412817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:54.429098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:54.429816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:54.430257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:54.431002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:54.432333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:54.432855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:54.529280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:54.547968 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08a41005-d9b3-4207-8261-32d24f264a7a tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1355 microversion: 2.1 time: 0.145761 Oct 28 18:44:54.548684 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4064/6464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:54 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1355 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:55.082930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:55.083665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:55.099776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:55.102234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:55.103985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:55.107737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:55.108437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:55.109054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:55.423868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:55.468229 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3739170-ba55-47aa-ab9c-eb7318400ff9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1203 microversion: 2.1 time: 0.387236 Oct 28 18:44:55.469185 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2401/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:55 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1203 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:55.572546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:55.573788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:55.587384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:55.589651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:55.591722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:55.593721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:55.597861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:55.599074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:55.768001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:55.783131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a0879a2a-562e-486f-b2ab-0137b9f699c5 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1361 microversion: 2.1 time: 0.215228 Oct 28 18:44:55.783906 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4065/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:55 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:56.495977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:56.497118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:56.505531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:56.506565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:56.507176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:56.508115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:56.508740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:56.510073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:56.755338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:56.765378 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bdceeae2-1153-4af8-8082-9f82b4d38cfc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1203 microversion: 2.1 time: 0.274169 Oct 28 18:44:56.766057 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2402/6467] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:56 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:56.810130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:56.810596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:56.818434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:56.819032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:56.819533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:56.820500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:56.820968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:56.821401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:57.035575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:57.047198 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da4b8ef3-63a0-4be0-a837-a430638c1a4b tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1428 microversion: 2.1 time: 0.241737 Oct 28 18:44:57.058692 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4066/6468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:56 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1428 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:57.236145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-79c96ad7-b160-4c87-8cb3-e7b86d04c9ec req-ad30be32-60c7-46a7-b526-fa9eb207ad21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3464d4c5-432a-40b4-93c9-b1a46d2044f0", "tag": "cb490cef-7c49-4e3f-9968-f9e9907f3e8e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:57.256324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-79c96ad7-b160-4c87-8cb3-e7b86d04c9ec req-ad30be32-60c7-46a7-b526-fa9eb207ad21 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:57.257233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-79c96ad7-b160-4c87-8cb3-e7b86d04c9ec req-ad30be32-60c7-46a7-b526-fa9eb207ad21 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:57.258382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-79c96ad7-b160-4c87-8cb3-e7b86d04c9ec req-ad30be32-60c7-46a7-b526-fa9eb207ad21 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:57.272634 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-79c96ad7-b160-4c87-8cb3-e7b86d04c9ec req-ad30be32-60c7-46a7-b526-fa9eb207ad21 service nova] Creating event network-changed:cb490cef-7c49-4e3f-9968-f9e9907f3e8e for instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 on n-h1-862404-2 Oct 28 18:44:57.279672 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-79c96ad7-b160-4c87-8cb3-e7b86d04c9ec req-ad30be32-60c7-46a7-b526-fa9eb207ad21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263196 Oct 28 18:44:57.286384 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2403/6469] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:44:57.791584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:57.793113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:57.800991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:57.801833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:57.802436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:57.803517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:57.804263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:57.804841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:57.854149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-af6aa855-0d4f-45d5-9b13-28737a7bce69 req-45b8993d-1b25-44c1-997d-00ef504fa358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c", "name": "network-vif-plugged", "status": "completed", "tag": "2a6585e9-e141-427e-9975-cee6fa4ba39b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:57.873619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af6aa855-0d4f-45d5-9b13-28737a7bce69 req-45b8993d-1b25-44c1-997d-00ef504fa358 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:57.874500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af6aa855-0d4f-45d5-9b13-28737a7bce69 req-45b8993d-1b25-44c1-997d-00ef504fa358 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:57.875254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-af6aa855-0d4f-45d5-9b13-28737a7bce69 req-45b8993d-1b25-44c1-997d-00ef504fa358 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:57.889666 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-af6aa855-0d4f-45d5-9b13-28737a7bce69 req-45b8993d-1b25-44c1-997d-00ef504fa358 service nova] Creating event network-vif-plugged:2a6585e9-e141-427e-9975-cee6fa4ba39b for instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c on n-h2-862404-2 Oct 28 18:44:57.895581 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-af6aa855-0d4f-45d5-9b13-28737a7bce69 req-45b8993d-1b25-44c1-997d-00ef504fa358 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208315 Oct 28 18:44:57.896772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4067/6470] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:58.046111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:58.062473 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f4646369-b184-4db2-8735-17124ddda68f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1203 microversion: 2.1 time: 0.277206 Oct 28 18:44:58.063112 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2404/6471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:57 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1203 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:58.084553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:58.085289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:58.099318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:58.100133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:58.100775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:58.101648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:58.102309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:58.103195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:58.273853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:58.283407 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-54e29532-b7d1-4228-a043-b9c0427a0660 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1428 microversion: 2.1 time: 0.207879 Oct 28 18:44:58.284170 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4068/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:58 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1428 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:59.086276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:59.086964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:59.095199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:59.095694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:59.096335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:59.097216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:59.097856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:59.098300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:59.255355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:59.267195 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e16c73de-023d-4c33-b6a1-c3ca2788bc1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1203 microversion: 2.1 time: 0.185621 Oct 28 18:44:59.270702 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2405/6473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:59 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:59.307317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:59.307983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:44:59.316059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:59.316549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:59.316986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:59.317679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:59.318305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:59.318917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:59.529230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:59.538033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eea44a00-fe00-4639-811e-4582236676d9 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1428 microversion: 2.1 time: 0.235390 Oct 28 18:44:59.538826 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4069/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:59 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1428 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:00.294581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:00.295349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:00.303328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.304396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.305316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.306827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.307726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.308354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.465334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:00.473372 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b4dd9f3d-a1c0-4099-8cca-da8d227671fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1389 microversion: 2.1 time: 0.184926 Oct 28 18:45:00.473956 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2406/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:00 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1389 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:00.498765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:00.500049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:00.503016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:00.508248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.508744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.510020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.510901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.511519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.512133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.515522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=82 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:00.565994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:00.566853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:00.573596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.574335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.575022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.575935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.576679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.577518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.675998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:00.685372 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a75e18fe-caa8-4c70-9d53-fca24a42861b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1389 microversion: 2.1 time: 0.191456 Oct 28 18:45:00.703101 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4070/6476] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:00 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1389 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:45:00.708860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:00.709667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:00.717384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.718126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.718725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.719617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.720268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.720878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.742184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:00.752082 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a0424c5-0ace-4d56-b6bc-ee2901c70559 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1428 microversion: 2.1 time: 0.189827 Oct 28 18:45:00.767838 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2407/6477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:00 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1428 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:45:00.880674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:00.902160 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5cfae63e-fb5b-4804-aa81-29149db8aac5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1389 microversion: 2.1 time: 0.197109 Oct 28 18:45:00.902781 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4071/6478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:00 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1389 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:45:00.991874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:00.992421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:00.999904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:01.000321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:01.000927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:01.001645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:01.002257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:01.002858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:01.033246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:45:01.145919 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5bfc7b26-9828-49bf-ab7e-8bb3bef4b8f1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 204 len: 0 microversion: 2.1 time: 0.157564 Oct 28 18:45:01.146739 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2408/6479] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:45:00 2022] DELETE /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:45:01.156286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:01.157175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:01.166367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:01.167281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:01.167877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:01.169850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:01.170678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:01.171536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:01.380981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:01.389325 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e14f2731-3bb6-4515-a937-3d65708a30c1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1395 microversion: 2.1 time: 0.237859 Oct 28 18:45:01.390576 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4072/6480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:01 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1395 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:01.778486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:01.780047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:01.791873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:01.792848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:01.793818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:01.795033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:01.795653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:01.796953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:02.046823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:02.089840 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-80886743-bc73-447f-b22d-9eb17ef93e86 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1428 microversion: 2.1 time: 0.313862 Oct 28 18:45:02.108366 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2409/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:01 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1428 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:02.413953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:02.414764 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:02.425012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:02.425891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:02.426712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:02.427982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:02.428886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:02.429611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:02.639474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:02.648614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-781f0a8a-83e2-43a4-a373-e768779067a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1395 microversion: 2.1 time: 0.238516 Oct 28 18:45:02.651071 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4073/6482] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:02 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1395 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:03.127503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:03.128980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:03.151926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:03.153627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=10 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:03.156948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:03.158391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:03.159330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:03.160617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:03.161393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:03.162067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:03.369126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:03.379452 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-532a2f7d-863a-4fb9-bb97-cecbfedf8b35 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1428 microversion: 2.1 time: 0.256715 Oct 28 18:45:03.393059 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2410/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:03 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1428 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:03.603220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1f51425b-5740-4088-95b4-057d3ea18870 req-2544809b-261a-474d-a7eb-ab765b60fade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3464d4c5-432a-40b4-93c9-b1a46d2044f0", "name": "network-vif-plugged", "status": "completed", "tag": "cb490cef-7c49-4e3f-9968-f9e9907f3e8e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:03.615756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:03.624943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f51425b-5740-4088-95b4-057d3ea18870 req-2544809b-261a-474d-a7eb-ab765b60fade service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:03.625571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f51425b-5740-4088-95b4-057d3ea18870 req-2544809b-261a-474d-a7eb-ab765b60fade service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:03.626728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1f51425b-5740-4088-95b4-057d3ea18870 req-2544809b-261a-474d-a7eb-ab765b60fade service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:03.640957 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1f51425b-5740-4088-95b4-057d3ea18870 req-2544809b-261a-474d-a7eb-ab765b60fade service nova] Creating event network-vif-plugged:cb490cef-7c49-4e3f-9968-f9e9907f3e8e for instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 on n-h1-862404-2 Oct 28 18:45:03.652492 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1f51425b-5740-4088-95b4-057d3ea18870 req-2544809b-261a-474d-a7eb-ab765b60fade service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099753 Oct 28 18:45:03.654281 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4074/6484] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:03.688672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:03.690146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:03.713703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f04f4e1c-8c91-4fed-b72c-1e48cdcb8781 req-3334bf6e-a1a9-4113-8ed9-be244db95bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c", "name": "network-vif-deleted", "tag": "2a6585e9-e141-427e-9975-cee6fa4ba39b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:03.731980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:03.735482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:03.738285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:03.739889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:03.744854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:03.745614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f04f4e1c-8c91-4fed-b72c-1e48cdcb8781 req-3334bf6e-a1a9-4113-8ed9-be244db95bc0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:03.747771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f04f4e1c-8c91-4fed-b72c-1e48cdcb8781 req-3334bf6e-a1a9-4113-8ed9-be244db95bc0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:03.751207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f04f4e1c-8c91-4fed-b72c-1e48cdcb8781 req-3334bf6e-a1a9-4113-8ed9-be244db95bc0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:03.751639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:03.784940 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f04f4e1c-8c91-4fed-b72c-1e48cdcb8781 req-3334bf6e-a1a9-4113-8ed9-be244db95bc0 service nova] Creating event network-vif-deleted:2a6585e9-e141-427e-9975-cee6fa4ba39b for instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c on n-h2-862404-2 Oct 28 18:45:03.795347 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f04f4e1c-8c91-4fed-b72c-1e48cdcb8781 req-3334bf6e-a1a9-4113-8ed9-be244db95bc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087648 Oct 28 18:45:03.796484 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4075/6485] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:45:03.810615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:03.965788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:03.975710 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-12dd409b-8204-4142-b5f2-bcefbcce5c1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1353 microversion: 2.1 time: 0.300418 Oct 28 18:45:03.976669 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2411/6486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:03 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1353 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:04.409821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:04.411799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:04.429205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:04.430036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:04.430780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:04.431964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:04.432843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:04.433903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:04.615442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:04.626790 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d564fc7f-9265-413f-a7d1-1bfef4fa9e21 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1428 microversion: 2.1 time: 0.223402 Oct 28 18:45:04.628846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4076/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:04 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1428 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:05.004314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:05.005676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:05.014677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:05.015440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:05.016299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:05.017580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:05.018266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:05.018922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:05.110221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:05.120016 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14d79e4a-34c8-4fe7-afab-2daec6a7e728 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1188 microversion: 2.1 time: 0.121236 Oct 28 18:45:05.121910 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2412/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:04 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1188 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:05.651413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:05.652085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:05.659099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:05.659592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:05.660081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:05.660795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:05.661259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:05.661721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:05.810739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:05.819558 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-57ddf47b-21e9-4092-b012-a0cf0759b51f tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1608 microversion: 2.1 time: 0.172612 Oct 28 18:45:05.820176 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4077/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:05 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1608 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:05.844041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:05.844819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:05.852278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:05.853621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:05.854296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:05.855233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:05.856110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:05.856746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.076484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:06.094781 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0bd49dd9-5421-4fb2-9ffd-8e5140a71328 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1608 microversion: 2.1 time: 0.255243 Oct 28 18:45:06.095627 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2413/6490] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:05 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1608 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:06.120744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:06.121952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:06.128946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:06.134802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:06.135369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.136527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:06.137016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:06.137691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.153735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:06.154540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:06.162907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:06.167478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:06.168127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.169041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:06.170825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:06.172177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.271507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:06.284325 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e0435976-39c0-4e3e-9fb1-6317d771a7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1188 microversion: 2.1 time: 0.138638 Oct 28 18:45:06.289168 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2414/6491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:06 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1188 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:06.411416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:06.420732 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d91441d5-80e8-4c24-bdc9-b0424e8e10ef tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1608 microversion: 2.1 time: 0.303922 Oct 28 18:45:06.422183 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4078/6492] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:06 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1608 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:07.327711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:07.328396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:07.337497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:07.338529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:07.339277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:07.340323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:07.341205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:07.342597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:07.454411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:07.510504 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-70bb1d83-a6eb-4ceb-b48b-d6fead30fee2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1188 microversion: 2.1 time: 0.188301 Oct 28 18:45:07.518704 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2415/6493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:07 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1188 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:08.553528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:08.554864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:08.567657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:08.568521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:08.572232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:08.573648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:08.574328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:08.574961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:08.669411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:08.677828 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc867fbb-90c1-432a-91ce-8311e1d96d24 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1188 microversion: 2.1 time: 0.134074 Oct 28 18:45:08.679290 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4079/6494] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:08 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1188 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:08.921540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b3b9da23-836e-44b1-89c2-aaae02fd11b6 req-689b94c0-16e8-49ee-8695-5473d5d16cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3464d4c5-432a-40b4-93c9-b1a46d2044f0", "tag": "cb490cef-7c49-4e3f-9968-f9e9907f3e8e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:08.937507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b3b9da23-836e-44b1-89c2-aaae02fd11b6 req-689b94c0-16e8-49ee-8695-5473d5d16cc6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:08.938329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b3b9da23-836e-44b1-89c2-aaae02fd11b6 req-689b94c0-16e8-49ee-8695-5473d5d16cc6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:08.939149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b3b9da23-836e-44b1-89c2-aaae02fd11b6 req-689b94c0-16e8-49ee-8695-5473d5d16cc6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:08.954532 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b3b9da23-836e-44b1-89c2-aaae02fd11b6 req-689b94c0-16e8-49ee-8695-5473d5d16cc6 service nova] Creating event network-changed:cb490cef-7c49-4e3f-9968-f9e9907f3e8e for instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 on n-h1-862404-2 Oct 28 18:45:08.960702 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b3b9da23-836e-44b1-89c2-aaae02fd11b6 req-689b94c0-16e8-49ee-8695-5473d5d16cc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044095 Oct 28 18:45:08.961785 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2416/6495] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:45:09.704354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:09.704998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:09.713117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:09.713627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:09.714079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:09.726879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:09.729549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:09.731688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:09.855111 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:09.856424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:09.856908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:09.857389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lazy-loading 'fault' on Instance uuid 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:45:09.964900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:09.977066 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf3b17e1-67e1-44d1-a8ed-3ad3646f5d6a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 200 len: 1147 microversion: 2.1 time: 0.273827 Oct 28 18:45:09.991870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4080/6496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:09 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 1147 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:11.008360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:11.009582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:11.016262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:11.016804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:11.017139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:11.018045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:11.018668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:11.019445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:11.035024 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c HTTP/1.1 Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c'} Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:11.036730 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6b83c208-5261-41af-ae64-24fbbdfe4bc6 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 404 len: 111 microversion: 2.1 time: 0.035216 Oct 28 18:45:11.041992 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2417/6497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:11 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:45:13.212993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:13.214616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:13.222326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:13.223367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:13.224229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:13.225176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:13.225862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:13.226531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:13.243684 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c HTTP/1.1 Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c'} Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:45:13.246130 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.250412 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.253561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:45:13.254850 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e64feb2a-ccc8-4ece-bef7-2251ae82faac tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 404 len: 111 microversion: 2.1 time: 0.046777 Oct 28 18:45:13.255438 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4081/6498] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:45:13 2022] DELETE /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:45:13.264353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:13.264891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:13.271808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:13.273693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:13.274187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:13.276098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:13.276821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:13.277334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:13.278576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:13.297391 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c HTTP/1.1 Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c'} Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:13.298952 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d4afef2-c5b4-4b0f-ab7a-25e0e6cc3d97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c" status: 404 len: 111 microversion: 2.1 time: 0.040083 Oct 28 18:45:13.305494 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2418/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:13 2022] GET /compute/v2.1/servers/46802e8d-5e3d-4ff0-86bc-bc1c3df28a5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:45:25.598335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6a176ee-80b2-442d-a497-eba2c33b6cdc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'create', calling method: .version_select at 0x7f78dc8f0b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-829193488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJerTO/9RwZTXjFjxIr7HQZqfRbjIAbppvOOk6ajAxgLGjfkx07o5sht7kFnO2GnpoMVzMzXwI5KKmiWg88zxRIplvPInaaQla2nx9DlDv2es6AAzlQcePmZDzxE+JgzQQ=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:25.614059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=25 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:25.615042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=61 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:25.632961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c6a176ee-80b2-442d-a497-eba2c33b6cdc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:45:25.640943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-c6a176ee-80b2-442d-a497-eba2c33b6cdc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for user c1e3f916f6424ca4927b7499c797dbe7 and project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:45:25.686735 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6a176ee-80b2-442d-a497-eba2c33b6cdc tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.093756 Oct 28 18:45:25.687856 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4082/6500] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:45:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:27.691263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-805151534", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "f0f811b3-4af5-46e0-8f17-8bcec485f3c3"}], "key_name": "tempest-TestNetworkBasicOps-829193488", "security_groups": [{"name": "tempest-secgroup-smoke-929597216"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:27.741280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=33 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:27.745786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:27.878724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] validate_networks() for [('f0f811b3-4af5-46e0-8f17-8bcec485f3c3', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:45:28.583490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:45:28.584234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:45:28.584780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:45:28.585267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:45:28.585762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:45:28.605965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:28.606721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:28.607329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:28.608325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:28.608979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:28.609593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:28.630585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:45:28.637378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for user c1e3f916f6424ca4927b7499c797dbe7 and project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:45:28.661610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:45:28.669423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:45:28.741642 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b3958f56-1162-40ae-b2a2-2d65b8931d28 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.056298 Oct 28 18:45:28.744109 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2419/6501] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:45:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:45:28.755499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d033c642-93e9-4bb4-a7ea-305f7f400d66 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:28.756826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d033c642-93e9-4bb4-a7ea-305f7f400d66 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:28.893137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d033c642-93e9-4bb4-a7ea-305f7f400d66 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:28.905989 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d033c642-93e9-4bb4-a7ea-305f7f400d66 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1247 microversion: 2.1 time: 0.153894 Oct 28 18:45:28.907143 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4083/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:28 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1247 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:45:29.938963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:29.940605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:29.951872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:29.952387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:29.952825 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:29.953537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:29.953989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:29.956010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:30.077916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:30.108409 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2c9b2796-585f-40ba-8bb2-07d272afc27b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1299 microversion: 2.1 time: 0.179306 Oct 28 18:45:30.115254 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2420/6503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:29 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:31.134931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:31.136471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:31.145268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:31.146054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:31.146603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:31.147429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:31.148032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:31.148759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:31.263747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:31.272833 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05717f76-9846-4339-a5fb-bf69620f6842 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1305 microversion: 2.1 time: 0.142981 Oct 28 18:45:31.280808 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4084/6504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:31 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1305 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:32.299065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:32.299862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:32.317804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:32.318671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:32.319330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:32.320294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:32.321539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:32.323449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:32.533045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:32.542729 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1e4b4751-b784-44cd-b5f2-e459049be13e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1372 microversion: 2.1 time: 0.248517 Oct 28 18:45:32.544364 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2421/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:32 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:33.130439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-81bf017e-91bf-4ada-886b-546203fa2364 req-ac93b471-c628-4a60-b9d2-393f22ea944f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022f549e-6c31-4ce0-90b7-6b5018ec6625", "tag": "b06ef7cd-8e13-4947-9eaf-806a22416f38"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:33.166060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81bf017e-91bf-4ada-886b-546203fa2364 req-ac93b471-c628-4a60-b9d2-393f22ea944f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:33.167405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81bf017e-91bf-4ada-886b-546203fa2364 req-ac93b471-c628-4a60-b9d2-393f22ea944f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:33.168138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-81bf017e-91bf-4ada-886b-546203fa2364 req-ac93b471-c628-4a60-b9d2-393f22ea944f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:33.189036 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-81bf017e-91bf-4ada-886b-546203fa2364 req-ac93b471-c628-4a60-b9d2-393f22ea944f service nova] Creating event network-changed:b06ef7cd-8e13-4947-9eaf-806a22416f38 for instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 on n-h2-862404-2 Oct 28 18:45:33.206148 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-81bf017e-91bf-4ada-886b-546203fa2364 req-ac93b471-c628-4a60-b9d2-393f22ea944f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080579 Oct 28 18:45:33.207423 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4085/6506] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:33.572049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:33.573268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:33.592086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:33.592578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:33.593010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:33.593710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:33.594164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:33.594594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:33.798729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:33.809032 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-51351a3f-dfe4-4aaa-b242-d932b206e175 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1372 microversion: 2.1 time: 0.242013 Oct 28 18:45:33.822073 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2422/6507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:33 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:34.836798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:34.837629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:34.854952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:34.856154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:34.856609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:34.857338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:34.857806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:34.858236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:35.115929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:35.132819 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a89e9d1-0523-4a10-ace3-5fb5b0a14017 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1372 microversion: 2.1 time: 0.301975 Oct 28 18:45:35.136197 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4086/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:34 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1372 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:36.159093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:36.159723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:36.168907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:36.169705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:36.170333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:36.171301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:36.172668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:36.174188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:36.435615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:36.444765 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-302925be-6fbd-4d6d-9302-5372ff6b576e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1372 microversion: 2.1 time: 0.289551 Oct 28 18:45:36.446838 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2423/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:36 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1372 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:37.470544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:37.471184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:37.486220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:37.486730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:37.487448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:37.488219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:37.488697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:37.489133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:37.685223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:37.697354 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d24858fb-f62a-48fb-b9b0-c349c0e6131e tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1372 microversion: 2.1 time: 0.232447 Oct 28 18:45:37.698729 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4087/6510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:37 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:37.846744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4d800701-1b88-4d10-a5a7-c206c230325c req-af4c7d65-e6db-42cd-9613-ae8d85b17dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022f549e-6c31-4ce0-90b7-6b5018ec6625", "name": "network-vif-plugged", "status": "completed", "tag": "b06ef7cd-8e13-4947-9eaf-806a22416f38"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:37.866955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d800701-1b88-4d10-a5a7-c206c230325c req-af4c7d65-e6db-42cd-9613-ae8d85b17dc8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:37.867753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d800701-1b88-4d10-a5a7-c206c230325c req-af4c7d65-e6db-42cd-9613-ae8d85b17dc8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:37.874070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d800701-1b88-4d10-a5a7-c206c230325c req-af4c7d65-e6db-42cd-9613-ae8d85b17dc8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:37.889044 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4d800701-1b88-4d10-a5a7-c206c230325c req-af4c7d65-e6db-42cd-9613-ae8d85b17dc8 service nova] Creating event network-vif-plugged:b06ef7cd-8e13-4947-9eaf-806a22416f38 for instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 on n-h2-862404-2 Oct 28 18:45:37.895199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4d800701-1b88-4d10-a5a7-c206c230325c req-af4c7d65-e6db-42cd-9613-ae8d85b17dc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052336 Oct 28 18:45:37.896484 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2424/6511] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:38.720977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:38.721591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:38.729617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:38.730341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:38.730961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:38.731895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:38.732528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:38.733133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:38.904395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:38.915417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:38.941247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-63a7e7ca-0d44-46fc-b65f-10ba7b4c2558 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1372 microversion: 2.1 time: 0.223819 Oct 28 18:45:38.942479 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4088/6512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:38 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:39.971034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:39.971677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:39.973712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:39.975034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:39.984893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:39.985677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:39.986363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:39.987678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:39.988726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:39.989887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:40.179367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:40.189464 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2790f509-c4ab-4719-8f4d-2aa9cd9db7c5 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1545 microversion: 2.1 time: 0.222749 Oct 28 18:45:40.189990 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2425/6513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:39 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1545 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:45:40.212809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:40.214055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:40.223058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:40.223865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:40.224622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:40.225604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:40.226300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:40.235746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:40.418946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:40.432905 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa9966d7-a022-4189-b58a-d385f10cbe04 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1545 microversion: 2.1 time: 0.223319 Oct 28 18:45:40.434238 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4089/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:40 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1545 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:41.505582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2008525552", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ff7e65f0-751c-4847-a79c-e99aea74899a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ca633313-4d95-4fc0-8f7a-c33539b3174e"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:41.576390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] validate_networks() for [('ca633313-4d95-4fc0-8f7a-c33539b3174e', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:45:42.015225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:45:42.015887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:45:42.016478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:45:42.017647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:45:42.018183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:45:42.030626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:42.031277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:42.032409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:42.033260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:42.033820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:42.034844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:42.067909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:45:42.074614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:45:42.151843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:45:42.154119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff7e65f0-751c-4847-a79c-e99aea74899a',volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:45:42.360745 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c74f8598-db22-42c5-b05b-3b033f4f8294 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858880 Oct 28 18:45:42.361805 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2426/6515] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:45:42.373593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f7709939-b7fe-4067-a088-b40fe5ec7ac7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:42.374311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f7709939-b7fe-4067-a088-b40fe5ec7ac7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:42.458931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f7709939-b7fe-4067-a088-b40fe5ec7ac7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:42.478025 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f7709939-b7fe-4067-a088-b40fe5ec7ac7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1071 microversion: 2.1 time: 0.108606 Oct 28 18:45:42.480133 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4090/6516] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:42 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1071 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:43.503639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:43.504654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:43.514182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:43.514689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:43.515135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:43.516333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:43.516798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:43.517233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:43.632398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:43.643855 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3d24caaa-915f-4193-b66d-3aa4bc70383b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1169 microversion: 2.1 time: 0.145031 Oct 28 18:45:43.647946 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2427/6517] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:43 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1169 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:44.666870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:44.667997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:44.685148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:44.687369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:44.689914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:44.690818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:44.702030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:44.702823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:44.822461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:44.832591 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c1847d4-5116-4af0-8f94-86c529ec4c8f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1187 microversion: 2.1 time: 0.169705 Oct 28 18:45:44.836638 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4091/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:44 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1187 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:45.863399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:45.865423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:45.882144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:45.897290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:45.897756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:45.912244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:45.912776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:45.913232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:46.442150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:46.456746 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9cf9daf8-e0d9-4393-a4c8-081203cd9b59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1229 microversion: 2.1 time: 0.601047 Oct 28 18:45:46.457926 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2428/6519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:45 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1229 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:46.682754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3ec7e7f5-25b7-416b-bc52-0e9513dca171 req-ca250dc6-0ceb-4689-b465-212341bd84b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f83034-8908-443e-83ee-1a3843970ef3", "tag": "e81339fe-fa96-46a7-ab0b-65443053b0a4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:46.734196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3ec7e7f5-25b7-416b-bc52-0e9513dca171 req-ca250dc6-0ceb-4689-b465-212341bd84b2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:46.734696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3ec7e7f5-25b7-416b-bc52-0e9513dca171 req-ca250dc6-0ceb-4689-b465-212341bd84b2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:46.735133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3ec7e7f5-25b7-416b-bc52-0e9513dca171 req-ca250dc6-0ceb-4689-b465-212341bd84b2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:46.767293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3ec7e7f5-25b7-416b-bc52-0e9513dca171 req-ca250dc6-0ceb-4689-b465-212341bd84b2 service nova] Creating event network-changed:e81339fe-fa96-46a7-ab0b-65443053b0a4 for instance 40f83034-8908-443e-83ee-1a3843970ef3 on n-h1-862404-2 Oct 28 18:45:46.786539 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3ec7e7f5-25b7-416b-bc52-0e9513dca171 req-ca250dc6-0ceb-4689-b465-212341bd84b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108053 Oct 28 18:45:46.787643 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4092/6520] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:47.485421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:47.486060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:47.499542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:47.500061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:47.514694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:47.517351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:47.521226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:47.521890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:48.672546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:48.682017 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dfacacc2-4398-448b-bd9d-ce7c0151fd9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1229 microversion: 2.1 time: 1.200662 Oct 28 18:45:48.682616 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2429/6521] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:47 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1229 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:45:49.710128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:49.710914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:49.719582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:49.720104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:49.720543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:49.721260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:49.721716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:49.722143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:50.016846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:50.026142 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03f0b714-2836-4e22-998c-4d089a93d950 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1229 microversion: 2.1 time: 0.320206 Oct 28 18:45:50.049576 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4093/6522] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:49 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1229 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:51.056401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:51.058423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:51.093999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:51.094647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:51.095841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:51.096176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:51.096759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:51.098055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:51.383940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:51.393539 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2fea62e4-9be3-4952-a980-d618aae7f426 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1229 microversion: 2.1 time: 0.342851 Oct 28 18:45:51.394917 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2430/6523] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:51 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1229 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:52.424600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:52.426155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:52.434811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:52.435610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:52.436422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:52.437372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:52.438040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:52.438543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:52.479548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:52.656088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:52.664768 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76c28176-e8c8-46ad-90fc-35c4c5f2df2f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.248765 Oct 28 18:45:52.665676 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4094/6524] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:52 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:53.694105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:53.694718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:53.698157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:53.700057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:53.712432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:53.712933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:53.713590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:53.714545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:53.715188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:53.716122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:53.933415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:53.942456 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3c12867-6639-456f-a8f5-41e672aa4ee8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.252091 Oct 28 18:45:53.956800 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2431/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:53 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:54.965971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:54.966598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:54.974050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:54.975703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:54.977238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:54.978467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:54.979319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:54.979955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:55.201533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:55.214843 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82568179-3b9c-47e5-ad1e-2ef97a521541 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.253067 Oct 28 18:45:55.216542 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4095/6526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:54 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:56.240115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:56.240868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:56.249028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:56.249669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:56.250369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:56.251216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:56.251754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:56.252465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:56.403179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:56.413160 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9edc6094-bd91-46c9-95a1-33b2fc4ee952 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.176621 Oct 28 18:45:56.415088 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2432/6527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:56 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:57.440181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:57.441661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:57.450527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:57.453616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:57.454195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:57.454717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:57.455956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:57.456537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:57.457622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:57.467404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=59 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:57.674921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:57.685284 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82873578-b0cc-44e8-858e-5b5af4c256f0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.250380 Oct 28 18:45:57.687428 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4096/6528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:57 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:58.708480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:58.709101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:58.712871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:58.718074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:58.718570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:58.719007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:58.719919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:58.720551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:58.721060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:58.725817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=73 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:58.872020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:58.881215 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f7014b2c-28c6-4c4b-a349-1c08992f66ae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.176490 Oct 28 18:45:58.890330 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2433/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:58 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:59.910571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:59.911281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:45:59.922134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:59.922854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:59.924170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:59.925095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:59.925769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:59.926376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:00.123434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:00.136693 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2485237b-9dc0-4b81-a0df-baef22f8f2d8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.235180 Oct 28 18:46:00.138363 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4097/6530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:59 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:01.161836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:01.164464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:01.176351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:01.177095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:01.177755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:01.178664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:01.180080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:01.180715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:01.348888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:01.352872 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9589fb25-25a8-462a-a2fa-4ac4a5f3a0a2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.196092 Oct 28 18:46:01.353716 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2434/6531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:01 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:46:02.383601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:02.383601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:02.388908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:02.389409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:02.390305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:02.391215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:02.392173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:02.392964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:02.577373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:02.588434 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-70ecab14-b200-4d00-98a5-92f8539c2083 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.214887 Oct 28 18:46:02.589043 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4098/6532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:02 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:03.615996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:03.615996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:03.646360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-268d715a-7abe-4bd1-8c13-7e6207ebc100 req-9d120e69-fafd-452e-9738-39a2d29655bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f83034-8908-443e-83ee-1a3843970ef3", "name": "network-vif-plugged", "status": "completed", "tag": "e81339fe-fa96-46a7-ab0b-65443053b0a4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:03.661833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-268d715a-7abe-4bd1-8c13-7e6207ebc100 req-9d120e69-fafd-452e-9738-39a2d29655bf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:03.662652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-268d715a-7abe-4bd1-8c13-7e6207ebc100 req-9d120e69-fafd-452e-9738-39a2d29655bf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:03.663114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:03.663809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-268d715a-7abe-4bd1-8c13-7e6207ebc100 req-9d120e69-fafd-452e-9738-39a2d29655bf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:03.665893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:03.666593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:03.668317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:03.669988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:03.670576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:03.687370 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-268d715a-7abe-4bd1-8c13-7e6207ebc100 req-9d120e69-fafd-452e-9738-39a2d29655bf service nova] Creating event network-vif-plugged:e81339fe-fa96-46a7-ab0b-65443053b0a4 for instance 40f83034-8908-443e-83ee-1a3843970ef3 on n-h1-862404-2 Oct 28 18:46:03.700977 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-268d715a-7abe-4bd1-8c13-7e6207ebc100 req-9d120e69-fafd-452e-9738-39a2d29655bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058821 Oct 28 18:46:03.702241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4099/6533] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:46:04.019943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:04.047342 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a9acd0a-3d27-4d16-8f2a-3b96ac43a2ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.436580 Oct 28 18:46:04.048518 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2435/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:03 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:05.082166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:05.082871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:05.089953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:05.090445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:05.091068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:05.091781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:05.092264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:05.092685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:05.326941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:05.338985 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c18f049-e8e8-4ee8-83c9-1618e68c9e09 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1217 microversion: 2.1 time: 0.258180 Oct 28 18:46:05.339762 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4100/6535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:05 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1217 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:06.369189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:06.369869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:06.387184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:06.387686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:06.388155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:06.396952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:06.397527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:06.398175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:06.815998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:06.828185 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d376eaf-e114-483c-99c0-777875b24359 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1403 microversion: 2.1 time: 0.462348 Oct 28 18:46:06.830959 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2436/6536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:06 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1403 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:06.855793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:06.856588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:06.870022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:06.870022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:06.870022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:06.870758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:06.871227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:06.871659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:07.351854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:07.363055 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae72a00b-82ae-4a4e-bc5e-f368f4a31a62 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1403 microversion: 2.1 time: 0.512153 Oct 28 18:46:07.368384 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4101/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:06 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1403 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:07.394690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1511419096"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:07.397259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:07.410302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:07.414093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:07.419196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:07.420263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:07.420913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:07.421579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:07.599631 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.compute.api [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Attempting to quiesce instance before volume snapshot. Oct 28 18:46:07.675911 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.compute.api [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 28 18:46:07.860629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Creating snapshot from volume ff7e65f0-751c-4847-a79c-e99aea74899a. {{(pid=120679) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Oct 28 18:46:09.183885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:09.184410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:09.194080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:09.194571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:09.195026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:09.195836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:09.196651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:09.196651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:09.247898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:46:09.566086 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84dcd2c8-3cf3-4dfa-9391-6e09cf5ed22b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 204 len: 0 microversion: 2.1 time: 0.386167 Oct 28 18:46:09.576441 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4102/6538] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:46:09 2022] DELETE /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:46:09.611081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:09.611955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:09.633617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:09.637461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:09.639855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:09.641948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:09.644464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:09.645297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:09.833589 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78ab0653-ab76-4a8d-ae1e-c8664bac7aa2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3/action" status: 202 len: 0 microversion: 2.1 time: 2.442914 Oct 28 18:46:09.834689 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2437/6539] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:46:07 2022] POST /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3/action => generated 0 bytes in 2445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:46:10.230677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:10.238794 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-899cb044-aba7-4f6e-8b90-51eb0eb9b3d1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1551 microversion: 2.1 time: 0.656945 Oct 28 18:46:10.239925 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4103/6540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:09 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1551 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:11.173056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2123359573", "imageRef": "79ffc68b-8f7d-4c14-b955-c5c76b8d1e01", "flavorRef": "452", "networks": [{"uuid": "ca633313-4d95-4fc0-8f7a-c33539b3174e"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:11.258158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] validate_networks() for [('ca633313-4d95-4fc0-8f7a-c33539b3174e', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:46:11.273354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:11.274081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:11.283130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:11.284334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:11.284786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:11.285562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:11.286091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:11.286519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:12.077617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:12.090355 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5cda600c-1961-4790-b770-fd8bdcf00ce9 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 200 len: 1551 microversion: 2.1 time: 0.823868 Oct 28 18:46:12.108884 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4104/6541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:11 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 1551 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:12.225562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:46:12.226163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:46:12.226684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:46:12.227124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:46:12.227561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:46:12.246558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:12.247052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:12.247691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:12.248279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:12.248903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:12.249587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:12.277486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1039f8a0-c9d5-4376-9625-1c915c36d554 req-cdb82dd7-0b07-471f-abf3-b38a3a83355f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022f549e-6c31-4ce0-90b7-6b5018ec6625", "name": "network-vif-deleted", "tag": "b06ef7cd-8e13-4947-9eaf-806a22416f38"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:12.302886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:46:12.305609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1039f8a0-c9d5-4376-9625-1c915c36d554 req-cdb82dd7-0b07-471f-abf3-b38a3a83355f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:12.306526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1039f8a0-c9d5-4376-9625-1c915c36d554 req-cdb82dd7-0b07-471f-abf3-b38a3a83355f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:12.307336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1039f8a0-c9d5-4376-9625-1c915c36d554 req-cdb82dd7-0b07-471f-abf3-b38a3a83355f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:12.316206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:46:12.325473 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1039f8a0-c9d5-4376-9625-1c915c36d554 req-cdb82dd7-0b07-471f-abf3-b38a3a83355f service nova] Creating event network-vif-deleted:b06ef7cd-8e13-4947-9eaf-806a22416f38 for instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 on n-h2-862404-2 Oct 28 18:46:12.339771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:46:12.342863 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1039f8a0-c9d5-4376-9625-1c915c36d554 req-cdb82dd7-0b07-471f-abf3-b38a3a83355f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068976 Oct 28 18:46:12.344913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='524abbc6-fa16-47bc-b621-4a8cffe4939a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:46:12.353873 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4105/6542] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:12.463727 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9aa3ca6e-d339-4b65-86c2-f740e1d2d9d4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.295981 Oct 28 18:46:12.468037 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2438/6543] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:46:12.487127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d76606e5-528d-4a19-9072-5471ffeaf73c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:12.489959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d76606e5-528d-4a19-9072-5471ffeaf73c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:12.612904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d76606e5-528d-4a19-9072-5471ffeaf73c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:12.625996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d76606e5-528d-4a19-9072-5471ffeaf73c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1230 microversion: 2.1 time: 0.148987 Oct 28 18:46:12.627131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4106/6544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:12 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1230 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:13.120220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:13.120960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 022f549e-6c31-4ce0-90b7-6b5018ec6625] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:13.128022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:13.128624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:13.129253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:13.130048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:13.130597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:13.131111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:13.147839 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] HTTP exception thrown: Instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 could not be found. Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Request method failure captured: Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 HTTP/1.1 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCLgVqRhj3qjlCekfhV9HUG1QohtkKImJaZEUegU7dAoLG56Kr0S3ZUUWB9l3jxlfRGsVfEIcI_PXlY-PlOyXksIZEtp3PBTZ_HXuEGChyzfSXYU2Yv0YgRYF9Jr5FjrC1u8XIfeR8ShWXQK8S6gUm0ivtFP-f9XBCym8Wv5Zz4VUbI Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 813c0d60ff9d4b3d92f1be8041a24742 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestNetworkBasicOps-823751000 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_813c0d60ff9d4b3d92f1be8041a24742", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestNetworkBasicOps-823751000 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 813c0d60ff9d4b3d92f1be8041a24742 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestNetworkBasicOps-823751000 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestNetworkBasicOps-823751000-project Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c1e3f916f6424ca4927b7499c797dbe7 Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestNetworkBasicOps-823751000-project Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 could not be found. Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '022f549e-6c31-4ce0-90b7-6b5018ec6625'} Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 could not be found. Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 could not be found. Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:46:13.150016 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 could not be found. Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Returning 404 to user: Instance 022f549e-6c31-4ce0-90b7-6b5018ec6625 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f600732-1cf3-46c5-8cb6-16b25ab626ea tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625" status: 404 len: 111 microversion: 2.1 time: 0.036280 Oct 28 18:46:13.156278 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2439/6545] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:13 2022] GET /compute/v2.1/servers/022f549e-6c31-4ce0-90b7-6b5018ec6625 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:46:13.344372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc907294-f113-40ba-8e60-58f8cc6b89cd tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '.version_select at 0x7f78dd72f310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:13.378334 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc907294-f113-40ba-8e60-58f8cc6b89cd tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-829193488" status: 202 len: 0 microversion: 2.1 time: 0.038582 Oct 28 18:46:13.378931 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4107/6546] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 18:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-829193488 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:46:13.649740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:13.650390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:13.657956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:13.658498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:13.658957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:13.659687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:13.660686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:13.661136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 28 18:46:13.695291 n-d-862404-2 devstack@n-api.service[120679]: ERROR sqlalchemy.pool.impl.QueuePool Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: Exception ignored in: . at 0x7f78e2541e50> Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: Traceback (most recent call last): Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: connection_record.checkin() Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: pool.dispatch.checkin(connection, self) Oct 28 18:46:13.697867 n-d-862404-2 devstack@n-api.service[120679]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 28 18:46:13.701416 n-d-862404-2 devstack@n-api.service[120679]: fn(*args, **kw) Oct 28 18:46:13.701416 n-d-862404-2 devstack@n-api.service[120679]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 28 18:46:13.727249 n-d-862404-2 devstack@n-api.service[120679]: time.sleep(0) Oct 28 18:46:13.727249 n-d-862404-2 devstack@n-api.service[120679]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 28 18:46:13.733804 n-d-862404-2 devstack@n-api.service[120679]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 28 18:46:13.733804 n-d-862404-2 devstack@n-api.service[120679]: AssertionError: do not call blocking functions from the mainloop Oct 28 18:46:13.836728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:13.856629 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df1ce9ff-79ad-4af6-8018-092f447c096d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1282 microversion: 2.1 time: 0.211120 Oct 28 18:46:13.857238 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2440/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:13 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:14.889357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:14.890953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:14.900677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:14.901956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:14.902831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:14.904073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:14.906002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:14.911931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:15.095413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:15.105744 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2aeb25f6-cec5-4e83-8833-7a615a07f7f8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1300 microversion: 2.1 time: 0.224555 Oct 28 18:46:15.120645 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4108/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:14 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1300 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:16.144565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:16.146161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:16.170860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:16.171052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:16.172218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:16.175310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:16.178145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:16.181644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:16.899205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:16.900618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:16.930217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:16.931124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:16.931935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:16.935113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:16.936550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:16.941543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:17.021015 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7d2359c-733b-43c9-b780-61a768d2b9a1 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.126406 Oct 28 18:46:17.026714 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4109/6549] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 18:46:16 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0/os-server-password => generated 116 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:17.646460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:17.661272 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7b2b47e6-b3aa-4974-a8a1-3147deaa53ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 1.522020 Oct 28 18:46:17.668889 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2441/6550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:16 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:18.554927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-65578899-0892-4288-824c-f1aa60c6c77f req-82066dcc-e434-4aca-9f50-def9a291a62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8ae5bd-4826-4aaf-bc47-721cf4706af6", "tag": "bff23640-b4b7-42c5-a676-f91c70123df9"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:18.559309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:18.561691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:18.589484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-65578899-0892-4288-824c-f1aa60c6c77f req-82066dcc-e434-4aca-9f50-def9a291a62e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:18.592573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-65578899-0892-4288-824c-f1aa60c6c77f req-82066dcc-e434-4aca-9f50-def9a291a62e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:18.592906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:18.594698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:18.596176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-65578899-0892-4288-824c-f1aa60c6c77f req-82066dcc-e434-4aca-9f50-def9a291a62e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:18.601304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:18.602752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:18.605689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:18.608574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:18.629261 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-65578899-0892-4288-824c-f1aa60c6c77f req-82066dcc-e434-4aca-9f50-def9a291a62e service nova] Creating event network-changed:bff23640-b4b7-42c5-a676-f91c70123df9 for instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 on n-h1-862404-2 Oct 28 18:46:18.668948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:46:18.669252 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-65578899-0892-4288-824c-f1aa60c6c77f req-82066dcc-e434-4aca-9f50-def9a291a62e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095310 Oct 28 18:46:18.679563 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2442/6551] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:46:18.707693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:18.722022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:18.760560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:18.765697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:18.766176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:18.766955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:18.767439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:18.767915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:18.916724 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-605dc709-d6e6-4327-bb19-0b8392d64f01 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 204 len: 0 microversion: 2.1 time: 0.380509 Oct 28 18:46:18.924217 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4110/6552] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:46:18 2022] DELETE /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:46:18.949611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-20b52c2f-cb51-4377-86ab-4c1d2dfcb174 req-fb2a0560-1403-4fab-b924-669d8518b044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca21f92-3c0e-4166-a248-49c9f73baf91", "tag": "fc82491d-2c13-4cff-b484-54eb4f9b66ff"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:18.996707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-20b52c2f-cb51-4377-86ab-4c1d2dfcb174 req-fb2a0560-1403-4fab-b924-669d8518b044 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:18.999118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-20b52c2f-cb51-4377-86ab-4c1d2dfcb174 req-fb2a0560-1403-4fab-b924-669d8518b044 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:19.001194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-20b52c2f-cb51-4377-86ab-4c1d2dfcb174 req-fb2a0560-1403-4fab-b924-669d8518b044 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:19.061896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-20b52c2f-cb51-4377-86ab-4c1d2dfcb174 req-fb2a0560-1403-4fab-b924-669d8518b044 service nova] Creating event network-changed:fc82491d-2c13-4cff-b484-54eb4f9b66ff for instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 on n-h2-862404-2 Oct 28 18:46:19.101934 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-20b52c2f-cb51-4377-86ab-4c1d2dfcb174 req-fb2a0560-1403-4fab-b924-669d8518b044 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170886 Oct 28 18:46:19.104671 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4111/6553] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:19.131121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:19.135601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:19.166476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:19.167366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:19.168034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:19.168969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:19.174338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:19.175126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:19.684430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:19.693534 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa4ddcc0-16f4-475e-a732-b8783fd22aee tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1671 microversion: 2.1 time: 0.587342 Oct 28 18:46:19.696536 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4112/6554] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:19 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1671 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:19.772287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:19.782305 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a2c8db1-5312-4b75-90b6-7a8c1921fe58 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 1.095780 Oct 28 18:46:19.785949 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2443/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:18 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:20.724092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:20.724732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:20.753824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:20.754341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:20.754793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:20.755530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:20.769029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:20.774003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:20.818318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:20.819673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:20.836754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:20.841226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:20.844959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:20.846038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:20.847487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:20.848210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:22.119353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:22.123300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:22.149106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec47672d-c340-4b64-908b-6aa2fbb15df1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1671 microversion: 2.1 time: 1.428713 Oct 28 18:46:22.150799 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4113/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:20 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1671 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:22.280186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:22.327033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:22.388257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:22.421304 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4e22877-f637-4384-a23e-7ede10186335 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 1.605310 Oct 28 18:46:22.426662 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2444/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:20 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:46:23.192102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:23.193653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:23.196488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:23.221714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.235276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.236507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.237683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.238592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.239275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.283065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.283975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.284700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.285390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lazy-loading 'fault' on Instance uuid 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:46:23.389966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:23.403682 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5e5f19d-13ff-475c-b6be-11ecce34a991 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 200 len: 1339 microversion: 2.1 time: 0.215295 Oct 28 18:46:23.417138 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4114/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:23 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 1339 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:23.454383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-97e41df9-e47d-406b-834b-2efd050b4cde req-62feef08-5d02-4f87-b2b2-3b27cf8ec839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8ae5bd-4826-4aaf-bc47-721cf4706af6", "name": "network-vif-deleted", "tag": "bff23640-b4b7-42c5-a676-f91c70123df9"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:23.463131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:23.464987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:23.467850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-97e41df9-e47d-406b-834b-2efd050b4cde req-62feef08-5d02-4f87-b2b2-3b27cf8ec839 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.468596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-97e41df9-e47d-406b-834b-2efd050b4cde req-62feef08-5d02-4f87-b2b2-3b27cf8ec839 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.469261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-97e41df9-e47d-406b-834b-2efd050b4cde req-62feef08-5d02-4f87-b2b2-3b27cf8ec839 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.483575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.487266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.488062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.491729 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-97e41df9-e47d-406b-834b-2efd050b4cde req-62feef08-5d02-4f87-b2b2-3b27cf8ec839 service nova] Creating event network-vif-deleted:bff23640-b4b7-42c5-a676-f91c70123df9 for instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 on n-h1-862404-2 Oct 28 18:46:23.492809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.493417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.494330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.505008 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-97e41df9-e47d-406b-834b-2efd050b4cde req-62feef08-5d02-4f87-b2b2-3b27cf8ec839 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054732 Oct 28 18:46:23.506205 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2445/6559] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:23.824124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:23.835266 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fac36e16-859d-4977-a05b-9527c845b516 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.382977 Oct 28 18:46:23.836068 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4115/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:23 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:24.433860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:24.434805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 1c8ae5bd-4826-4aaf-bc47-721cf4706af6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:24.442229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:24.442969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:24.444219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:24.452525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:24.453455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:24.453923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:24.490044 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] HTTP exception thrown: Instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 could not be found. Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Request method failure captured: Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 HTTP/1.1 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCLgVqRhj3qjlCekfhV9HUG1QohtkKImJaZEUegU7dAoLG56Kr0S3ZUUWB9l3jxlfRGsVfEIcI_PXlY-PlOyXksIZEtp3PBTZ_HXuEGChyzfSXYU2Yv0YgRYF9Jr5FjrC1u8XIfeR8ShWXQK8S6gUm0ivtFP-f9XBCym8Wv5Zz4VUbI Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 813c0d60ff9d4b3d92f1be8041a24742 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestNetworkBasicOps-823751000 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_813c0d60ff9d4b3d92f1be8041a24742", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestNetworkBasicOps-823751000 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 813c0d60ff9d4b3d92f1be8041a24742 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestNetworkBasicOps-823751000 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestNetworkBasicOps-823751000-project Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: c1e3f916f6424ca4927b7499c797dbe7 Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestNetworkBasicOps-823751000-project Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 could not be found. Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '1c8ae5bd-4826-4aaf-bc47-721cf4706af6'} Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 could not be found. Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 could not be found. Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:46:24.493816 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 could not be found. Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Returning 404 to user: Instance 1c8ae5bd-4826-4aaf-bc47-721cf4706af6 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:46:24.499530 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe8dcab5-c01d-468c-943c-c1d7e264633f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6" status: 404 len: 111 microversion: 2.1 time: 0.068717 Oct 28 18:46:24.503218 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2446/6561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:24 2022] GET /compute/v2.1/servers/1c8ae5bd-4826-4aaf-bc47-721cf4706af6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:46:24.824924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8c23ac90-ef9f-44f3-abae-2e22629f2277 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '.version_select at 0x7f78dc9ff3a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:24.876587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:24.877835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:24.895562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:24.896308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:24.896890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:24.899707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:24.900362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:24.901719 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8c23ac90-ef9f-44f3-abae-2e22629f2277 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1764205223" status: 202 len: 0 microversion: 2.1 time: 0.082733 Oct 28 18:46:24.902453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:24.903151 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4116/6562] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 18:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1764205223 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:46:25.282066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:25.295677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-567b8b7d-b9bb-4dc3-a320-cc154d14047b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.424495 Oct 28 18:46:25.308640 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2447/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:24 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:26.325846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:26.326392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:26.341116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:26.346636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:26.347368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:26.348556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:26.349336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:26.350081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:26.901972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:26.916127 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9e6b09f-c347-4675-8502-ed1c8a25d8b8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.594631 Oct 28 18:46:26.923738 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4117/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:26 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:27.950233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:27.951809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:27.965611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:27.970267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:27.971087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:27.972593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:27.974895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:27.976659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:28.405414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:28.414503 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08879ac7-ab2e-41dc-8c02-405900f4a135 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.471331 Oct 28 18:46:28.420829 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2448/6565] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:27 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:29.455355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:29.458997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:29.465653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:29.503829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:29.508399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:29.510694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:29.519871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:29.524705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:29.525229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:29.957585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:29.971768 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b819c295-f836-4410-9e40-e8c505589ce3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.527252 Oct 28 18:46:29.972313 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4118/6566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:29 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:30.995972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:30.996604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:31.013967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:31.024083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:31.032949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:31.033489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:31.034732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:31.035552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:31.036100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:31.042511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:31.422843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:31.435364 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0fda6670-3c6c-41e2-b178-720e67de5f2b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.442590 Oct 28 18:46:31.440490 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2449/6567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:30 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:32.461737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:32.462363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:32.481612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:32.482124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:32.482637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:32.483470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:32.483993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:32.484429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:32.918730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:32.933388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee18a966-4132-480a-9f7b-bb6dd378d9db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.476351 Oct 28 18:46:32.933682 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4119/6568] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:32 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:33.960155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:33.962846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:33.972619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:33.973465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:33.976584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:33.977688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:33.978742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:33.979406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:34.217857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:34.235737 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-205181c8-f417-477f-a9bc-637749fcfb9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.278586 Oct 28 18:46:34.239921 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2450/6569] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:33 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:35.290433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:35.292034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:35.300715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:35.301471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:35.302105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:35.303641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:35.304875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:35.305540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:35.764439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:35.778326 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-820a63d0-cbcd-4e52-ac4a-2fb269617fc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.514138 Oct 28 18:46:35.781670 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4120/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:35 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:36.809067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:36.810337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:36.824235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:36.825480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:36.832612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:36.833631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:36.835143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:36.835972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:37.761130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:37.774747 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8704ba67-7c5a-44e1-8316-e9ba6a33c630 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1342 microversion: 2.1 time: 0.969540 Oct 28 18:46:37.788232 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2451/6571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:36 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1342 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:38.802613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:38.805095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:38.817364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:38.832491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:38.833378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:38.835279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:38.836061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:38.838484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:39.111497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:39.154724 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1a03f608-7ac5-49d8-ac7e-15fc2cd1a90e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1388 microversion: 2.1 time: 0.355861 Oct 28 18:46:39.172059 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4121/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:38 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1388 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:40.190584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:40.191289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:40.214777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:40.215323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:40.215785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:40.221877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:40.222613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:40.223083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:40.587755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:40.605906 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-18065212-d2da-419a-8453-dcd418238ea0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.425611 Oct 28 18:46:40.608724 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2452/6573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:40 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:41.632539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:41.633990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:41.652590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:41.655089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:41.655806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:41.657776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:41.658270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:41.658715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:41.996968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:42.005549 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1410e1d8-5c14-42b8-9030-8fc29ab349ba tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.378457 Oct 28 18:46:42.014786 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4122/6574] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:41 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:43.034329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:43.035154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:43.066010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d535c2b-68e5-49a1-ab3a-ffd284050ddd tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'create', calling method: .version_select at 0x7f78dc886af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1103715265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK4CVAxGcG8e9UB1G5x9mpWef5UlDpvGbx7rbjB5dUlUKg7UKtpyxdaRkAXMYqFg5maxwBL0KiCwEWhC9A/GVGIwkZnxGDGgAS/dzzeCthEiiNRWTwR1qiPv9jfiyS5bA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:43.067613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:43.068889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:43.070179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:43.072429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:43.073370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:43.074069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:43.133466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6d535c2b-68e5-49a1-ab3a-ffd284050ddd tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:46:43.151355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-6d535c2b-68e5-49a1-ab3a-ffd284050ddd tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for user c1e3f916f6424ca4927b7499c797dbe7 and project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:46:43.197116 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d535c2b-68e5-49a1-ab3a-ffd284050ddd tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.134969 Oct 28 18:46:43.200208 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4123/6575] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:46:43 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:43.457759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:43.470193 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9e1fcf27-4ec3-4240-bc74-b2b6c048f506 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.440905 Oct 28 18:46:43.484274 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2453/6576] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:43 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:44.510739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:44.512053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:44.523173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:44.528559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:44.530203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:44.532820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:44.533890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:44.534937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:44.767797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:44.780502 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c4b9df7-ac37-438e-ba03-d526dc3ecff5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.273556 Oct 28 18:46:44.783390 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4124/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:44 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:45.711260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1331736578", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "4a7fddf6-fe21-4eda-826d-d8d9d8d1724d"}], "key_name": "tempest-TestNetworkBasicOps-1103715265", "security_groups": [{"name": "tempest-secgroup-smoke-325079496"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:45.809084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:45.809812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:45.820153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:45.831562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:45.832301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:45.833310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:45.834539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:45.835050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:46.106986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:46.118714 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ef944ec-b3fa-4399-b4df-a9b8d9915126 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.313699 Oct 28 18:46:46.120081 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4125/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:45 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:46:46.195887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] validate_networks() for [('4a7fddf6-fe21-4eda-826d-d8d9d8d1724d', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:46:46.981628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:46:46.982898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:46:46.983367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:46:46.983794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:46:46.984363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:46:46.994893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:46.995639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:46.996295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:46.997057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:46.997525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:46.998008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:47.029246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:46:47.036081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Getting quotas for user c1e3f916f6424ca4927b7499c797dbe7 and project 813c0d60ff9d4b3d92f1be8041a24742. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:46:47.064870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:46:47.068848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:46:47.126133 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a96279f2-b5c7-429c-adbe-2640ef074549 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.421850 Oct 28 18:46:47.132286 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2454/6579] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:46:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:46:47.140665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31f7ba17-fc8b-4dd6-9d6c-1e50e5918849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:47.142441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31f7ba17-fc8b-4dd6-9d6c-1e50e5918849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:47.149567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:47.150631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:47.168026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:47.169294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:47.170633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:47.171773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:47.173411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:47.174183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:47.253376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31f7ba17-fc8b-4dd6-9d6c-1e50e5918849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:47.263468 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31f7ba17-fc8b-4dd6-9d6c-1e50e5918849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1249 microversion: 2.1 time: 0.127362 Oct 28 18:46:47.277562 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4126/6580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:47 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:47.573544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:47.582344 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-018944bc-8e35-4afb-82f1-a54a2dd10d6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.438572 Oct 28 18:46:47.583079 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2455/6581] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:47 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:48.292948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:48.294340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:48.309694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:48.310479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:48.311090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:48.312015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:48.312747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:48.314265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:48.410223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:48.420902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3d66323-7bd2-4652-9ac9-bd44ead7e7c1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1301 microversion: 2.1 time: 0.133490 Oct 28 18:46:48.422105 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4127/6582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:48 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1301 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:48.607013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:48.607911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:48.619462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:48.622221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:48.623439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:48.624425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:48.625011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:48.625688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:48.844363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:48.865646 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-984706c5-001b-4854-b80f-5786106e30da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.261120 Oct 28 18:46:48.867451 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2456/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:48 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:49.448328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:49.450197 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:49.469075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:49.472456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:49.472819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:49.473561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:49.475170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:49.475802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:49.644378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:49.657600 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a77479e-5b68-4d28-bf6a-db4ddf4e9094 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1307 microversion: 2.1 time: 0.215196 Oct 28 18:46:49.676773 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4128/6584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:49 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:49.893016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:49.894495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:49.903761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:49.904305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:49.905133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:49.906049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:49.908397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:49.909094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:50.251869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-282016ac-7acd-44d6-92d4-4f94dd15a1a9 req-8fa8d9ec-c2c3-4387-8682-4f477179f449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca21f92-3c0e-4166-a248-49c9f73baf91", "name": "network-vif-plugged", "status": "completed", "tag": "fc82491d-2c13-4cff-b484-54eb4f9b66ff"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:50.266373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-282016ac-7acd-44d6-92d4-4f94dd15a1a9 req-8fa8d9ec-c2c3-4387-8682-4f477179f449 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:50.267629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-282016ac-7acd-44d6-92d4-4f94dd15a1a9 req-8fa8d9ec-c2c3-4387-8682-4f477179f449 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:50.268559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-282016ac-7acd-44d6-92d4-4f94dd15a1a9 req-8fa8d9ec-c2c3-4387-8682-4f477179f449 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:50.290914 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-282016ac-7acd-44d6-92d4-4f94dd15a1a9 req-8fa8d9ec-c2c3-4387-8682-4f477179f449 service nova] Creating event network-vif-plugged:fc82491d-2c13-4cff-b484-54eb4f9b66ff for instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 on n-h2-862404-2 Oct 28 18:46:50.301830 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-282016ac-7acd-44d6-92d4-4f94dd15a1a9 req-8fa8d9ec-c2c3-4387-8682-4f477179f449 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056404 Oct 28 18:46:50.304532 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4129/6585] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:46:50.336019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:50.354931 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b421373e-131b-47f7-b724-0804b23de096 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.467684 Oct 28 18:46:50.355573 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2457/6586] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:49 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:50.692195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:50.694116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:50.701187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:50.701927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:50.702536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:50.703550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:50.704932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:50.705535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:50.900744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:50.910130 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a1d1d6e9-1f67-4818-9fdf-f72758589fef tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1374 microversion: 2.1 time: 0.223212 Oct 28 18:46:50.911244 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4130/6587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:50 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1374 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:51.378744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:51.379999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:51.394419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:51.397157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:51.400424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:51.401197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:51.408761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:51.409249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:51.725940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9e4fc09e-6e1a-4e12-8495-c31bc0d2cb1f req-d44d4470-1f9e-4ed5-97d8-34a34e1f50ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d5e44d-271b-4351-91b4-448ea0b103ca", "tag": "7127e048-4c20-40c9-bb47-af9f380929c3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:51.738563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9e4fc09e-6e1a-4e12-8495-c31bc0d2cb1f req-d44d4470-1f9e-4ed5-97d8-34a34e1f50ed service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:51.747397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:51.755211 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-929cf911-98c9-4050-917e-78d79e46ef80 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1376 microversion: 2.1 time: 0.380317 Oct 28 18:46:51.762376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9e4fc09e-6e1a-4e12-8495-c31bc0d2cb1f req-d44d4470-1f9e-4ed5-97d8-34a34e1f50ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:51.763958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9e4fc09e-6e1a-4e12-8495-c31bc0d2cb1f req-d44d4470-1f9e-4ed5-97d8-34a34e1f50ed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:51.775224 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2458/6588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:51 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1376 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:51.797605 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9e4fc09e-6e1a-4e12-8495-c31bc0d2cb1f req-d44d4470-1f9e-4ed5-97d8-34a34e1f50ed service nova] Creating event network-changed:7127e048-4c20-40c9-bb47-af9f380929c3 for instance 37d5e44d-271b-4351-91b4-448ea0b103ca on n-h1-862404-2 Oct 28 18:46:51.809488 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9e4fc09e-6e1a-4e12-8495-c31bc0d2cb1f req-d44d4470-1f9e-4ed5-97d8-34a34e1f50ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087378 Oct 28 18:46:51.810666 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4131/6589] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:51.940962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:51.951530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:51.966624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:51.979116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:51.979772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:51.981136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:51.982441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:51.983166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:52.281162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:52.317273 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4baa990-5344-477a-8ed1-826b89ab575c tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1374 microversion: 2.1 time: 0.384615 Oct 28 18:46:52.323695 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2459/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:51 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1374 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:52.796641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:52.797939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:52.806055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:52.806851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:52.807508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:52.815885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:52.817247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:52.818471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.079092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:53.088789 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e11c8a08-e744-4cac-9bb0-abb3d6e37918 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1562 microversion: 2.1 time: 0.301796 Oct 28 18:46:53.089396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4132/6591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:52 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1562 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:53.115200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:53.116218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:53.123450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.124116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.124737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.125573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.126173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.126964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.335003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:53.345350 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f5ec672-f87c-47fc-b7ae-8f39b96f6d1b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1562 microversion: 2.1 time: 0.234467 Oct 28 18:46:53.346566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2460/6592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:53 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:53.350540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:53.351390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:53.358639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.359374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.360453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.361422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.362059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.362669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.367472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=92 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:53.472413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:53.474999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:53.483418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.484283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.485070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.486668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.487743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.488465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.527264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:46:53.658033 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f4b2ff72-ac63-471f-94d5-8014871edfe9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 204 len: 0 microversion: 2.1 time: 0.188868 Oct 28 18:46:53.666109 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2461/6593] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:46:53 2022] DELETE /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:46:53.673537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:53.674933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:53.682274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.683114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.683935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.685172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.685882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.686555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.707307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:53.716271 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c3ca88e4-8fb4-4750-8e53-fbb4f9cd8849 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1374 microversion: 2.1 time: 0.371664 Oct 28 18:46:53.721157 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4133/6594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:53 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1374 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:46:53.963515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:53.972925 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a88dd7e7-3f43-4225-8059-c80b1a1dc5ef tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1568 microversion: 2.1 time: 0.304829 Oct 28 18:46:53.980821 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2462/6595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:53 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1568 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:54.741982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:54.742649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:54.750269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:54.751214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:54.751905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:54.752842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:54.753532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:54.754310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:55.018604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:55.020845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:55.032247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:55.034169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:55.034983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:55.036120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:55.037327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:55.038733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:55.115193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:55.131167 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b334cc11-49bf-4409-8ecb-695b73e28875 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1374 microversion: 2.1 time: 0.393404 Oct 28 18:46:55.133198 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4134/6596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:54 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1374 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:55.323024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:55.349024 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5cb589a8-87b1-4492-a6bb-e5fd7c7d7032 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1568 microversion: 2.1 time: 0.345704 Oct 28 18:46:55.349792 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2463/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:55 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:56.156898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:56.157619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:56.169052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:56.172401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:56.173198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:56.174086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:56.176663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:56.178734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:56.382570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:56.384116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:56.399249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:56.399835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:56.400308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:56.401032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:56.405636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:56.406302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:56.556120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:56.573199 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6efae745-a29a-4638-8e94-ef1647507aba tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1374 microversion: 2.1 time: 0.420980 Oct 28 18:46:56.595885 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4135/6598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:56 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1374 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:56.631348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:56.638487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:56.645370 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f9b5526a-3e33-4911-995a-1dbcaea04767 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1568 microversion: 2.1 time: 0.267476 Oct 28 18:46:56.653005 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2464/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:56 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:46:57.051520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c052a4b7-68e4-4430-b68a-953683f2a7f0 req-747679f9-c649-42db-bc5b-f1d98b8739d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca21f92-3c0e-4166-a248-49c9f73baf91", "name": "network-vif-deleted", "tag": "fc82491d-2c13-4cff-b484-54eb4f9b66ff"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:57.096458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c052a4b7-68e4-4430-b68a-953683f2a7f0 req-747679f9-c649-42db-bc5b-f1d98b8739d7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:57.096988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c052a4b7-68e4-4430-b68a-953683f2a7f0 req-747679f9-c649-42db-bc5b-f1d98b8739d7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:57.100317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c052a4b7-68e4-4430-b68a-953683f2a7f0 req-747679f9-c649-42db-bc5b-f1d98b8739d7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:57.124785 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c052a4b7-68e4-4430-b68a-953683f2a7f0 req-747679f9-c649-42db-bc5b-f1d98b8739d7 service nova] Creating event network-vif-deleted:fc82491d-2c13-4cff-b484-54eb4f9b66ff for instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 on n-h2-862404-2 Oct 28 18:46:57.137453 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c052a4b7-68e4-4430-b68a-953683f2a7f0 req-747679f9-c649-42db-bc5b-f1d98b8739d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.393839 Oct 28 18:46:57.142233 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4136/6600] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:46:57.620777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:57.621369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:57.625143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:57.626941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:57.639090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:57.656299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:57.657204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:57.658059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:57.660023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:57.660653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:57.670616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:57.673216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:57.682305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:57.700463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:57.701592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:57.703846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:57.705947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:57.709660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:57.710411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:57.890811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:57.909272 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3474e73-7e6e-4b4f-afe1-75945fd6df6f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1361 microversion: 2.1 time: 0.243557 Oct 28 18:46:57.910982 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4137/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:57 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:46:57.985513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:57.995751 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1d73c34a-56df-405c-b34a-03891f222087 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1374 microversion: 2.1 time: 0.379108 Oct 28 18:46:58.013696 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2465/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:57 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1374 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:58.431486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8f19633c-9502-49c4-ab89-6ed8f1b24e75 req-b4edcfdd-93d4-42da-9e44-75803c3c0475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d5e44d-271b-4351-91b4-448ea0b103ca", "name": "network-vif-plugged", "status": "completed", "tag": "7127e048-4c20-40c9-bb47-af9f380929c3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:58.524275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8f19633c-9502-49c4-ab89-6ed8f1b24e75 req-b4edcfdd-93d4-42da-9e44-75803c3c0475 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:58.528119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8f19633c-9502-49c4-ab89-6ed8f1b24e75 req-b4edcfdd-93d4-42da-9e44-75803c3c0475 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:58.528795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8f19633c-9502-49c4-ab89-6ed8f1b24e75 req-b4edcfdd-93d4-42da-9e44-75803c3c0475 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:58.564376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8f19633c-9502-49c4-ab89-6ed8f1b24e75 req-b4edcfdd-93d4-42da-9e44-75803c3c0475 service nova] Creating event network-vif-plugged:7127e048-4c20-40c9-bb47-af9f380929c3 for instance 37d5e44d-271b-4351-91b4-448ea0b103ca on n-h1-862404-2 Oct 28 18:46:58.570395 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8f19633c-9502-49c4-ab89-6ed8f1b24e75 req-b4edcfdd-93d4-42da-9e44-75803c3c0475 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144010 Oct 28 18:46:58.571619 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4138/6603] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:58.938052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:58.941085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:58.959046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:58.960623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:58.961342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:58.962259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:58.963105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:58.963733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:59.034963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:59.036836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:46:59.045917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:59.046724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:59.047356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:59.049466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:59.050127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:59.050797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:59.081418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:59.097315 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9a9d27cd-c523-4d41-9886-75b772230417 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1361 microversion: 2.1 time: 0.163562 Oct 28 18:46:59.108749 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2466/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:58 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:59.249694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:59.261266 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db9594e0-a782-4bbc-806b-42247ed71ab8 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1374 microversion: 2.1 time: 0.233921 Oct 28 18:46:59.274924 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4139/6605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:59 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:47:00.125255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:00.127025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:00.145717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:00.148105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:00.148802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:00.150013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:00.150711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:00.151413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:00.266168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:00.278120 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e346143-a8f7-4a41-b8a2-6d0dea992e02 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1361 microversion: 2.1 time: 0.157248 Oct 28 18:47:00.280019 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2467/6606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:00 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:00.288697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:00.290036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:00.293028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:00.303769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:00.304254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:00.304785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:00.305466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:00.305951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:00.306439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:00.495621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:00.508523 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bc20fd02-1078-4f9d-bab3-40ce536d974a tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1545 microversion: 2.1 time: 0.223818 Oct 28 18:47:00.538047 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4140/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:00 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1545 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:00.539482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:00.541149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:00.548944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:00.549756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:00.551081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:00.552255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:00.553354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:00.554017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:00.812307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:00.866841 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ef313f8-ecac-4454-96b0-362f9c34bddb tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1545 microversion: 2.1 time: 0.329710 Oct 28 18:47:00.868417 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2468/6608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:00 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1545 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:01.309601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:01.310198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:01.323831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:01.324453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:01.324944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:01.328092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:01.328577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:01.329907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:01.456883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:01.467662 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df5af93a-e239-4c14-ad46-64624da4f2ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1361 microversion: 2.1 time: 0.161983 Oct 28 18:47:01.468780 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4141/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:01 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:02.493407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:02.494845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:02.510629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:02.517377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:02.519500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:02.522514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:02.527861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:02.529963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:02.530707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:03.316305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:03.333002 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bd7d3c01-07de-438f-b401-d03bed70f936 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 200 len: 1361 microversion: 2.1 time: 0.844803 Oct 28 18:47:03.334720 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2469/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:02 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 1361 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:04.236814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2804fd66-6356-44f4-ad28-be9cc8f3ddba req-b75035ed-552b-478e-97b0-4fcf0d16146e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d5e44d-271b-4351-91b4-448ea0b103ca", "tag": "7127e048-4c20-40c9-bb47-af9f380929c3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:04.266103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2804fd66-6356-44f4-ad28-be9cc8f3ddba req-b75035ed-552b-478e-97b0-4fcf0d16146e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:04.266593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2804fd66-6356-44f4-ad28-be9cc8f3ddba req-b75035ed-552b-478e-97b0-4fcf0d16146e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:04.267144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2804fd66-6356-44f4-ad28-be9cc8f3ddba req-b75035ed-552b-478e-97b0-4fcf0d16146e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:04.297203 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2804fd66-6356-44f4-ad28-be9cc8f3ddba req-b75035ed-552b-478e-97b0-4fcf0d16146e service nova] Creating event network-changed:7127e048-4c20-40c9-bb47-af9f380929c3 for instance 37d5e44d-271b-4351-91b4-448ea0b103ca on n-h1-862404-2 Oct 28 18:47:04.317961 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2804fd66-6356-44f4-ad28-be9cc8f3ddba req-b75035ed-552b-478e-97b0-4fcf0d16146e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086078 Oct 28 18:47:04.319459 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4142/6611] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:47:04.364299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:04.368710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:04.382628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:04.383453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:04.384579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:04.389307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:04.390084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:04.390924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:04.416578 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 HTTP/1.1 Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '2ca21f92-3c0e-4166-a248-49c9f73baf91'} Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:04.420561 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:04.427742 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:04.427742 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:04.427742 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:04.427742 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:47:04.427742 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:47:04.427742 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:04.427742 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:04.427742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:47:04.429974 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-93574a0d-205e-43cc-8714-37ca2b2c7958 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 404 len: 111 microversion: 2.1 time: 0.070595 Oct 28 18:47:04.437446 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2470/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:04 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:47:11.166539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:11.167239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:11.186648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:11.187190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:11.189266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:11.190114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:11.190596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:11.191038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:11.258586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:47:11.384895 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-699d8692-af74-4a73-a030-c0473f290b86 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 204 len: 0 microversion: 2.1 time: 0.224007 Oct 28 18:47:11.386778 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4143/6613] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:47:11 2022] DELETE /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:47:11.394918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:11.396860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:11.412205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:11.412714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:11.413183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:11.413864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:11.414433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:11.414751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:11.583983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:11.595443 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-479ec665-9a55-4e49-b752-55d9f0c7d7c4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1409 microversion: 2.1 time: 0.204374 Oct 28 18:47:11.596238 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2471/6614] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:11 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1409 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:12.621916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:12.623318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:12.632523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:12.633352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:12.633835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:12.634533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:12.635161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:12.635771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:12.854985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:12.863126 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5718aae-8d55-48d2-b4d3-263ef411281e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1409 microversion: 2.1 time: 0.246805 Oct 28 18:47:12.863870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4144/6615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:12 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1409 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:13.820787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-13a73206-a9e2-4fe7-9f4e-381597dfa701 req-ea8bda16-04b0-4183-a9b8-5897cb3201dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f83034-8908-443e-83ee-1a3843970ef3", "name": "network-vif-deleted", "tag": "e81339fe-fa96-46a7-ab0b-65443053b0a4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:13.833959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13a73206-a9e2-4fe7-9f4e-381597dfa701 req-ea8bda16-04b0-4183-a9b8-5897cb3201dd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.834614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13a73206-a9e2-4fe7-9f4e-381597dfa701 req-ea8bda16-04b0-4183-a9b8-5897cb3201dd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.835168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-13a73206-a9e2-4fe7-9f4e-381597dfa701 req-ea8bda16-04b0-4183-a9b8-5897cb3201dd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.850343 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-13a73206-a9e2-4fe7-9f4e-381597dfa701 req-ea8bda16-04b0-4183-a9b8-5897cb3201dd service nova] Creating event network-vif-deleted:e81339fe-fa96-46a7-ab0b-65443053b0a4 for instance 40f83034-8908-443e-83ee-1a3843970ef3 on n-h1-862404-2 Oct 28 18:47:13.857075 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-13a73206-a9e2-4fe7-9f4e-381597dfa701 req-ea8bda16-04b0-4183-a9b8-5897cb3201dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040713 Oct 28 18:47:13.861798 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2472/6616] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:47:13.886919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:13.888113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:13.897215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.897998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.898621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.899506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.900162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.901063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.977799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:13.987253 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f95733c7-3007-4c20-895c-2ccf688fc8ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1202 microversion: 2.1 time: 0.104163 Oct 28 18:47:13.988255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4145/6617] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:13 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:15.011247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:15.012011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:15.024261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:15.024975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:15.025548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:15.026305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:15.026782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:15.027224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:15.124800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:15.140780 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-59298038-299e-4051-a1a3-e02d734ef405 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1202 microversion: 2.1 time: 0.134542 Oct 28 18:47:15.141743 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2473/6618] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:15 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1202 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:47:16.172054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:16.174179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:16.195355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:16.196382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:16.197463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:16.199037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:16.200816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:16.202017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:16.289921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:16.300543 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-447166b8-8ec2-483f-bdee-82c8d51ff551 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1202 microversion: 2.1 time: 0.137004 Oct 28 18:47:16.331504 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4146/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:16 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:17.331761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:17.332365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:17.371719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:17.372283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:17.372751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:17.373514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:17.373998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:17.379065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:17.555715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:17.564874 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45d9321b-9c22-454a-b3ea-12619a8c7fbf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1202 microversion: 2.1 time: 0.238151 Oct 28 18:47:17.573185 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2474/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:17 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1202 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:47:18.598049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:18.600342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:18.607770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:18.608667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:18.609332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:18.610263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:18.610962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:18.611623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:18.689766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:18.699434 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9e4a90ed-841e-4319-93c2-3e5f07970d00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1202 microversion: 2.1 time: 0.107131 Oct 28 18:47:18.700599 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4147/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:18 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1202 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:19.724558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:19.725828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:19.737290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:19.740802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:19.741491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:19.743099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:19.745351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:19.746007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:19.839642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:19.840191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:19.840651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:19.841457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lazy-loading 'fault' on Instance uuid 40f83034-8908-443e-83ee-1a3843970ef3 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:47:19.965796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:19.977973 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-36666018-8841-477a-b305-3154250c43a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 200 len: 1207 microversion: 2.1 time: 0.258999 Oct 28 18:47:19.980110 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2475/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:19 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 1207 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:21.002656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:21.003942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:21.012987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:21.013746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:21.014662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:21.017346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:21.018252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:21.018852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:21.034554 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 HTTP/1.1 Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '40f83034-8908-443e-83ee-1a3843970ef3'} Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:21.045638 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:21.052692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:21.052692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:21.052692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:21.052692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:47:21.052692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:47:21.052692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:21.052692 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:21.052692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:47:21.065167 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-156c3c70-8939-4c66-a0cf-e4c132eb9f44 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 404 len: 111 microversion: 2.1 time: 0.066229 Oct 28 18:47:21.068741 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4148/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:20 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:47:27.734841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:27.735425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:27.749680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:27.751727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:27.752387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:27.753277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:27.758290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:27.758868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:27.787008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=62 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:27.788914 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 HTTP/1.1 Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '2ca21f92-3c0e-4166-a248-49c9f73baf91'} Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:47:27.790922 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.795767 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.799042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:47:27.800191 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9716615c-3c97-4c43-b6a5-5b402067f26b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 404 len: 111 microversion: 2.1 time: 0.069531 Oct 28 18:47:27.802356 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2476/6624] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:47:27 2022] DELETE /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:47:27.810028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:27.810540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 2ca21f92-3c0e-4166-a248-49c9f73baf91] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:27.818745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:27.819526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:27.820391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:27.821304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:27.821932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:27.822527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:27.825937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:27.841906 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 HTTP/1.1 Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2ca21f92-3c0e-4166-a248-49c9f73baf91'} Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:27.844774 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.851019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:27.851019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:27.851019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:27.851019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:47:27.851019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:47:27.851019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. Oct 28 18:47:27.851019 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:27.854562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 2ca21f92-3c0e-4166-a248-49c9f73baf91 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:47:27.855763 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7343322-6a84-4e58-bcb3-faae8c814ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91" status: 404 len: 111 microversion: 2.1 time: 0.049762 Oct 28 18:47:27.856865 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4149/6625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:27 2022] GET /compute/v2.1/servers/2ca21f92-3c0e-4166-a248-49c9f73baf91 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:47:28.719260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:28.719926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:28.729461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:28.729981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:28.730443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:28.731176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:28.731651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:28.732132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:28.769646 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 HTTP/1.1 Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '40f83034-8908-443e-83ee-1a3843970ef3'} Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:47:28.772297 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.777424 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.779251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:47:28.780879 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d5ce4c4-6a11-4c14-a9b6-819fab8783a4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 404 len: 111 microversion: 2.1 time: 0.067369 Oct 28 18:47:28.784219 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2477/6626] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:47:28 2022] DELETE /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:47:28.803474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:28.804148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 40f83034-8908-443e-83ee-1a3843970ef3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:28.812373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:28.813033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:28.813339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:28.814477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:28.814945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:28.815371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:28.842582 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 HTTP/1.1 Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '40f83034-8908-443e-83ee-1a3843970ef3'} Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:47:28.844704 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.852175 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:47:28.852175 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:47:28.852175 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:47:28.852175 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:47:28.852175 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:47:28.852175 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. Oct 28 18:47:28.852175 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:47:28.860120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 40f83034-8908-443e-83ee-1a3843970ef3 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:47:28.861211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61f92682-e54a-4cfd-924c-4280faff3d7f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3" status: 404 len: 111 microversion: 2.1 time: 0.071415 Oct 28 18:47:28.862266 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4150/6627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:28 2022] GET /compute/v2.1/servers/40f83034-8908-443e-83ee-1a3843970ef3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:47:29.260681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7218d38b-2605-40e0-933c-6811184834e1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: .version_select at 0x7f78de2629d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1149075686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5aquYBkb1hQ041coytUuCD6KiV6BJd00l5ramjzetrMnBSjykmqVvqq22K07TQy8EReSmkX3VbWlY/SpmBbacArrEnExBE89ZPMuUNuYQ0WF04TRkS0KE2AStU4Y3e5Q=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:29.260681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-7218d38b-2605-40e0-933c-6811184834e1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:47:29.260681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-7218d38b-2605-40e0-933c-6811184834e1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:47:29.260681 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7218d38b-2605-40e0-933c-6811184834e1 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.077473 Oct 28 18:47:29.260681 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2478/6628] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:47:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:47:36.914300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:36.918683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:36.945506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:36.951110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:36.951854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:36.952517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:36.953421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:36.954084 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:36.954665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:37.036888 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db559fe8-c983-4045-91d1-39e86bd47d6b tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca/action" status: 200 len: 24571 microversion: 2.1 time: 0.128784 Oct 28 18:47:37.045387 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4151/6629] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:47:36 2022] POST /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca/action => generated 24571 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:47:55.142653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-260678410", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1149075686", "security_groups": [{"name": "tempest-secgroup-smoke-328668395"}], "block_device_mapping_v2": [{"uuid": "a59da80c-19cc-4e04-9f54-387150cd72f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca633313-4d95-4fc0-8f7a-c33539b3174e"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:55.168317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:55.169508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:55.170484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:55.524263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] validate_networks() for [('ca633313-4d95-4fc0-8f7a-c33539b3174e', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:47:55.986137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:47:55.986727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:47:55.987188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:47:55.987655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:47:55.988144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:47:55.999013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:55.999519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:56.000002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:56.001504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:56.002007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:56.002605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:56.026032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:47:56.031730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:47:56.107487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:47:56.109801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a59da80c-19cc-4e04-9f54-387150cd72f0',volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:47:56.276910 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c8976e33-9215-4ded-ae37-a2bfa348c5a9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.138351 Oct 28 18:47:56.279961 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2479/6630] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:47:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:47:56.291566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e32e41a-561d-4083-8406-b2001d2f9f46 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:56.292388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4e32e41a-561d-4083-8406-b2001d2f9f46 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:56.295862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=7 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:56.297465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:56.368767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e32e41a-561d-4083-8406-b2001d2f9f46 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:56.376351 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e32e41a-561d-4083-8406-b2001d2f9f46 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1094 microversion: 2.1 time: 0.089375 Oct 28 18:47:56.376942 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4152/6631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:56 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:57.401155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:57.402383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:57.429923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:57.430697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:57.431309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:57.432427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:57.432991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:57.433451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:57.543707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:57.557131 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-73cb1cd3-73f3-43fa-809b-316f68c07c4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1200 microversion: 2.1 time: 0.160637 Oct 28 18:47:57.557811 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2480/6632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:57 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1200 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:58.581320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:58.582715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:47:58.591564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:58.592421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:58.593062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:58.594181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:58.594854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:58.595478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:59.496138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:59.507605 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b1fdfe5-6a8c-49dc-81d3-139d32d278f4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1277 microversion: 2.1 time: 0.930066 Oct 28 18:47:59.508409 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4153/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:58 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1277 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:59.647193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2a0ed9a7-6b73-49bf-9ab2-06c291a0a527 req-bc71e560-9dd4-43ff-8f7a-d4074c884254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a19812-72cb-47c4-90d5-904681fd2e2d", "tag": "c906fb89-f79c-4b99-b5a1-97c76b5b7cf8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:59.663236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a0ed9a7-6b73-49bf-9ab2-06c291a0a527 req-bc71e560-9dd4-43ff-8f7a-d4074c884254 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:59.663740 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a0ed9a7-6b73-49bf-9ab2-06c291a0a527 req-bc71e560-9dd4-43ff-8f7a-d4074c884254 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:59.664212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a0ed9a7-6b73-49bf-9ab2-06c291a0a527 req-bc71e560-9dd4-43ff-8f7a-d4074c884254 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:59.681717 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2a0ed9a7-6b73-49bf-9ab2-06c291a0a527 req-bc71e560-9dd4-43ff-8f7a-d4074c884254 service nova] Creating event network-changed:c906fb89-f79c-4b99-b5a1-97c76b5b7cf8 for instance a3a19812-72cb-47c4-90d5-904681fd2e2d on n-h2-862404-2 Oct 28 18:47:59.693182 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2a0ed9a7-6b73-49bf-9ab2-06c291a0a527 req-bc71e560-9dd4-43ff-8f7a-d4074c884254 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050104 Oct 28 18:47:59.694777 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2481/6634] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:48:00.531721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:00.532430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:00.552411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:00.552912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:00.553423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:00.554207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:00.554676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:00.555100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:00.820931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:00.830992 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5560627-d878-4511-8c8c-0bee3530d793 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1277 microversion: 2.1 time: 0.303927 Oct 28 18:48:00.834617 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4154/6635] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:00 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1277 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:01.862512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:01.863905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:01.891598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:01.891598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:01.891598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:01.891598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:01.891598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:01.891598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:02.092390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:02.109093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ea77a63a-9eb2-4038-8a9b-29c0e17b46db tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1277 microversion: 2.1 time: 0.251499 Oct 28 18:48:02.110259 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2482/6636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:01 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:03.135734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:03.137599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:03.147336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:03.158150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:03.160635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:03.161633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:03.164834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:03.166129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:03.369709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:03.378620 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a4db42b-4057-4c9f-8a80-a4be23148542 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1277 microversion: 2.1 time: 0.248128 Oct 28 18:48:03.383032 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4155/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:03 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1277 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:04.406490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:04.407131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:04.415675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:04.416230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:04.416692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:04.417449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:04.417933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:04.418381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:04.685807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:04.695413 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a52fd7d-2f1c-4705-b913-967ef2e64913 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.292906 Oct 28 18:48:04.696157 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2483/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:04 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:48:05.721299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:05.722171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:05.729847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:05.730512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:05.731056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:05.731927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:05.732504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:05.733076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:05.879787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:05.888105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b66432f3-d4dd-412d-add8-f342590022c0 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.170879 Oct 28 18:48:05.888987 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4156/6639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:05 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:06.912614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:06.913347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:06.916254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:06.917131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:06.923132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:06.923941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:06.924278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:06.925622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:06.926359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:06.926864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:07.071308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:07.080286 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25cebbef-9778-4ab3-aca1-16f9c9fdc974 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.171652 Oct 28 18:48:07.080917 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2484/6640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:06 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:07.576958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:07.579616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:07.586878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:07.590174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:07.590856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:07.591550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:07.592554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:07.593622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:07.594196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:07.655302 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90e8372a-4f73-4a73-abea-2c2387a322a1 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "POST /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca/action" status: 200 len: 32642 microversion: 2.1 time: 0.082752 Oct 28 18:48:07.656008 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4157/6641] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:48:07 2022] POST /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca/action => generated 32642 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:48:08.106141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:08.106902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:08.118317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:08.119908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:08.120525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:08.121594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:08.122514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:08.123443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:08.332660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:08.344252 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e3cc35e-6420-4726-80ff-2deaf22c51f2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.243459 Oct 28 18:48:08.356699 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2485/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:08 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:08.922291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:08.922903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:08.926921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2c087f05-a5b7-4ebc-acb5-867faeb67382 req-545849c8-8e3c-4d3a-a01f-dcb7aa4f9c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d5e44d-271b-4351-91b4-448ea0b103ca", "tag": "7127e048-4c20-40c9-bb47-af9f380929c3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:08.934398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:08.934910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:08.935365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:08.938017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c087f05-a5b7-4ebc-acb5-867faeb67382 req-545849c8-8e3c-4d3a-a01f-dcb7aa4f9c1e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:08.938691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c087f05-a5b7-4ebc-acb5-867faeb67382 req-545849c8-8e3c-4d3a-a01f-dcb7aa4f9c1e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:08.939325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c087f05-a5b7-4ebc-acb5-867faeb67382 req-545849c8-8e3c-4d3a-a01f-dcb7aa4f9c1e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:08.940119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:08.940731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:08.944819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:08.952752 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2c087f05-a5b7-4ebc-acb5-867faeb67382 req-545849c8-8e3c-4d3a-a01f-dcb7aa4f9c1e service nova] Creating event network-changed:7127e048-4c20-40c9-bb47-af9f380929c3 for instance 37d5e44d-271b-4351-91b4-448ea0b103ca on n-h1-862404-2 Oct 28 18:48:08.960227 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2c087f05-a5b7-4ebc-acb5-867faeb67382 req-545849c8-8e3c-4d3a-a01f-dcb7aa4f9c1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038570 Oct 28 18:48:08.961388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2486/6643] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:48:08.986071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:48:09.106401 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-883a222c-3d0a-4c24-885d-b0113994beb3 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 204 len: 0 microversion: 2.1 time: 0.188697 Oct 28 18:48:09.107292 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4158/6644] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:48:08 2022] DELETE /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:48:09.141756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:09.143193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:09.158117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:09.163462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:09.164236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:09.165259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:09.165881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:09.166612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:09.381173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:09.382102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:09.397590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:09.398266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:09.400210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:09.404374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:09.405019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:09.405547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:09.463728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:09.473182 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-872167ea-baad-4185-8542-44f2a0bf591f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1670 microversion: 2.1 time: 0.352217 Oct 28 18:48:09.474318 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2487/6645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:09 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1670 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:09.615548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:09.624570 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35721cc2-3e2e-424b-a814-6e001f367eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.248897 Oct 28 18:48:09.625394 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4159/6646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:09 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:10.499440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:10.500853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:10.511837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:10.512650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:10.513114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:10.513861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:10.514499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:10.515097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:10.649095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:10.649637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:10.656929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:10.657424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:10.658155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:10.658875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:10.659432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:10.660187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:10.720579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:10.730573 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d13e9227-b857-4c50-9928-37925d07ea34 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1670 microversion: 2.1 time: 0.235891 Oct 28 18:48:10.736519 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2488/6647] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:10 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1670 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:10.864259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:10.875321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af496b53-4f91-4459-9084-d36bee755d35 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.230302 Oct 28 18:48:10.876470 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4160/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:10 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:48:11.588173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-05dfee65-8a93-41b9-889a-89e0bb84daf4 req-27141ad0-2b92-422c-a89e-99ceba83941f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d5e44d-271b-4351-91b4-448ea0b103ca", "name": "network-vif-deleted", "tag": "7127e048-4c20-40c9-bb47-af9f380929c3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:11.617884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-05dfee65-8a93-41b9-889a-89e0bb84daf4 req-27141ad0-2b92-422c-a89e-99ceba83941f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:11.619134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-05dfee65-8a93-41b9-889a-89e0bb84daf4 req-27141ad0-2b92-422c-a89e-99ceba83941f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:11.619608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-05dfee65-8a93-41b9-889a-89e0bb84daf4 req-27141ad0-2b92-422c-a89e-99ceba83941f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:11.633762 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-05dfee65-8a93-41b9-889a-89e0bb84daf4 req-27141ad0-2b92-422c-a89e-99ceba83941f service nova] Creating event network-vif-deleted:7127e048-4c20-40c9-bb47-af9f380929c3 for instance 37d5e44d-271b-4351-91b4-448ea0b103ca on n-h1-862404-2 Oct 28 18:48:11.639847 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-05dfee65-8a93-41b9-889a-89e0bb84daf4 req-27141ad0-2b92-422c-a89e-99ceba83941f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055383 Oct 28 18:48:11.641027 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2489/6649] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:48:11.759521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:11.760941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:11.780738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:11.781442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:11.781916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:11.782635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:11.783097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:11.783525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:11.837908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:11.838406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:11.838852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:11.839316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lazy-loading 'fault' on Instance uuid 37d5e44d-271b-4351-91b4-448ea0b103ca {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:48:11.883845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e3f916f6424ca4927b7499c797dbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813c0d60ff9d4b3d92f1be8041a24742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:11.895097 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c1c44ea9-bfa3-4b8c-83ec-a3c9a523420d tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 200 len: 1339 microversion: 2.1 time: 0.144095 Oct 28 18:48:11.895705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4161/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:11 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:11.902996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:11.903713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:11.910529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:11.911228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:11.911876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:11.912918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:11.913392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:11.913831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:12.065332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:12.079698 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-58ee68b0-f81b-4ee4-9d8d-434a3b0c3d1c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.178528 Oct 28 18:48:12.080432 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2490/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:11 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:12.921658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:12.922894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] [instance: 37d5e44d-271b-4351-91b4-448ea0b103ca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:12.932998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:12.933910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:12.934564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:12.935988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:12.936890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:12.937552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:12.955257 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] HTTP exception thrown: Instance 37d5e44d-271b-4351-91b4-448ea0b103ca could not be found. Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Request method failure captured: Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca HTTP/1.1 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCLgVqRhj3qjlCekfhV9HUG1QohtkKImJaZEUegU7dAoLG56Kr0S3ZUUWB9l3jxlfRGsVfEIcI_PXlY-PlOyXksIZEtp3PBTZ_HXuEGChyzfSXYU2Yv0YgRYF9Jr5FjrC1u8XIfeR8ShWXQK8S6gUm0ivtFP-f9XBCym8Wv5Zz4VUbI Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 813c0d60ff9d4b3d92f1be8041a24742 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestNetworkBasicOps-823751000 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_813c0d60ff9d4b3d92f1be8041a24742", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/813c0d60ff9d4b3d92f1be8041a24742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestNetworkBasicOps-823751000 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 813c0d60ff9d4b3d92f1be8041a24742 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestNetworkBasicOps-823751000 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestNetworkBasicOps-823751000-project Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: c1e3f916f6424ca4927b7499c797dbe7 Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestNetworkBasicOps-823751000-project Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 37d5e44d-271b-4351-91b4-448ea0b103ca could not be found. Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '37d5e44d-271b-4351-91b4-448ea0b103ca'} Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37d5e44d-271b-4351-91b4-448ea0b103ca could not be found. Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37d5e44d-271b-4351-91b4-448ea0b103ca could not be found. Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:48:12.957863 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:12.961317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:48:12.961317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:48:12.961317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:48:12.961317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:48:12.961317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:48:12.961317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37d5e44d-271b-4351-91b4-448ea0b103ca could not be found. Oct 28 18:48:12.961317 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:12.966378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Returning 404 to user: Instance 37d5e44d-271b-4351-91b4-448ea0b103ca could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:48:12.967363 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9cdeb20e-3276-4e3f-bfbc-17ecc1902401 tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca" status: 404 len: 111 microversion: 2.1 time: 0.050721 Oct 28 18:48:12.968084 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4162/6652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:12 2022] GET /compute/v2.1/servers/37d5e44d-271b-4351-91b4-448ea0b103ca => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:48:13.106033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:13.106826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:13.121460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:13.124136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:13.124762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:13.126228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:13.129213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:13.129814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:13.281849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2c6a9af-1d49-4633-9b80-0997c6b0e06f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] Calling method '.version_select at 0x7f78dd44eaf0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:13.328640 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2c6a9af-1d49-4633-9b80-0997c6b0e06f tempest-TestNetworkBasicOps-823751000 tempest-TestNetworkBasicOps-823751000-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1103715265" status: 202 len: 0 microversion: 2.1 time: 0.052339 Oct 28 18:48:13.348974 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4163/6653] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 18:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1103715265 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:48:13.353934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:13.364254 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-135d50d4-4d43-47ef-9d67-250ae9b089be tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.263391 Oct 28 18:48:13.365917 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2491/6654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:13 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:14.387444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:14.388120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:14.396882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:14.397613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:14.398058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:14.398770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:14.399233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:14.399661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:14.606567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-53b862d9-8044-48aa-9052-459b55c49bab req-7c56ad15-aa09-429d-9e13-1a031f33a1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a19812-72cb-47c4-90d5-904681fd2e2d", "name": "network-vif-plugged", "status": "completed", "tag": "c906fb89-f79c-4b99-b5a1-97c76b5b7cf8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:14.631004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-53b862d9-8044-48aa-9052-459b55c49bab req-7c56ad15-aa09-429d-9e13-1a031f33a1a7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:14.642884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-53b862d9-8044-48aa-9052-459b55c49bab req-7c56ad15-aa09-429d-9e13-1a031f33a1a7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:14.643350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-53b862d9-8044-48aa-9052-459b55c49bab req-7c56ad15-aa09-429d-9e13-1a031f33a1a7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:14.665028 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-53b862d9-8044-48aa-9052-459b55c49bab req-7c56ad15-aa09-429d-9e13-1a031f33a1a7 service nova] Creating event network-vif-plugged:c906fb89-f79c-4b99-b5a1-97c76b5b7cf8 for instance a3a19812-72cb-47c4-90d5-904681fd2e2d on n-h2-862404-2 Oct 28 18:48:14.671171 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-53b862d9-8044-48aa-9052-459b55c49bab req-7c56ad15-aa09-429d-9e13-1a031f33a1a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071362 Oct 28 18:48:14.672397 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2492/6655] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:48:14.869513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:14.879324 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-948f57b1-3410-436d-9797-ac10f2708f4f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.495711 Oct 28 18:48:14.895999 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4164/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:14 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:15.906942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:15.908280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:15.922760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:15.923275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:15.923809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:15.925698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:15.926190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:15.926631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:16.196492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:16.210384 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c31f1943-174e-447f-b55b-92e7b5e2dae2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1265 microversion: 2.1 time: 0.307854 Oct 28 18:48:16.214292 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2493/6657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:15 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:17.242569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:17.243856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:17.253639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:17.254572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:17.255141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:17.255911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:17.256386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:17.256882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:17.510398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:17.518933 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-819bd865-beef-4393-8c06-29795bc83bb9 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1452 microversion: 2.1 time: 0.281057 Oct 28 18:48:17.519787 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4165/6658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:17 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1452 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:17.545472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:17.546317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:17.555247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:17.555873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:17.556561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:17.557552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:17.558206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:17.558829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:17.737964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:17.746339 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c4db7f26-f0d3-4f88-80f4-21fb97f2ce9f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1452 microversion: 2.1 time: 0.205309 Oct 28 18:48:17.746923 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2494/6659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:17 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:20.908408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2da03b1b-1fe6-48b7-87b7-11dc8c59c33e req-d4b05a44-d3e7-4b7f-bc50-8557acb2b4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a19812-72cb-47c4-90d5-904681fd2e2d", "tag": "c906fb89-f79c-4b99-b5a1-97c76b5b7cf8"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:20.920525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2da03b1b-1fe6-48b7-87b7-11dc8c59c33e req-d4b05a44-d3e7-4b7f-bc50-8557acb2b4c4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:20.921224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2da03b1b-1fe6-48b7-87b7-11dc8c59c33e req-d4b05a44-d3e7-4b7f-bc50-8557acb2b4c4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:20.921832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2da03b1b-1fe6-48b7-87b7-11dc8c59c33e req-d4b05a44-d3e7-4b7f-bc50-8557acb2b4c4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:20.935480 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2da03b1b-1fe6-48b7-87b7-11dc8c59c33e req-d4b05a44-d3e7-4b7f-bc50-8557acb2b4c4 service nova] Creating event network-changed:c906fb89-f79c-4b99-b5a1-97c76b5b7cf8 for instance a3a19812-72cb-47c4-90d5-904681fd2e2d on n-h2-862404-2 Oct 28 18:48:20.942415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2da03b1b-1fe6-48b7-87b7-11dc8c59c33e req-d4b05a44-d3e7-4b7f-bc50-8557acb2b4c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037977 Oct 28 18:48:20.943623 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4166/6660] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:48:24.105180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1184044310", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "68ee6160-ca00-4fc5-bf05-1d04dec07fd8"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:24.165659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] validate_networks() for [('68ee6160-ca00-4fc5-bf05-1d04dec07fd8', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:48:24.523996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:48:24.524439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:48:24.524935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:48:24.525364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:48:24.525833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:48:24.535045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:24.535544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:24.536055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:24.536806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:24.537285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:24.537730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:24.554620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Getting quotas for project 3e954e5a4246496d8faef771da8a5aae. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:48:24.559949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Getting quotas for user f20322474d8c4211a656371741938bb0 and project 3e954e5a4246496d8faef771da8a5aae. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:48:24.572977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:48:24.575316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:48:24.620772 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eabe0ead-7db3-403e-97b7-f3a854cde8bc tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647717 Oct 28 18:48:24.628545 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2495/6661] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:48:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:48:24.635616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e604654-c109-4b69-9148-cb1788d8cb5e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:24.636488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2e604654-c109-4b69-9148-cb1788d8cb5e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:24.694060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e604654-c109-4b69-9148-cb1788d8cb5e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:24.701832 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e604654-c109-4b69-9148-cb1788d8cb5e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1215 microversion: 2.1 time: 0.071823 Oct 28 18:48:24.702418 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4167/6662] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:24 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:25.729444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:25.730206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:25.733552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:25.740611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:25.741219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:25.741820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:25.742649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:25.743282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:25.743934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:25.750655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=79 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:25.835554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:25.844061 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65ae8257-6189-4b92-9934-321c605a7249 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1285 microversion: 2.1 time: 0.121013 Oct 28 18:48:25.844623 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2496/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:25 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:26.868222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:26.868981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:26.873224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:26.880822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:26.881340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:26.881783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:26.882720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:26.883350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:26.883793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:26.889096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:27.040153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:27.051332 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5494778-3d01-475b-af27-61125e8cd409 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1315 microversion: 2.1 time: 0.187650 Oct 28 18:48:27.052453 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4168/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:26 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:48:27.101385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-abbe3f51-283f-4e88-baea-4706fa21b25b req-593f41bf-9c5f-4398-af3d-036776f9a34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83f0fba-a4c0-4318-a2ae-a785ce484585", "tag": "683cffe4-239b-4a0f-83dc-a2b2c286b21c"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:27.116469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-abbe3f51-283f-4e88-baea-4706fa21b25b req-593f41bf-9c5f-4398-af3d-036776f9a34a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:27.117116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-abbe3f51-283f-4e88-baea-4706fa21b25b req-593f41bf-9c5f-4398-af3d-036776f9a34a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:27.117771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-abbe3f51-283f-4e88-baea-4706fa21b25b req-593f41bf-9c5f-4398-af3d-036776f9a34a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:27.135199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-abbe3f51-283f-4e88-baea-4706fa21b25b req-593f41bf-9c5f-4398-af3d-036776f9a34a service nova] Creating event network-changed:683cffe4-239b-4a0f-83dc-a2b2c286b21c for instance c83f0fba-a4c0-4318-a2ae-a785ce484585 on n-h1-862404-2 Oct 28 18:48:27.141077 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-abbe3f51-283f-4e88-baea-4706fa21b25b req-593f41bf-9c5f-4398-af3d-036776f9a34a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044623 Oct 28 18:48:27.142061 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2497/6665] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:48:28.078022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:28.078852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:28.086776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:28.087265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:28.087707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:28.088436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:28.088925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:28.089353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:28.224941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:28.232983 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3f58914b-04ce-4c0a-9cb0-eb05906f9519 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1315 microversion: 2.1 time: 0.158988 Oct 28 18:48:28.233615 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4169/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:28 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:29.258347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:29.259125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:29.273776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:29.274283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:29.274731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:29.275448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:29.275936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:29.276526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:29.430352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:29.438268 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a5a9ea12-0af4-4148-91ee-3e52c0dc83bb tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1315 microversion: 2.1 time: 0.185412 Oct 28 18:48:29.438850 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2498/6667] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:29 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:30.466047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:30.467433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:30.480753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:30.481844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:30.482871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:30.484383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:30.485622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:30.486375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:30.635573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:30.644576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8599474a-3c47-43e9-9e0a-8ab9f3d006b9 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1315 microversion: 2.1 time: 0.184764 Oct 28 18:48:30.645175 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4170/6668] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:30 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:31.667431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:31.668019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:31.675379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:31.675921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:31.676381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:31.677101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:31.677583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:31.678027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:31.810504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:31.818862 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72f6b118-5098-471e-b9a8-3f738e6e038e tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1315 microversion: 2.1 time: 0.155502 Oct 28 18:48:31.819442 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2499/6669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:31 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:32.412205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fb702f12-f7dc-4cf6-8f9a-a41617ff9fce req-3baf0136-a523-4693-a16a-48a02f6ff5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83f0fba-a4c0-4318-a2ae-a785ce484585", "name": "network-vif-plugged", "status": "completed", "tag": "683cffe4-239b-4a0f-83dc-a2b2c286b21c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:32.423650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb702f12-f7dc-4cf6-8f9a-a41617ff9fce req-3baf0136-a523-4693-a16a-48a02f6ff5f0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:32.424936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb702f12-f7dc-4cf6-8f9a-a41617ff9fce req-3baf0136-a523-4693-a16a-48a02f6ff5f0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:32.425422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb702f12-f7dc-4cf6-8f9a-a41617ff9fce req-3baf0136-a523-4693-a16a-48a02f6ff5f0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:32.437386 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fb702f12-f7dc-4cf6-8f9a-a41617ff9fce req-3baf0136-a523-4693-a16a-48a02f6ff5f0 service nova] Creating event network-vif-plugged:683cffe4-239b-4a0f-83dc-a2b2c286b21c for instance c83f0fba-a4c0-4318-a2ae-a785ce484585 on n-h1-862404-2 Oct 28 18:48:32.443180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fb702f12-f7dc-4cf6-8f9a-a41617ff9fce req-3baf0136-a523-4693-a16a-48a02f6ff5f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035197 Oct 28 18:48:32.444020 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4171/6670] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:48:32.842649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:32.843336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:32.850931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:32.851425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:32.851917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:32.852626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:32.853347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:32.853786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:32.994980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:33.006529 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a8462588-d78e-452b-b2d7-865fe1b56bf3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1315 microversion: 2.1 time: 0.168356 Oct 28 18:48:33.007519 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2500/6671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:32 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:34.031216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:34.032041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:34.039653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:34.040168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:34.040636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:34.041330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:34.041785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:34.042236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:34.205852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:34.211423 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4eff72cb-b1eb-43f4-a232-9964880d65ac tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1502 microversion: 2.1 time: 0.184493 Oct 28 18:48:34.212404 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4172/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:34 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:34.237644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:34.241305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:34.247311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:34.247900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:34.248516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:34.249240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:34.249733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:34.250145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:34.402367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:34.412676 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e25ed61-48bb-4f91-b52d-f53db4f44082 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1502 microversion: 2.1 time: 0.178859 Oct 28 18:48:34.413420 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2501/6673] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:34 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:34.440258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:34.441136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:34.457986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:34.458821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:34.459516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:34.460334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:34.461165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:34.461711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:34.492521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lazy-loading 'flavor' on Instance uuid c83f0fba-a4c0-4318-a2ae-a785ce484585 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:48:34.573651 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7be13179-b7a8-4548-9fdf-4c20f49c3715 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "POST /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585/action" status: 202 len: 0 microversion: 2.1 time: 0.138507 Oct 28 18:48:34.574559 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4173/6674] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:48:34 2022] POST /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:48:34.589383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:34.595274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:34.597558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:34.600543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:34.606655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:34.607156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:34.607603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:34.608370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:34.608817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:34.609253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:34.754903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:34.763566 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-370b756b-7e48-428d-bdd1-7174c7361cb1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1510 microversion: 2.1 time: 0.178069 Oct 28 18:48:34.764182 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2502/6675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:34 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:35.788793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:35.790339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:35.792500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:35.799493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:35.800026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:35.800846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:35.801790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:35.802265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:35.802701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:35.967695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:35.978810 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-671fc57e-18df-4ffa-a00f-5673a4d64884 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1493 microversion: 2.1 time: 0.194353 Oct 28 18:48:35.979407 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4174/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:35 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1493 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:36.002795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:36.003358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:36.011573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:36.012104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:36.012756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:36.013487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:36.014041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:36.014585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:36.089093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a0d45f1-57a9-49fc-b976-d6cbfd9b2279 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "POST /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585/action" status: 202 len: 0 microversion: 2.1 time: 0.090096 Oct 28 18:48:36.092851 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2503/6677] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:48:35 2022] POST /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:48:36.100277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:36.100935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:36.107983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:36.108491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:36.109046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:36.109878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:36.110352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:36.110914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:36.278413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:36.288081 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92a1b9ae-8a59-45d3-9997-7e9f42a8dfa2 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1499 microversion: 2.1 time: 0.193899 Oct 28 18:48:36.289161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4175/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:36 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1499 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:37.311739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:37.312580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:37.320317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:37.320818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:37.321265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:37.321976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:37.322441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:37.322906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:37.467427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:37.476350 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a2f270d8-fbcf-4c08-b64b-8c94099c45c6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1499 microversion: 2.1 time: 0.169346 Oct 28 18:48:37.476929 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2504/6679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:37 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1499 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:38.501109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:38.501866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:38.510055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:38.510560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:38.511286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:38.512257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:38.512881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:38.513319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:38.683432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:38.693135 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2392791-76ba-46a8-84ac-1cf3516d35de tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1502 microversion: 2.1 time: 0.195822 Oct 28 18:48:38.693743 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4176/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:38 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:38.717490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:38.718182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:38.726234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:38.726748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:38.727350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:38.728530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:38.729009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:38.729603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:38.756236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lazy-loading 'flavor' on Instance uuid c83f0fba-a4c0-4318-a2ae-a785ce484585 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:48:38.823227 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6747cf9d-25b1-4b04-ba4f-476ebd78d2b7 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "POST /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585/action" status: 202 len: 0 microversion: 2.1 time: 0.109801 Oct 28 18:48:38.823933 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2505/6681] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:48:38 2022] POST /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:48:38.832704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:38.833485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:38.839455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:38.839981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:38.840437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:38.841129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:38.841641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:38.842005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:38.988971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:38.998349 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d9cdeb7-6f34-4d9e-aa8c-4b288104443c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1510 microversion: 2.1 time: 0.170161 Oct 28 18:48:38.998892 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4177/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:38 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:40.024940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:40.025999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:40.032782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:40.033379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:40.033846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:40.034567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:40.035091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:40.035676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:40.184140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:40.192639 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b3b0130-a114-4ee0-9a6b-4f257c5504b3 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1493 microversion: 2.1 time: 0.173808 Oct 28 18:48:40.193455 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2506/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:40 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1493 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:40.217228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:40.217778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:40.226317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:40.226820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:40.227379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:40.228426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:40.228892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:40.229327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:40.325757 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-133fa9e2-0a94-4340-b01a-8ad4b79289e6 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "POST /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585/action" status: 202 len: 0 microversion: 2.1 time: 0.112405 Oct 28 18:48:40.326766 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4178/6684] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:48:40 2022] POST /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:48:40.335561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:40.336432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:40.343382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:40.344647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:40.345233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:40.345972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:40.346655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:40.347318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:40.577462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:40.586100 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23bc521e-9d64-40f5-8dd3-9539ae640195 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1499 microversion: 2.1 time: 0.254744 Oct 28 18:48:40.599962 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2507/6685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:40 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1499 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:41.612642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:41.613368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:41.620777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:41.621272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:41.621713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:41.622419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:41.622880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:41.623316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:41.762897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:41.773356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3454c13-1771-40c4-8892-7557604d912c tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1499 microversion: 2.1 time: 0.164987 Oct 28 18:48:41.774263 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4179/6686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:41 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:42.797784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:42.798421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:42.805526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:42.806076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:42.806467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:42.807182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:42.807652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:42.808300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:42.952195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:42.960790 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbc3cab4-9019-42f4-afcb-be9432acec7f tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1502 microversion: 2.1 time: 0.166914 Oct 28 18:48:42.961371 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2508/6687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:42 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:42.984385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:42.984879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:42.992005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:42.992492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:42.992928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:42.993622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:42.994104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:42.994526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:43.021496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:48:43.104314 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b9675d1c-f384-4589-b936-de3d3a02b29b tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 204 len: 0 microversion: 2.1 time: 0.123750 Oct 28 18:48:43.105325 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4180/6688] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:48:42 2022] DELETE /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:48:43.115385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:43.116053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:43.122101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:43.122604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:43.123057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:43.123769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:43.124280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:43.124726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:43.260583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:43.268438 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ead2add-8636-4684-9eb4-0ffa9bf296b0 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1508 microversion: 2.1 time: 0.158941 Oct 28 18:48:43.269013 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2509/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:43 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:48:44.293735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:44.294378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:44.302994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:44.303493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:44.303976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:44.304694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:44.305335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:44.305770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:44.308991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:44.459090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:44.468385 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9cb5f60d-955f-48c8-9613-09581c6822a1 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1508 microversion: 2.1 time: 0.179851 Oct 28 18:48:44.469137 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4181/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:44 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:45.496759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:45.497408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:45.506655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:45.507238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:45.507709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:45.508489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:45.509055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:45.509509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:45.549675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d37a3755-d8a5-481d-add9-dfe37348caaf req-61b1e266-1e97-436a-b172-697e1c740a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83f0fba-a4c0-4318-a2ae-a785ce484585", "name": "network-vif-deleted", "tag": "683cffe4-239b-4a0f-83dc-a2b2c286b21c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:48:45.579299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d37a3755-d8a5-481d-add9-dfe37348caaf req-61b1e266-1e97-436a-b172-697e1c740a0e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:45.581245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d37a3755-d8a5-481d-add9-dfe37348caaf req-61b1e266-1e97-436a-b172-697e1c740a0e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:45.581719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d37a3755-d8a5-481d-add9-dfe37348caaf req-61b1e266-1e97-436a-b172-697e1c740a0e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:45.605200 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d37a3755-d8a5-481d-add9-dfe37348caaf req-61b1e266-1e97-436a-b172-697e1c740a0e service nova] Creating event network-vif-deleted:683cffe4-239b-4a0f-83dc-a2b2c286b21c for instance c83f0fba-a4c0-4318-a2ae-a785ce484585 on n-h1-862404-2 Oct 28 18:48:45.611577 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d37a3755-d8a5-481d-add9-dfe37348caaf req-61b1e266-1e97-436a-b172-697e1c740a0e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066841 Oct 28 18:48:45.612846 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4182/6691] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:48:45.631892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20322474d8c4211a656371741938bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e954e5a4246496d8faef771da8a5aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:48:45.634354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:48:45.644498 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1b2ca85f-8feb-472c-b565-65c963498f37 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 200 len: 1466 microversion: 2.1 time: 0.153458 Oct 28 18:48:45.646800 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2510/6692] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:45 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:48:46.671567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:48:46.672571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] [instance: c83f0fba-a4c0-4318-a2ae-a785ce484585] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:48:46.681444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:46.681444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:46.681888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:46.682596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:48:46.683072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:48:46.683465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:48:46.697691 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] HTTP exception thrown: Instance c83f0fba-a4c0-4318-a2ae-a785ce484585 could not be found. Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Request method failure captured: Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 HTTP/1.1 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCP2bef10bqMOwSzZKtwkwUMQ8UaTGO8L9_wDGNPZ638sh3-wII9HDFzZt8qHE_p5n1UCU4Tu66nT-CUARN2Ig0p67XasDr80lH8UL5w8o29gz3oJc4ps4Qwr2oZJmN1YrcSVRegHAg1FF0eOpuBlV_OBw1TGkEAbJyFpzgQ2Oo7Mv8 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 3e954e5a4246496d8faef771da8a5aae Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestServerAdvancedOps-1312221068 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e954e5a4246496d8faef771da8a5aae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3e954e5a4246496d8faef771da8a5aae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3e954e5a4246496d8faef771da8a5aae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3e954e5a4246496d8faef771da8a5aae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestServerAdvancedOps-1312221068 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 3e954e5a4246496d8faef771da8a5aae Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestServerAdvancedOps-1312221068 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestServerAdvancedOps-1312221068-project Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: f20322474d8c4211a656371741938bb0 Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestServerAdvancedOps-1312221068-project Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance c83f0fba-a4c0-4318-a2ae-a785ce484585 could not be found. Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'c83f0fba-a4c0-4318-a2ae-a785ce484585'} Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83f0fba-a4c0-4318-a2ae-a785ce484585 could not be found. Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83f0fba-a4c0-4318-a2ae-a785ce484585 could not be found. Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:48:46.699372 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83f0fba-a4c0-4318-a2ae-a785ce484585 could not be found. Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] Returning 404 to user: Instance c83f0fba-a4c0-4318-a2ae-a785ce484585 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd42a621-2dbf-4657-8fdc-7b8579e5f635 tempest-TestServerAdvancedOps-1312221068 tempest-TestServerAdvancedOps-1312221068-project] 10.222.0.16 "GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585" status: 404 len: 111 microversion: 2.1 time: 0.034647 Oct 28 18:48:46.703498 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4183/6693] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:48:46 2022] GET /compute/v2.1/servers/c83f0fba-a4c0-4318-a2ae-a785ce484585 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:50:18.264301 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52f951e5-e896-445b-b633-afd01c521d0a] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 18:50:18.265342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=29 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:18.266553 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:50:18.267012 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d (ip 10.222.0.16) !!! Oct 28 18:50:18.271509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:18.272068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:18.283894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:18.284398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:18.284854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:18.285571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:18.286046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:18.286486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:18.313388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:50:18.391237 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-63df6c7c-78cd-4186-9734-e8c3fca45853 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 204 len: 0 microversion: 2.1 time: 0.128958 Oct 28 18:50:18.391870 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2511/6694] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:50:18 2022] DELETE /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:50:18.399508 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 18:50:18.400828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:18.401698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=9 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:18.403392 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:50:18.403548 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 18:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d (ip 10.222.0.16) !!! Oct 28 18:50:18.408192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:18.408819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:18.422623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:18.423120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:18.423566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:18.424301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:18.424776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:18.425215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:18.562225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:18.570776 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-129b2009-6ed1-4f29-bf7f-06d71f8ac60b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1576 microversion: 2.1 time: 0.174711 Oct 28 18:50:18.571362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4184/6695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:18 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:19.596519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:19.597237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:19.606280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:19.606781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:19.607232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:19.608109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:19.608438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:19.608888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:19.615211 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [52f951e5-e896-445b-b633-afd01c521d0a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59890. Oct 28 18:50:19.746887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:19.754624 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f4940f6-eddc-45d5-ae9b-088a74e152e8 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1576 microversion: 2.1 time: 0.162572 Oct 28 18:50:19.755201 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2512/6696] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:19 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:20.672972 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59896. Oct 28 18:50:20.779430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:20.780163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:20.789279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:20.789862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:20.790410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:20.791197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:20.791731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:20.792259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:20.854894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:20.855426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:20.862216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:20.862729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:20.863172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:20.863917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:20.864393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:20.864815 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:20.892459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:50:20.948514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:20.957018 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1933dcac-ad56-4027-ae7a-bc29db253722 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1576 microversion: 2.1 time: 0.182478 Oct 28 18:50:20.957999 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2513/6697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:20 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:20.998072 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0816f49d-c54d-4eb8-95d1-e4df548cfe83 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 204 len: 0 microversion: 2.1 time: 0.339365 Oct 28 18:50:20.998686 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4185/6698] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:50:20 2022] DELETE /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:50:21.007793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:21.008583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:21.015201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:21.015591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:21.016244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:21.016949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:21.017348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:21.017933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:21.170552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:21.178635 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b71b81bf-12c7-47df-9dc0-533ba89bc93c tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1732 microversion: 2.1 time: 0.175441 Oct 28 18:50:21.179262 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2514/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:21 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:21.592462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fab92d3a-b36a-4c25-abe1-f958efa11f27 req-b81eb61b-431e-43ef-9fe7-ccae08bb6df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a19812-72cb-47c4-90d5-904681fd2e2d", "name": "network-vif-deleted", "tag": "c906fb89-f79c-4b99-b5a1-97c76b5b7cf8"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:50:21.605451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fab92d3a-b36a-4c25-abe1-f958efa11f27 req-b81eb61b-431e-43ef-9fe7-ccae08bb6df9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:21.606038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fab92d3a-b36a-4c25-abe1-f958efa11f27 req-b81eb61b-431e-43ef-9fe7-ccae08bb6df9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:21.606547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fab92d3a-b36a-4c25-abe1-f958efa11f27 req-b81eb61b-431e-43ef-9fe7-ccae08bb6df9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:21.620236 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fab92d3a-b36a-4c25-abe1-f958efa11f27 req-b81eb61b-431e-43ef-9fe7-ccae08bb6df9 service nova] Creating event network-vif-deleted:c906fb89-f79c-4b99-b5a1-97c76b5b7cf8 for instance a3a19812-72cb-47c4-90d5-904681fd2e2d on n-h2-862404-2 Oct 28 18:50:21.626112 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fab92d3a-b36a-4c25-abe1-f958efa11f27 req-b81eb61b-431e-43ef-9fe7-ccae08bb6df9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038404 Oct 28 18:50:21.627616 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4186/6700] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:50:21.985835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:21.987141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:21.993573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:21.994400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:21.995119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:21.996072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:21.996723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:21.997340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:22.085736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:22.095683 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1529acb1-3c59-4a57-9b9e-22007aa06c61 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1225 microversion: 2.1 time: 0.113979 Oct 28 18:50:22.111698 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2515/6701] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:21 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:22.203990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:22.204774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:22.213466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:22.214237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:22.214889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:22.215789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:22.216584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:22.217231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:22.323504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886f784cd65a441b893409078b3ecb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053712da02cd4299a4beedaa35ee459c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:22.332123 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13e4d81e-cf97-4605-8554-a0a8eaff9b63 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 200 len: 1665 microversion: 2.1 time: 0.133130 Oct 28 18:50:22.347884 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4187/6702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:22 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 1665 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:22.735330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6d04c0c0-8d87-471e-a3f8-449f6b93edf7 req-5d2deef4-bc6a-4032-94a4-0ee3cc61041b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3464d4c5-432a-40b4-93c9-b1a46d2044f0", "name": "network-vif-deleted", "tag": "cb490cef-7c49-4e3f-9968-f9e9907f3e8e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:50:22.757886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6d04c0c0-8d87-471e-a3f8-449f6b93edf7 req-5d2deef4-bc6a-4032-94a4-0ee3cc61041b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:22.758393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6d04c0c0-8d87-471e-a3f8-449f6b93edf7 req-5d2deef4-bc6a-4032-94a4-0ee3cc61041b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:22.758837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6d04c0c0-8d87-471e-a3f8-449f6b93edf7 req-5d2deef4-bc6a-4032-94a4-0ee3cc61041b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:22.797699 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6d04c0c0-8d87-471e-a3f8-449f6b93edf7 req-5d2deef4-bc6a-4032-94a4-0ee3cc61041b service nova] Creating event network-vif-deleted:cb490cef-7c49-4e3f-9968-f9e9907f3e8e for instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 on n-h1-862404-2 Oct 28 18:50:22.812540 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6d04c0c0-8d87-471e-a3f8-449f6b93edf7 req-5d2deef4-bc6a-4032-94a4-0ee3cc61041b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194160 Oct 28 18:50:22.829015 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2516/6703] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:50:23.126176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:23.126873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:23.138868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:23.139650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:23.140319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:23.141269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:23.141939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:23.142588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:23.218854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:23.228450 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05edaefe-9bc4-49d1-b7b1-e330835df529 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1225 microversion: 2.1 time: 0.105971 Oct 28 18:50:23.235988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4188/6704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:23 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:23.357696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:23.358417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:23.367651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:23.368399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:23.368945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:23.369753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:23.370281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:23.370794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:23.385827 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] HTTP exception thrown: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Request method failure captured: Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 HTTP/1.1 Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCMZEvoZYYvBfyGgrZChCe5mbZEz-JY66lrCUs_n7dDiVq6SQWP8azL0-9_er1-L4RQORrZID-5TrxUvXTTGJtBn5HuYN0dfowAQiZ3aQSeYOOc2QoGXYXjFZ4s4ie_sdiI3g-hAgy4Tw23TYCMxdw-0nt8WYJEpTF9y_E08bf1Q7qY Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 053712da02cd4299a4beedaa35ee459c Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_053712da02cd4299a4beedaa35ee459c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 053712da02cd4299a4beedaa35ee459c Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestServerBasicOps-878612537-project Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 886f784cd65a441b893409078b3ecb6d Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestServerBasicOps-878612537-project Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '3464d4c5-432a-40b4-93c9-b1a46d2044f0'} Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:50:23.387663 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Returning 404 to user: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff9eaefb-919a-4f02-b1bc-0c437b09bb23 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 404 len: 111 microversion: 2.1 time: 0.036021 Oct 28 18:50:23.391565 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2517/6705] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:23 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:50:23.902362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:23.902875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:23.910316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:23.910814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:23.911261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:23.912002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:23.912470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:23.912902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:23.927320 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] HTTP exception thrown: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Request method failure captured: Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 HTTP/1.1 Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCMZEvoZYYvBfyGgrZChCe5mbZEz-JY66lrCUs_n7dDiVq6SQWP8azL0-9_er1-L4RQORrZID-5TrxUvXTTGJtBn5HuYN0dfowAQiZ3aQSeYOOc2QoGXYXjFZ4s4ie_sdiI3g-hAgy4Tw23TYCMxdw-0nt8WYJEpTF9y_E08bf1Q7qY Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 053712da02cd4299a4beedaa35ee459c Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_053712da02cd4299a4beedaa35ee459c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 053712da02cd4299a4beedaa35ee459c Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestServerBasicOps-878612537-project Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 886f784cd65a441b893409078b3ecb6d Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestServerBasicOps-878612537-project Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '3464d4c5-432a-40b4-93c9-b1a46d2044f0'} Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:50:23.929233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Returning 404 to user: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae499782-a21f-4c70-8f96-bad8d8e60e68 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 404 len: 111 microversion: 2.1 time: 0.033737 Oct 28 18:50:23.933667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4189/6706] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:50:23 2022] DELETE /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:50:23.940044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:23.940675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] [instance: 3464d4c5-432a-40b4-93c9-b1a46d2044f0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:23.947587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:23.948113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:23.948562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:23.949274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:23.949746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:23.950187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:23.964592 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] HTTP exception thrown: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Request method failure captured: Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 HTTP/1.1 Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCMZEvoZYYvBfyGgrZChCe5mbZEz-JY66lrCUs_n7dDiVq6SQWP8azL0-9_er1-L4RQORrZID-5TrxUvXTTGJtBn5HuYN0dfowAQiZ3aQSeYOOc2QoGXYXjFZ4s4ie_sdiI3g-hAgy4Tw23TYCMxdw-0nt8WYJEpTF9y_E08bf1Q7qY Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 053712da02cd4299a4beedaa35ee459c Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_053712da02cd4299a4beedaa35ee459c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/053712da02cd4299a4beedaa35ee459c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 053712da02cd4299a4beedaa35ee459c Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestServerBasicOps-878612537 Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestServerBasicOps-878612537-project Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 886f784cd65a441b893409078b3ecb6d Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestServerBasicOps-878612537-project Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '3464d4c5-432a-40b4-93c9-b1a46d2044f0'} Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:50:23.966138 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Returning 404 to user: Instance 3464d4c5-432a-40b4-93c9-b1a46d2044f0 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-169f5815-df79-4686-ae66-59d3aa3308eb tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0" status: 404 len: 111 microversion: 2.1 time: 0.031487 Oct 28 18:50:23.970038 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2518/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:23 2022] GET /compute/v2.1/servers/3464d4c5-432a-40b4-93c9-b1a46d2044f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:50:24.143121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab743b39-911c-4b18-8497-e0558ec72e96 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] Calling method '.version_select at 0x7f78dd5f7790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:24.167046 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab743b39-911c-4b18-8497-e0558ec72e96 tempest-TestServerBasicOps-878612537 tempest-TestServerBasicOps-878612537-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1522057187" status: 202 len: 0 microversion: 2.1 time: 0.028070 Oct 28 18:50:24.167646 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4190/6708] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 18:50:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1522057187 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:50:24.251845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:24.252497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:24.259771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:24.260314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:24.260776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:24.261504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:24.261982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:24.262429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:24.349430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:24.358845 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50ee3ed9-e46c-4a0f-9aa9-017a9e18b9bb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1225 microversion: 2.1 time: 0.110836 Oct 28 18:50:24.359534 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2519/6709] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:24 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:25.382514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:25.383933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:25.396753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:25.398242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:25.398858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:25.399723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:25.400348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:25.400920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:25.514651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:25.529899 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d61f1099-e187-41a0-bf61-54792dd52fbb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1225 microversion: 2.1 time: 0.151365 Oct 28 18:50:25.531259 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4191/6710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:25 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:26.553172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:26.554340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:26.561194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:26.561691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:26.562135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:26.562842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:26.563304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:26.563732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:26.595188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:26.595681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:26.596172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:26.596615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lazy-loading 'fault' on Instance uuid a3a19812-72cb-47c4-90d5-904681fd2e2d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:50:26.638905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:26.646848 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a1798d9e-1ac6-42d7-bdfd-d336d3b88ef2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 200 len: 1230 microversion: 2.1 time: 0.097790 Oct 28 18:50:26.647566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2520/6711] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:26 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:50:27.670791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:27.671943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:27.680145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:27.680873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:27.681506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:27.682267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:27.682736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:27.683174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:27.699021 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d HTTP/1.1 Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'a3a19812-72cb-47c4-90d5-904681fd2e2d'} Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:50:27.700860 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:50:27.704352 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a302b2ff-1c90-40d0-b663-e5296d6d0c1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 404 len: 111 microversion: 2.1 time: 0.036134 Oct 28 18:50:27.708670 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4192/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:27 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:50:27.813392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-887375075", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1149075686", "security_groups": [{"name": "tempest-secgroup-smoke-328668395"}], "block_device_mapping_v2": [{"uuid": "a59da80c-19cc-4e04-9f54-387150cd72f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca633313-4d95-4fc0-8f7a-c33539b3174e"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:50:27.975018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] validate_networks() for [('ca633313-4d95-4fc0-8f7a-c33539b3174e', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:50:28.670159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:50:28.670613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:50:28.671110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:50:28.671543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:50:28.672015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:50:28.682944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:28.683455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:28.684148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:28.685070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:28.685539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:28.686317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:28.706917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:50:28.714506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:50:28.780774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:50:28.783372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a59da80c-19cc-4e04-9f54-387150cd72f0',volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:50:28.941073 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b9b34543-e460-43f6-ac60-8be090a73bc7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.131513 Oct 28 18:50:28.945215 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2521/6713] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:50:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:50:28.954303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c109d27-c660-4bed-a535-90118dbdc0c7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:28.955502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c109d27-c660-4bed-a535-90118dbdc0c7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:29.019985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c109d27-c660-4bed-a535-90118dbdc0c7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:29.028635 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c109d27-c660-4bed-a535-90118dbdc0c7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1094 microversion: 2.1 time: 0.078081 Oct 28 18:50:29.029440 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4193/6714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:28 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:30.054741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:30.056143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:30.063514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:30.064294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:30.064905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:30.066031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:30.066513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:30.066960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:30.171414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:30.180183 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc69476f-4149-4e9d-98ad-765320969303 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1192 microversion: 2.1 time: 0.129626 Oct 28 18:50:30.180794 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2522/6715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:30 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:31.209719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:31.211503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:31.219847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:31.220378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:31.220999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:31.222141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:31.222775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:31.223417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:31.299271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:31.315406 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6762110-5ffe-4e0d-abd8-fdd6288b29ee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1210 microversion: 2.1 time: 0.109679 Oct 28 18:50:31.316600 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4194/6716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:31 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:32.342651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:32.343879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:32.352559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:32.353567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:32.354163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:32.355082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:32.355689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:32.356321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:32.610850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:32.619591 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-89f62bbe-2005-4d31-91ca-2e27fb922ad4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1277 microversion: 2.1 time: 0.284168 Oct 28 18:50:32.620975 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2523/6717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:32 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:50:32.731605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d027f06a-7d4d-47e4-83b5-6d11cfcc2485 req-ccea5b57-51d4-4223-a460-7a95cc84c0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779de867-7a6f-44fd-a1d5-7ee86602ce6f", "tag": "363adc16-43ac-4250-a0da-5614ee908d14"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:50:32.745762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d027f06a-7d4d-47e4-83b5-6d11cfcc2485 req-ccea5b57-51d4-4223-a460-7a95cc84c0c6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:32.746529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d027f06a-7d4d-47e4-83b5-6d11cfcc2485 req-ccea5b57-51d4-4223-a460-7a95cc84c0c6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:32.747119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d027f06a-7d4d-47e4-83b5-6d11cfcc2485 req-ccea5b57-51d4-4223-a460-7a95cc84c0c6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:32.761874 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d027f06a-7d4d-47e4-83b5-6d11cfcc2485 req-ccea5b57-51d4-4223-a460-7a95cc84c0c6 service nova] Creating event network-changed:363adc16-43ac-4250-a0da-5614ee908d14 for instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f on n-h1-862404-2 Oct 28 18:50:32.767437 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d027f06a-7d4d-47e4-83b5-6d11cfcc2485 req-ccea5b57-51d4-4223-a460-7a95cc84c0c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040411 Oct 28 18:50:32.768835 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4195/6718] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:50:33.647883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:33.649487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:33.659113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:33.659705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:33.660581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:33.661498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:33.662262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:33.663562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:33.880264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:33.889541 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d38fe6e6-c12d-4875-8517-2fbd958facc5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1277 microversion: 2.1 time: 0.245940 Oct 28 18:50:33.890349 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2524/6719] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:33 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:34.914486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:34.915191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:34.930951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:34.931575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:34.932063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:34.932795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:34.933681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:34.934129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:35.093701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:35.104321 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50cdc1ac-60ec-46b0-86f0-afe36a77196a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1277 microversion: 2.1 time: 0.195306 Oct 28 18:50:35.105286 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4196/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:34 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:36.129043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:36.129673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:36.137977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:36.138674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:36.139128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:36.139866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:36.140334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:36.140777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:36.365953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:36.373844 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d33c8ce5-97f6-4aa6-bd63-da75ee28b378 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.248641 Oct 28 18:50:36.374427 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2525/6721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:36 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:37.400360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:37.401127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:37.407301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:37.407974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:37.408553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:37.409485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:37.410169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:37.410703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:37.559055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:37.567843 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-024c290c-bfaa-44e9-85c9-a0458765db67 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.174461 Oct 28 18:50:37.568568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4197/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:37 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:38.591906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:38.594043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:38.607840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:38.608643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:38.609143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:38.609808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:38.610899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:38.611581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:38.698623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:38.725893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:38.806063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:38.814850 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50743c97-c93c-46bf-83bd-2251fd4e9a7e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.227116 Oct 28 18:50:38.815672 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2526/6723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:38 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:39.840875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:39.841594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:39.846005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:39.851101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:39.851883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:39.852554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:39.853736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:39.854292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:39.854793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:40.010848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:40.019312 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55c80f05-e7e8-453a-a25d-867ab8f1c627 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.184666 Oct 28 18:50:40.019931 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4198/6724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:39 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:41.043856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:41.044724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:41.051830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:41.052394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:41.052979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:41.054048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:41.054857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:41.055308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:41.302213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:41.310883 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96bd9ce2-2cc0-438b-a2f5-f1c2387b7423 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.271626 Oct 28 18:50:41.311583 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2527/6725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:41 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:42.335411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:42.336282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:42.343340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:42.343860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:42.344296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:42.344992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:42.345448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:42.345869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:42.539349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:42.548041 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38da8bbd-a010-4365-b078-9c247f0160ad tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.216943 Oct 28 18:50:42.548673 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4199/6726] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:42 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:43.571705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:43.572375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:43.579680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:43.580221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:43.580678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:43.581405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:43.581900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:43.582303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:43.587613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:43.746645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:43.757940 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a888b001-dafd-4cee-ba56-64487385188a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.190935 Oct 28 18:50:43.759031 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2528/6727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:43 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:44.781001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:44.781632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:44.789269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:44.789771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:44.790214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:44.790928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:44.791391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:44.792299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:44.946477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:44.954786 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-875a3bb3-97fa-46ea-b6cd-269fcd5e78da tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.177660 Oct 28 18:50:44.955392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4200/6728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:44 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:45.978957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:45.979501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:45.986279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:45.986772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:45.987220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:45.987988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:45.988458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:45.988892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:46.121445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:46.129189 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-836543d5-8d62-470b-87d5-dda324e48d81 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.154656 Oct 28 18:50:46.129763 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2529/6729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:45 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:47.152388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:47.153027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:47.154863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b9e96784-7b0a-4ceb-9184-80297005dd93 req-ab754b99-1221-47a4-b863-a36849fe4069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779de867-7a6f-44fd-a1d5-7ee86602ce6f", "name": "network-vif-plugged", "status": "completed", "tag": "363adc16-43ac-4250-a0da-5614ee908d14"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:50:47.160000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:47.160508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:47.160968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:47.161689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:47.162166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:47.163196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:47.164894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b9e96784-7b0a-4ceb-9184-80297005dd93 req-ab754b99-1221-47a4-b863-a36849fe4069 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:47.165374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b9e96784-7b0a-4ceb-9184-80297005dd93 req-ab754b99-1221-47a4-b863-a36849fe4069 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:47.165809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b9e96784-7b0a-4ceb-9184-80297005dd93 req-ab754b99-1221-47a4-b863-a36849fe4069 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:47.177810 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b9e96784-7b0a-4ceb-9184-80297005dd93 req-ab754b99-1221-47a4-b863-a36849fe4069 service nova] Creating event network-vif-plugged:363adc16-43ac-4250-a0da-5614ee908d14 for instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f on n-h1-862404-2 Oct 28 18:50:47.183873 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b9e96784-7b0a-4ceb-9184-80297005dd93 req-ab754b99-1221-47a4-b863-a36849fe4069 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222793 Oct 28 18:50:47.184848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4201/6730] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:50:47.348745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:47.357712 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ccbd9fac-dae8-469f-81cd-9bb208825c37 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.209200 Oct 28 18:50:47.358932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2530/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:47 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:50:48.382988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:48.383705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:48.389925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:48.390413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:48.390855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:48.391551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:48.392048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:48.392479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:48.529102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:48.531418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:48.539618 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0bfa5e33-92f1-44df-8bdc-47d1fc27b397 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1265 microversion: 2.1 time: 0.162355 Oct 28 18:50:48.540231 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4202/6732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:48 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:49.563299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:49.563972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:49.566805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:49.572690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:49.573195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:49.573649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:49.574389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:49.574862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:49.575300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:49.707062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:49.715480 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb444962-c132-4a05-8dd6-7317e43fc7bf tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1452 microversion: 2.1 time: 0.156084 Oct 28 18:50:49.716096 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2531/6733] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:49 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:49.739214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:50:49.739880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:50:49.742843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:50:49.749272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:49.749761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:49.750201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:49.750893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:49.751348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:49.751776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:49.889699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:50:49.897553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-85f8fe43-63c7-48cc-8528-d8d711974af7 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1452 microversion: 2.1 time: 0.162659 Oct 28 18:50:49.898706 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4203/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:50:49 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:50:51.496585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b6d77309-c4b6-49ed-b53d-c3cd7524c058 req-86cd3590-d465-4650-b5c3-0531979ce6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779de867-7a6f-44fd-a1d5-7ee86602ce6f", "tag": "363adc16-43ac-4250-a0da-5614ee908d14"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:50:51.507786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6d77309-c4b6-49ed-b53d-c3cd7524c058 req-86cd3590-d465-4650-b5c3-0531979ce6cd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:50:51.508523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6d77309-c4b6-49ed-b53d-c3cd7524c058 req-86cd3590-d465-4650-b5c3-0531979ce6cd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:50:51.508975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b6d77309-c4b6-49ed-b53d-c3cd7524c058 req-86cd3590-d465-4650-b5c3-0531979ce6cd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:50:51.520179 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b6d77309-c4b6-49ed-b53d-c3cd7524c058 req-86cd3590-d465-4650-b5c3-0531979ce6cd service nova] Creating event network-changed:363adc16-43ac-4250-a0da-5614ee908d14 for instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f on n-h1-862404-2 Oct 28 18:50:51.525334 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b6d77309-c4b6-49ed-b53d-c3cd7524c058 req-86cd3590-d465-4650-b5c3-0531979ce6cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033548 Oct 28 18:50:51.525960 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2532/6735] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:52:41.654662 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 18:52:41.655158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:41.656074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=7 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:41.661240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1817064681", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1149075686", "security_groups": [{"name": "tempest-secgroup-smoke-328668395"}], "block_device_mapping_v2": [{"uuid": "da8d21ae-4e05-46e7-bbb6-5b90de6ef8ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca633313-4d95-4fc0-8f7a-c33539b3174e"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:52:41.786100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] validate_networks() for [('ca633313-4d95-4fc0-8f7a-c33539b3174e', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:52:42.321340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:52:42.321765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:52:42.322240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:52:42.322650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:52:42.323064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:52:42.332439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:42.332924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:42.333362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:42.334088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:42.334551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:42.334974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:42.351739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:52:42.357299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Getting quotas for user a6e8160df1044c63a0655853daf85b9a and project 319f24101e3e4c8ba0449f54bcdb46aa. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:52:42.414846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:52:42.417186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da8d21ae-4e05-46e7-bbb6-5b90de6ef8ac',volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:52:42.546014 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d5ba813b-8abe-4927-a3dc-21042d114eae tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.893564 Oct 28 18:52:42.546673 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4204/6736] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:52:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:52:42.557626 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 18:52:42.558466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:42.559376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=25 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:42.564591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e1eba03f-0881-4a8a-a56b-a1cfaffb69f5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:42.566087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e1eba03f-0881-4a8a-a56b-a1cfaffb69f5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:42.627330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e1eba03f-0881-4a8a-a56b-a1cfaffb69f5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:42.635615 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e1eba03f-0881-4a8a-a56b-a1cfaffb69f5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1095 microversion: 2.1 time: 0.080412 Oct 28 18:52:42.636570 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2533/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:42 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:43.662269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:43.662830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:43.672944 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60244. Oct 28 18:52:43.677422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:43.677910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:43.678348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:43.679050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:43.679500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:43.679960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:43.752342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:43.760500 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd1e98dc-dcc3-413f-8031-e4511e50f6d2 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1193 microversion: 2.1 time: 0.105842 Oct 28 18:52:43.761140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4205/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:43 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:44.788337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:44.789007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:44.800759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:44.801287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:44.801787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:44.802520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:44.803625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:44.804107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:44.808698 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60252. Oct 28 18:52:44.960084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:44.968670 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13846e02-dad1-43c9-af2e-1bc9dde95c97 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1278 microversion: 2.1 time: 0.187906 Oct 28 18:52:44.969558 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2534/6739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:44 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:52:45.696485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-06d19ef6-9023-40bf-ab6b-6128c9c2b117 req-0b7ecbcf-b401-470c-85e0-13928df3f9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bbd96d-3fee-4f73-b54d-4fde680f9b82", "tag": "e0ffe0b2-522e-4224-b5d2-b10f9378c82d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:52:45.706716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-06d19ef6-9023-40bf-ab6b-6128c9c2b117 req-0b7ecbcf-b401-470c-85e0-13928df3f9b6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:45.707201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-06d19ef6-9023-40bf-ab6b-6128c9c2b117 req-0b7ecbcf-b401-470c-85e0-13928df3f9b6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:45.707631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-06d19ef6-9023-40bf-ab6b-6128c9c2b117 req-0b7ecbcf-b401-470c-85e0-13928df3f9b6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:45.719119 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-06d19ef6-9023-40bf-ab6b-6128c9c2b117 req-0b7ecbcf-b401-470c-85e0-13928df3f9b6 service nova] Creating event network-changed:e0ffe0b2-522e-4224-b5d2-b10f9378c82d for instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 on n-h2-862404-2 Oct 28 18:52:45.725665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-06d19ef6-9023-40bf-ab6b-6128c9c2b117 req-0b7ecbcf-b401-470c-85e0-13928df3f9b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149953 Oct 28 18:52:45.726796 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4206/6740] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:52:45.994896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:45.995453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:46.003318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:46.004254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:46.004711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:46.005441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:46.005911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:46.006384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:46.155381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:46.164755 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-88ebf145-57d0-4766-9937-8dd5cbb9230c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1278 microversion: 2.1 time: 0.174906 Oct 28 18:52:46.165392 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2535/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:45 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:47.188885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:47.189612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:47.197484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:47.198278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:47.198929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:47.200026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:47.200598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:47.201134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:47.352132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:47.360442 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e3b7e795-9480-4b1a-a94e-214659004aee tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1278 microversion: 2.1 time: 0.175776 Oct 28 18:52:47.361036 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4207/6742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:47 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:48.384172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:48.384809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:48.391654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:48.392190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:48.392642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:48.393550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:48.394117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:48.394561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:48.551687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:48.559582 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d83348ee-b4f9-4e07-9417-e4f69ff5065a tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1278 microversion: 2.1 time: 0.179431 Oct 28 18:52:48.560206 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2536/6743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:48 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:49.583619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:49.584260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:49.591078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:49.591563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:49.592031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:49.592769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:49.593225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:49.593648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:49.742264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:49.754522 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e5806478-826c-47aa-a0b4-a1756d0dd08f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.174849 Oct 28 18:52:49.755261 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4208/6744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:49 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:50.778824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:50.779458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:50.786112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:50.786628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:50.787060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:50.787831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:50.788304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:50.788752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:50.928951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:50.938416 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a78649c6-347b-41ee-a758-4bab4ad7e483 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.163506 Oct 28 18:52:50.939082 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2537/6745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:50 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:51.966696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:51.967276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:51.974695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:51.975195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:51.975674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:51.976488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:51.977076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:51.977496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:52.139540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:52.148320 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-63c80500-fa33-4441-a10b-1a821ad4636c tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.186166 Oct 28 18:52:52.149162 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4209/6746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:51 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:53.171957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:53.172592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:53.176069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:53.181673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:53.182169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:53.182622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:53.183331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:53.183804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:53.184268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:53.321037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:53.328980 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-89b2f6c6-3352-43da-9074-807b707fec03 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.160953 Oct 28 18:52:53.329558 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2538/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:53 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:54.352195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:54.352823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:54.355021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:54.355696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:54.362732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:54.363217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:54.363658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:54.364381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:54.364842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:54.365270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:54.502783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:54.510945 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e9bc3967-cfbf-4c9f-8958-644b0943d411 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.162690 Oct 28 18:52:54.511532 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4210/6748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:54 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:55.535652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:55.536311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:55.543132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:55.543632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:55.544110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:55.544815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:55.545288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:55.545729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:55.762787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:55.770881 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5dde9734-6756-43c4-83b4-9f51239e5e59 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.239357 Oct 28 18:52:55.771454 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2539/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:55 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:56.793769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:56.794334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:56.801772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:56.802254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:56.802693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:56.803390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:56.803864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:56.804296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:56.934873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:56.943506 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fe9568ff-f572-4c29-833f-cf0e95147880 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.153773 Oct 28 18:52:56.944139 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4211/6750] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:56 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:57.966580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:57.967135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:57.974539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:57.975044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:57.975518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:57.976262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:57.976733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:57.977179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:58.113493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:58.121290 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b899ae3-51cd-42a5-8497-beea772743b5 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.158686 Oct 28 18:52:58.121874 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2540/6751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:57 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:59.144665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:59.145286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:52:59.152245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:59.152733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:59.153168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:59.153859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:59.154313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:59.154739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:59.342728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:59.351132 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-943f4708-9ed9-4c80-b54f-ec0942374b7b tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.210613 Oct 28 18:52:59.351721 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4212/6752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:59 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:59.910644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8ab7f3bb-1ec2-4293-a486-25ba95674865 req-1101e0b2-c0de-4b71-9806-13b138e053e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bbd96d-3fee-4f73-b54d-4fde680f9b82", "name": "network-vif-plugged", "status": "completed", "tag": "e0ffe0b2-522e-4224-b5d2-b10f9378c82d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:52:59.921522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ab7f3bb-1ec2-4293-a486-25ba95674865 req-1101e0b2-c0de-4b71-9806-13b138e053e2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:59.922023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ab7f3bb-1ec2-4293-a486-25ba95674865 req-1101e0b2-c0de-4b71-9806-13b138e053e2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:59.922470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ab7f3bb-1ec2-4293-a486-25ba95674865 req-1101e0b2-c0de-4b71-9806-13b138e053e2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:59.934774 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8ab7f3bb-1ec2-4293-a486-25ba95674865 req-1101e0b2-c0de-4b71-9806-13b138e053e2 service nova] Creating event network-vif-plugged:e0ffe0b2-522e-4224-b5d2-b10f9378c82d for instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 on n-h2-862404-2 Oct 28 18:52:59.940792 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8ab7f3bb-1ec2-4293-a486-25ba95674865 req-1101e0b2-c0de-4b71-9806-13b138e053e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033241 Oct 28 18:52:59.941400 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2541/6753] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:53:00.374415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:00.375058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:53:00.381988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:00.382477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:00.382913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:00.383608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:00.384093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:00.384520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:00.520475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:00.528395 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c1661ef5-89da-418c-99f9-b3d18f79fdd3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1266 microversion: 2.1 time: 0.157949 Oct 28 18:53:00.528980 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4213/6754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:00 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:01.554069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:01.554720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:53:01.561087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:01.561589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:01.562044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:01.562749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:01.563242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:01.563680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:01.705264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:01.713499 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e78898df-fa6a-4e25-822f-1dac72ab6e1f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1453 microversion: 2.1 time: 0.165312 Oct 28 18:53:01.714087 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2542/6755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:01 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:01.737585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:01.738214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:53:01.745043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:01.745542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:01.745984 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:01.746689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:01.747154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:01.747589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:01.882983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:01.890744 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d9781b1f-a71c-46ed-b71c-aee3f8516051 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1453 microversion: 2.1 time: 0.157947 Oct 28 18:53:01.891850 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4214/6756] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:01 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:03.565458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5f650b07-8720-4800-8958-7e56df768168 req-87a2d67e-7481-46b3-b14a-7804be2c5348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bbd96d-3fee-4f73-b54d-4fde680f9b82", "tag": "e0ffe0b2-522e-4224-b5d2-b10f9378c82d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:53:03.575592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5f650b07-8720-4800-8958-7e56df768168 req-87a2d67e-7481-46b3-b14a-7804be2c5348 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:03.576122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5f650b07-8720-4800-8958-7e56df768168 req-87a2d67e-7481-46b3-b14a-7804be2c5348 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:03.576569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5f650b07-8720-4800-8958-7e56df768168 req-87a2d67e-7481-46b3-b14a-7804be2c5348 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:03.588509 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5f650b07-8720-4800-8958-7e56df768168 req-87a2d67e-7481-46b3-b14a-7804be2c5348 service nova] Creating event network-changed:e0ffe0b2-522e-4224-b5d2-b10f9378c82d for instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 on n-h2-862404-2 Oct 28 18:53:03.595320 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5f650b07-8720-4800-8958-7e56df768168 req-87a2d67e-7481-46b3-b14a-7804be2c5348 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033806 Oct 28 18:53:03.596777 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2543/6757] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:32.868954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:32.870952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=58 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:32.872380 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:54:32.872710 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 18:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 (ip 10.222.0.16) !!! Oct 28 18:54:32.875909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=24 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:32.876981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=52 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:32.877933 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:54:32.878211 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 18:54:32.878656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:32.879240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:32.881120 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:54:32.881120 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 18:54:32.889475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:32.889973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:32.890419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:32.891217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:32.891676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:32.901594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:32.901776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-1955a0ca-f361-4762-95b7-d35185a90888 req-b8cfecfd-131f-49f9-a9a4-8670d15ec7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7bbd96d-3fee-4f73-b54d-4fde680f9b82", "tag": "e0ffe0b2-522e-4224-b5d2-b10f9378c82d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:32.914649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1955a0ca-f361-4762-95b7-d35185a90888 req-b8cfecfd-131f-49f9-a9a4-8670d15ec7a2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:32.915144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1955a0ca-f361-4762-95b7-d35185a90888 req-b8cfecfd-131f-49f9-a9a4-8670d15ec7a2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:32.915578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-1955a0ca-f361-4762-95b7-d35185a90888 req-b8cfecfd-131f-49f9-a9a4-8670d15ec7a2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:32.930095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:54:32.931255 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-1955a0ca-f361-4762-95b7-d35185a90888 req-b8cfecfd-131f-49f9-a9a4-8670d15ec7a2 service nova] Creating event network-changed:e0ffe0b2-522e-4224-b5d2-b10f9378c82d for instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 on n-h2-862404-2 Oct 28 18:54:32.937044 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-1955a0ca-f361-4762-95b7-d35185a90888 req-b8cfecfd-131f-49f9-a9a4-8670d15ec7a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067197 Oct 28 18:54:32.937886 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2544/6758] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:54:33.020481 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bd371ccb-c024-46fd-94f3-4d5413a61b15 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 204 len: 0 microversion: 2.1 time: 0.153516 Oct 28 18:54:33.021456 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4215/6759] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:54:32 2022] DELETE /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:54:33.033776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:33.034623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:33.042560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:33.043600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:33.044485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:33.045227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:33.045698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:33.046140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:33.191456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:33.199781 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e6984146-272b-40eb-b0d3-136b88cc1bfa tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1577 microversion: 2.1 time: 0.172137 Oct 28 18:54:33.200392 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2545/6760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:33 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:34.224408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:34.225108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:34.233298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:34.233784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:34.234221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:34.234908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:34.235364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:34.235792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:34.427701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:34.437078 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-152046d6-7a10-4699-b189-04a0df5f581e tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1577 microversion: 2.1 time: 0.217040 Oct 28 18:54:34.437677 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4216/6761] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:34 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:35.301093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5d75dee8-6039-45cb-8254-7e5db57f6cc3 req-09e7554f-e8a5-4087-88f6-fec584b646f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7bbd96d-3fee-4f73-b54d-4fde680f9b82", "name": "network-vif-deleted", "tag": "e0ffe0b2-522e-4224-b5d2-b10f9378c82d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:35.315123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d75dee8-6039-45cb-8254-7e5db57f6cc3 req-09e7554f-e8a5-4087-88f6-fec584b646f4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:35.315542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d75dee8-6039-45cb-8254-7e5db57f6cc3 req-09e7554f-e8a5-4087-88f6-fec584b646f4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:35.316007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d75dee8-6039-45cb-8254-7e5db57f6cc3 req-09e7554f-e8a5-4087-88f6-fec584b646f4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:35.328892 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5d75dee8-6039-45cb-8254-7e5db57f6cc3 req-09e7554f-e8a5-4087-88f6-fec584b646f4 service nova] Creating event network-vif-deleted:e0ffe0b2-522e-4224-b5d2-b10f9378c82d for instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 on n-h2-862404-2 Oct 28 18:54:35.335161 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5d75dee8-6039-45cb-8254-7e5db57f6cc3 req-09e7554f-e8a5-4087-88f6-fec584b646f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037807 Oct 28 18:54:35.335760 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2546/6762] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:35.461316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:35.462057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:35.469374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:35.469964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:35.470485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:35.471199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:35.471663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:35.472129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:35.536970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:35.545094 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-194b34a2-c258-4296-b9ee-abe75a568444 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1226 microversion: 2.1 time: 0.087749 Oct 28 18:54:35.545679 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4217/6763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:35 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:36.569333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:36.569939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:36.577652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:36.578144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:36.578589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:36.579293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:36.579759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:36.580216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:36.643245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:36.651916 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d198e4a7-f479-4c32-a05d-b1410acaa68d tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1226 microversion: 2.1 time: 0.086318 Oct 28 18:54:36.652501 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2547/6764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:36 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:37.675929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:37.676581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:37.683986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:37.684480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:37.684925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:37.685633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:37.686087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:37.686512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:37.757946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:37.767196 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d62b19e-59ef-4ef0-be45-0cc2887ebacc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1226 microversion: 2.1 time: 0.095228 Oct 28 18:54:37.767833 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4218/6765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:37 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:38.790596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:38.791225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:38.798175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:38.798680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:38.799135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:38.799891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:38.800352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:38.800793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:38.864401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:38.872386 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-39457c72-5233-49c0-9ff2-d0641efc9ed3 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1226 microversion: 2.1 time: 0.085721 Oct 28 18:54:38.872970 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2548/6766] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:38 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:39.896065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:39.896727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:39.903955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:39.904455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:39.904901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:39.905605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:39.906065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:39.906498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:39.939675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:39.940203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:39.940646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:39.941102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lazy-loading 'fault' on Instance uuid f7bbd96d-3fee-4f73-b54d-4fde680f9b82 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:54:39.988167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:39.995379 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01ec7ac5-256c-4339-8da3-c47a196ec5af tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 200 len: 1185 microversion: 2.1 time: 0.103420 Oct 28 18:54:39.996509 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4219/6767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:39 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 1185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:41.020860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:41.021487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: f7bbd96d-3fee-4f73-b54d-4fde680f9b82] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:41.028878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:41.029472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:41.029948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:41.030655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:41.031118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:41.031553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:41.044810 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 could not be found. Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 HTTP/1.1 Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 could not be found. Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f7bbd96d-3fee-4f73-b54d-4fde680f9b82'} Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 could not be found. Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 could not be found. Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:41.046454 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 could not be found. Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance f7bbd96d-3fee-4f73-b54d-4fde680f9b82 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4fb9f055-afac-4034-a446-c6f839bc36fc tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82" status: 404 len: 111 microversion: 2.1 time: 0.031005 Oct 28 18:54:41.050870 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2549/6768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:41 2022] GET /compute/v2.1/servers/f7bbd96d-3fee-4f73-b54d-4fde680f9b82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:54:47.287722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:47.288295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:47.290133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-331615d1-23a5-40b2-9cb5-8f43d49244a7 req-460c9574-27c1-4814-85da-2ddf7fd4a9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779de867-7a6f-44fd-a1d5-7ee86602ce6f", "tag": "363adc16-43ac-4250-a0da-5614ee908d14"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:47.295027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:47.295739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:47.296209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:47.296925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:47.297389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:47.297820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:47.301060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-331615d1-23a5-40b2-9cb5-8f43d49244a7 req-460c9574-27c1-4814-85da-2ddf7fd4a9a4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:47.301558 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-331615d1-23a5-40b2-9cb5-8f43d49244a7 req-460c9574-27c1-4814-85da-2ddf7fd4a9a4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:47.302184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-331615d1-23a5-40b2-9cb5-8f43d49244a7 req-460c9574-27c1-4814-85da-2ddf7fd4a9a4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:47.322089 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-331615d1-23a5-40b2-9cb5-8f43d49244a7 req-460c9574-27c1-4814-85da-2ddf7fd4a9a4 service nova] Creating event network-changed:363adc16-43ac-4250-a0da-5614ee908d14 for instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f on n-h1-862404-2 Oct 28 18:54:47.325933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:54:47.328426 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-331615d1-23a5-40b2-9cb5-8f43d49244a7 req-460c9574-27c1-4814-85da-2ddf7fd4a9a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042195 Oct 28 18:54:47.329413 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2550/6769] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:54:47.425588 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a75361ad-4a44-4a9c-ba20-e6b1ddb2d879 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 204 len: 0 microversion: 2.1 time: 0.141019 Oct 28 18:54:47.426538 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4220/6770] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:54:47 2022] DELETE /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:54:47.435746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:47.436734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:47.443127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:47.443651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:47.444132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:47.444889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:47.445585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:47.446039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:47.607623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:47.615455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a6062c9a-659f-4de1-b12d-3bb099fc332f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1576 microversion: 2.1 time: 0.184483 Oct 28 18:54:47.616166 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2551/6771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:47 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:48.639548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:48.640309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:48.647122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:48.647617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:48.648217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:48.648924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:48.649389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:48.649823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:48.790524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:48.799384 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ff2b5ea-35ed-41ee-96ee-0944d3a9059f tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1576 microversion: 2.1 time: 0.164449 Oct 28 18:54:48.800008 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4221/6772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:48 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:54:49.511321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-82893370-944c-4a7f-a5b2-ca50f2a5b791 req-f7d4b709-2c81-4dcf-ad59-9b9faef7a8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779de867-7a6f-44fd-a1d5-7ee86602ce6f", "name": "network-vif-deleted", "tag": "363adc16-43ac-4250-a0da-5614ee908d14"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:49.522276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-82893370-944c-4a7f-a5b2-ca50f2a5b791 req-f7d4b709-2c81-4dcf-ad59-9b9faef7a8d0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:49.522776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-82893370-944c-4a7f-a5b2-ca50f2a5b791 req-f7d4b709-2c81-4dcf-ad59-9b9faef7a8d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:49.523223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-82893370-944c-4a7f-a5b2-ca50f2a5b791 req-f7d4b709-2c81-4dcf-ad59-9b9faef7a8d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:49.535041 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-82893370-944c-4a7f-a5b2-ca50f2a5b791 req-f7d4b709-2c81-4dcf-ad59-9b9faef7a8d0 service nova] Creating event network-vif-deleted:363adc16-43ac-4250-a0da-5614ee908d14 for instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f on n-h1-862404-2 Oct 28 18:54:49.539711 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-82893370-944c-4a7f-a5b2-ca50f2a5b791 req-f7d4b709-2c81-4dcf-ad59-9b9faef7a8d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032221 Oct 28 18:54:49.540346 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2552/6773] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:49.822667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:49.824109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:49.831663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:49.832460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:49.833140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:49.833916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:49.834633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:49.835069 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:49.904590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:49.915961 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c481246c-12f9-4d58-af31-ee3ac19e2363 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1225 microversion: 2.1 time: 0.097093 Oct 28 18:54:49.916936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4222/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:49 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:50.940532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:50.941288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:50.947534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:50.948068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:50.949134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:50.949867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:50.950347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:50.950789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:51.016210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:51.024162 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0426218-13b8-44c4-945c-7c7a6a5951b4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1225 microversion: 2.1 time: 0.088770 Oct 28 18:54:51.024759 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2553/6775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:50 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:52.048037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:52.048588 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:52.055359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:52.055882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:52.056335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:52.057044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:52.057515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:52.059033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:52.122491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:52.130285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43ea0294-8a88-4081-8dd7-71e4574c8f30 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1225 microversion: 2.1 time: 0.086304 Oct 28 18:54:52.130871 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4223/6776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:52 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:53.153766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:53.154390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:53.163939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:53.164879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:53.165716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:53.167058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:53.167933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:53.168453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:53.231133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e8160df1044c63a0655853daf85b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319f24101e3e4c8ba0449f54bcdb46aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:53.239119 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f0dd006e-c037-49cc-ad80-04eff89cefda tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 200 len: 1225 microversion: 2.1 time: 0.089421 Oct 28 18:54:53.239701 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2554/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:53 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:54.263212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:54.263757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: 779de867-7a6f-44fd-a1d5-7ee86602ce6f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:54.270575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:54.271064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:54.271506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:54.272240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:54.272699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:54.273124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:54.289757 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f could not be found. Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f HTTP/1.1 Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f could not be found. Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '779de867-7a6f-44fd-a1d5-7ee86602ce6f'} Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f could not be found. Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f could not be found. Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:54.291409 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f could not be found. Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance 779de867-7a6f-44fd-a1d5-7ee86602ce6f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f97b02d9-70d9-40ac-b175-bff0edc74a00 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f" status: 404 len: 111 microversion: 2.1 time: 0.034284 Oct 28 18:54:54.296091 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4224/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:54 2022] GET /compute/v2.1/servers/779de867-7a6f-44fd-a1d5-7ee86602ce6f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:54:54.740756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:54.741295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:54.749516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:54.750016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:54.750472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:54.751179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:54.751652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:54.752117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:54.766301 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d HTTP/1.1 Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'a3a19812-72cb-47c4-90d5-904681fd2e2d'} Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:54:54.767987 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e0dbf3f7-7c2c-457d-9b9f-9a6d9247fdd4 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 404 len: 111 microversion: 2.1 time: 0.032607 Oct 28 18:54:54.772034 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2555/6779] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:54:54 2022] DELETE /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:54:54.778324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:54.778948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] [instance: a3a19812-72cb-47c4-90d5-904681fd2e2d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:54:54.785262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:54.785747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:54.786191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:54.786884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:54.787347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:54.787774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:54.801301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] HTTP exception thrown: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Request method failure captured: Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d HTTP/1.1 Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCJrOACJytvYLqcQ8s7i1h2b9I-WBKCwEEHH36_8iQwTWFlxulywsi1RS1BCnFG8FOA84gxViX9Nx_FP5WZ9iPetSzeMBBOFBNZRLdkoc013CT2gt18fxMQBgW0wU_Y8488G8HsHbd-DoD7sE93XO7Bo3zIr7m7ooCzTd89TM5_u8fM Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_319f24101e3e4c8ba0449f54bcdb46aa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/319f24101e3e4c8ba0449f54bcdb46aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 319f24101e3e4c8ba0449f54bcdb46aa Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1769329375 Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a6e8160df1044c63a0655853daf85b9a Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-1769329375-project Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'a3a19812-72cb-47c4-90d5-904681fd2e2d'} Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:54.802824 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Returning 404 to user: Instance a3a19812-72cb-47c4-90d5-904681fd2e2d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24cd7017-442e-4e57-8434-5801d6a08d41 tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d" status: 404 len: 111 microversion: 2.1 time: 0.030066 Oct 28 18:54:54.806896 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4225/6780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:54 2022] GET /compute/v2.1/servers/a3a19812-72cb-47c4-90d5-904681fd2e2d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:54:58.226544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-471253e6-b32b-4a7a-8d4f-33ea764744fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] Calling method '.version_select at 0x7f78ddc15ee0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:58.267472 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-471253e6-b32b-4a7a-8d4f-33ea764744fb tempest-TestVolumeBootPattern-1769329375 tempest-TestVolumeBootPattern-1769329375-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1149075686" status: 202 len: 0 microversion: 2.1 time: 0.044722 Oct 28 18:54:58.268103 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2556/6781] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 18:54:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1149075686 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:55:16.694632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:16.695564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:16.808067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-6253239", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:16.864183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] validate_networks() for None {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:55:17.142656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:55:17.143076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:55:17.143556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:55:17.143997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:55:17.144437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:55:17.153808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:17.154391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:17.154885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:17.155661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:17.156178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:17.156618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:17.174592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Getting quotas for project 3ced02291b674bc3a57abc2fa7ae43f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:55:17.179867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Getting quotas for user 645cd4627ec34938bcf6059b96ed6aa2 and project 3ced02291b674bc3a57abc2fa7ae43f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:55:17.192341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:55:17.194662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:55:17.241773 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f5f4479d-3983-41bc-b513-8ea89255b487 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552573 Oct 28 18:55:17.242464 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4226/6782] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:55:17.253248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=48 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:17.254114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:17.258551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2cf61ca-f8c8-440c-92a2-a75912d7656f tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:17.259183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c2cf61ca-f8c8-440c-92a2-a75912d7656f tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:17.317434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c2cf61ca-f8c8-440c-92a2-a75912d7656f tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:17.324592 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2cf61ca-f8c8-440c-92a2-a75912d7656f tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1219 microversion: 2.1 time: 0.073077 Oct 28 18:55:17.325177 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2557/6783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:17 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:18.348378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:18.349027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:18.357123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:18.357627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:18.358076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:18.358783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:18.359248 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:18.359686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:18.426766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:18.435847 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64e9c623-0f2a-4392-b4f7-ad34526ec0d0 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1271 microversion: 2.1 time: 0.091393 Oct 28 18:55:18.436496 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4227/6784] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:18 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:19.459093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:19.459855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:19.468046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:19.468548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:19.469000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:19.469720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:19.470207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:19.470643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:19.712138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:19.721073 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3ec1efd4-5b33-45e7-94e6-e5658a1f64e4 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1319 microversion: 2.1 time: 0.265874 Oct 28 18:55:19.721904 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2558/6785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:19 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:20.337914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a2f28fd4-6b05-4146-959a-0d6e7b86155a req-28185efa-0d6f-406d-aca3-11f6169480ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721173ed-ad49-42d4-81e7-bb2748c172e9", "tag": "9d7e0eef-9184-47bd-987d-fb8173dfeb8c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:20.348904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a2f28fd4-6b05-4146-959a-0d6e7b86155a req-28185efa-0d6f-406d-aca3-11f6169480ef service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:20.349393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a2f28fd4-6b05-4146-959a-0d6e7b86155a req-28185efa-0d6f-406d-aca3-11f6169480ef service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:20.349835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a2f28fd4-6b05-4146-959a-0d6e7b86155a req-28185efa-0d6f-406d-aca3-11f6169480ef service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:20.362137 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a2f28fd4-6b05-4146-959a-0d6e7b86155a req-28185efa-0d6f-406d-aca3-11f6169480ef service nova] Creating event network-changed:9d7e0eef-9184-47bd-987d-fb8173dfeb8c for instance 721173ed-ad49-42d4-81e7-bb2748c172e9 on n-h1-862404-2 Oct 28 18:55:20.367336 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a2f28fd4-6b05-4146-959a-0d6e7b86155a req-28185efa-0d6f-406d-aca3-11f6169480ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Oct 28 18:55:20.368183 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4228/6786] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:20.745010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:20.745644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:20.753988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:20.754472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:20.754926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:20.755643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:20.756147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:20.756829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:20.889229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:20.896975 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d2778790-e242-4736-9f04-123f26b759e3 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1319 microversion: 2.1 time: 0.155846 Oct 28 18:55:20.897567 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2559/6787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:20 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:21.920958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:21.921675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:21.928135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:21.928625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:21.929064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:21.929756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:21.930210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:21.930661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:22.065207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:22.073222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90bbbd55-49e3-47ab-b96f-db144efaa31d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1319 microversion: 2.1 time: 0.157521 Oct 28 18:55:22.073809 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4229/6788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:21 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:23.095973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:23.096733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:23.103736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:23.104271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:23.104721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:23.105570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:23.106095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:23.106596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:23.310934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:23.318671 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-871524ea-0fbb-4aee-9596-cec084f60da2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1319 microversion: 2.1 time: 0.226547 Oct 28 18:55:23.319198 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2560/6789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:23 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:24.342753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:24.343289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:24.350189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:24.350669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:24.351103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:24.351791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:24.352269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:24.352722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:24.483252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:24.491156 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81b734e0-8afe-4365-87c5-8d7d396ff0bf tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1319 microversion: 2.1 time: 0.152499 Oct 28 18:55:24.491741 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4230/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:24 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:25.515217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:25.515859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:25.522967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:25.523456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:25.523930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:25.524632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:25.525098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:25.525530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:25.655284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:25.662940 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ba9a32e8-0941-4d10-8993-2840846f7efb tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1319 microversion: 2.1 time: 0.152281 Oct 28 18:55:25.663523 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2561/6791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:25 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:26.129878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-64d83ef2-04fd-497c-9f92-ae9419e9d4c0 req-2d59590a-deaa-485b-95d3-052273c73b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721173ed-ad49-42d4-81e7-bb2748c172e9", "name": "network-vif-plugged", "status": "completed", "tag": "9d7e0eef-9184-47bd-987d-fb8173dfeb8c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:26.141485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-64d83ef2-04fd-497c-9f92-ae9419e9d4c0 req-2d59590a-deaa-485b-95d3-052273c73b30 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:26.142012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-64d83ef2-04fd-497c-9f92-ae9419e9d4c0 req-2d59590a-deaa-485b-95d3-052273c73b30 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:26.142455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-64d83ef2-04fd-497c-9f92-ae9419e9d4c0 req-2d59590a-deaa-485b-95d3-052273c73b30 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:26.154016 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-64d83ef2-04fd-497c-9f92-ae9419e9d4c0 req-2d59590a-deaa-485b-95d3-052273c73b30 service nova] Creating event network-vif-plugged:9d7e0eef-9184-47bd-987d-fb8173dfeb8c for instance 721173ed-ad49-42d4-81e7-bb2748c172e9 on n-h1-862404-2 Oct 28 18:55:26.159039 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-64d83ef2-04fd-497c-9f92-ae9419e9d4c0 req-2d59590a-deaa-485b-95d3-052273c73b30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033058 Oct 28 18:55:26.159876 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4231/6792] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:26.686676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:26.687221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:26.694038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:26.694532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:26.694982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:26.695681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:26.696179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:26.696619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:26.828850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:26.836624 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbcbfa2e-6433-43ef-8181-f28848352b93 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1319 microversion: 2.1 time: 0.154218 Oct 28 18:55:26.837207 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2562/6793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:26 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:27.858534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:27.859301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:27.863610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:27.864393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:27.872150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:27.872637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:27.873079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:27.873771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:27.874230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:27.874660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.007227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:28.015196 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-54f9144e-1913-4830-a5bc-001000841b1d tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1469 microversion: 2.1 time: 0.158376 Oct 28 18:55:28.015714 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4232/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:27 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:28.040845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:28.099356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2dba1cb1-1423-4064-8fba-92cfbdd922da tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Calling method '.version_select at 0x7f78dfab1430>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:28.166824 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2dba1cb1-1423-4064-8fba-92cfbdd922da tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/dc4968fc8b994aa3acb9f4a30206a2d9" status: 200 len: 371 microversion: 2.1 time: 0.130719 Oct 28 18:55:28.167406 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2563/6795] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:55:28 2022] GET /compute/v2.1/os-quota-sets/dc4968fc8b994aa3acb9f4a30206a2d9 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:28.179771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ac78cad-0008-4e9d-b5cc-a68ca9c640ea tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2081999283", "id": 1134018524, "os-flavor-access:is_public": "True"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:28.197678 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ac78cad-0008-4e9d-b5cc-a68ca9c640ea tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021646 Oct 28 18:55:28.198256 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4233/6796] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:55:28 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:28.210100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1134018524"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:28.212470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:28.218534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.219032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.219489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.220226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.220700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.221147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.413819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6ad1c4a4d85b4ec2bd1a0934b96a3ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4968fc8b994aa3acb9f4a30206a2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:28.420030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2081999283 {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:55:28.426766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.427259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.427712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.428481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.428948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.429386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.456345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Getting quotas for project 3ced02291b674bc3a57abc2fa7ae43f9. Resources: {'cores', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:55:28.461388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Getting quotas for user 645cd4627ec34938bcf6059b96ed6aa2 and project 3ced02291b674bc3a57abc2fa7ae43f9. Resources: {'cores', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:55:28.474776 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.compute.api [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] ram quota exceeded for dc4968fc8b994aa3acb9f4a30206a2d9, tried to resize instance. Oct 28 18:55:28.475326 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Request method failure captured: Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9/action HTTP/1.1 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 39 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCWUixoM65BQ8sF19YXQSjdD61FMedp2byO1OBK90h95fhii6Siuzni7SDPn98EVhJe2ZA6TiZZqsNSP6kN1-kBMOKLoVidwFV3vXDiEphxTgNyQkgNOmWSACTQHmAlgizs0Q1vsYh4ZXb5455wXLUOdI2tYtv6D8F85ohyiSnixg9g Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: dc4968fc8b994aa3acb9f4a30206a2d9 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-574960394 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader,admin Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader,admin Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc4968fc8b994aa3acb9f4a30206a2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc4968fc8b994aa3acb9f4a30206a2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc4968fc8b994aa3acb9f4a30206a2d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc4968fc8b994aa3acb9f4a30206a2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersAdminNegativeTestJSON-574960394 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: dc4968fc8b994aa3acb9f4a30206a2d9 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-574960394 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersAdminNegativeTestJSON-574960394-project-admin Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 6ad1c4a4d85b4ec2bd1a0934b96a3ed7 Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersAdminNegativeTestJSON-574960394-project-admin Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: {"resize": {"flavorRef": "1134018524"}} Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '721173ed-ad49-42d4-81e7-bb2748c172e9', 'body': {'resize': {'flavorRef': '1134018524'}}} Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:55:28.477310 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b38c263-140d-44c4-95d5-d1ade4a4f71c tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9/action" status: 403 len: 118 microversion: 2.1 time: 0.272453 Oct 28 18:55:28.482482 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2564/6797] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:55:28 2022] POST /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9/action => generated 118 bytes in 274 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:55:28.488216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8952b90a-a151-4695-a64e-92f672d3e867 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:28.505494 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8952b90a-a151-4695-a64e-92f672d3e867 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1134018524" status: 202 len: 0 microversion: 2.1 time: 0.021010 Oct 28 18:55:28.506049 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4234/6798] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:55:28 2022] DELETE /compute/v2.1/flavors/1134018524 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:55:28.514853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9a4163d7-97bf-4e67-81f9-4dbc0b3fec00 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:28.535783 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9a4163d7-97bf-4e67-81f9-4dbc0b3fec00 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025510 Oct 28 18:55:28.536377 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2565/6799] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:55:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:55:28.556373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-40c44f1c-af07-4fd3-94de-99504a01a211 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Calling method '.version_select at 0x7f78e252aca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:28.628225 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-40c44f1c-af07-4fd3-94de-99504a01a211 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/dc4968fc8b994aa3acb9f4a30206a2d9" status: 200 len: 371 microversion: 2.1 time: 0.075514 Oct 28 18:55:28.628869 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4235/6800] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 18:55:28 2022] GET /compute/v2.1/os-quota-sets/dc4968fc8b994aa3acb9f4a30206a2d9 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:28.641334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8c54708e-ec73-4d94-9093-2885755d69bc tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-905587544", "id": 2132659322, "os-flavor-access:is_public": "True"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:28.658232 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8c54708e-ec73-4d94-9093-2885755d69bc tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.020681 Oct 28 18:55:28.658838 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2566/6801] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:55:28 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:28.671191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2132659322"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:28.673619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:28.679664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.680191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.680649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.681352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.681818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.682256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.769936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6ad1c4a4d85b4ec2bd1a0934b96a3ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4968fc8b994aa3acb9f4a30206a2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:28.775910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-905587544 {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:55:28.782811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.783319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.783754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.784510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.784993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.785419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.807106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Getting quotas for project 3ced02291b674bc3a57abc2fa7ae43f9. Resources: {'cores', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:55:28.812814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Getting quotas for user 645cd4627ec34938bcf6059b96ed6aa2 and project 3ced02291b674bc3a57abc2fa7ae43f9. Resources: {'cores', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:55:28.825652 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.compute.api [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] cores quota exceeded for dc4968fc8b994aa3acb9f4a30206a2d9, tried to resize instance. Oct 28 18:55:28.826453 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Request method failure captured: Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9/action HTTP/1.1 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 39 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCWUixoM65BQ8sF19YXQSjdD61FMedp2byO1OBK90h95fhii6Siuzni7SDPn98EVhJe2ZA6TiZZqsNSP6kN1-kBMOKLoVidwFV3vXDiEphxTgNyQkgNOmWSACTQHmAlgizs0Q1vsYh4ZXb5455wXLUOdI2tYtv6D8F85ohyiSnixg9g Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: dc4968fc8b994aa3acb9f4a30206a2d9 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-574960394 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader,admin Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader,admin Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc4968fc8b994aa3acb9f4a30206a2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dc4968fc8b994aa3acb9f4a30206a2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dc4968fc8b994aa3acb9f4a30206a2d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dc4968fc8b994aa3acb9f4a30206a2d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdminNegativeTestJSON-574960394 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: dc4968fc8b994aa3acb9f4a30206a2d9 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-574960394 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdminNegativeTestJSON-574960394-project-admin Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 6ad1c4a4d85b4ec2bd1a0934b96a3ed7 Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdminNegativeTestJSON-574960394-project-admin Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: {"resize": {"flavorRef": "2132659322"}} Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '721173ed-ad49-42d4-81e7-bb2748c172e9', 'body': {'resize': {'flavorRef': '2132659322'}}} Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:55:28.828544 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42f1497d-0ca1-4561-acb5-10dff1af5789 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9/action" status: 403 len: 113 microversion: 2.1 time: 0.163005 Oct 28 18:55:28.832303 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4236/6802] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:55:28 2022] POST /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9/action => generated 113 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:55:28.838859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-03fc5f0f-d3a4-47e0-a6db-58105a0e0f47 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:28.857220 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-03fc5f0f-d3a4-47e0-a6db-58105a0e0f47 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2132659322" status: 202 len: 0 microversion: 2.1 time: 0.022051 Oct 28 18:55:28.857782 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2567/6803] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 18:55:28 2022] DELETE /compute/v2.1/flavors/2132659322 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:55:28.866080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4fc80515-a18d-4eb3-8f0c-ed8c5777c2d9 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:28.889377 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4fc80515-a18d-4eb3-8f0c-ed8c5777c2d9 tempest-ServersAdminNegativeTestJSON-574960394 tempest-ServersAdminNegativeTestJSON-574960394-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027221 Oct 28 18:55:28.890165 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4237/6804] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 18:55:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:28.911313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:28.911852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:28.918332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.918842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.919294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.920036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:28.920512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:28.920954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:28.946107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:55:29.023454 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb646000-bded-4565-b59a-33d8a8756dab tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "DELETE /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 204 len: 0 microversion: 2.1 time: 0.115789 Oct 28 18:55:29.024210 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2568/6805] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:55:28 2022] DELETE /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:55:29.032719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:29.033339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:29.039238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:29.039724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:29.040213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:29.040902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:29.041361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:29.041789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:29.177630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:29.185473 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f47f107-793a-443a-8580-c765c70369cd tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1475 microversion: 2.1 time: 0.156824 Oct 28 18:55:29.186060 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4238/6806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:29 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1475 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:30.209750 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:30.210519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:30.217713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:30.218241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:30.218701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:30.219417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:30.219924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:30.220364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:30.352123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:30.360655 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4a07f8d2-6e6c-4180-a960-16a9cc330ba2 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1475 microversion: 2.1 time: 0.155221 Oct 28 18:55:30.361243 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2569/6807] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:30 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1475 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:31.080006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-21069b2d-1e8a-4511-a108-67573d5ee646 req-b15d2668-096e-4eb6-8e14-5e9a8f642bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721173ed-ad49-42d4-81e7-bb2748c172e9", "name": "network-vif-deleted", "tag": "9d7e0eef-9184-47bd-987d-fb8173dfeb8c"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:31.090497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-21069b2d-1e8a-4511-a108-67573d5ee646 req-b15d2668-096e-4eb6-8e14-5e9a8f642bf8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:31.090985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-21069b2d-1e8a-4511-a108-67573d5ee646 req-b15d2668-096e-4eb6-8e14-5e9a8f642bf8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:31.091435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-21069b2d-1e8a-4511-a108-67573d5ee646 req-b15d2668-096e-4eb6-8e14-5e9a8f642bf8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:31.105731 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-21069b2d-1e8a-4511-a108-67573d5ee646 req-b15d2668-096e-4eb6-8e14-5e9a8f642bf8 service nova] Creating event network-vif-deleted:9d7e0eef-9184-47bd-987d-fb8173dfeb8c for instance 721173ed-ad49-42d4-81e7-bb2748c172e9 on n-h1-862404-2 Oct 28 18:55:31.112461 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-21069b2d-1e8a-4511-a108-67573d5ee646 req-b15d2668-096e-4eb6-8e14-5e9a8f642bf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123761 Oct 28 18:55:31.113145 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4239/6808] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:31.383121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:31.383754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:31.391458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:31.392010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:31.392473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:31.393219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:31.393757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:31.394132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:31.434587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:31.435194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:31.435657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:31.436188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lazy-loading 'fault' on Instance uuid 721173ed-ad49-42d4-81e7-bb2748c172e9 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:55:31.480934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645cd4627ec34938bcf6059b96ed6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ced02291b674bc3a57abc2fa7ae43f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:31.491309 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25e7c292-c80f-4be4-bc4b-742b3a12cd21 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 200 len: 1309 microversion: 2.1 time: 0.111131 Oct 28 18:55:31.492445 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2570/6809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:31 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:32.516859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:32.517573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] [instance: 721173ed-ad49-42d4-81e7-bb2748c172e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:32.524788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:32.525279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:32.525724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:32.526423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:32.526887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:32.527633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:32.540792 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] HTTP exception thrown: Instance 721173ed-ad49-42d4-81e7-bb2748c172e9 could not be found. Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Request method failure captured: Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 HTTP/1.1 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCWUhq_y6b1ehT_HAjAuddLnljksoYmHQmIvln-Qom5VeAx7OAVoQVRXHNTFxTN-9ear0MNl8lm_cmnWP7x7mPF68w8xhlmUrYgFWvb_7an3MXQQOYFmfiH3idqSsZEsCO28x2wggLiKllYh71qq9sGu8hDjytCGW1TfEgI8pOzETIY Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 3ced02291b674bc3a57abc2fa7ae43f9 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-164154676 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ced02291b674bc3a57abc2fa7ae43f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ced02291b674bc3a57abc2fa7ae43f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ced02291b674bc3a57abc2fa7ae43f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ced02291b674bc3a57abc2fa7ae43f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersAdminNegativeTestJSON-164154676 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 3ced02291b674bc3a57abc2fa7ae43f9 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-164154676 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersAdminNegativeTestJSON-164154676-project Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 645cd4627ec34938bcf6059b96ed6aa2 Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersAdminNegativeTestJSON-164154676-project Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 721173ed-ad49-42d4-81e7-bb2748c172e9 could not be found. Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '721173ed-ad49-42d4-81e7-bb2748c172e9'} Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721173ed-ad49-42d4-81e7-bb2748c172e9 could not be found. Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721173ed-ad49-42d4-81e7-bb2748c172e9 could not be found. Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:32.542405 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721173ed-ad49-42d4-81e7-bb2748c172e9 could not be found. Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] Returning 404 to user: Instance 721173ed-ad49-42d4-81e7-bb2748c172e9 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b9a01e6b-d73b-4b3b-8e80-034ed2ab8b70 tempest-ServersAdminNegativeTestJSON-164154676 tempest-ServersAdminNegativeTestJSON-164154676-project] 10.222.0.16 "GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9" status: 404 len: 111 microversion: 2.1 time: 0.032194 Oct 28 18:55:32.547233 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4240/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:32 2022] GET /compute/v2.1/servers/721173ed-ad49-42d4-81e7-bb2748c172e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:55:38.674788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:38.676085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:38.796317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1194535362", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "7b8dd9c8-f4df-4ecb-ad7c-55f929696b58"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:38.853372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] validate_networks() for [('7b8dd9c8-f4df-4ecb-ad7c-55f929696b58', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:55:39.239330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:55:39.239764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:55:39.240272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:55:39.240692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:55:39.241113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:55:39.249978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:39.250469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:39.250917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:39.251668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:39.252153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:39.252608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:39.269499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Getting quotas for project cb0997add51d440fae67f9878fc15f32. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:55:39.274829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Getting quotas for user dbddd5a5c94c41d1befc844976f8ec75 and project cb0997add51d440fae67f9878fc15f32. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:55:39.287327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:55:39.289702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:55:39.335624 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a038a348-389d-4f44-bfac-9bbaa76a155c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666506 Oct 28 18:55:39.336330 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2571/6811] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:55:39.348312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f7fa7964-653e-4636-af64-08fea59fa205 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:39.348924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f7fa7964-653e-4636-af64-08fea59fa205 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:39.352008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:39.352697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:39.413652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f7fa7964-653e-4636-af64-08fea59fa205 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:39.421930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f7fa7964-653e-4636-af64-08fea59fa205 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1215 microversion: 2.1 time: 0.077435 Oct 28 18:55:39.422510 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4241/6812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:39 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:40.446708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:40.447339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:40.455039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:40.455835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:40.456442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:40.457323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:40.458132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:40.458579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:40.536177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:40.548699 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cd746d46-eecc-4f4e-b8dc-1636d9d54fbd tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1285 microversion: 2.1 time: 0.106567 Oct 28 18:55:40.549117 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2572/6813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:40 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:41.572323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:41.574526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:41.583983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:41.584711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:41.585218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:41.586000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:41.586632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:41.587219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:41.744561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:41.753968 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb5e9012-a787-4e71-bc06-6d7d4c2c6d0e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1315 microversion: 2.1 time: 0.185741 Oct 28 18:55:41.754731 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4242/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:41 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:42.309254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d034df6d-d515-418f-8f7a-3d142b552f29 req-a46546e7-e17d-49b9-8f8e-6c51b32afbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4453f605-97f8-4ad6-aa12-52ca34232026", "tag": "722e8b88-f2da-4084-95c9-c433b8f48fef"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:42.325372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d034df6d-d515-418f-8f7a-3d142b552f29 req-a46546e7-e17d-49b9-8f8e-6c51b32afbe8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:42.326127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d034df6d-d515-418f-8f7a-3d142b552f29 req-a46546e7-e17d-49b9-8f8e-6c51b32afbe8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:42.327036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d034df6d-d515-418f-8f7a-3d142b552f29 req-a46546e7-e17d-49b9-8f8e-6c51b32afbe8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:42.344833 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d034df6d-d515-418f-8f7a-3d142b552f29 req-a46546e7-e17d-49b9-8f8e-6c51b32afbe8 service nova] Creating event network-changed:722e8b88-f2da-4084-95c9-c433b8f48fef for instance 4453f605-97f8-4ad6-aa12-52ca34232026 on n-h1-862404-2 Oct 28 18:55:42.350169 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d034df6d-d515-418f-8f7a-3d142b552f29 req-a46546e7-e17d-49b9-8f8e-6c51b32afbe8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045484 Oct 28 18:55:42.351177 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2573/6815] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:55:42.777170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:42.777724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:42.784604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:42.785112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:42.785652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:42.786361 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:42.786817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:42.787251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:42.920177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:42.927804 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2cb232ee-9d31-439c-a8ee-7641cf04fcc3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1315 microversion: 2.1 time: 0.155247 Oct 28 18:55:42.928396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4243/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:42 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:43.951829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:43.952602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:43.959561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:43.960085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:43.960535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:43.961243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:43.961711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:43.962145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:44.098995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:44.107068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4f21ac9c-f9c4-4e5d-ada3-8aba9537a41e tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1315 microversion: 2.1 time: 0.160084 Oct 28 18:55:44.107649 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2574/6817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:43 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:45.130430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:45.131097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:45.138518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:45.139022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:45.139565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:45.140246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:45.140860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:45.141297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:45.271189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:45.279406 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29a04dba-cc44-4954-94be-a0f042afca4b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1315 microversion: 2.1 time: 0.152931 Oct 28 18:55:45.280029 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4244/6818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:45 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:46.302764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:46.303385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:46.310093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:46.310636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:46.311102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:46.311803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:46.312327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:46.312765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:46.445328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:46.453555 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94bbb7dc-9184-4a96-b5ce-f291975e3c85 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1315 microversion: 2.1 time: 0.154873 Oct 28 18:55:46.454141 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2575/6819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:46 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:47.476768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:47.477421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:47.480398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:47.485664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:47.486156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:47.486587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:47.487287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:47.487747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:47.488204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:47.491652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=72 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:47.624393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:47.632777 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e31566f9-bc70-447e-9ff4-1ab9062e6902 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1315 microversion: 2.1 time: 0.159899 Oct 28 18:55:47.633363 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4245/6820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:47 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:48.305841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-87b9d99b-9199-4fb3-bf17-d62f44702a43 req-96057878-8985-4327-b580-a8807d462efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4453f605-97f8-4ad6-aa12-52ca34232026", "name": "network-vif-plugged", "status": "completed", "tag": "722e8b88-f2da-4084-95c9-c433b8f48fef"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:48.311416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:48.317928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87b9d99b-9199-4fb3-bf17-d62f44702a43 req-96057878-8985-4327-b580-a8807d462efe service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:48.318369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87b9d99b-9199-4fb3-bf17-d62f44702a43 req-96057878-8985-4327-b580-a8807d462efe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:48.318833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-87b9d99b-9199-4fb3-bf17-d62f44702a43 req-96057878-8985-4327-b580-a8807d462efe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:48.322781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:48.331348 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-87b9d99b-9199-4fb3-bf17-d62f44702a43 req-96057878-8985-4327-b580-a8807d462efe service nova] Creating event network-vif-plugged:722e8b88-f2da-4084-95c9-c433b8f48fef for instance 4453f605-97f8-4ad6-aa12-52ca34232026 on n-h1-862404-2 Oct 28 18:55:48.336735 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-87b9d99b-9199-4fb3-bf17-d62f44702a43 req-96057878-8985-4327-b580-a8807d462efe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108885 Oct 28 18:55:48.337332 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2576/6821] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:48.657008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:48.657639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:48.664469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:48.664967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:48.665411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:48.666112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:48.666574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:48.667008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:48.798387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:48.806036 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5649d8a2-9a62-465e-aa90-af3279d956d8 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1315 microversion: 2.1 time: 0.153651 Oct 28 18:55:48.806623 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4246/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:48 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:49.828054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:49.828790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:49.833490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:49.834201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:49.844509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:49.845003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:49.845450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:49.846149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:49.846615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:49.847049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:49.983463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:49.991283 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9b69eaab-2dc3-45de-8f25-5f68cbf79836 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1501 microversion: 2.1 time: 0.165571 Oct 28 18:55:49.991888 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2577/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:49 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:50.014280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:50.016642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:50.018574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:50.024698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:50.025183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:50.025620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:50.026310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:50.026763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:50.027187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:50.107337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:50.112944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Old instance type m1.heat2, new instance type m1.heat {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:55:50.119400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:55:50.119837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:55:50.120319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:55:50.120720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:55:50.121126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:55:50.225848 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c143c03a-21a8-4afc-b101-ad8df0308818 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "POST /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026/action" status: 202 len: 0 microversion: 2.1 time: 0.215740 Oct 28 18:55:50.226772 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4247/6824] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:55:50 2022] POST /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:55:50.235652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:50.236409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:50.242612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:50.243093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:50.243545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:50.244278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:50.244751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:50.245192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:50.379036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:50.387062 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94707ca1-871f-4caf-beb3-27339de89831 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1510 microversion: 2.1 time: 0.155882 Oct 28 18:55:50.388573 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2578/6825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:50 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:51.412271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:51.412826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:51.420308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:51.420805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:51.421245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:51.421945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:51.422447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:51.422878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:51.564519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:51.572258 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e09af3fc-b5dc-422e-bf49-a672470bb6d0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1510 microversion: 2.1 time: 0.164982 Oct 28 18:55:51.572832 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4248/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:51 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:52.596476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:52.597107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:52.604337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:52.604836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:52.605290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:52.606949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:52.607786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:52.608433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:52.741749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:52.749609 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8fa4f203-01ef-43b1-a739-81eba8abae08 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.157127 Oct 28 18:55:52.750211 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2579/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:52 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:55:53.773201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:53.773817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:53.781776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:53.782264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:53.782699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:53.783389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:53.783863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:53.784292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:53.912733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:53.920473 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b35e820-43eb-4b4e-a902-a075009615aa tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.151190 Oct 28 18:55:53.921059 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4249/6828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:53 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:54.944146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:54.944785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:54.952133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:54.952645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:54.953437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:54.953811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:54.954281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:54.954723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:55.090992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:55.098709 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1b88a54-b726-4dd2-9889-0510c09cdf29 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.158574 Oct 28 18:55:55.099282 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2580/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:54 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:56.122551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:56.123163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:56.130080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:56.130567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:56.131005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:56.131699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:56.132180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:56.132610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:56.269067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:56.276829 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0622381c-2d87-476b-a1f8-ece19028de30 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.158195 Oct 28 18:55:56.277421 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4250/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:56 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:57.300354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:57.301103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:57.307895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:57.308399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:57.308867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:57.310373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:57.310849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:57.311293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:57.447149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:57.454882 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-373ebbe7-7d53-4d12-9405-59a9dd6e7cf0 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.158432 Oct 28 18:55:57.455465 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2581/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:57 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:58.477577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:58.478219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:58.485581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:58.486061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:58.486494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:58.487175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:58.487626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:58.488075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:58.623501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:58.631338 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07937593-f357-452a-987d-7bd712f7ac3a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.157587 Oct 28 18:55:58.631998 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4251/6832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:58 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:59.655488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:59.656682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:55:59.663582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:59.664124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:59.664575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:59.665289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:59.665761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:59.666214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:59.797938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:59.805849 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7bb84456-c291-4bea-8ed8-54aed334de8f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.154548 Oct 28 18:55:59.806433 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2582/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:59 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:00.829645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:00.830192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:00.837170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:00.837656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:00.838093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:00.838784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:00.839509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:00.839967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:00.973863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:00.981809 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4b895294-a238-46f0-92de-de1cb1123f2d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.156096 Oct 28 18:56:00.982394 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4252/6834] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:00 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:02.004453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:02.005143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:02.012360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:02.013512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:02.013980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:02.014706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:02.015178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:02.015808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:02.148689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:02.157527 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d7f677a1-68e4-4205-abaa-ea747bf5464d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.157485 Oct 28 18:56:02.158196 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2583/6835] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:01 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:03.181234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:03.181847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:03.189291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:03.189772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:03.190211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:03.190894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:03.191347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:03.191767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:03.321844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:03.329701 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2755bec-6e56-4614-b7a0-eebb250029eb tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.152399 Oct 28 18:56:03.330271 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4253/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:03 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:04.352127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:04.352761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:04.360072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:04.360569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:04.361019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:04.361724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:04.362195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:04.362636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:04.494118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:04.502502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d563e038-0485-4d36-b472-cda52ba989b6 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.154247 Oct 28 18:56:04.503077 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2584/6837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:04 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:05.526141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:05.526754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:05.533578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:05.534065 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:05.534501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:05.535187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:05.535642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:05.536103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:05.671229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:05.678807 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ed914c2-79a4-4674-88d0-850d70c3999c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.156666 Oct 28 18:56:05.679383 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4254/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:05 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:06.703014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:06.703646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:06.710492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:06.710991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:06.711443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:06.712187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:06.712658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:06.713099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:06.842538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:06.850209 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d2664718-f011-42f8-beff-656697e35bb9 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.151913 Oct 28 18:56:06.850783 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2585/6839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:06 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:07.873466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:07.874086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:07.881002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:07.881490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:07.881931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:07.882629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:07.883085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:07.883512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:08.019840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:08.027603 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9293578-3b7b-4bc6-bd06-ace88641cebf tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.158332 Oct 28 18:56:08.028986 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4255/6840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:07 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:09.051329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:09.051992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:09.059000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:09.059510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:09.059998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:09.060807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:09.061362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:09.061816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:09.200201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:09.208586 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23a66c4d-1d6b-4605-8ee9-8eb36098cdf3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.161268 Oct 28 18:56:09.209209 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2586/6841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:09 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:10.233375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:10.234021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:10.241128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:10.241620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:10.242061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:10.242760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:10.243218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:10.243647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:10.373135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:10.380849 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fba842f2-c01a-4c63-ba89-abe86346f320 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.152792 Oct 28 18:56:10.381424 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4256/6842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:10 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:11.404219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:11.404869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:11.411638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:11.412160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:11.412608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:11.413303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:11.413768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:11.414199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:11.544143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:11.552569 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1583b03b-c9aa-49f4-98a3-e72403a81954 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.152274 Oct 28 18:56:11.553147 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2587/6843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:11 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:12.575584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:12.576867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:12.583925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:12.584418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:12.584859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:12.585562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:12.586022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:12.586453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:12.724277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:12.733033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ebb98d30-efd2-4d55-b877-49268c102e9f tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.161275 Oct 28 18:56:12.733623 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4257/6844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:12 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:13.755709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:13.756391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:13.764580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:13.765072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:13.765518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:13.766218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:13.766683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:13.767119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:13.896778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:13.905087 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8eebb2db-c2dc-462a-8d64-2d50e75fcbce tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.153282 Oct 28 18:56:13.905659 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2588/6845] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:13 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:14.928008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:14.928626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:14.936041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:14.936530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:14.936968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:14.937669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:14.938129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:14.938584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:15.072920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:15.081553 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1db4854d-10b3-49c5-b1a5-a6201191009c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.157518 Oct 28 18:56:15.082139 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4258/6846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:14 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:56:16.105921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:16.106554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:16.114070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:16.114570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:16.115025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:16.115731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:16.116235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:16.116680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:16.250335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:16.258100 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09bc2e76-1ac4-472e-9727-350981f6f29c tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.156437 Oct 28 18:56:16.258688 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2589/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:16 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:17.281666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:17.282326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:17.289282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:17.289784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:17.290232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:17.290933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:17.291394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:17.291843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:17.421978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:17.429812 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43c779be-fe95-4887-8840-2de09b18767b tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.152238 Oct 28 18:56:17.430391 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4259/6848] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:17 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:56:18.452593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:18.453217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:18.460003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:18.460499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:18.460940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:18.461665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:18.462127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:18.462559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:18.594146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:18.601941 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3646d518-7fd9-4bb4-bc83-39c9f304aa9a tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1515 microversion: 2.1 time: 0.153301 Oct 28 18:56:18.602515 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2590/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:18 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:19.626898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:19.627529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:19.630247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=34 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:19.635775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:19.636302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:19.636747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:19.637508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:19.637915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:19.638950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:19.643423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:19.838404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:19.846349 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e877559d-172d-4dbf-bd02-f8c7f51b2cb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1514 microversion: 2.1 time: 0.224077 Oct 28 18:56:19.846930 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4260/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:19 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:19.889813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-206d3822-5c7a-4279-b289-91828d444b8a req-88569e8a-3707-4992-b97a-6cd43bd4b9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4453f605-97f8-4ad6-aa12-52ca34232026", "name": "network-vif-unplugged", "status": "completed", "tag": "722e8b88-f2da-4084-95c9-c433b8f48fef"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:19.895441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=30 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:19.901782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-206d3822-5c7a-4279-b289-91828d444b8a req-88569e8a-3707-4992-b97a-6cd43bd4b9f3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:19.902335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-206d3822-5c7a-4279-b289-91828d444b8a req-88569e8a-3707-4992-b97a-6cd43bd4b9f3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:19.902816 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-206d3822-5c7a-4279-b289-91828d444b8a req-88569e8a-3707-4992-b97a-6cd43bd4b9f3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:19.907233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=86 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:19.916961 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-206d3822-5c7a-4279-b289-91828d444b8a req-88569e8a-3707-4992-b97a-6cd43bd4b9f3 service nova] Creating event network-vif-unplugged:722e8b88-f2da-4084-95c9-c433b8f48fef for instance 4453f605-97f8-4ad6-aa12-52ca34232026 on n-h2-862404-2 Oct 28 18:56:19.923724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-206d3822-5c7a-4279-b289-91828d444b8a req-88569e8a-3707-4992-b97a-6cd43bd4b9f3 service nova] Instance 4453f605-97f8-4ad6-aa12-52ca34232026 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:56:19.934896 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-206d3822-5c7a-4279-b289-91828d444b8a req-88569e8a-3707-4992-b97a-6cd43bd4b9f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049413 Oct 28 18:56:19.936533 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2591/6851] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:56:20.870324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:20.870942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:20.878372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:20.878864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:20.879303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:20.880025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:20.880490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:20.880918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:21.010844 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:21.020496 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06144913-09d7-4487-a739-7816a9e5e843 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1512 microversion: 2.1 time: 0.153995 Oct 28 18:56:21.021091 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4261/6852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:20 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:21.952762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-28139819-4efa-47af-99b6-ef38452f4cea req-78ac9dad-bfe7-4d5a-a11c-f515f95db8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4453f605-97f8-4ad6-aa12-52ca34232026", "tag": "722e8b88-f2da-4084-95c9-c433b8f48fef"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:21.962174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28139819-4efa-47af-99b6-ef38452f4cea req-78ac9dad-bfe7-4d5a-a11c-f515f95db8a3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:21.962658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28139819-4efa-47af-99b6-ef38452f4cea req-78ac9dad-bfe7-4d5a-a11c-f515f95db8a3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:21.963104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-28139819-4efa-47af-99b6-ef38452f4cea req-78ac9dad-bfe7-4d5a-a11c-f515f95db8a3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:21.975413 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-28139819-4efa-47af-99b6-ef38452f4cea req-78ac9dad-bfe7-4d5a-a11c-f515f95db8a3 service nova] Creating event network-changed:722e8b88-f2da-4084-95c9-c433b8f48fef for instance 4453f605-97f8-4ad6-aa12-52ca34232026 on n-h2-862404-2 Oct 28 18:56:21.981464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-28139819-4efa-47af-99b6-ef38452f4cea req-78ac9dad-bfe7-4d5a-a11c-f515f95db8a3 service nova] Instance 4453f605-97f8-4ad6-aa12-52ca34232026 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:56:21.992179 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-28139819-4efa-47af-99b6-ef38452f4cea req-78ac9dad-bfe7-4d5a-a11c-f515f95db8a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045007 Oct 28 18:56:21.992781 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2592/6853] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:22.042792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:22.043439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:22.050730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:22.051220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:22.051662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:22.052391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:22.052852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:22.053281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:22.191075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:22.199069 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4bee564-5bb7-47f5-b0c8-5431f9246068 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1512 microversion: 2.1 time: 0.160246 Oct 28 18:56:22.199661 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4262/6854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:22 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:23.224436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:23.225293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:23.231690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:23.232746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:23.233196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:23.234076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:23.234540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:23.235092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:23.373997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:23.381725 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fca73cae-b49f-4e0a-850e-505326297ed3 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1509 microversion: 2.1 time: 0.162351 Oct 28 18:56:23.382310 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2593/6855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:23 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:23.405295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:23.405800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:23.412758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:23.413246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:23.413687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:23.414379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:23.414845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:23.415272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:23.443832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:56:23.492909 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.compute.api [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Found an unconfirmed migration during delete, id: 16, status: finished Oct 28 18:56:24.846651 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42ac1d08-97c4-4602-a52d-2d4fc6852aac tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 204 len: 0 microversion: 2.1 time: 1.445484 Oct 28 18:56:24.848225 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4263/6856] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:56:23 2022] DELETE /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:56:24.856719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:24.857648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:24.867053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:24.867556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:24.868041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:24.868758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:24.869228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:24.869672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:24.904144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8d64f186-1b0e-4a5f-8d81-563dd31f7685 req-92bc4838-a523-4317-a12b-a2bde7073bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4453f605-97f8-4ad6-aa12-52ca34232026", "name": "network-vif-plugged", "status": "completed", "tag": "722e8b88-f2da-4084-95c9-c433b8f48fef"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:24.915884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8d64f186-1b0e-4a5f-8d81-563dd31f7685 req-92bc4838-a523-4317-a12b-a2bde7073bbf service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:24.916392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8d64f186-1b0e-4a5f-8d81-563dd31f7685 req-92bc4838-a523-4317-a12b-a2bde7073bbf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:24.916896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8d64f186-1b0e-4a5f-8d81-563dd31f7685 req-92bc4838-a523-4317-a12b-a2bde7073bbf service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:24.931490 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8d64f186-1b0e-4a5f-8d81-563dd31f7685 req-92bc4838-a523-4317-a12b-a2bde7073bbf service nova] Creating event network-vif-plugged:722e8b88-f2da-4084-95c9-c433b8f48fef for instance 4453f605-97f8-4ad6-aa12-52ca34232026 on n-h2-862404-2 Oct 28 18:56:24.937333 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8d64f186-1b0e-4a5f-8d81-563dd31f7685 req-92bc4838-a523-4317-a12b-a2bde7073bbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037828 Oct 28 18:56:24.938158 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4264/6857] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:25.018777 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:25.026721 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de404a78-9f7a-4b65-9ede-a92d16a5a280 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1501 microversion: 2.1 time: 0.174230 Oct 28 18:56:25.027308 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2594/6858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:24 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:26.051550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:26.052294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:26.059303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:26.059848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:26.060341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:26.061040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:26.061493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:26.061971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:26.198407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbddd5a5c94c41d1befc844976f8ec75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0997add51d440fae67f9878fc15f32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:26.206131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1f7dbdfe-bfd8-4bfd-ae0d-71bfa43fb2db tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 200 len: 1501 microversion: 2.1 time: 0.159074 Oct 28 18:56:26.206712 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4265/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:26 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:26.791224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ffb21e5e-9c71-4f23-bfa1-1c194cf4d686 req-96fe4fce-ce2e-4442-8f62-9d20a2294124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4453f605-97f8-4ad6-aa12-52ca34232026", "name": "network-vif-deleted", "tag": "722e8b88-f2da-4084-95c9-c433b8f48fef"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:26.802252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ffb21e5e-9c71-4f23-bfa1-1c194cf4d686 req-96fe4fce-ce2e-4442-8f62-9d20a2294124 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:26.802755 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ffb21e5e-9c71-4f23-bfa1-1c194cf4d686 req-96fe4fce-ce2e-4442-8f62-9d20a2294124 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:26.803199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ffb21e5e-9c71-4f23-bfa1-1c194cf4d686 req-96fe4fce-ce2e-4442-8f62-9d20a2294124 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:26.816234 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ffb21e5e-9c71-4f23-bfa1-1c194cf4d686 req-96fe4fce-ce2e-4442-8f62-9d20a2294124 service nova] Creating event network-vif-deleted:722e8b88-f2da-4084-95c9-c433b8f48fef for instance 4453f605-97f8-4ad6-aa12-52ca34232026 on n-h2-862404-2 Oct 28 18:56:26.821906 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ffb21e5e-9c71-4f23-bfa1-1c194cf4d686 req-96fe4fce-ce2e-4442-8f62-9d20a2294124 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034873 Oct 28 18:56:26.826939 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2595/6860] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:27.230276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:27.230832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:27.237905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:27.238392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:27.238830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:27.239557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:27.240047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:27.240475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:27.253913 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] HTTP exception thrown: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Request method failure captured: Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 HTTP/1.1 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCWqHopR9TllK92EX6eqbECBsPgAKDBie3pBqux-gIVqeLgHkplMLQ4V0exPzGyeZLNIeVN4HLVX-ilw8eamBwBWGjK8H3NysBg5xUqjBZ8c4QYy_Ioh-k79e2p0DXlPTppHyGJhdnUdp4b9ZP1Vs5VMEHB5YDjJ6EEsIBrp0Kd5eYs Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cb0997add51d440fae67f9878fc15f32 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb0997add51d440fae67f9878fc15f32", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cb0997add51d440fae67f9878fc15f32 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-58744281-project Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: dbddd5a5c94c41d1befc844976f8ec75 Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-58744281-project Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4453f605-97f8-4ad6-aa12-52ca34232026'} Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:56:27.255553 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Returning 404 to user: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f26e9ca6-f324-46fa-82fc-e8e9642cf93d tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 404 len: 111 microversion: 2.1 time: 0.031184 Oct 28 18:56:27.260224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4266/6861] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:27 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:56:27.273146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:27.273757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:27.283941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:27.284447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:27.284902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:27.285616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:27.286088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:27.286534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:27.299638 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] HTTP exception thrown: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Request method failure captured: Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 HTTP/1.1 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCWqHopR9TllK92EX6eqbECBsPgAKDBie3pBqux-gIVqeLgHkplMLQ4V0exPzGyeZLNIeVN4HLVX-ilw8eamBwBWGjK8H3NysBg5xUqjBZ8c4QYy_Ioh-k79e2p0DXlPTppHyGJhdnUdp4b9ZP1Vs5VMEHB5YDjJ6EEsIBrp0Kd5eYs Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: cb0997add51d440fae67f9878fc15f32 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb0997add51d440fae67f9878fc15f32", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: cb0997add51d440fae67f9878fc15f32 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-DeleteServersTestJSON-58744281-project Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: dbddd5a5c94c41d1befc844976f8ec75 Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersTestJSON-58744281-project Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '4453f605-97f8-4ad6-aa12-52ca34232026'} Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:56:27.301326 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Returning 404 to user: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d916de6-2c2c-4840-b204-8d2ed4979872 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 404 len: 111 microversion: 2.1 time: 0.033941 Oct 28 18:56:27.305706 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2596/6862] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:56:27 2022] DELETE /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:56:27.311670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:27.312323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] [instance: 4453f605-97f8-4ad6-aa12-52ca34232026] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:27.318293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:27.318783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:27.319224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:27.319942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:27.320405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:27.320835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:27.334792 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] HTTP exception thrown: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Request method failure captured: Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 HTTP/1.1 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCWqHopR9TllK92EX6eqbECBsPgAKDBie3pBqux-gIVqeLgHkplMLQ4V0exPzGyeZLNIeVN4HLVX-ilw8eamBwBWGjK8H3NysBg5xUqjBZ8c4QYy_Ioh-k79e2p0DXlPTppHyGJhdnUdp4b9ZP1Vs5VMEHB5YDjJ6EEsIBrp0Kd5eYs Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: cb0997add51d440fae67f9878fc15f32 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb0997add51d440fae67f9878fc15f32", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb0997add51d440fae67f9878fc15f32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: cb0997add51d440fae67f9878fc15f32 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-58744281 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-58744281-project Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: dbddd5a5c94c41d1befc844976f8ec75 Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-58744281-project Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '4453f605-97f8-4ad6-aa12-52ca34232026'} Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:56:27.336323 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] Returning 404 to user: Instance 4453f605-97f8-4ad6-aa12-52ca34232026 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad5167df-7694-4eef-be96-6b69b3e41fb7 tempest-DeleteServersTestJSON-58744281 tempest-DeleteServersTestJSON-58744281-project] 10.222.0.16 "GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026" status: 404 len: 111 microversion: 2.1 time: 0.030183 Oct 28 18:56:27.340576 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4267/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:27 2022] GET /compute/v2.1/servers/4453f605-97f8-4ad6-aa12-52ca34232026 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:56:36.155114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1059448587", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "b1a00ddc-c5d0-4dcb-830c-3408d6632ae5"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:36.210953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] validate_networks() for [('b1a00ddc-c5d0-4dcb-830c-3408d6632ae5', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:56:36.616293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:56:36.616728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:56:36.617241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:56:36.617665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:56:36.618086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:56:36.628267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:36.628766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:36.629400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:36.630150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:36.630771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:36.631246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:36.650516 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Getting quotas for project 080c13acd00642889e427fb7a3e6a61a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:56:36.656397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Getting quotas for user 31cf7ca7de8648adaf2766a700803b03 and project 080c13acd00642889e427fb7a3e6a61a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:56:36.669204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:56:36.671864 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:56:36.719875 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-39ae6dff-41e4-4484-8abb-bef99b2ce7e9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719505 Oct 28 18:56:36.720549 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2597/6864] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:56:36.733314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65a94eb5-5360-48dc-8ca8-c96a5c443acb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:36.734135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65a94eb5-5360-48dc-8ca8-c96a5c443acb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:36.805959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-65a94eb5-5360-48dc-8ca8-c96a5c443acb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:36.814542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65a94eb5-5360-48dc-8ca8-c96a5c443acb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1218 microversion: 2.1 time: 0.086043 Oct 28 18:56:36.815434 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4268/6865] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:36 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:37.848126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:37.849427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:37.862367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:37.862875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:37.864290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:37.866088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:37.866763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:37.867358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:37.958402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:37.967384 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9cc427a7-a157-4b82-90bc-f4ae30ef7b1e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1278 microversion: 2.1 time: 0.132998 Oct 28 18:56:37.968609 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2598/6866] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:37 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:38.990635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:38.991847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:38.995639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:39.001974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:39.002766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:39.003433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:39.004373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:39.005015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:39.005667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:39.240858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:39.249164 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee97eeb8-5477-4517-84d2-a241ba7175f4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1318 microversion: 2.1 time: 0.262367 Oct 28 18:56:39.264312 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4269/6867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:38 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:39.489910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d85087a7-5e96-4dbd-ae0f-7072d426c3f3 req-fb6e6d1c-d7d4-49c2-a145-8e78d7825be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affeb735-cd48-4391-9179-2ae0567ca542", "tag": "8dcccc3b-6395-4a96-a447-93a19767e5d2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:39.502318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d85087a7-5e96-4dbd-ae0f-7072d426c3f3 req-fb6e6d1c-d7d4-49c2-a145-8e78d7825be7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:39.503228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d85087a7-5e96-4dbd-ae0f-7072d426c3f3 req-fb6e6d1c-d7d4-49c2-a145-8e78d7825be7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:39.503855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d85087a7-5e96-4dbd-ae0f-7072d426c3f3 req-fb6e6d1c-d7d4-49c2-a145-8e78d7825be7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:39.519117 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d85087a7-5e96-4dbd-ae0f-7072d426c3f3 req-fb6e6d1c-d7d4-49c2-a145-8e78d7825be7 service nova] Creating event network-changed:8dcccc3b-6395-4a96-a447-93a19767e5d2 for instance affeb735-cd48-4391-9179-2ae0567ca542 on n-h2-862404-2 Oct 28 18:56:39.525068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d85087a7-5e96-4dbd-ae0f-7072d426c3f3 req-fb6e6d1c-d7d4-49c2-a145-8e78d7825be7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042589 Oct 28 18:56:39.525843 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2599/6868] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:40.273165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:40.273813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:40.281170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:40.281648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:40.282080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:40.282767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:40.283224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:40.283646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:40.419941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:40.427748 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-405bfabc-fc5c-40ed-96fb-4b85bb306904 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1318 microversion: 2.1 time: 0.158517 Oct 28 18:56:40.428401 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4270/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:40 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:41.453229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:41.453979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:41.460128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:41.460627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:41.461079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:41.461797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:41.462266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:41.462707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:41.595774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:41.603454 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c4f30b56-8434-435a-94d6-dfeb64dff095 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1318 microversion: 2.1 time: 0.156557 Oct 28 18:56:41.604317 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2600/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:41 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:42.627009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:42.627629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:42.634618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:42.635103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:42.635539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:42.636258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:42.636713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:42.637141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:42.768268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:42.775865 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc4bee36-99d3-43da-9714-c742607950cd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1318 microversion: 2.1 time: 0.152799 Oct 28 18:56:42.776444 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4271/6871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:42 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:43.019943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6c5ea396-a4da-4145-b355-41cf36369412 req-47a456c6-6430-4665-a634-239dbe9ad701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affeb735-cd48-4391-9179-2ae0567ca542", "name": "network-vif-plugged", "status": "completed", "tag": "8dcccc3b-6395-4a96-a447-93a19767e5d2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:43.031260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6c5ea396-a4da-4145-b355-41cf36369412 req-47a456c6-6430-4665-a634-239dbe9ad701 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:43.032390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6c5ea396-a4da-4145-b355-41cf36369412 req-47a456c6-6430-4665-a634-239dbe9ad701 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:43.032848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6c5ea396-a4da-4145-b355-41cf36369412 req-47a456c6-6430-4665-a634-239dbe9ad701 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:43.044996 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6c5ea396-a4da-4145-b355-41cf36369412 req-47a456c6-6430-4665-a634-239dbe9ad701 service nova] Creating event network-vif-plugged:8dcccc3b-6395-4a96-a447-93a19767e5d2 for instance affeb735-cd48-4391-9179-2ae0567ca542 on n-h2-862404-2 Oct 28 18:56:43.050343 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6c5ea396-a4da-4145-b355-41cf36369412 req-47a456c6-6430-4665-a634-239dbe9ad701 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Oct 28 18:56:43.050954 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2601/6872] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:43.799467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:43.800035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:43.806927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:43.807408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:43.807859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:43.808547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:43.809020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:43.810058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:43.943602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:43.951463 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6391c548-29ea-4dcf-b528-e1e40cfb435f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1318 microversion: 2.1 time: 0.155905 Oct 28 18:56:43.952085 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4272/6873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:43 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:44.974803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:44.975567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:44.983302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:44.983800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:44.984271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:44.984971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:44.985434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:44.985869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.128579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:45.136371 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a98d2d45-748c-4285-9030-86e43ca57d07 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1508 microversion: 2.1 time: 0.166216 Oct 28 18:56:45.136954 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2602/6874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:44 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:45.158566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:45.159207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:45.165951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.166433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.166871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.167557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.168043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.168468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.297255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:45.305013 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4ea2843-1408-49d1-8243-e334980785b3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1508 microversion: 2.1 time: 0.150294 Oct 28 18:56:45.305590 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4273/6875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:45 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:45.327346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:45.329773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:45.335687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.336208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.336655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.337350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.337818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.338252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.400648 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e0d08b1-0387-42de-9bb6-93e8ee963e90 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "PUT /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1080 microversion: 2.1 time: 0.077423 Oct 28 18:56:45.401276 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2603/6876] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 18:56:45 2022] PUT /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1080 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:45.420590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:45.421209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:45.427077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.427565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.428050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.428745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.429201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.429635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.564030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:45.571715 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1fdfc6e6-ee42-41ae-b38b-9d4a994cb60b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1506 microversion: 2.1 time: 0.155624 Oct 28 18:56:45.572324 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4274/6877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:45 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:45.594182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:45.594817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:45.600830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.601329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.601786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.602495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.602965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.603412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.732179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:45.739780 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6a6607df-ed70-4f5a-80e4-4ff1089684ee tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1506 microversion: 2.1 time: 0.150382 Oct 28 18:56:45.740371 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2604/6878] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:45 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:45.762241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:45.765455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:45.771403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.771925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.772369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.773061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.773523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.773960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.801916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:45.807756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Old instance type m1.heat2, new instance type m1.heat {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:56:45.815185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:56:45.815616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:56:45.816117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:56:45.816534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:56:45.816957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:56:45.885000 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e43050a-a5ec-4d7e-b566-ebe9bd129024 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "POST /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542/action" status: 202 len: 0 microversion: 2.1 time: 0.126688 Oct 28 18:56:45.885625 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4275/6879] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:56:45 2022] POST /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:56:45.894349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:45.895005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:45.901055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.901551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.901999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:45.902699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:45.903288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:45.903718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:46.048916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:46.062311 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae6432c9-df79-47cc-b0e2-8a9a61588b9f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1517 microversion: 2.1 time: 0.167104 Oct 28 18:56:46.073735 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2605/6880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:45 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:47.079333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:47.083936 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:47.084558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:47.093333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:47.094334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:47.094781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:47.095493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:47.095978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:47.096409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:47.297603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:47.305398 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf91b316-34f4-45e9-bf19-7a1f7e1fd252 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1517 microversion: 2.1 time: 0.227731 Oct 28 18:56:47.305988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4276/6881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:47 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1517 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:48.327934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:48.328567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:48.330525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:48.331211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:48.338194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:48.338694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:48.339172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:48.339900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:48.340369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:48.340837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:48.469809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:48.477542 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-76939cf1-f746-4450-8d2c-24e4bf7951d5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.153606 Oct 28 18:56:48.478119 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2606/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:48 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:49.501778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:49.502396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:49.509198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:49.509687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:49.510130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:49.510839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:49.511294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:49.511722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:49.647565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:49.655307 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-27da1191-1292-447b-b8f3-af2ddee2a32e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.158294 Oct 28 18:56:49.655898 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4277/6883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:49 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:56:50.678811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:50.679440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:50.681776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:50.687270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:50.687763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:50.688238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:50.688950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:50.689416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:50.689858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:50.693397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:50.825424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:50.833100 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5750d6b3-04f6-46a8-bae5-6ce6f0b3f322 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.158422 Oct 28 18:56:50.833675 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2607/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:50 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:51.857663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:51.858321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:51.860823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:51.866170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:51.866656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:51.867102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:51.867795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:51.868280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:51.868710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:52.000021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:52.007700 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0d115b5-924a-461a-9854-b7921e57ed8a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.155039 Oct 28 18:56:52.008315 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4278/6885] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:51 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:53.031273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:53.032091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:53.038957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:53.039459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:53.039935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:53.040645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:53.041119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:53.041554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:53.179651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:53.187341 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e02483a-423e-4cec-9fa3-76d304cc63c0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.160709 Oct 28 18:56:53.187932 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2608/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:53 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:54.209503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:54.210125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:54.217417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:54.217906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:54.218343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:54.219036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:54.219492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:54.219948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:54.348319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:54.356940 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0593d7e-36d4-425e-9aa6-204e8c537412 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.150765 Oct 28 18:56:54.357527 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4279/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:54 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:55.382187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:55.382821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:55.390387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:55.390886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:55.391342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:55.392078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:55.392554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:55.392996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:55.523092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:55.531808 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-34b67f51-af21-4226-a8b0-c847dec8b5e4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.153550 Oct 28 18:56:55.532414 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2609/6888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:55 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:56.554494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:56.555088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:56.561938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:56.562416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:56.562848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:56.563535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:56.564020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:56.564446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:56.696945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:56.705303 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc1255e4-1e38-4639-93ea-8b29b3510498 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.154735 Oct 28 18:56:56.705883 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4280/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:56 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:57.729655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:57.730284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:57.737955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:57.738462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:57.738917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:57.739621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:57.740116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:57.740559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:57.873547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:57.881646 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-33918579-b33b-4268-9683-17c7489735f3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.156257 Oct 28 18:56:57.882223 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2610/6890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:57 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:56:58.906160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:58.906777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:56:58.913802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:58.914289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:58.914725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:58.915415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:58.915896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:58.916348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:59.046196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:59.054042 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76f490da-f08a-4f33-bced-c1cb05bf9b06 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.152476 Oct 28 18:56:59.054635 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4281/6891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:58 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:00.078089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:00.078763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:00.085810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:00.086302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:00.086746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:00.087443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:00.087942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:00.088409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:00.220792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:00.228442 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7a21b43f-98ec-4534-8daa-c3a01af6d4f5 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.154374 Oct 28 18:57:00.229284 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2611/6892] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:00 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:01.252688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:01.253312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:01.260707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:01.261119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:01.261558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:01.262520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:01.263314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:01.263749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:01.402190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:01.410659 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b90b6663-c2e8-4217-a296-621deba519bd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.161997 Oct 28 18:57:01.411254 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4282/6893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:01 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:02.434222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:02.435079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:02.442262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:02.442775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:02.443234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:02.444005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:02.444480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:02.444927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:02.581865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:02.589727 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-983f5234-717e-4ebf-a082-90b329a55990 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.159618 Oct 28 18:57:02.590937 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2612/6894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:02 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:03.614216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:03.614836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:03.622465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:03.622989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:03.623429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:03.624289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:03.624763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:03.625191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:03.754262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:03.762588 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-faf5bfeb-07d8-474b-bfc3-8110bf132859 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.151728 Oct 28 18:57:03.763345 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4283/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:03 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:04.785599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:04.786288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:04.793165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:04.793667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:04.794105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:04.794811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:04.795273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:04.795716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:04.922744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:04.930470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c845af37-b5f8-45ad-b646-2d749aabaf70 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.148854 Oct 28 18:57:04.931058 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2613/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:04 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:05.954215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:05.954842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:05.961800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:05.962286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:05.962726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:05.963417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:05.963904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:05.964333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:05.968329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:06.096795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:06.104819 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-207829b1-6cc6-4aa0-9d28-301322f7b72c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.155158 Oct 28 18:57:06.105408 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4284/6897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:05 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:07.128339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:07.128973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:07.135791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:07.136318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:07.136770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:07.138321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:07.138797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:07.139238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:07.274799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:07.282705 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7509ade7-a55c-4c74-ad4f-6017787152ca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.158329 Oct 28 18:57:07.283297 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2614/6898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:07 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:08.305801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:08.306415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:08.313930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:08.314412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:08.314848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:08.315535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:08.316037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:08.316461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:08.450473 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:08.458133 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d835791-9709-4f4c-8fd2-1226874c062b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.156209 Oct 28 18:57:08.458715 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4285/6899] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:08 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:09.480967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:09.481600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:09.488443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:09.488949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:09.489406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:09.490150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:09.490622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:09.491066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:09.620868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:09.629381 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e7001779-64f8-4fd0-a6de-0aafbe2adeec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.152743 Oct 28 18:57:09.629961 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2615/6900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:09 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:10.653961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:10.654596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:10.661571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:10.662046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:10.662480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:10.663166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:10.663616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:10.664133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:10.792470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:10.800207 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8935585e-e858-486d-9076-9ea1b7ffc0a6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.150896 Oct 28 18:57:10.800793 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4286/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:10 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:11.823273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:11.823936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:11.831191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:11.831690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:11.832180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:11.832880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:11.833346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:11.833785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:11.965885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:11.973600 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed1bd13d-2f38-4cbe-978c-c06ceea75e62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.154247 Oct 28 18:57:11.974176 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2616/6902] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:11 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:12.997429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:12.997972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:13.004832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:13.005315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:13.005748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:13.006439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:13.006887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:13.007312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:13.149372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:13.157656 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2251e91-415d-4b24-8ab0-24060418851f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.164712 Oct 28 18:57:13.158425 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4287/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:12 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:14.181696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:14.182338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:14.189425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:14.189923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:14.190391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:14.191088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:14.191553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:14.192026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:14.324631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:14.332241 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-31d8cd81-fe55-4645-8fd0-a1c6afdbeb00 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1522 microversion: 2.1 time: 0.154442 Oct 28 18:57:14.332806 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2617/6904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:14 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:15.355806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:15.356550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:15.363211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:15.363702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:15.364174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:15.364879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:15.365340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:15.365772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:15.418460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e6d8b11a-8e93-48c2-b097-cf53a3ec9784 req-4ecadf5b-a4d7-4812-889f-0bacc364164f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affeb735-cd48-4391-9179-2ae0567ca542", "name": "network-vif-unplugged", "status": "completed", "tag": "8dcccc3b-6395-4a96-a447-93a19767e5d2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:15.429694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e6d8b11a-8e93-48c2-b097-cf53a3ec9784 req-4ecadf5b-a4d7-4812-889f-0bacc364164f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:15.430196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e6d8b11a-8e93-48c2-b097-cf53a3ec9784 req-4ecadf5b-a4d7-4812-889f-0bacc364164f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:15.430647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e6d8b11a-8e93-48c2-b097-cf53a3ec9784 req-4ecadf5b-a4d7-4812-889f-0bacc364164f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:15.443271 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e6d8b11a-8e93-48c2-b097-cf53a3ec9784 req-4ecadf5b-a4d7-4812-889f-0bacc364164f service nova] Creating event network-vif-unplugged:8dcccc3b-6395-4a96-a447-93a19767e5d2 for instance affeb735-cd48-4391-9179-2ae0567ca542 on n-h1-862404-2 Oct 28 18:57:15.449029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-e6d8b11a-8e93-48c2-b097-cf53a3ec9784 req-4ecadf5b-a4d7-4812-889f-0bacc364164f service nova] Instance affeb735-cd48-4391-9179-2ae0567ca542 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:57:15.461176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e6d8b11a-8e93-48c2-b097-cf53a3ec9784 req-4ecadf5b-a4d7-4812-889f-0bacc364164f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047462 Oct 28 18:57:15.461787 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2618/6905] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:57:15.509439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:15.518078 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6ce53f3-4ca3-4833-a5a4-01c3ca6a2314 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1521 microversion: 2.1 time: 0.166509 Oct 28 18:57:15.518667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4288/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:15 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:16.544020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:16.544741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:16.551492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:16.552028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:16.552485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:16.553199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:16.553672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:16.554219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:16.717921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:16.728011 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-56b5ca89-d2d4-42b8-982d-ad0b51ac5885 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1519 microversion: 2.1 time: 0.189425 Oct 28 18:57:16.728616 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2619/6907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:16 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:17.476809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c33f39e2-6187-40e3-955c-8b208cba10b5 req-7f8468b4-1934-41eb-acd1-26154d15b777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affeb735-cd48-4391-9179-2ae0567ca542", "tag": "8dcccc3b-6395-4a96-a447-93a19767e5d2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:17.487546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c33f39e2-6187-40e3-955c-8b208cba10b5 req-7f8468b4-1934-41eb-acd1-26154d15b777 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:17.488055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c33f39e2-6187-40e3-955c-8b208cba10b5 req-7f8468b4-1934-41eb-acd1-26154d15b777 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:17.488484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c33f39e2-6187-40e3-955c-8b208cba10b5 req-7f8468b4-1934-41eb-acd1-26154d15b777 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:17.501454 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c33f39e2-6187-40e3-955c-8b208cba10b5 req-7f8468b4-1934-41eb-acd1-26154d15b777 service nova] Creating event network-changed:8dcccc3b-6395-4a96-a447-93a19767e5d2 for instance affeb735-cd48-4391-9179-2ae0567ca542 on n-h1-862404-2 Oct 28 18:57:17.506668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-c33f39e2-6187-40e3-955c-8b208cba10b5 req-7f8468b4-1934-41eb-acd1-26154d15b777 service nova] Instance affeb735-cd48-4391-9179-2ae0567ca542 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:57:17.517925 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c33f39e2-6187-40e3-955c-8b208cba10b5 req-7f8468b4-1934-41eb-acd1-26154d15b777 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044856 Oct 28 18:57:17.518627 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4289/6908] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:57:17.760214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:17.760852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:17.767783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:17.768318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:17.768783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:17.769494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:17.769970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:17.770416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:17.902908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:17.910659 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-988e08c4-761c-46f6-a5b7-44ac7af3dfd1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1519 microversion: 2.1 time: 0.154401 Oct 28 18:57:17.911249 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2620/6909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:17 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:18.936644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:18.937272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:18.944364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:18.944884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:18.945331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:18.946040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:18.946502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:18.946935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:19.092702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:19.100834 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbf0d5b6-b0a3-417c-a4c2-68f2602d89dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1519 microversion: 2.1 time: 0.169856 Oct 28 18:57:19.101423 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4290/6910] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:18 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:20.124811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:20.125432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:20.132029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:20.132525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:20.132998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:20.133695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:20.134157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:20.134595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:20.270068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:20.277880 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79158bda-e135-47aa-bc11-150b49f1253f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1516 microversion: 2.1 time: 0.157421 Oct 28 18:57:20.278459 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2621/6911] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:20 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:20.300160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:20.300705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:20.307422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:20.307941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:20.308971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:20.309712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:20.310163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:20.310611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:20.366628 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-15c079cb-6f3d-4798-9236-558e7bd10892 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "POST /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542/action" status: 204 len: 0 microversion: 2.1 time: 0.070234 Oct 28 18:57:20.367299 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4291/6912] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:57:20 2022] POST /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:57:20.376382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:20.376991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:20.383205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:20.383849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:20.384310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:20.385155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:20.385628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:20.386072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:20.519573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:20.528968 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13788b70-3c3a-4d09-8da9-c54a7686b301 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1516 microversion: 2.1 time: 0.156533 Oct 28 18:57:20.529756 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2622/6913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:20 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:21.553556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:21.554270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:21.561681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:21.562174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:21.562664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:21.563322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:21.563796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:21.564276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:21.704688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:21.712355 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5fd35219-faf1-48e5-aa5a-12441a12b1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1516 microversion: 2.1 time: 0.163094 Oct 28 18:57:21.712938 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4292/6914] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:21 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:22.695978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0a8b78cf-6ed0-44f6-bfd6-0cccfaf4b156 req-0e4c7e72-929d-4ca5-a246-15ff3bef2c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affeb735-cd48-4391-9179-2ae0567ca542", "name": "network-vif-plugged", "status": "completed", "tag": "8dcccc3b-6395-4a96-a447-93a19767e5d2"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:22.702458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=32 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:22.708276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0a8b78cf-6ed0-44f6-bfd6-0cccfaf4b156 req-0e4c7e72-929d-4ca5-a246-15ff3bef2c85 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:22.708856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0a8b78cf-6ed0-44f6-bfd6-0cccfaf4b156 req-0e4c7e72-929d-4ca5-a246-15ff3bef2c85 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:22.709310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0a8b78cf-6ed0-44f6-bfd6-0cccfaf4b156 req-0e4c7e72-929d-4ca5-a246-15ff3bef2c85 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:22.713368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=94 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:22.722403 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0a8b78cf-6ed0-44f6-bfd6-0cccfaf4b156 req-0e4c7e72-929d-4ca5-a246-15ff3bef2c85 service nova] Creating event network-vif-plugged:8dcccc3b-6395-4a96-a447-93a19767e5d2 for instance affeb735-cd48-4391-9179-2ae0567ca542 on n-h1-862404-2 Oct 28 18:57:22.727568 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0a8b78cf-6ed0-44f6-bfd6-0cccfaf4b156 req-0e4c7e72-929d-4ca5-a246-15ff3bef2c85 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Oct 28 18:57:22.728234 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2623/6915] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:57:22.736532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:22.737148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:22.739901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=30 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:22.745122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:22.745606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:22.746649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:22.747349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:22.747804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:22.748282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:22.877292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:22.885030 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e390c866-b1ed-49f8-98c4-80a3148dc2ba tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1508 microversion: 2.1 time: 0.152524 Oct 28 18:57:22.885614 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4293/6916] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:22 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:22.907768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:22.908513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:22.914667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:22.915361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:22.915834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:22.916554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:22.917008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:22.917450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:23.050960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:23.058850 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-817afe76-f42f-437d-97ec-8b72799ac12a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1508 microversion: 2.1 time: 0.155375 Oct 28 18:57:23.059442 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2624/6917] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:22 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:23.084467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08cbb5ae-855b-40bb-872f-eacdc73f3779 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Action: 'create', calling method: .version_select at 0x7f78de1924c0>, body: {"keypair": {"name": "tempest-keypair-841434216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPIQzHyH0EJ7WD1KoSRcILlxrl1iJAplSt5bUbC63rnpI9K/BWtIzH3Rpl0VuHxfJhwXCk5XO6fT0z7FjuUdZyL4PNblx8k28kdOMJqo9tUVw0lEl9Aymo8vIyWbx782g=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:23.100317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-08cbb5ae-855b-40bb-872f-eacdc73f3779 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Getting quotas for project 080c13acd00642889e427fb7a3e6a61a. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:57:23.106214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-08cbb5ae-855b-40bb-872f-eacdc73f3779 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Getting quotas for user 31cf7ca7de8648adaf2766a700803b03 and project 080c13acd00642889e427fb7a3e6a61a. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:57:23.134581 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08cbb5ae-855b-40bb-872f-eacdc73f3779 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054049 Oct 28 18:57:23.135208 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4294/6918] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:57:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:57:24.639952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:24.640575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:24.647314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:24.647800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:24.648276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:24.648971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:24.649432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:24.649865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:24.779129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:24.786851 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5b2c1dc2-9ce5-400f-bb13-4ab1987f4203 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 200 len: 1508 microversion: 2.1 time: 0.151433 Oct 28 18:57:24.787420 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2625/6919] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:24 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:24.810038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:24.810552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:24.817143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:24.817629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:24.818096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:24.818786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:24.819244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:24.819666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:24.844143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:57:24.920988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81185e0e-dbf9-4f07-b76c-ad07affe4c29 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "DELETE /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 204 len: 0 microversion: 2.1 time: 0.115892 Oct 28 18:57:24.921541 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4295/6920] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:57:24 2022] DELETE /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:57:24.982070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2109378299", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "b1a00ddc-c5d0-4dcb-830c-3408d6632ae5"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:25.036338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] validate_networks() for [('b1a00ddc-c5d0-4dcb-830c-3408d6632ae5', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:57:25.402779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:57:25.403233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:57:25.403707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:57:25.404164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:57:25.404592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:57:25.413448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:25.413940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:25.414391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:25.415132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:25.415604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:25.416079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:25.432747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Getting quotas for project 080c13acd00642889e427fb7a3e6a61a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:57:25.438584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Getting quotas for user 31cf7ca7de8648adaf2766a700803b03 and project 080c13acd00642889e427fb7a3e6a61a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:57:25.451364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:57:25.453698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:57:25.499116 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1f942e2-5697-4d7b-9752-b86221414243 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522587 Oct 28 18:57:25.499716 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2626/6921] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:57:25.512166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7366edda-d94e-4dee-83d1-451dde045a0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:25.512771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7366edda-d94e-4dee-83d1-451dde045a0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:25.566959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7366edda-d94e-4dee-83d1-451dde045a0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:25.575884 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7366edda-d94e-4dee-83d1-451dde045a0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1218 microversion: 2.1 time: 0.068666 Oct 28 18:57:25.576403 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4296/6922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:25 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:26.598903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:26.599633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:26.607244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:26.607753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:26.608390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:26.609101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:26.609566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:26.610012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:26.680868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:26.689187 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62fc7048-e7ce-485e-994d-9d075e089239 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1270 microversion: 2.1 time: 0.095006 Oct 28 18:57:26.689765 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2627/6923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:26 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:26.868322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7e2f8e78-2cca-48fd-aea6-cb6912fc2ef1 req-31f15d5e-467c-4ad9-8249-2daf4b4b4855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affeb735-cd48-4391-9179-2ae0567ca542", "name": "network-vif-deleted", "tag": "8dcccc3b-6395-4a96-a447-93a19767e5d2"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:26.904072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7e2f8e78-2cca-48fd-aea6-cb6912fc2ef1 req-31f15d5e-467c-4ad9-8249-2daf4b4b4855 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:26.904574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7e2f8e78-2cca-48fd-aea6-cb6912fc2ef1 req-31f15d5e-467c-4ad9-8249-2daf4b4b4855 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:26.905014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7e2f8e78-2cca-48fd-aea6-cb6912fc2ef1 req-31f15d5e-467c-4ad9-8249-2daf4b4b4855 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:26.929692 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7e2f8e78-2cca-48fd-aea6-cb6912fc2ef1 req-31f15d5e-467c-4ad9-8249-2daf4b4b4855 service nova] Creating event network-vif-deleted:8dcccc3b-6395-4a96-a447-93a19767e5d2 for instance affeb735-cd48-4391-9179-2ae0567ca542 on n-h1-862404-2 Oct 28 18:57:26.936248 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7e2f8e78-2cca-48fd-aea6-cb6912fc2ef1 req-31f15d5e-467c-4ad9-8249-2daf4b4b4855 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072261 Oct 28 18:57:26.937667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4297/6924] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:57:27.712908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:27.713723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:27.720602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:27.721093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:27.721535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:27.722241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:27.722703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:27.723137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:27.921300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:27.929086 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1d9215d3-317c-4c4c-8894-8aeb8b2c7756 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1318 microversion: 2.1 time: 0.220095 Oct 28 18:57:27.929678 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2628/6925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:27 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:28.953576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:28.954257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fcf9a019-49bb-41de-94fd-906ca673541f req-a6a6a56d-08df-4b9b-ab5f-82fa76445b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a80dc2-3c33-442c-b3f7-ba6a3b091a22", "tag": "31433204-4b27-4122-b1d5-d4a8bc923b5e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:28.954658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:28.961326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:28.961829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:28.962279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:28.962997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:28.963518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:28.963639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fcf9a019-49bb-41de-94fd-906ca673541f req-a6a6a56d-08df-4b9b-ab5f-82fa76445b65 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:28.963937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:28.964067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fcf9a019-49bb-41de-94fd-906ca673541f req-a6a6a56d-08df-4b9b-ab5f-82fa76445b65 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:28.964571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fcf9a019-49bb-41de-94fd-906ca673541f req-a6a6a56d-08df-4b9b-ab5f-82fa76445b65 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:28.976285 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fcf9a019-49bb-41de-94fd-906ca673541f req-a6a6a56d-08df-4b9b-ab5f-82fa76445b65 service nova] Creating event network-changed:31433204-4b27-4122-b1d5-d4a8bc923b5e for instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 on n-h1-862404-2 Oct 28 18:57:28.982132 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fcf9a019-49bb-41de-94fd-906ca673541f req-a6a6a56d-08df-4b9b-ab5f-82fa76445b65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034134 Oct 28 18:57:28.982737 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4298/6926] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:57:29.106399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:29.114139 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b9e25069-195b-4afe-a4f4-ca09b35f82a4 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1318 microversion: 2.1 time: 0.165152 Oct 28 18:57:29.114716 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2629/6927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:28 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:30.138173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:30.138964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:30.145974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:30.146461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:30.146896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:30.147590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:30.148091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:30.148520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:30.288890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:30.297045 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fdc2648f-f354-4e60-ad4a-da384fa64eec tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1318 microversion: 2.1 time: 0.163696 Oct 28 18:57:30.297651 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4299/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:30 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:31.319786 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:31.320435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:31.327463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:31.328001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:31.328452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:31.329158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:31.329622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:31.330063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:31.462094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:31.470255 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-792c99f0-032c-488a-9ba2-c200c7d8e0c6 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1318 microversion: 2.1 time: 0.154472 Oct 28 18:57:31.470842 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2630/6929] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:31 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:32.494013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:32.494643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:32.502284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:32.502777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:32.503219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:32.503959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:32.504425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:32.504858 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:32.636061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:32.644412 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-046f33e6-5616-4e4a-9d15-714091e95152 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1318 microversion: 2.1 time: 0.154361 Oct 28 18:57:32.644999 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4300/6930] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:32 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:33.667036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:33.667831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:33.674869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:33.675363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:33.675834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:33.676544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:33.677011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:33.677458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:33.808757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:33.816465 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ac9fa84f-0b0d-4f1b-91ba-296c22846d3e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1318 microversion: 2.1 time: 0.153359 Oct 28 18:57:33.817041 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2631/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:33 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:34.758289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-fb1624a8-b621-4e0e-a262-079ee0ebf2ec req-2cd771b3-ac67-434a-84db-ad5da896d3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a80dc2-3c33-442c-b3f7-ba6a3b091a22", "name": "network-vif-plugged", "status": "completed", "tag": "31433204-4b27-4122-b1d5-d4a8bc923b5e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:34.770434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb1624a8-b621-4e0e-a262-079ee0ebf2ec req-2cd771b3-ac67-434a-84db-ad5da896d3df service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:34.771131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb1624a8-b621-4e0e-a262-079ee0ebf2ec req-2cd771b3-ac67-434a-84db-ad5da896d3df service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:34.771563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-fb1624a8-b621-4e0e-a262-079ee0ebf2ec req-2cd771b3-ac67-434a-84db-ad5da896d3df service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:34.783658 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-fb1624a8-b621-4e0e-a262-079ee0ebf2ec req-2cd771b3-ac67-434a-84db-ad5da896d3df service nova] Creating event network-vif-plugged:31433204-4b27-4122-b1d5-d4a8bc923b5e for instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 on n-h1-862404-2 Oct 28 18:57:34.788604 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-fb1624a8-b621-4e0e-a262-079ee0ebf2ec req-2cd771b3-ac67-434a-84db-ad5da896d3df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034128 Oct 28 18:57:34.789507 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4301/6932] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:57:34.838715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:34.839556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:34.846170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:34.846679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:34.847153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:34.847940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:34.848411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:34.848853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:35.016493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:35.024160 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9b767ab5-0da3-4cba-ba70-eccfa237c103 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1318 microversion: 2.1 time: 0.189450 Oct 28 18:57:35.024745 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2632/6933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:34 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:36.044803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:36.050011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:36.050721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:36.057193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:36.057685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:36.058916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:36.059728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:36.060234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:36.060671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:36.063342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:36.200781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:36.208559 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3247bd75-1324-496c-bcf0-fca199351bb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1318 microversion: 2.1 time: 0.165016 Oct 28 18:57:36.209145 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4302/6934] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:36 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:37.231226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:37.231876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:37.233876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:37.234564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:37.241747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:37.242248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:37.242700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:37.243416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:37.243910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:37.244356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:37.375144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:37.382904 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1d994bb-8fd7-44f5-ab6a-e344c5834f4b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1508 microversion: 2.1 time: 0.155890 Oct 28 18:57:37.383488 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2633/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:37 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:37.405656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:37.406275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:37.413064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:37.413545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:37.413979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:37.414700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:37.415156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:37.415584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:37.544435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:37.552100 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2015f604-d8d7-4fbd-ad61-4c4e85f40ff3 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1508 microversion: 2.1 time: 0.150422 Oct 28 18:57:37.552680 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4303/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:37 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:37.574646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:37.576972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:37.582986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:37.583480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:37.583956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:37.584655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:37.585116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:37.585553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:37.613099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:37.618380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Old instance type m1.heat2, new instance type m1.heat {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:57:37.625272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:57:37.625701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:57:37.626184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:57:37.626599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:57:37.627016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:57:37.691835 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40855af3-8007-4a75-9810-fd74b2be953a tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "POST /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22/action" status: 202 len: 0 microversion: 2.1 time: 0.121680 Oct 28 18:57:37.692493 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2634/6937] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:57:37 2022] POST /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:57:37.700857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:37.701475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:37.707342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:37.707847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:37.708282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:37.708978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:37.709459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:37.709883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:37.874975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:37.883421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38881b87-4aeb-45dc-98db-f72d4dee8491 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1515 microversion: 2.1 time: 0.186547 Oct 28 18:57:37.884082 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4304/6938] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:37 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:38.906416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:38.907041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:38.913888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:38.914381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:38.914827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:38.915524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:38.916017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:38.916453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:39.078801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:39.086763 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2d99d583-c916-41c7-a779-c6947deb2c62 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1515 microversion: 2.1 time: 0.184360 Oct 28 18:57:39.087458 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2635/6939] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:38 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:40.111126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:40.111771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:40.118567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:40.119054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:40.119495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:40.120272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:40.120734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:40.121160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:40.251082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:40.258828 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42bbee3d-33e1-4b49-a9f1-8e33462c3758 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.152408 Oct 28 18:57:40.259409 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4305/6940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:40 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:41.281633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:41.282272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:41.289170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:41.289671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:41.290128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:41.290837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:41.291311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:41.291752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:41.424365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:41.432111 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-26e0c622-5985-4f07-974e-8ff7be2f7259 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.154844 Oct 28 18:57:41.432781 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2636/6941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:41 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:42.456487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:42.457110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:42.464081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:42.464567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:42.465002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:42.465689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:42.467006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:42.467438 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:42.601235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:42.609149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0d408f69-7e85-4136-9d38-51a487964a84 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.156582 Oct 28 18:57:42.609728 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4306/6942] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:42 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:43.632737 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:43.633367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:43.640895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:43.641389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:43.641841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:43.642545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:43.643010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:43.643447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:43.770798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:43.778644 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-524eb2a7-f145-474f-ae02-c9ecd20a5ea7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.149689 Oct 28 18:57:43.779357 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2637/6943] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:43 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:44.802771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:44.803400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:44.810126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:44.810675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:44.811117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:44.811856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:44.812315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:44.812742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:44.944095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:44.952022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2eff9680-41cc-48d0-90f9-794fd79270b1 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.153375 Oct 28 18:57:44.952853 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4307/6944] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:44 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:45.976144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:45.976803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:45.984125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:45.984620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:45.985067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:45.985774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:45.986242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:45.986685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:46.121600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:46.130015 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b9a2bab7-13a4-4e1e-a51c-168170b5f521 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.157967 Oct 28 18:57:46.130595 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2638/6945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:45 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:47.153208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:47.154170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:47.161313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:47.161828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:47.162261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:47.162942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:47.163392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:47.163834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:47.297240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:47.305005 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ab727603-976e-466f-b195-a5f7497616a2 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.155726 Oct 28 18:57:47.305584 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4308/6946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:47 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:48.329283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:48.329910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:48.337000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:48.337498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:48.337951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:48.338674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:48.339144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:48.339586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:48.472747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:48.474999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:48.482337 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5cfea876-6856-4dc8-a53e-fb5ec5f2bc74 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.157590 Oct 28 18:57:48.482920 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2639/6947] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:48 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:49.505373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:49.505999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:49.512829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:49.513318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:49.513759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:49.514453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:49.514910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:49.515338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:49.646312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:49.654789 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8bfc50c-e9da-42ab-9deb-167a95c2d03e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.153216 Oct 28 18:57:49.655364 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4309/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:49 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:50.678088 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:50.678717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:50.687029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:50.687531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:50.688026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:50.688732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:50.689205 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:50.689646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:50.829940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:50.837665 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aa183afe-b0df-456d-9f16-cb2346eeeced tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.163686 Oct 28 18:57:50.838248 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2640/6949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:50 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:51.863068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:51.863684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:51.870205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:51.870683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:51.871211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:51.871934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:51.872980 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:51.873405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:52.005398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:52.013394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f1851cd-27cd-46ae-9152-fad53353be34 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.154196 Oct 28 18:57:52.013988 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4310/6950] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:51 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:53.036603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:53.037162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:53.039807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:53.045295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:53.045789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:53.046248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:53.046972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:53.047452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:53.047925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:53.179410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:53.188087 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-472121ea-5958-4c3f-8d9c-2dcd33f146dd tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.155439 Oct 28 18:57:53.188678 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2641/6951] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:53 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:54.211363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:54.211923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:54.214629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:54.220939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:54.221425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:54.221862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:54.222554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:54.223010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:54.223446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:54.359193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:54.366940 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31fc18a5-4808-45ed-8e5b-90f1dbc5b147 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.159528 Oct 28 18:57:54.367522 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4311/6952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:54 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:55.390588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:55.391250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:55.393282 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:57:55.393412 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 18:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 (ip 10.222.0.16) !!! Oct 28 18:57:55.401143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:55.401667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:55.402124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:55.402843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:55.403965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:55.404422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:55.601465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:55.609596 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2f708fcd-2a78-4f1a-84a5-1f8bcf488e02 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.223372 Oct 28 18:57:55.610172 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2642/6953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:55 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:56.632789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:56.633414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:56.640909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:56.641395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:56.641833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:56.642528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:56.642991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:56.643419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:56.772038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:56.780422 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e41081f-3caf-40ac-9f6b-470b6fe05aca tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.151579 Oct 28 18:57:56.781012 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4312/6954] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:56 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:57.804361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:57.805011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:57.812337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:57.812828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:57.813275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:57.813973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:57.814432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:57.814865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:57.943839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:57.951848 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6bff3beb-87c8-4d0d-9bbd-93db495c4ac7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.151447 Oct 28 18:57:57.952433 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2643/6955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:57 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:58.974668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:58.975205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:57:58.982534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:58.983029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:58.983470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:58.984205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:58.984666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:58.985097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:59.120620 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:59.129011 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6311523a-24ed-4d98-82ac-3ce96a49f075 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.158385 Oct 28 18:57:59.129594 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4313/6956] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:58 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:00.153109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:00.154368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:00.161452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:00.161940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:00.162383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:00.163093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:00.163554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:00.164025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:00.293534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:00.301545 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-116d4112-3622-40c7-a35e-2647a4094804 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.152316 Oct 28 18:58:00.302167 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2644/6957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:00 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:01.325217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:01.325831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:01.332619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:01.333103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:01.333537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:01.334222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:01.334675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:01.335142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:01.522913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:01.531494 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a24a3d77-3ef9-4126-8553-3842201b6387 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.210188 Oct 28 18:58:01.532123 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4314/6958] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:01 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:02.556264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:02.557017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:02.564592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:02.565163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:02.565676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:02.566469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:02.567004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:02.567506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:02.706159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:02.713981 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f02b5c1-5165-4128-821b-1ce64de3789b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.161736 Oct 28 18:58:02.727834 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2645/6959] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:02 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:03.738172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:03.738784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:03.745591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:03.746090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:03.746507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:03.747201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:03.748196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:03.748627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:03.878727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:03.886473 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1c954b5a-f42e-4d7e-b3ff-c474bfe11c2d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.152230 Oct 28 18:58:03.887062 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4315/6960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:03 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:04.909424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:04.910060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:04.916876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:04.917369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:04.917814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:04.918509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:04.918972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:04.919466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:05.050430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:05.058395 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4bfb8e6d-4bd9-4b17-89df-8a9a7f9cca51 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.152936 Oct 28 18:58:05.059002 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2646/6961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:04 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:06.082398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:06.083029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:06.089918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:06.090396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:06.090827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:06.092205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:06.092662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:06.093085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:06.095624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=84 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:06.235054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:06.242721 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76f6a962-3c27-46cb-a03b-261904fa390f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1520 microversion: 2.1 time: 0.164260 Oct 28 18:58:06.243318 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4316/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:06 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:07.000198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-63a431d4-f4ad-4e29-8d41-15a8aea2c08a req-675140cb-86c1-40fd-a75e-19d9e71563e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a80dc2-3c33-442c-b3f7-ba6a3b091a22", "name": "network-vif-unplugged", "status": "completed", "tag": "31433204-4b27-4122-b1d5-d4a8bc923b5e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:07.010018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-63a431d4-f4ad-4e29-8d41-15a8aea2c08a req-675140cb-86c1-40fd-a75e-19d9e71563e0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:07.010528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-63a431d4-f4ad-4e29-8d41-15a8aea2c08a req-675140cb-86c1-40fd-a75e-19d9e71563e0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:07.010980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-63a431d4-f4ad-4e29-8d41-15a8aea2c08a req-675140cb-86c1-40fd-a75e-19d9e71563e0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:07.023445 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-63a431d4-f4ad-4e29-8d41-15a8aea2c08a req-675140cb-86c1-40fd-a75e-19d9e71563e0 service nova] Creating event network-vif-unplugged:31433204-4b27-4122-b1d5-d4a8bc923b5e for instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 on n-h2-862404-2 Oct 28 18:58:07.029247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-63a431d4-f4ad-4e29-8d41-15a8aea2c08a req-675140cb-86c1-40fd-a75e-19d9e71563e0 service nova] Instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:58:07.041455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-63a431d4-f4ad-4e29-8d41-15a8aea2c08a req-675140cb-86c1-40fd-a75e-19d9e71563e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110381 Oct 28 18:58:07.042088 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2647/6963] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:58:07.265324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:07.266057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:07.273031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:07.273527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:07.273972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:07.274680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:07.275147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:07.275577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:07.496493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:07.504350 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a13e0b0-c535-43b5-aae4-adb42f82fe0d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1519 microversion: 2.1 time: 0.243300 Oct 28 18:58:07.504937 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4317/6964] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:07 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:08.528076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:08.528861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:08.535964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:08.536458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:08.536904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:08.537610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:08.538073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:08.538508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:08.672859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:08.681019 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbfeadcb-f74f-45fb-a9c4-0e30eaf1ac27 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1517 microversion: 2.1 time: 0.157209 Oct 28 18:58:08.681593 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2648/6965] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:08 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:09.065785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-83467fe0-847e-4ff3-b15f-3a7036204706 req-ede4e430-eb47-46fa-adb8-81f9392f1130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a80dc2-3c33-442c-b3f7-ba6a3b091a22", "tag": "31433204-4b27-4122-b1d5-d4a8bc923b5e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:09.076487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-83467fe0-847e-4ff3-b15f-3a7036204706 req-ede4e430-eb47-46fa-adb8-81f9392f1130 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:09.076966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-83467fe0-847e-4ff3-b15f-3a7036204706 req-ede4e430-eb47-46fa-adb8-81f9392f1130 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:09.077399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-83467fe0-847e-4ff3-b15f-3a7036204706 req-ede4e430-eb47-46fa-adb8-81f9392f1130 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:09.088848 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-83467fe0-847e-4ff3-b15f-3a7036204706 req-ede4e430-eb47-46fa-adb8-81f9392f1130 service nova] Creating event network-changed:31433204-4b27-4122-b1d5-d4a8bc923b5e for instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 on n-h2-862404-2 Oct 28 18:58:09.094712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-83467fe0-847e-4ff3-b15f-3a7036204706 req-ede4e430-eb47-46fa-adb8-81f9392f1130 service nova] Instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:58:09.105593 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-83467fe0-847e-4ff3-b15f-3a7036204706 req-ede4e430-eb47-46fa-adb8-81f9392f1130 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043606 Oct 28 18:58:09.106197 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4318/6966] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:09.704378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:09.705117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:09.712255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:09.712761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:09.713216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:09.713936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:09.714412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:09.714860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:09.851508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:09.859708 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5c8aae24-2684-4493-9637-41ef58a6e76b tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1514 microversion: 2.1 time: 0.159287 Oct 28 18:58:09.869435 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2649/6967] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:09 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:09.883962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:09.884601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:09.891262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:09.891758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:09.892233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:09.892939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:09.893401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:09.893833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:09.953420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1047583e-afdb-4f94-8ab1-4ae0c2d619d9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "POST /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22/action" status: 204 len: 0 microversion: 2.1 time: 0.073697 Oct 28 18:58:09.954107 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4319/6968] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:58:09 2022] POST /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:58:09.962343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:09.963103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:09.969872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:09.970340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:09.970855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:09.971577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:09.972087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:09.972566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:10.181849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:10.190479 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1d7ae243-6954-41e5-b471-46599cc7871d tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1514 microversion: 2.1 time: 0.232069 Oct 28 18:58:10.191071 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2650/6969] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:09 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:11.214910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:11.215612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:11.223049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:11.223529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:11.223989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:11.224677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:11.225133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:11.225551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:11.362073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:11.371149 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7e7aa716-1112-4122-bff5-6da931952636 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1514 microversion: 2.1 time: 0.160332 Oct 28 18:58:11.371735 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4320/6970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:11 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:12.395024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:12.395652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:12.402554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:12.403045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:12.403504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:12.404392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:12.404865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:12.405309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:12.538291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:12.546583 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4a8ec21-ee7d-438f-8a42-e0ece2100cfb tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1506 microversion: 2.1 time: 0.155475 Oct 28 18:58:12.547150 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2651/6971] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:12 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:12.568566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:12.569191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:12.576019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:12.576505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:12.576940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:12.577636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:12.578094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:12.578519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:12.711282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:12.719523 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-62dfccf5-9315-433a-83ce-350a5643ddce tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1506 microversion: 2.1 time: 0.154951 Oct 28 18:58:12.720132 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4321/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:12 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:12.741989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:12.742621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:12.748847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:12.749336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:12.749783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:12.750481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:12.750948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:12.751382 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:12.883451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:12.891719 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-51466d30-f9d7-4722-b8bf-d53f378cc5f0 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1506 microversion: 2.1 time: 0.153575 Oct 28 18:58:12.892336 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2652/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:12 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:12.914017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:12.914452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:12.920511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:12.920995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:12.921430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:12.922113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:12.922562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:12.922983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:12.947651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:58:13.027309 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-10905d1e-5db8-4f16-93f2-ffed7cffa38c tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 204 len: 0 microversion: 2.1 time: 0.116894 Oct 28 18:58:13.028175 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4322/6974] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:58:12 2022] DELETE /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:58:13.042630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:13.043134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:13.050639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:13.051135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:13.051577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:13.052312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:13.052773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:13.053209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:13.081221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 18:58:13.127968 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.compute.api [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Instance is already in deleting state, ignoring this request Oct 28 18:58:13.128994 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-87b41061-cd7f-4de7-a231-c785d1282f7e tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 204 len: 0 microversion: 2.1 time: 0.090280 Oct 28 18:58:13.129813 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2653/6975] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:58:13 2022] DELETE /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:58:13.139364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:13.140131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:13.146352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:13.146836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:13.147272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:13.147989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:13.148442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:13.148863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:13.277834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:13.285861 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06042822-6763-443f-a03c-06047c3ca1e7 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1512 microversion: 2.1 time: 0.151544 Oct 28 18:58:13.286441 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4323/6976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:13 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:13.482457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4a503683-1634-4730-9def-f54afd962766 req-c31d2a85-ed48-4087-ab85-d08a4fc6dcee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a80dc2-3c33-442c-b3f7-ba6a3b091a22", "name": "network-vif-plugged", "status": "completed", "tag": "31433204-4b27-4122-b1d5-d4a8bc923b5e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:13.493752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4a503683-1634-4730-9def-f54afd962766 req-c31d2a85-ed48-4087-ab85-d08a4fc6dcee service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:13.494425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4a503683-1634-4730-9def-f54afd962766 req-c31d2a85-ed48-4087-ab85-d08a4fc6dcee service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:13.494876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4a503683-1634-4730-9def-f54afd962766 req-c31d2a85-ed48-4087-ab85-d08a4fc6dcee service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:13.509618 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4a503683-1634-4730-9def-f54afd962766 req-c31d2a85-ed48-4087-ab85-d08a4fc6dcee service nova] Creating event network-vif-plugged:31433204-4b27-4122-b1d5-d4a8bc923b5e for instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 on n-h2-862404-2 Oct 28 18:58:13.515946 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4a503683-1634-4730-9def-f54afd962766 req-c31d2a85-ed48-4087-ab85-d08a4fc6dcee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037461 Oct 28 18:58:13.516715 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2654/6977] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:14.309243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:14.309830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:14.316633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:14.317113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:14.317549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:14.318267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:14.318725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:14.319153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:14.452934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cf7ca7de8648adaf2766a700803b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080c13acd00642889e427fb7a3e6a61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:14.460732 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e532483f-7ea2-4c90-9246-b7d3a14d0188 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 200 len: 1512 microversion: 2.1 time: 0.155487 Oct 28 18:58:14.461333 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4324/6978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:14 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:14.918833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a738995f-63c7-4f68-9b7d-8cd1aa9e8b3e req-47fbf5b2-36ca-48d4-a86e-526b253c5326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a80dc2-3c33-442c-b3f7-ba6a3b091a22", "name": "network-vif-deleted", "tag": "31433204-4b27-4122-b1d5-d4a8bc923b5e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:14.933041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a738995f-63c7-4f68-9b7d-8cd1aa9e8b3e req-47fbf5b2-36ca-48d4-a86e-526b253c5326 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:14.934008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a738995f-63c7-4f68-9b7d-8cd1aa9e8b3e req-47fbf5b2-36ca-48d4-a86e-526b253c5326 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:14.934623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a738995f-63c7-4f68-9b7d-8cd1aa9e8b3e req-47fbf5b2-36ca-48d4-a86e-526b253c5326 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:14.948115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a738995f-63c7-4f68-9b7d-8cd1aa9e8b3e req-47fbf5b2-36ca-48d4-a86e-526b253c5326 service nova] Creating event network-vif-deleted:31433204-4b27-4122-b1d5-d4a8bc923b5e for instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 on n-h2-862404-2 Oct 28 18:58:14.967206 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a738995f-63c7-4f68-9b7d-8cd1aa9e8b3e req-47fbf5b2-36ca-48d4-a86e-526b253c5326 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051646 Oct 28 18:58:14.968405 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2655/6979] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:15.485537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:15.486136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: 30a80dc2-3c33-442c-b3f7-ba6a3b091a22] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:15.492990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:15.493476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:15.493913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:15.494604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:15.495059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:15.495487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:15.508644 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] HTTP exception thrown: Instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 could not be found. Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Request method failure captured: Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 HTTP/1.1 Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCXjeGMSHbKnH_2NYZx4PO43IopjwJ5eewJZwgqHUd2FEQfoYzOsPLGWKx6Vf3u5DS4GMPlZDYQz2XHP_2qEs34q12_FSqP1Dqdo3l8TDgspasOjpj93H4345G1N6QH2xQe5uo-H6_6E4T1Oa6JebwU35bAV9vD0fKqU1A_T5LLicBM Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 080c13acd00642889e427fb7a3e6a61a Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_080c13acd00642889e427fb7a3e6a61a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 080c13acd00642889e427fb7a3e6a61a Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerDiskConfigTestJSON-303948330-project Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 31cf7ca7de8648adaf2766a700803b03 Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerDiskConfigTestJSON-303948330-project Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 could not be found. Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '30a80dc2-3c33-442c-b3f7-ba6a3b091a22'} Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 could not be found. Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 could not be found. Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:58:15.510263 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 could not be found. Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Returning 404 to user: Instance 30a80dc2-3c33-442c-b3f7-ba6a3b091a22 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2eda2957-63e9-491f-af58-c8877b3cc24f tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22" status: 404 len: 111 microversion: 2.1 time: 0.030951 Oct 28 18:58:15.515144 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4325/6980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:15 2022] GET /compute/v2.1/servers/30a80dc2-3c33-442c-b3f7-ba6a3b091a22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:58:15.520879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-88044c2b-3817-4607-b631-16314a95cf77 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '.version_select at 0x7f78dd3bb550>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:15.543759 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-88044c2b-3817-4607-b631-16314a95cf77 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-841434216" status: 202 len: 0 microversion: 2.1 time: 0.026982 Oct 28 18:58:15.544946 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2656/6981] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 18:58:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-841434216 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:58:16.138466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:16.139117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:16.145243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:16.145734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:16.146183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:16.146879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:16.147339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:16.147770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:16.161878 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] HTTP exception thrown: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Request method failure captured: Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 HTTP/1.1 Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCXjeGMSHbKnH_2NYZx4PO43IopjwJ5eewJZwgqHUd2FEQfoYzOsPLGWKx6Vf3u5DS4GMPlZDYQz2XHP_2qEs34q12_FSqP1Dqdo3l8TDgspasOjpj93H4345G1N6QH2xQe5uo-H6_6E4T1Oa6JebwU35bAV9vD0fKqU1A_T5LLicBM Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 080c13acd00642889e427fb7a3e6a61a Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_080c13acd00642889e427fb7a3e6a61a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 080c13acd00642889e427fb7a3e6a61a Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerDiskConfigTestJSON-303948330-project Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 31cf7ca7de8648adaf2766a700803b03 Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerDiskConfigTestJSON-303948330-project Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'affeb735-cd48-4391-9179-2ae0567ca542'} Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:58:16.163422 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Returning 404 to user: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7119b4ba-f0f2-46a7-9313-0d79cbcddbb9 tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "DELETE /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 404 len: 111 microversion: 2.1 time: 0.031078 Oct 28 18:58:16.170725 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4326/6982] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 18:58:16 2022] DELETE /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:58:16.175967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:16.176715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] [instance: affeb735-cd48-4391-9179-2ae0567ca542] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:16.183645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:16.184160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:16.184605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:16.185972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:16.186437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:16.186873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:16.200034 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] HTTP exception thrown: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Request method failure captured: Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 HTTP/1.1 Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCXjeGMSHbKnH_2NYZx4PO43IopjwJ5eewJZwgqHUd2FEQfoYzOsPLGWKx6Vf3u5DS4GMPlZDYQz2XHP_2qEs34q12_FSqP1Dqdo3l8TDgspasOjpj93H4345G1N6QH2xQe5uo-H6_6E4T1Oa6JebwU35bAV9vD0fKqU1A_T5LLicBM Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 080c13acd00642889e427fb7a3e6a61a Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_080c13acd00642889e427fb7a3e6a61a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/080c13acd00642889e427fb7a3e6a61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 080c13acd00642889e427fb7a3e6a61a Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-303948330 Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerDiskConfigTestJSON-303948330-project Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 31cf7ca7de8648adaf2766a700803b03 Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerDiskConfigTestJSON-303948330-project Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'affeb735-cd48-4391-9179-2ae0567ca542'} Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:58:16.202266 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] Returning 404 to user: Instance affeb735-cd48-4391-9179-2ae0567ca542 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8b02769-7635-486d-9277-865fc16654dc tempest-ServerDiskConfigTestJSON-303948330 tempest-ServerDiskConfigTestJSON-303948330-project] 10.222.0.16 "GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542" status: 404 len: 111 microversion: 2.1 time: 0.034190 Oct 28 18:58:16.207163 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2657/6983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:16 2022] GET /compute/v2.1/servers/affeb735-cd48-4391-9179-2ae0567ca542 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:58:24.822599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42f88192-216c-4e98-9822-542fa6f5c444 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'create', calling method: .version_select at 0x7f78e2472940>, body: {"keypair": {"name": "tempest-keypair-91495993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqUuFzk+9r8WhengYf89yypoHfKe50aSICKO6Wx2G3p4NnUDCcwZ6RwOAJpbMYBLoAb76KE3p2P2RlW8X9wDxIhtnYJHzcNp1eUemKgxr7qlzSlljYARRQtFRlOOJIMog=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:24.829014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:24.842502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-42f88192-216c-4e98-9822-542fa6f5c444 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for project a7562b55d5e24852bdd2a347309a8799. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:58:24.848323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-42f88192-216c-4e98-9822-542fa6f5c444 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for user 037e2796b1384a2b8881c2396300b164 and project a7562b55d5e24852bdd2a347309a8799. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:58:24.876147 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42f88192-216c-4e98-9822-542fa6f5c444 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.176773 Oct 28 18:58:24.876760 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4327/6984] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 18:58:24 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:26.130124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1323503117", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fc1d561-9a43-49d0-aefe-c3016e1dfe36"}], "security_groups": [{"name": "tempest-securitygroup--175089784"}], "key_name": "tempest-keypair-91495993", "user_data": "}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:26.140325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:26.194553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:26.245780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] validate_networks() for [('4fc1d561-9a43-49d0-aefe-c3016e1dfe36', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:58:26.641193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:58:26.641732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:58:26.642315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:58:26.642834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:58:26.643263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:58:26.652264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:26.652771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:26.653306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:26.654230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:26.654708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:26.655144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:26.673036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:58:26.679361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for user 037e2796b1384a2b8881c2396300b164 and project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:58:26.692644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:58:26.694992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:58:26.743530 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50bfe4e0-613f-458d-bdb7-80ff20440c0c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.617831 Oct 28 18:58:26.744408 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2658/6985] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 18:58:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:58:26.753177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:26.757704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-17d447d8-a632-49c1-807b-9cdef323eb50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:26.758327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-17d447d8-a632-49c1-807b-9cdef323eb50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:26.828943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-17d447d8-a632-49c1-807b-9cdef323eb50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:26.835707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-17d447d8-a632-49c1-807b-9cdef323eb50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1237 microversion: 2.1 time: 0.084318 Oct 28 18:58:26.836329 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4328/6986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:26 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:27.860032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:27.860965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:27.868997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:27.869504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:27.870125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:27.870677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:27.871143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:27.871581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:27.971832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:27.993656 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e94e9f4-56fd-4225-a0fc-98c92e091e0f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1289 microversion: 2.1 time: 0.138259 Oct 28 18:58:27.994484 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2659/6987] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:27 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:29.018096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:29.018937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:29.032281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:29.032906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:29.033367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:29.034182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:29.034706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:29.035136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:29.172650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:29.180415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24bdb39c-8fa4-4e42-9b6c-a95b86558ef9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1362 microversion: 2.1 time: 0.166291 Oct 28 18:58:29.181007 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4329/6988] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:29 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:29.457668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6e31ff5b-f641-441b-abbb-04a6532411ca req-13373e36-52e5-4ad3-aced-b5477e2dc637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0c9cd1-5939-4a11-a162-e6d897ba5ac6", "tag": "0e8017f6-6c3d-45b5-bceb-d214a2a8f405"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:29.471065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6e31ff5b-f641-441b-abbb-04a6532411ca req-13373e36-52e5-4ad3-aced-b5477e2dc637 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:29.471809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6e31ff5b-f641-441b-abbb-04a6532411ca req-13373e36-52e5-4ad3-aced-b5477e2dc637 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:29.472499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6e31ff5b-f641-441b-abbb-04a6532411ca req-13373e36-52e5-4ad3-aced-b5477e2dc637 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:29.485647 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6e31ff5b-f641-441b-abbb-04a6532411ca req-13373e36-52e5-4ad3-aced-b5477e2dc637 service nova] Creating event network-changed:0e8017f6-6c3d-45b5-bceb-d214a2a8f405 for instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 on n-h1-862404-2 Oct 28 18:58:29.490688 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6e31ff5b-f641-441b-abbb-04a6532411ca req-13373e36-52e5-4ad3-aced-b5477e2dc637 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037891 Oct 28 18:58:29.491312 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2660/6989] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:30.204281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:30.204908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:30.212307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:30.212803 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:30.213311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:30.214130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:30.214891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:30.215534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:30.354452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:30.362259 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa326cd5-7eb2-427b-8e96-c21674c69a63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1362 microversion: 2.1 time: 0.162510 Oct 28 18:58:30.362834 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4330/6990] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:30 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:31.385513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:31.386251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:31.393291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:31.393774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:31.394216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:31.394908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:31.395369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:31.395800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:31.529182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:31.537581 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f8231d0a-c6a9-4edf-81fc-6974e9eec760 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1362 microversion: 2.1 time: 0.156330 Oct 28 18:58:31.538162 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2661/6991] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:31 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:32.560094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:32.560647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:32.567594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:32.568107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:32.568543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:32.569261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:32.569715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:32.570139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:32.706720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:32.714967 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ddb82ba2-dec7-4ad5-8015-bce4e85ff58c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1362 microversion: 2.1 time: 0.158820 Oct 28 18:58:32.715592 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4331/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:32 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:33.738443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:33.739029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:33.745783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:33.746277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:33.746765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:33.747487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:33.747985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:33.748419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:33.881499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:33.889908 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-07c4f209-6608-4610-9a88-ac4b1d6be9d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1362 microversion: 2.1 time: 0.155416 Oct 28 18:58:33.890490 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2662/6993] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:33 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:34.912368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:34.913124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:34.920679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:34.921267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:34.921737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:34.922443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:34.922901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:34.923327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:35.007340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-10b45232-d77d-48e3-a886-95d97ca1d9c5 req-015d56af-9b89-40ee-a94f-9ba7a20e6a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c9cd1-5939-4a11-a162-e6d897ba5ac6", "name": "network-vif-plugged", "status": "completed", "tag": "0e8017f6-6c3d-45b5-bceb-d214a2a8f405"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:35.019866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-10b45232-d77d-48e3-a886-95d97ca1d9c5 req-015d56af-9b89-40ee-a94f-9ba7a20e6a35 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:35.020363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-10b45232-d77d-48e3-a886-95d97ca1d9c5 req-015d56af-9b89-40ee-a94f-9ba7a20e6a35 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:35.021493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-10b45232-d77d-48e3-a886-95d97ca1d9c5 req-015d56af-9b89-40ee-a94f-9ba7a20e6a35 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:35.036505 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-10b45232-d77d-48e3-a886-95d97ca1d9c5 req-015d56af-9b89-40ee-a94f-9ba7a20e6a35 service nova] Creating event network-vif-plugged:0e8017f6-6c3d-45b5-bceb-d214a2a8f405 for instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 on n-h1-862404-2 Oct 28 18:58:35.042512 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-10b45232-d77d-48e3-a886-95d97ca1d9c5 req-015d56af-9b89-40ee-a94f-9ba7a20e6a35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038917 Oct 28 18:58:35.043613 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2663/6994] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:35.075569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:35.084259 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-10970ff9-a465-47ad-828e-f395f272a9c9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1362 microversion: 2.1 time: 0.175677 Oct 28 18:58:35.088047 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4332/6995] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:34 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:36.107678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:36.108491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:36.115550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:36.116079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:36.116528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:36.117228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:36.117692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:36.118126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:36.253934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:36.261521 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aa343e34-790e-4f48-a615-d16c2160ad39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1362 microversion: 2.1 time: 0.158564 Oct 28 18:58:36.262098 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2664/6996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:36 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:37.284750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:37.285388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:37.288134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:37.294500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:37.295056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:37.295498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:37.296228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:37.296689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:37.297120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:37.429039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:37.437665 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a14f28e-e1fd-4c41-b603-7a9308dbf4e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1549 microversion: 2.1 time: 0.156851 Oct 28 18:58:37.438246 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4333/6997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:37 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:37.460482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:37.460986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:58:37.462961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:37.463849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:37.471068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:37.471566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:37.472052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:37.472762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:37.473233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:37.473674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:37.552420 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4b058aac-7839-4953-a758-998653df5a2f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095707 Oct 28 18:58:37.553061 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2665/6998] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 18:58:37 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:38.814340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cc288338-83aa-45bc-8bed-3c4436a1cde9 req-143a2324-9f6d-44f1-9a56-b92dbace1fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0c9cd1-5939-4a11-a162-e6d897ba5ac6", "tag": "0e8017f6-6c3d-45b5-bceb-d214a2a8f405"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:38.824849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cc288338-83aa-45bc-8bed-3c4436a1cde9 req-143a2324-9f6d-44f1-9a56-b92dbace1fb4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:38.825533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cc288338-83aa-45bc-8bed-3c4436a1cde9 req-143a2324-9f6d-44f1-9a56-b92dbace1fb4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:38.825988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cc288338-83aa-45bc-8bed-3c4436a1cde9 req-143a2324-9f6d-44f1-9a56-b92dbace1fb4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:38.837584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cc288338-83aa-45bc-8bed-3c4436a1cde9 req-143a2324-9f6d-44f1-9a56-b92dbace1fb4 service nova] Creating event network-changed:0e8017f6-6c3d-45b5-bceb-d214a2a8f405 for instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 on n-h1-862404-2 Oct 28 18:58:38.843728 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cc288338-83aa-45bc-8bed-3c4436a1cde9 req-143a2324-9f6d-44f1-9a56-b92dbace1fb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033154 Oct 28 18:58:38.844562 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4334/6999] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:43.409261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:43.410217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=34 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:43.416022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:43.416644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:43.423991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:43.424487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:43.425554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:43.426256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:43.426722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:43.427152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:43.558582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:43.567199 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-304c4cf6-d7de-4b63-a45b-0a787188b0d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1668 microversion: 2.1 time: 0.160586 Oct 28 18:59:43.567783 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2666/7000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:43 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:43.588053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:43.588787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=32 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:43.589773 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:59:43.589916 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 18:59:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 (ip 10.222.0.16) !!! Oct 28 18:59:43.596206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:43.597013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:43.605113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:43.605589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:43.606019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:43.606713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:43.607162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:43.607586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:43.744244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:43.752074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ff14abb-5ae1-4b89-8c23-02d97f713dc2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1668 microversion: 2.1 time: 0.166820 Oct 28 18:59:43.752654 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4335/7001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:43 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:43.774636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:43.775263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:43.781208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:43.781704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:43.782153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:43.782856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:43.783325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:43.783762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:43.912765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:43.920456 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-572d1422-bb07-424a-9696-3a821076ab97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1668 microversion: 2.1 time: 0.149679 Oct 28 18:59:43.921322 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2667/7002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:43 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:43.943480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:43.945676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:43.951581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:43.952094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:43.952529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:43.953211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:43.953661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:43.954080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:43.982214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:43.987973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Old instance type m1.heat2, new instance type m1.heat {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 18:59:43.996567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:59:43.996986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:59:43.997455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:59:43.997860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:59:43.998270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:59:44.067074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5026e00f-2119-453c-af7b-72be8a7293ee tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6/action" status: 202 len: 0 microversion: 2.1 time: 0.123453 Oct 28 18:59:44.067074 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4336/7003] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 18:59:43 2022] POST /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:59:44.073251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:44.073880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:44.079873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:44.080376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:44.080828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:44.081533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:44.082009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:44.083057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:44.220830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:44.230394 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-120394ed-2415-4a7b-af7b-5b987d2db61f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1677 microversion: 2.1 time: 0.160987 Oct 28 18:59:44.230965 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2668/7004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:44 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:45.255196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:45.256001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:45.262818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:45.263306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:45.263744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:45.264467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:45.264928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:45.265355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:45.408461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:45.417069 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0ef2a074-dca7-4bee-a728-4ae34d68c508 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1677 microversion: 2.1 time: 0.167073 Oct 28 18:59:45.417671 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4337/7005] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:45 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:46.440920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:46.441556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:46.448886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:46.449386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:46.449843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:46.450552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:46.451025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:46.451467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:46.582301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:46.590222 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2cbdf003-0995-4445-a716-bdfaa31eb8ca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.153223 Oct 28 18:59:46.590798 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2669/7006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:46 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:47.613814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:47.614539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:47.621309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:47.621798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:47.622236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:47.622930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:47.623391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:47.623838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:47.756853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:47.764602 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d091cbb9-7f02-4df3-98f1-d4c5f01549eb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.154706 Oct 28 18:59:47.765186 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4338/7007] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:47 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:48.788429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:48.789059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:48.796081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:48.796580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:48.797028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:48.797762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:48.798231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:48.798669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:48.935200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:48.943469 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0257d76f-d7f8-4bb3-9d17-7df65e6cb2d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.159359 Oct 28 18:59:48.944073 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2670/7008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:48 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:49.966599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:49.967266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:49.974447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:49.974929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:49.975363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:49.976118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:49.976577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:49.977001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:50.107565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:50.115736 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f465b25-874a-4200-a44e-1cefcc0b03bf tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.153168 Oct 28 18:59:50.116343 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4339/7009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:49 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:51.139903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:51.140545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:51.147607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:51.148156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:51.148609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:51.149320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:51.149789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:51.150231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:51.281176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:51.289171 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2f6e72bf-1f4c-4f10-b93c-1415de42a53d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.153379 Oct 28 18:59:51.289749 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2671/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:51 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:52.312676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:52.313211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:52.319794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:52.320302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:52.320738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:52.321419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:52.321877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:52.322296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:52.455093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:52.463270 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91f0461f-589b-4c45-8439-4772fd40dbfc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.154619 Oct 28 18:59:52.463872 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4340/7011] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:52 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:53.486492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:53.487114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:53.494279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:53.494770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:53.495248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:53.496015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:53.496463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:53.496893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:53.631787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:53.639697 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d75becdd-0693-4710-99e4-f528f0c3c900 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.157076 Oct 28 18:59:53.640302 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2672/7012] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:53 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:54.666167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:54.666809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:54.673431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:54.673907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:54.674340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:54.675033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:54.675482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:54.675958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:54.808097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:54.815880 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-661ea0c4-d622-4f55-a00f-015d58a67819 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.155401 Oct 28 18:59:54.816452 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4341/7013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:54 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:55.839329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:55.839984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:55.846805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:55.847296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:55.848281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:55.849203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:55.849665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:55.850100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:55.980427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:55.988133 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-904a10f3-dbb5-4d8e-9544-a4e30031ad89 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.152771 Oct 28 18:59:55.989323 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2673/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:55 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:57.011399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:57.012036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:57.018782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:57.019262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:57.019747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:57.020493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:57.020942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:57.021364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:57.151796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:57.159476 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-84ce55c5-9207-4cbe-9048-0b432348e4a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1682 microversion: 2.1 time: 0.151906 Oct 28 18:59:57.160090 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4342/7015] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:57 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:58.183330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:58.183982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:58.190804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:58.191297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:58.191766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:58.192497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:58.192960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:58.193397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:58.330351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:58.338830 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e1081a53-e168-4541-8107-b94a40debe23 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1681 microversion: 2.1 time: 0.159359 Oct 28 18:59:58.339500 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2674/7016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:58 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:58.385901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ad5e31e8-2555-48b3-ac9e-ece29ffdfa02 req-de1783ee-003d-47be-9233-237108e107c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c9cd1-5939-4a11-a162-e6d897ba5ac6", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8017f6-6c3d-45b5-bceb-d214a2a8f405"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:58.396861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ad5e31e8-2555-48b3-ac9e-ece29ffdfa02 req-de1783ee-003d-47be-9233-237108e107c7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:58.397341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ad5e31e8-2555-48b3-ac9e-ece29ffdfa02 req-de1783ee-003d-47be-9233-237108e107c7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:58.397853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ad5e31e8-2555-48b3-ac9e-ece29ffdfa02 req-de1783ee-003d-47be-9233-237108e107c7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:58.410139 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ad5e31e8-2555-48b3-ac9e-ece29ffdfa02 req-de1783ee-003d-47be-9233-237108e107c7 service nova] Creating event network-vif-unplugged:0e8017f6-6c3d-45b5-bceb-d214a2a8f405 for instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 on n-h2-862404-2 Oct 28 18:59:58.416351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-ad5e31e8-2555-48b3-ac9e-ece29ffdfa02 req-de1783ee-003d-47be-9233-237108e107c7 service nova] Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 18:59:58.427448 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ad5e31e8-2555-48b3-ac9e-ece29ffdfa02 req-de1783ee-003d-47be-9233-237108e107c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045204 Oct 28 18:59:58.428111 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4343/7017] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 18:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:59.363153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:59.364030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 18:59:59.370910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:59.371417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:59.371892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:59.372606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:59.373078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:59.373519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:59.506108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:59.513911 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-48210021-3d60-4764-9637-fb5f66eff1a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1681 microversion: 2.1 time: 0.154672 Oct 28 18:59:59.514566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2675/7018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:59 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:00.458602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6a3b9232-eedc-4432-ab8e-33b9f94410cf req-0d55cfef-6987-4d8a-b936-490edf5cdbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0c9cd1-5939-4a11-a162-e6d897ba5ac6", "tag": "0e8017f6-6c3d-45b5-bceb-d214a2a8f405"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:00.467953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6a3b9232-eedc-4432-ab8e-33b9f94410cf req-0d55cfef-6987-4d8a-b936-490edf5cdbd5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:00.468428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6a3b9232-eedc-4432-ab8e-33b9f94410cf req-0d55cfef-6987-4d8a-b936-490edf5cdbd5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:00.468863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6a3b9232-eedc-4432-ab8e-33b9f94410cf req-0d55cfef-6987-4d8a-b936-490edf5cdbd5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:00.482946 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6a3b9232-eedc-4432-ab8e-33b9f94410cf req-0d55cfef-6987-4d8a-b936-490edf5cdbd5 service nova] Creating event network-changed:0e8017f6-6c3d-45b5-bceb-d214a2a8f405 for instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 on n-h2-862404-2 Oct 28 19:00:00.488149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-6a3b9232-eedc-4432-ab8e-33b9f94410cf req-0d55cfef-6987-4d8a-b936-490edf5cdbd5 service nova] Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:00:00.499082 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6a3b9232-eedc-4432-ab8e-33b9f94410cf req-0d55cfef-6987-4d8a-b936-490edf5cdbd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046011 Oct 28 19:00:00.499722 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4344/7019] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:00.538705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:00.539615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:00.546318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:00.546830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:00.547282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:00.548061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:00.548536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:00.548979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:00.781518 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:00.789265 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2eb98a7b-6d6e-40ca-bb43-b4093d470839 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1679 microversion: 2.1 time: 0.254929 Oct 28 19:00:00.789855 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2676/7020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:00 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:01.814151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:01.814965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:01.821252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:01.821745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:01.822211 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:01.822907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:01.823369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:01.823802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:01.985492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:01.995468 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1d19f0fe-aafe-4488-81be-76f73aea63d6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1676 microversion: 2.1 time: 0.186450 Oct 28 19:00:01.996394 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4345/7021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:01 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:02.018466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:02.019031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:02.026089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:02.026591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:02.027042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:02.027753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:02.028246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:02.028682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:02.096382 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5ee610c3-e4e5-427b-b983-0309838c9096 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6/action" status: 204 len: 0 microversion: 2.1 time: 0.081273 Oct 28 19:00:02.097209 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2677/7022] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:00:02 2022] POST /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:02.106798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:02.107885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:02.114270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:02.114855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:02.115356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:02.116155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:02.116728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:02.117203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:02.265005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:02.273864 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9e696f58-996a-430d-9580-35685f66130c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1676 microversion: 2.1 time: 0.171282 Oct 28 19:00:02.274469 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4346/7023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:02 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:03.298807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:03.299551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:03.307585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.308143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.308605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.309327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.309803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.310250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.445581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:03.454573 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ebd2584a-d9fb-44e2-939e-9017c2278f9d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1668 microversion: 2.1 time: 0.160034 Oct 28 19:00:03.455254 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2678/7024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:03 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:03.478522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:03.479388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:03.486179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.486662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.487094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.487789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.488823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.489454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.619222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:03.626933 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05ad9065-482a-4dbc-9a58-30843b0367af tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1668 microversion: 2.1 time: 0.152464 Oct 28 19:00:03.627516 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4347/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:03 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:03.649208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:03.649838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:03.655868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.656364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.656804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.657498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.657960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.658393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.789295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:03.797009 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-414aa962-42d9-4501-9423-349aa555a616 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1668 microversion: 2.1 time: 0.152168 Oct 28 19:00:03.797588 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2679/7026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:03 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:03.819427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:03.819959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:03.826100 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.826586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.827020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.827713 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.828194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.828618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.854535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:00:03.931271 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5acc6c93-6d53-4325-b7e7-8a3edb1a481d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 204 len: 0 microversion: 2.1 time: 0.115630 Oct 28 19:00:03.932047 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4348/7027] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:00:03 2022] DELETE /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:03.945705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:03.946344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:03.952339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.952844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.953334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:03.954054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:03.954530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:03.954978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:04.095713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:04.103487 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb281ef2-673a-434c-bee7-25a2dad7c729 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1674 microversion: 2.1 time: 0.162729 Oct 28 19:00:04.104360 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2680/7028] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:03 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:05.127056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:05.127767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:05.135341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:05.135857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:05.136309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:05.137016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:05.137477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:05.137909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:05.142040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:05.273551 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:05.281235 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed8cbd5d-c9ca-4e71-962d-d739df23fd01 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1674 microversion: 2.1 time: 0.158442 Oct 28 19:00:05.282026 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4349/7029] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:05 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:06.257998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3eb28088-0a81-4287-9a61-632ab47f2dbf req-dddab9a4-0a17-4a96-93de-d396f78a0d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c9cd1-5939-4a11-a162-e6d897ba5ac6", "name": "network-vif-deleted", "tag": "0e8017f6-6c3d-45b5-bceb-d214a2a8f405"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:06.271637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3eb28088-0a81-4287-9a61-632ab47f2dbf req-dddab9a4-0a17-4a96-93de-d396f78a0d3c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:06.272541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3eb28088-0a81-4287-9a61-632ab47f2dbf req-dddab9a4-0a17-4a96-93de-d396f78a0d3c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:06.273111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3eb28088-0a81-4287-9a61-632ab47f2dbf req-dddab9a4-0a17-4a96-93de-d396f78a0d3c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:06.287093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3eb28088-0a81-4287-9a61-632ab47f2dbf req-dddab9a4-0a17-4a96-93de-d396f78a0d3c service nova] Creating event network-vif-deleted:0e8017f6-6c3d-45b5-bceb-d214a2a8f405 for instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 on n-h2-862404-2 Oct 28 19:00:06.293330 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3eb28088-0a81-4287-9a61-632ab47f2dbf req-dddab9a4-0a17-4a96-93de-d396f78a0d3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040030 Oct 28 19:00:06.294284 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2681/7030] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:06.304601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:06.305456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:06.313575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:06.321489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:06.321887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:06.322646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:06.323120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:06.323602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:06.392730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:06.402561 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-07c65e3e-0d78-4d2c-8323-f995359ca269 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 200 len: 1322 microversion: 2.1 time: 0.102011 Oct 28 19:00:06.403490 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4350/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:06 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 1322 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:07.427076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:07.427791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:07.434906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:07.435403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:07.435881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:07.436590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:07.437060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:07.437500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:07.440176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:07.452812 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 HTTP/1.1 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'ce0c9cd1-5939-4a11-a162-e6d897ba5ac6'} Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:00:07.454412 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-900e376d-ba25-4da3-918d-3b2de6b20c57 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 404 len: 111 microversion: 2.1 time: 0.033034 Oct 28 19:00:07.460531 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2682/7032] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:07 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:00:07.469169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:07.469799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:07.477268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:07.477756 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:07.478196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:07.478897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:07.479615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:07.480077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:07.495996 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 HTTP/1.1 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'ce0c9cd1-5939-4a11-a162-e6d897ba5ac6'} Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:00:07.497652 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52acc44c-0d9d-4027-aedc-1987ccf0068e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 404 len: 111 microversion: 2.1 time: 0.033816 Oct 28 19:00:07.502082 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4351/7033] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:07 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:00:07.548111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1148600358", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "4fc1d561-9a43-49d0-aefe-c3016e1dfe36"}], "security_groups": [{"name": "tempest-securitygroup--175089784"}], "key_name": "tempest-keypair-91495993", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:07.653141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] validate_networks() for [('4fc1d561-9a43-49d0-aefe-c3016e1dfe36', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:00:08.018819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:00:08.019258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:00:08.020384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:00:08.020833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:00:08.021259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:00:08.029994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:08.030495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:08.030943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:08.031682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:08.032183 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:08.032618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:08.049372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:00:08.054699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for user 037e2796b1384a2b8881c2396300b164 and project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:00:08.067668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:00:08.070037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:00:08.117858 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e14891e-e85a-4f49-908b-5443fc83b6e0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.573634 Oct 28 19:00:08.118518 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2683/7034] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:00:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:00:08.130394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c9706bb7-f9d8-4103-b1df-5dd903ed6ea0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:08.131013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c9706bb7-f9d8-4103-b1df-5dd903ed6ea0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:08.185666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c9706bb7-f9d8-4103-b1df-5dd903ed6ea0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:08.193222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c9706bb7-f9d8-4103-b1df-5dd903ed6ea0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1237 microversion: 2.1 time: 0.067416 Oct 28 19:00:08.193813 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4352/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:08 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:09.217450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:09.218193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:09.226011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:09.227001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:09.227001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:09.227681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:09.228181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:09.228632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:09.658607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:09.667192 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d3a8f526-f1aa-46de-aead-e5b6d94a3008 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1295 microversion: 2.1 time: 0.454543 Oct 28 19:00:09.667759 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2684/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:09 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1295 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:10.690819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:10.692343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:10.700300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:10.700798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:10.701245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:10.701967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:10.702556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:10.702996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:10.820942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a91be496-9248-47d4-9087-1df03522c95d req-3977fffd-9dac-46f3-9ea2-1c14e820422e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c", "tag": "956e093e-e125-4f18-8396-09529d9e0dcb"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:10.834012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a91be496-9248-47d4-9087-1df03522c95d req-3977fffd-9dac-46f3-9ea2-1c14e820422e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:10.834994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a91be496-9248-47d4-9087-1df03522c95d req-3977fffd-9dac-46f3-9ea2-1c14e820422e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:10.835670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a91be496-9248-47d4-9087-1df03522c95d req-3977fffd-9dac-46f3-9ea2-1c14e820422e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:10.848345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:10.857840 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f44444f3-d3cc-407a-9f6a-bf0c6c384241 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1362 microversion: 2.1 time: 0.170979 Oct 28 19:00:10.858641 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4353/7037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:10 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:10.859108 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a91be496-9248-47d4-9087-1df03522c95d req-3977fffd-9dac-46f3-9ea2-1c14e820422e service nova] Creating event network-changed:956e093e-e125-4f18-8396-09529d9e0dcb for instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c on n-h1-862404-2 Oct 28 19:00:10.864496 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a91be496-9248-47d4-9087-1df03522c95d req-3977fffd-9dac-46f3-9ea2-1c14e820422e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047658 Oct 28 19:00:10.865319 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2685/7038] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:11.882138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:11.882753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:11.889629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:11.890107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:11.890542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:11.891227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:11.891679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:11.892228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:12.024051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:12.031671 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60322d3c-86ea-49cc-b969-e93c2474ba4a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1362 microversion: 2.1 time: 0.153717 Oct 28 19:00:12.032275 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4354/7039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:11 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:13.056926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:13.057650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:13.064072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:13.064577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:13.065173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:13.065731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:13.066336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:13.067082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:13.201543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:13.209644 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1b5cacd-a089-4903-87b3-62de9862ce05 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1362 microversion: 2.1 time: 0.158729 Oct 28 19:00:13.210246 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2686/7040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:13 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:14.234460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:14.235034 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:14.237380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:14.243586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:14.244112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:14.244559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:14.245259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:14.245720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:14.246173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:14.379105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:14.386976 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f8d64e4-0ff4-4b1b-9a11-01cccf370d1b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1362 microversion: 2.1 time: 0.156700 Oct 28 19:00:14.387556 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4355/7041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:14 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:15.410769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:15.411401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:15.414046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:15.419300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:15.419801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:15.420285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:15.421001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:15.421475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:15.421917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:15.554781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:15.562495 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-be30810c-d739-4663-995d-8f6fa4c189a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1362 microversion: 2.1 time: 0.155796 Oct 28 19:00:15.563072 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2687/7042] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:15 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:16.586985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:16.587505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:16.594389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:16.594871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:16.595304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:16.596024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:16.596476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:16.596906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:16.725266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:16.733129 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-273b9729-c1d4-4b28-85c4-522539dba533 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1362 microversion: 2.1 time: 0.150112 Oct 28 19:00:16.733707 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4356/7043] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:16 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:17.614271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-07ffce37-b015-4f6d-8cb2-6149eec8314b req-1dd3df10-1e07-47e4-a2a1-e80d566ce4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c", "name": "network-vif-plugged", "status": "completed", "tag": "956e093e-e125-4f18-8396-09529d9e0dcb"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:17.625119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-07ffce37-b015-4f6d-8cb2-6149eec8314b req-1dd3df10-1e07-47e4-a2a1-e80d566ce4a2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:17.625622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-07ffce37-b015-4f6d-8cb2-6149eec8314b req-1dd3df10-1e07-47e4-a2a1-e80d566ce4a2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:17.626073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-07ffce37-b015-4f6d-8cb2-6149eec8314b req-1dd3df10-1e07-47e4-a2a1-e80d566ce4a2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:17.637719 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-07ffce37-b015-4f6d-8cb2-6149eec8314b req-1dd3df10-1e07-47e4-a2a1-e80d566ce4a2 service nova] Creating event network-vif-plugged:956e093e-e125-4f18-8396-09529d9e0dcb for instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c on n-h1-862404-2 Oct 28 19:00:17.642556 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-07ffce37-b015-4f6d-8cb2-6149eec8314b req-1dd3df10-1e07-47e4-a2a1-e80d566ce4a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032861 Oct 28 19:00:17.643352 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2688/7044] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:17.756604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:17.757341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:17.764152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:17.764640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:17.765077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:17.765771 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:17.766229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:17.766681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:17.899405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:17.906982 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d56cc55-9116-4bdc-b23d-886dd3571482 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1362 microversion: 2.1 time: 0.154445 Oct 28 19:00:17.907559 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4357/7045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:17 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:00:18.928675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:18.929459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:18.934823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:18.935540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:18.943022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:18.943519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:18.944012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:18.944720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:18.945188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:18.945658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:19.083493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:19.092866 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a584e9da-c575-47e6-8380-91b259d7a6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1362 microversion: 2.1 time: 0.165131 Oct 28 19:00:19.093465 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2689/7046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:18 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:20.118196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:20.118817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:20.120727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:20.126663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:20.127146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:20.127583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:20.128302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:20.129708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:20.130233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:20.258200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:20.265918 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff5dfb9b-84d7-4023-b516-ef74e9139eab tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1550 microversion: 2.1 time: 0.151730 Oct 28 19:00:20.266501 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4358/7047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:20 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:20.289060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:20.289585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:00:20.296171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:20.296665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:20.297116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:20.297814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:20.298283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:20.298724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:20.376156 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40727075-0d9e-45d5-849d-d3008c40bbeb tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091047 Oct 28 19:00:20.376773 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2690/7048] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 19:00:20 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:00:21.332816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0eaf5e51-3129-44cd-93b9-0e354e19bd1e req-71c32a1d-d5b1-4a63-94d0-bfb29d49654c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c", "tag": "956e093e-e125-4f18-8396-09529d9e0dcb"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:21.345692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0eaf5e51-3129-44cd-93b9-0e354e19bd1e req-71c32a1d-d5b1-4a63-94d0-bfb29d49654c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:21.346188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0eaf5e51-3129-44cd-93b9-0e354e19bd1e req-71c32a1d-d5b1-4a63-94d0-bfb29d49654c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:21.346714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0eaf5e51-3129-44cd-93b9-0e354e19bd1e req-71c32a1d-d5b1-4a63-94d0-bfb29d49654c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:21.362845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0eaf5e51-3129-44cd-93b9-0e354e19bd1e req-71c32a1d-d5b1-4a63-94d0-bfb29d49654c service nova] Creating event network-changed:956e093e-e125-4f18-8396-09529d9e0dcb for instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c on n-h1-862404-2 Oct 28 19:00:21.369353 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0eaf5e51-3129-44cd-93b9-0e354e19bd1e req-71c32a1d-d5b1-4a63-94d0-bfb29d49654c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041436 Oct 28 19:00:21.370634 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4359/7049] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:24.999796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=7 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:25.000633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=35 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:25.002398 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:01:25.002558 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:01:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action (ip 10.222.0.16) !!! Oct 28 19:01:25.009448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d799576d-aae9-42b2-867f-cd90ffd6e140 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:25.016886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d799576d-aae9-42b2-867f-cd90ffd6e140 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:25.017385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d799576d-aae9-42b2-867f-cd90ffd6e140 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:25.017837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d799576d-aae9-42b2-867f-cd90ffd6e140 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:25.040985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d799576d-aae9-42b2-867f-cd90ffd6e140 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Going to try to stop instance {{(pid=120679) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 19:01:25.083954 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d799576d-aae9-42b2-867f-cd90ffd6e140 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action" status: 202 len: 0 microversion: 2.1 time: 0.086372 Oct 28 19:01:25.084561 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2691/7050] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:01:24 2022] POST /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:01:25.092104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=9 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:25.093206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=50 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:25.094502 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:01:25.094651 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:01:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c (ip 10.222.0.16) !!! Oct 28 19:01:25.102146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:25.102866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:25.110835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:25.111325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:25.111765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:25.112493 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:25.112951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:25.113943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:25.436299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:25.444363 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-63086497-7662-4cdd-bca1-3a179f37fda2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.355175 Oct 28 19:01:25.444952 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4360/7051] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:25 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:26.469270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:26.470020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:26.476426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:26.476930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:26.477392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:26.478097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:26.478577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:26.479018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:26.654173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:26.662596 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ccf607fd-b13c-47d9-a62b-e35586fddbed tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.198514 Oct 28 19:01:26.663173 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2692/7052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:26 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:27.686736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:27.687349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:27.694334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:27.694821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:27.695254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:27.695971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:27.696431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:27.696855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:27.828929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:27.836795 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52375e83-7338-458a-b32b-1bd6ff2dad79 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.154059 Oct 28 19:01:27.837370 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4361/7053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:27 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:28.861038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:28.861672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:28.869264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:28.869763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:28.870220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:28.870930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:28.871407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:28.871876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:29.004647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:29.013142 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b2a0945d-4b04-4f31-b3d6-1710f1ba01f0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.155953 Oct 28 19:01:29.013773 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2693/7054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:28 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:30.036931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:30.037478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:30.044310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:30.044798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:30.045342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:30.046087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:30.046546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:30.046972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:30.180416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:30.188346 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eba73df0-99bb-499e-a182-b352be76b0f1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.155775 Oct 28 19:01:30.188956 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4362/7055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:30 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:31.212970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:31.213604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:31.220434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:31.220932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:31.221385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:31.222092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:31.223363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:31.223862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:31.357952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:31.365742 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7909ea78-e70a-47f6-87a6-8218aef60581 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.156672 Oct 28 19:01:31.366329 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2694/7056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:31 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:32.389686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:32.390323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:32.397829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:32.398325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:32.398761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:32.399460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:32.399938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:32.400363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:32.534449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:32.542146 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c960ebf-b4a6-4e60-88c1-3c9de23e3da0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.156434 Oct 28 19:01:32.542724 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4363/7057] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:32 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:33.566724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:33.567486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:33.574168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:33.574661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:33.575109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:33.575809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:33.576296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:33.576736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:33.704914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:33.713336 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-adf14caa-72e5-4280-9121-d3bb33481b1a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.151172 Oct 28 19:01:33.713914 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2695/7058] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:33 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:34.735945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:34.736549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:34.743676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:34.744187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:34.744624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:34.745310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:34.745779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:34.746187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:34.873055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:34.880791 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-19847beb-81a3-4d26-84c4-6238f89a65aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.148816 Oct 28 19:01:34.881383 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4364/7059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:34 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:35.904442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:35.905077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:35.912854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:35.913355 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:35.913806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:35.914514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:35.914983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:35.915423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:36.047423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:36.055795 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fee2925b-d600-4a00-abf4-b11a7a04ea66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1656 microversion: 2.1 time: 0.155310 Oct 28 19:01:36.056388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2696/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:35 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:36.079805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:36.082287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:36.089246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:36.089734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:36.090175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:36.090871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:36.091329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:36.091755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:36.123226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:36.129131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Old instance type m1.heat2, new instance type m1.heat {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 19:01:36.135511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:01:36.135971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:01:36.136457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:01:36.136869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:01:36.137284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:01:36.200060 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-231e7a25-f443-4455-8bba-48266dca98a1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action" status: 202 len: 0 microversion: 2.1 time: 0.124026 Oct 28 19:01:36.200678 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4365/7061] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:01:36 2022] POST /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:01:36.209137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:36.209868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:36.216034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:36.216537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:36.216984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:36.217704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:36.218149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:36.218580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:36.354004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:36.362580 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96fe1ab1-0aca-4302-a930-40e34aa69d80 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.157537 Oct 28 19:01:36.363759 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2697/7062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:36 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:37.387353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:37.388011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:37.395327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:37.395853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:37.396288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:37.396998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:37.397459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:37.397892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:37.534203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:37.542293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78accbde-76f3-4677-9236-a6c19bbbdd4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.159605 Oct 28 19:01:37.542870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4366/7063] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:37 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:38.566474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:38.567245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:38.574291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:38.574800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:38.575227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:38.575974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:38.576440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:38.576875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:38.712085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:38.719870 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-21b041e1-edaa-45e6-960a-91cdd4f903da tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1679 microversion: 2.1 time: 0.157451 Oct 28 19:01:38.720453 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2698/7064] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:38 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:39.744972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:39.745509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:39.752334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:39.752818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:39.753255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:39.753973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:39.754499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:39.754922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:39.884114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:39.891703 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4f26c63-d48b-4aa0-a940-e9135f9878e8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1684 microversion: 2.1 time: 0.150754 Oct 28 19:01:39.892310 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4367/7065] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:39 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:40.914832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:40.915424 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:40.922633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:40.923142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:40.923599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:40.924356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:40.924831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:40.925806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:41.070932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:41.078521 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8bee949a-5694-4db7-bd94-ae423c04378e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1683 microversion: 2.1 time: 0.167765 Oct 28 19:01:41.079096 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2699/7066] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:40 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:41.322991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ead982eb-95ea-4f04-9fa2-76016335851a req-c3b9e6e1-41e6-4555-8fb3-56d41984b73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c", "name": "network-vif-unplugged", "status": "completed", "tag": "956e093e-e125-4f18-8396-09529d9e0dcb"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:41.332710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ead982eb-95ea-4f04-9fa2-76016335851a req-c3b9e6e1-41e6-4555-8fb3-56d41984b73a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:41.333214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ead982eb-95ea-4f04-9fa2-76016335851a req-c3b9e6e1-41e6-4555-8fb3-56d41984b73a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:41.333623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ead982eb-95ea-4f04-9fa2-76016335851a req-c3b9e6e1-41e6-4555-8fb3-56d41984b73a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:41.346691 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ead982eb-95ea-4f04-9fa2-76016335851a req-c3b9e6e1-41e6-4555-8fb3-56d41984b73a service nova] Creating event network-vif-unplugged:956e093e-e125-4f18-8396-09529d9e0dcb for instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c on n-h2-862404-2 Oct 28 19:01:41.353726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-ead982eb-95ea-4f04-9fa2-76016335851a req-c3b9e6e1-41e6-4555-8fb3-56d41984b73a service nova] Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:01:41.365751 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ead982eb-95ea-4f04-9fa2-76016335851a req-c3b9e6e1-41e6-4555-8fb3-56d41984b73a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097451 Oct 28 19:01:41.373106 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4368/7067] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:42.102571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:42.103308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:42.110514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:42.111020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:42.111479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:42.112222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:42.112703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:42.113306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:42.250491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:42.259588 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f138e5ff-cb63-4a1f-a165-81676bab6b48 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1683 microversion: 2.1 time: 0.160818 Oct 28 19:01:42.260204 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2700/7068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:42 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:43.284490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:43.286020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:43.292269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:43.292752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:43.293196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:43.293903 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:43.294370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:43.294802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:43.382668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5da426db-15b1-468b-868a-1b3a8da7b834 req-08326c1e-525e-431c-95ae-446040be718b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c", "tag": "956e093e-e125-4f18-8396-09529d9e0dcb"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:43.393081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5da426db-15b1-468b-868a-1b3a8da7b834 req-08326c1e-525e-431c-95ae-446040be718b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:43.393752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5da426db-15b1-468b-868a-1b3a8da7b834 req-08326c1e-525e-431c-95ae-446040be718b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:43.394924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5da426db-15b1-468b-868a-1b3a8da7b834 req-08326c1e-525e-431c-95ae-446040be718b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:43.406966 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5da426db-15b1-468b-868a-1b3a8da7b834 req-08326c1e-525e-431c-95ae-446040be718b service nova] Creating event network-changed:956e093e-e125-4f18-8396-09529d9e0dcb for instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c on n-h2-862404-2 Oct 28 19:01:43.413133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-5da426db-15b1-468b-868a-1b3a8da7b834 req-08326c1e-525e-431c-95ae-446040be718b service nova] Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:01:43.424017 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5da426db-15b1-468b-868a-1b3a8da7b834 req-08326c1e-525e-431c-95ae-446040be718b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045762 Oct 28 19:01:43.424633 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2701/7069] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:01:43.442536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:43.451102 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-965814bf-4ab0-4920-a2ef-9e6caf1fcfe6 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1681 microversion: 2.1 time: 0.172020 Oct 28 19:01:43.451706 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4369/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:43 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:44.476976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:44.477605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:44.484002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.484509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.484938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.485638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.486105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.486539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.617858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:44.625502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-61587f7b-f978-4df5-939d-7890b8c333b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1677 microversion: 2.1 time: 0.154379 Oct 28 19:01:44.626071 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2702/7071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:44 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:44.648954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:44.649489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:44.656163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.656660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.657103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.657834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.658298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.658730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.715040 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-80bec1d6-8dbe-46b9-8912-b68ba35faca8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action" status: 204 len: 0 microversion: 2.1 time: 0.069886 Oct 28 19:01:44.715756 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4370/7072] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:01:44 2022] POST /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:44.724620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:44.725250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:44.731524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.732252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.732866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.733597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.734046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.734486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.949214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:44.958532 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3ea543f-2a8f-41f5-8fff-1551d8c59ab8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1677 microversion: 2.1 time: 0.238445 Oct 28 19:01:44.959150 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2703/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:44 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:45.982859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:45.983535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:45.992116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:45.992643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:45.993235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:45.994021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:45.994548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:45.995055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:46.138304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:46.147017 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da356c92-81dd-4cff-b93f-0e5a496b5796 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1656 microversion: 2.1 time: 0.168823 Oct 28 19:01:46.147604 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4371/7074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:45 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:46.169838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:46.170410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:46.177326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:46.177824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:46.178274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:46.178976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:46.179446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:46.179913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:46.309071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:46.317310 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d7086e6b-219f-4957-b4c5-d814a702ab2d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1656 microversion: 2.1 time: 0.151484 Oct 28 19:01:46.317921 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2704/7075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:46 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:46.340617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-43785c1f-c510-4aba-9979-879555da4f39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:46.346718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43785c1f-c510-4aba-9979-879555da4f39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:46.347311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43785c1f-c510-4aba-9979-879555da4f39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:46.347806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-43785c1f-c510-4aba-9979-879555da4f39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:46.369935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-43785c1f-c510-4aba-9979-879555da4f39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Going to try to start instance {{(pid=120680) start /opt/stack/nova/nova/compute/api.py:2787}} Oct 28 19:01:46.412742 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-43785c1f-c510-4aba-9979-879555da4f39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action" status: 202 len: 0 microversion: 2.1 time: 0.075801 Oct 28 19:01:46.413510 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4372/7076] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:01:46 2022] POST /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:01:46.422769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:46.423338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:46.431340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:46.431951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:46.432450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:46.433254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:46.433738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:46.434222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:46.585344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:46.593026 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e4cdf747-0a44-4ce9-8d86-ae6d8a2cd121 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1665 microversion: 2.1 time: 0.175190 Oct 28 19:01:46.593691 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2705/7077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:46 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1665 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:47.617767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:47.618503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:47.625453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:47.625934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:47.626368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:47.627054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:47.627506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:47.627960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:47.642800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.764343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:47.772589 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e00aaf2c-6b1b-45e5-9a32-0a4b5401a448 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1669 microversion: 2.1 time: 0.159265 Oct 28 19:01:47.773157 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4373/7078] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:47 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:47.795251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:47.795832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:47.802910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:47.803413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:47.803895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:47.804607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:47.805081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:47.805526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:47.832323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:01:47.835317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:47.910003 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9238a51b-669a-413f-abfd-bde1e9869fc7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 204 len: 0 microversion: 2.1 time: 0.118134 Oct 28 19:01:47.910451 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2706/7079] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:01:47 2022] DELETE /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:47.919219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:47.919890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:47.926679 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:47.927173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:47.927612 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:47.928339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:47.928798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:47.929225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:48.062977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:48.071681 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06550c4c-9fef-4a05-b71e-e3487e3f2931 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1675 microversion: 2.1 time: 0.156497 Oct 28 19:01:48.072290 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4374/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:47 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:48.534305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5d3a393e-fdd7-458d-ac09-6f6e21043df8 req-ce549822-dcd1-4c89-8b9a-30cc9bfdf755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c", "name": "network-vif-plugged", "status": "completed", "tag": "956e093e-e125-4f18-8396-09529d9e0dcb"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:48.544522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d3a393e-fdd7-458d-ac09-6f6e21043df8 req-ce549822-dcd1-4c89-8b9a-30cc9bfdf755 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:48.544962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d3a393e-fdd7-458d-ac09-6f6e21043df8 req-ce549822-dcd1-4c89-8b9a-30cc9bfdf755 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:48.545407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d3a393e-fdd7-458d-ac09-6f6e21043df8 req-ce549822-dcd1-4c89-8b9a-30cc9bfdf755 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:48.559536 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5d3a393e-fdd7-458d-ac09-6f6e21043df8 req-ce549822-dcd1-4c89-8b9a-30cc9bfdf755 service nova] Creating event network-vif-plugged:956e093e-e125-4f18-8396-09529d9e0dcb for instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c on n-h2-862404-2 Oct 28 19:01:48.564407 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5d3a393e-fdd7-458d-ac09-6f6e21043df8 req-ce549822-dcd1-4c89-8b9a-30cc9bfdf755 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083439 Oct 28 19:01:48.564989 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2707/7081] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:49.096239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:49.096854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:49.104270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:49.105010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:49.105442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:49.106126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:49.106577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:49.107001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:49.237787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:49.245509 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34d3ed7c-22b4-46cf-823d-c0d55dab20bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1675 microversion: 2.1 time: 0.153293 Oct 28 19:01:49.246083 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4375/7082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:49 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:50.205581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4e4df837-e709-45b3-9ecb-ed9ba380af52 req-68aebef3-3ea8-47ed-9ed3-635e226246ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c", "name": "network-vif-deleted", "tag": "956e093e-e125-4f18-8396-09529d9e0dcb"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:50.215623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4e4df837-e709-45b3-9ecb-ed9ba380af52 req-68aebef3-3ea8-47ed-9ed3-635e226246ac service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:50.216256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4e4df837-e709-45b3-9ecb-ed9ba380af52 req-68aebef3-3ea8-47ed-9ed3-635e226246ac service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:50.216775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4e4df837-e709-45b3-9ecb-ed9ba380af52 req-68aebef3-3ea8-47ed-9ed3-635e226246ac service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:50.229253 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4e4df837-e709-45b3-9ecb-ed9ba380af52 req-68aebef3-3ea8-47ed-9ed3-635e226246ac service nova] Creating event network-vif-deleted:956e093e-e125-4f18-8396-09529d9e0dcb for instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c on n-h2-862404-2 Oct 28 19:01:50.234587 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4e4df837-e709-45b3-9ecb-ed9ba380af52 req-68aebef3-3ea8-47ed-9ed3-635e226246ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034244 Oct 28 19:01:50.235601 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2708/7083] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:50.269532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:50.270767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:50.277672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:50.278471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:50.278911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:50.280777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:50.281474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:50.281714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:50.319143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:50.319645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:50.320108 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:50.320596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lazy-loading 'fault' on Instance uuid 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:01:50.370238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:50.378868 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0961568c-bb46-49e5-9b0c-2c3a7be9edb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 200 len: 1327 microversion: 2.1 time: 0.113160 Oct 28 19:01:50.379882 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4376/7084] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:50 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:51.405990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:51.406719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:51.413982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:51.414488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:51.414944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:51.415714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:51.416172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:51.416618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:51.430374 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c HTTP/1.1 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c'} Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:01:51.432076 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3771c442-92f9-4cbe-998d-69bcbdc013d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 404 len: 111 microversion: 2.1 time: 0.033106 Oct 28 19:01:51.436924 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2709/7085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:51 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:01:51.449629 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:51.450246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:51.457309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:51.457821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:51.458255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:51.458941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:51.459391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:51.459834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:51.473413 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c HTTP/1.1 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c'} Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:01:51.475018 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f46a2023-aa87-4e69-9258-aeb915a639ef tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 404 len: 111 microversion: 2.1 time: 0.030990 Oct 28 19:01:51.480131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4377/7086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:51 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:01:51.525465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1690771202", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "4fc1d561-9a43-49d0-aefe-c3016e1dfe36"}], "security_groups": [{"name": "tempest-securitygroup--175089784"}], "key_name": "tempest-keypair-91495993", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:51.630957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] validate_networks() for [('4fc1d561-9a43-49d0-aefe-c3016e1dfe36', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:01:52.077109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:01:52.077546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:01:52.078033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:01:52.078454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:01:52.078878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:01:52.088560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:52.089056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:52.089505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:52.090240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:52.090709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:52.091146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:52.109011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:01:52.114331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for user 037e2796b1384a2b8881c2396300b164 and project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:01:52.126371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:01:52.128840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:01:52.175298 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bd36007d-e85d-4882-b9d9-fb710471e87c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.653720 Oct 28 19:01:52.175967 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2710/7087] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:01:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:01:52.187354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5686177-1d0e-480a-b154-979df30504f4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:52.188033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5686177-1d0e-480a-b154-979df30504f4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:52.242322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5686177-1d0e-480a-b154-979df30504f4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:52.249535 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5686177-1d0e-480a-b154-979df30504f4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1237 microversion: 2.1 time: 0.066091 Oct 28 19:01:52.250111 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4378/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:52 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:53.278352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:53.278991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:53.289720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:53.290226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:53.290682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:53.291405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:53.291900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:53.292341 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:53.368238 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:53.375806 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-53f36edd-3557-4449-b006-9942ee08c05b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1295 microversion: 2.1 time: 0.106447 Oct 28 19:01:53.376398 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2711/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:53 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1295 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:54.401285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:54.401908 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:54.409893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:54.410390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:54.410839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:54.411542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:54.412057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:54.412490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:54.554869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:54.564378 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db76703e-eef9-4b06-a3a2-2b7d8b83dd2c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1362 microversion: 2.1 time: 0.167603 Oct 28 19:01:54.565368 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4379/7090] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:54 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:54.701614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-de60ac43-4893-44e0-b94c-50098b4b2571 req-7d7490c8-f00b-40a2-9d7a-5077e38c6f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:54.711974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de60ac43-4893-44e0-b94c-50098b4b2571 req-7d7490c8-f00b-40a2-9d7a-5077e38c6f41 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:54.712469 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de60ac43-4893-44e0-b94c-50098b4b2571 req-7d7490c8-f00b-40a2-9d7a-5077e38c6f41 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:54.712913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-de60ac43-4893-44e0-b94c-50098b4b2571 req-7d7490c8-f00b-40a2-9d7a-5077e38c6f41 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:54.724929 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-de60ac43-4893-44e0-b94c-50098b4b2571 req-7d7490c8-f00b-40a2-9d7a-5077e38c6f41 service nova] Creating event network-changed:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h1-862404-2 Oct 28 19:01:54.730120 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-de60ac43-4893-44e0-b94c-50098b4b2571 req-7d7490c8-f00b-40a2-9d7a-5077e38c6f41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082325 Oct 28 19:01:54.730897 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2712/7091] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:55.588938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:55.589537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:55.592194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=49 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:55.598308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:55.598784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:55.599217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:55.599923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:55.600378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:55.600806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:55.730181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:55.738376 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0cc40f84-f5fa-4211-a686-399298397e39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1362 microversion: 2.1 time: 0.152908 Oct 28 19:01:55.739054 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4380/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:55 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:56.763721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:56.764467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:56.766406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:56.772546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:56.772995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:56.773459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:56.774170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:56.774647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:56.775094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:56.941306 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:56.949137 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-57ce2c4b-c8aa-4cd5-87a9-c46ecc9ced94 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1362 microversion: 2.1 time: 0.190584 Oct 28 19:01:56.949729 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2713/7093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:56 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:57.973076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:57.973652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:57.980795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:57.981287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:57.981721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:57.982416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:57.982872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:57.983296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:58.122103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:58.130779 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0a0f834-ea8d-4c31-9577-c672b0252fac tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1362 microversion: 2.1 time: 0.161740 Oct 28 19:01:58.131372 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4381/7094] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:57 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:59.154435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:59.155062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:01:59.161962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:59.162459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:59.162912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:59.163616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:59.164113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:59.164561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:59.299886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:59.307750 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f505fe20-1e9c-4ea3-b4f5-4135050c8a0d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1362 microversion: 2.1 time: 0.157225 Oct 28 19:01:59.308350 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2714/7095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:59 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:00.262033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2b9bccf0-12eb-46da-8f9b-aa8e90fba4d9 req-1470ef59-24fa-47e6-b092-f26ab266820e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "name": "network-vif-plugged", "status": "completed", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:02:00.274273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2b9bccf0-12eb-46da-8f9b-aa8e90fba4d9 req-1470ef59-24fa-47e6-b092-f26ab266820e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:00.274895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2b9bccf0-12eb-46da-8f9b-aa8e90fba4d9 req-1470ef59-24fa-47e6-b092-f26ab266820e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:00.275330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2b9bccf0-12eb-46da-8f9b-aa8e90fba4d9 req-1470ef59-24fa-47e6-b092-f26ab266820e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:00.286984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2b9bccf0-12eb-46da-8f9b-aa8e90fba4d9 req-1470ef59-24fa-47e6-b092-f26ab266820e service nova] Creating event network-vif-plugged:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h1-862404-2 Oct 28 19:02:00.292230 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2b9bccf0-12eb-46da-8f9b-aa8e90fba4d9 req-1470ef59-24fa-47e6-b092-f26ab266820e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033872 Oct 28 19:02:00.292964 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4382/7096] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:02:00.331757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:00.333040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:02:00.340154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:00.340654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:00.341101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:00.342045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:00.342507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:00.343125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:00.523390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:00.531015 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-93c6298b-649e-41ff-ad88-55f9cb62a676 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1362 microversion: 2.1 time: 0.203207 Oct 28 19:02:00.531610 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2715/7097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:00 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:01.556949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:01.557691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:02:01.564046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:01.564534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:01.564974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:01.565667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:01.566123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:01.566658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:01.701407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:01.709933 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0cafc02f-43ea-498d-8ea7-5e8feffb7727 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1362 microversion: 2.1 time: 0.158156 Oct 28 19:02:01.711113 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4383/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:01 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:02.734942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:02.735672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:02:02.738482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:02.739285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:02.745494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:02.745992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:02.746445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:02.747162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:02.747636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:02.748103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:02.884634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:02.892471 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a05361f-ab7f-4788-bd5d-97c94be8d438 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1550 microversion: 2.1 time: 0.161489 Oct 28 19:02:02.893126 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2716/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:02 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:02.916282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:02.916810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:02:02.918754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:02.925675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:02.926562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:02.927087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:02.927800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:02.928284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:02.928712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:03.015350 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c8af4f7a-3774-4ade-b52e-552378fcf21b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102952 Oct 28 19:02:03.016212 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4384/7100] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 19:02:02 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:02:04.271350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4482654c-db2a-4f16-b0be-044e58a22aee req-9f74d066-e958-4787-8c3b-83569cfc02af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:02:04.281435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4482654c-db2a-4f16-b0be-044e58a22aee req-9f74d066-e958-4787-8c3b-83569cfc02af service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:04.281921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4482654c-db2a-4f16-b0be-044e58a22aee req-9f74d066-e958-4787-8c3b-83569cfc02af service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:04.282562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4482654c-db2a-4f16-b0be-044e58a22aee req-9f74d066-e958-4787-8c3b-83569cfc02af service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:04.294178 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4482654c-db2a-4f16-b0be-044e58a22aee req-9f74d066-e958-4787-8c3b-83569cfc02af service nova] Creating event network-changed:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h1-862404-2 Oct 28 19:02:04.299313 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4482654c-db2a-4f16-b0be-044e58a22aee req-9f74d066-e958-4787-8c3b-83569cfc02af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032333 Oct 28 19:02:04.300311 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2717/7101] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:16.579560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=9 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:16.580306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=55 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:16.586276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:16.588538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:16.595226 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:16.595703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:16.596158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:16.597559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:16.598014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:16.598436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:16.625825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:16.631291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Old instance type m1.heat2, new instance type m1.heat {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 19:03:16.637741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:03:16.638157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:03:16.638622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:03:16.639025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:03:16.639430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:03:16.708848 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c4be8bed-5362-460f-a00c-654c74a77d06 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c/action" status: 202 len: 0 microversion: 2.1 time: 0.131667 Oct 28 19:03:16.709485 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4385/7102] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:03:16 2022] POST /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:03:16.716851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=9 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:16.717756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:16.724667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:16.725402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:16.732552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:16.733068 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:16.733512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:16.734283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:16.734762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:16.735184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:16.951362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:16.960685 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96613777-b004-4327-a660-4745e061890b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1678 microversion: 2.1 time: 0.246825 Oct 28 19:03:16.961276 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2718/7103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:16 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:17.985666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:17.986287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:17.995441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:17.995968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:17.996414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:17.997113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:17.997574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:17.998007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:18.431436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:18.439254 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7259863-fb77-4766-9c99-95f379e011cc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1678 microversion: 2.1 time: 0.457530 Oct 28 19:03:18.439969 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4386/7104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:17 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1678 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:19.462506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:19.463129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:19.469859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:19.470353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:19.470797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:19.471493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:19.471992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:19.472560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:19.603090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:19.611051 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5117dbf4-efd7-4d54-a5af-48ed5ebb30d9 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.152458 Oct 28 19:03:19.611702 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2719/7105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:19 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:20.635753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:20.636402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:20.643151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:20.643641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:20.644786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:20.645538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:20.645999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:20.646433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:20.779469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:20.787244 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-130a6e68-4a54-4776-a1ca-a1587c0724aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.155472 Oct 28 19:03:20.787834 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4387/7106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:20 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:03:21.811010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:21.811673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:21.820794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:21.821300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:21.821756 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:21.822472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:21.822945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:21.823408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:21.956378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:21.964650 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6fe33759-37a7-42dc-8a42-7ad8413387d2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.157706 Oct 28 19:03:21.965226 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2720/7107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:21 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:22.987729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:22.989253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:22.996458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:22.996939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:22.997374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:22.998070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:22.998526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:22.998952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:23.134227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:23.141913 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78343746-28d2-4f90-8d3a-ca0057be5d54 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.158102 Oct 28 19:03:23.142493 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4388/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:22 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:24.166508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:24.167097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:24.173928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:24.174425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:24.174873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:24.176255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:24.176834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:24.177273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:24.304127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:24.311798 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9efa436e-f9b5-48be-9c78-4e880df57045 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.149308 Oct 28 19:03:24.312402 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2721/7109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:24 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:25.385859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:25.386494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:25.393525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:25.394938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:25.395707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:25.397020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:25.397864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:25.398502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:25.539090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:25.551473 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd9da1cb-6a07-453e-9b54-b29cec406e24 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.220429 Oct 28 19:03:25.552243 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4389/7110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:25 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:26.575911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:26.576548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:26.583553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:26.584090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:26.584543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:26.585252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:26.585722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:26.586162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:26.724701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:26.732739 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-97563853-ec91-492e-a85e-3ee23582846b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.160810 Oct 28 19:03:26.733308 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2722/7111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:26 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:27.757387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:27.758016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:27.765013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:27.765504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:27.765945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:27.766645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:27.767105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:27.767536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:27.908746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:27.917236 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a9da811b-8d17-434d-942f-e4aaecc36965 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.165021 Oct 28 19:03:27.917823 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4390/7112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:27 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:28.941051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:28.941968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:28.948762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:28.949260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:28.949710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:28.950420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:28.950889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:28.951330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:29.082672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:29.090455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8532f277-d500-4370-8d81-f977511b7d9a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.153497 Oct 28 19:03:29.091069 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2723/7113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:28 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:30.115500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:30.116157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:30.123036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:30.123532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:30.124015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:30.124729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:30.125194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:30.125628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:30.259761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:30.267489 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e9c7ef6-a72a-486b-a335-506d30134ec8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.156651 Oct 28 19:03:30.268097 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4391/7114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:30 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:31.290602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:31.291263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:31.298065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:31.298559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:31.299013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:31.299722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:31.300745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:31.301187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:31.429452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:31.437093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-731860c0-6a3c-4c57-993e-476c9ed7ab88 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.150422 Oct 28 19:03:31.437664 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2724/7115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:31 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:32.461660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:32.462282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:32.469077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:32.469565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:32.470007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:32.470705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:32.471165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:32.471594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:32.604670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:32.612571 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3c1faff-818b-48ca-b6f3-17e90d9f2eb0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.155802 Oct 28 19:03:32.613149 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4392/7116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:32 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:33.636170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:33.636807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:33.643607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:33.644139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:33.644600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:33.645311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:33.645787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:33.646230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:33.781190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:33.788791 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7db632c5-6eec-46a7-b367-3f84acf3efca tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.156549 Oct 28 19:03:33.789389 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2725/7117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:33 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:34.812949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:34.813573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:34.821392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:34.821881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:34.822326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:34.823024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:34.823483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:34.824013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:34.954816 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:34.963494 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-730862e6-7197-492a-a6cb-e8db49fc485b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1683 microversion: 2.1 time: 0.154546 Oct 28 19:03:34.964100 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4393/7118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:34 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:35.986833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:35.987490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:35.994537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:35.995267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:35.995607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:35.996397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:35.997017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:35.997459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:36.120933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-00e1733a-c18d-4a3c-9c70-ea08bf97ae7c req-ace6795e-e775-459d-8fce-a90a243e9c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "name": "network-vif-unplugged", "status": "completed", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:36.132094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-00e1733a-c18d-4a3c-9c70-ea08bf97ae7c req-ace6795e-e775-459d-8fce-a90a243e9c5f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:36.132583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-00e1733a-c18d-4a3c-9c70-ea08bf97ae7c req-ace6795e-e775-459d-8fce-a90a243e9c5f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:36.133024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-00e1733a-c18d-4a3c-9c70-ea08bf97ae7c req-ace6795e-e775-459d-8fce-a90a243e9c5f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:36.139920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:36.146717 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-00e1733a-c18d-4a3c-9c70-ea08bf97ae7c req-ace6795e-e775-459d-8fce-a90a243e9c5f service nova] Creating event network-vif-unplugged:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h2-862404-2 Oct 28 19:03:36.149467 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-80707418-c608-4a17-9e66-4160875f68b1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1682 microversion: 2.1 time: 0.166615 Oct 28 19:03:36.150284 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2726/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:35 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:36.153289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-00e1733a-c18d-4a3c-9c70-ea08bf97ae7c req-ace6795e-e775-459d-8fce-a90a243e9c5f service nova] Instance d09a012b-be60-47c3-b94b-ace29f339c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:03:36.168526 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-00e1733a-c18d-4a3c-9c70-ea08bf97ae7c req-ace6795e-e775-459d-8fce-a90a243e9c5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051556 Oct 28 19:03:36.169140 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4394/7120] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:03:37.174513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:37.175153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:37.182812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:37.183320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:37.183779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:37.184530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:37.185008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:37.185452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:37.320542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:37.328455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de971269-f57d-43e2-a05a-cd1e6cd0e7aa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1682 microversion: 2.1 time: 0.157861 Oct 28 19:03:37.329026 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2727/7121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:37 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:38.185927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4fbb16fc-f789-4e17-9777-05999662fc55 req-93a70bdb-e513-4693-b210-c4bcf51db848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:38.196192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4fbb16fc-f789-4e17-9777-05999662fc55 req-93a70bdb-e513-4693-b210-c4bcf51db848 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:38.196680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4fbb16fc-f789-4e17-9777-05999662fc55 req-93a70bdb-e513-4693-b210-c4bcf51db848 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:38.197121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4fbb16fc-f789-4e17-9777-05999662fc55 req-93a70bdb-e513-4693-b210-c4bcf51db848 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:38.208333 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4fbb16fc-f789-4e17-9777-05999662fc55 req-93a70bdb-e513-4693-b210-c4bcf51db848 service nova] Creating event network-changed:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h2-862404-2 Oct 28 19:03:38.213671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-4fbb16fc-f789-4e17-9777-05999662fc55 req-93a70bdb-e513-4693-b210-c4bcf51db848 service nova] Instance d09a012b-be60-47c3-b94b-ace29f339c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:03:38.224727 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4fbb16fc-f789-4e17-9777-05999662fc55 req-93a70bdb-e513-4693-b210-c4bcf51db848 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043799 Oct 28 19:03:38.225317 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4395/7122] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:38.356249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:38.357026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:38.365010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:38.365439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:38.365893 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:38.366612 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:38.367083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:38.367547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:38.581156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:38.589100 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5ea80a4-eaa3-482d-a5f9-bbf5d0bbe35a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1680 microversion: 2.1 time: 0.237123 Oct 28 19:03:38.589693 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2728/7123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:38 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:39.615273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:39.616010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:39.622109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:39.622603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:39.623047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:39.623748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:39.624238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:39.624674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:39.758920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:39.766664 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2d14131-c0b6-4b58-a8a4-0acd105796a4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1677 microversion: 2.1 time: 0.157115 Oct 28 19:03:39.767248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4396/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:39 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:39.789505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:39.790090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:39.796877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:39.797371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:39.797823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:39.798527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:39.798996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:39.799433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:39.838185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:39.838680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:39.839136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:39.839909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:39.840379 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:39.840821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:39.864552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:03:39.870043 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for user 037e2796b1384a2b8881c2396300b164 and project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:03:39.977309 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-607b717c-30ca-46bd-bd12-2625e4e59cfe tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c/action" status: 202 len: 0 microversion: 2.1 time: 0.191622 Oct 28 19:03:39.977944 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2729/7125] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:03:39 2022] POST /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:03:39.986398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:39.987018 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:39.993825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:39.994323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:39.994760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:39.995472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:39.995959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:39.996384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:40.198851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:40.207708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ba580d1-6e11-4c00-b214-b57b1b18cd3f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1676 microversion: 2.1 time: 0.224555 Oct 28 19:03:40.208365 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4397/7126] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:39 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:41.232264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:41.232982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:41.239917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:41.240419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:41.240870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:41.241576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:41.242050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:41.242492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:41.375466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:41.383328 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c597f48e-e1c9-46b2-a228-eb4a69326437 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1676 microversion: 2.1 time: 0.156453 Oct 28 19:03:41.383922 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2730/7127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:41 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:42.407121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:42.407741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:42.415324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:42.415830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:42.416284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:42.416987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:42.417446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:42.417875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:42.552420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:42.560924 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c04df2c-26ae-4be1-b2e3-f2176aa6017e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1676 microversion: 2.1 time: 0.157706 Oct 28 19:03:42.561517 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4398/7128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:42 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:42.853787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b0f940cc-6c77-4d5e-b294-2bcfe593e36f req-df945ab4-ebbd-461d-99c1-0e63c722f365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "name": "network-vif-plugged", "status": "completed", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:42.865937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b0f940cc-6c77-4d5e-b294-2bcfe593e36f req-df945ab4-ebbd-461d-99c1-0e63c722f365 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:42.866648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b0f940cc-6c77-4d5e-b294-2bcfe593e36f req-df945ab4-ebbd-461d-99c1-0e63c722f365 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:42.867109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b0f940cc-6c77-4d5e-b294-2bcfe593e36f req-df945ab4-ebbd-461d-99c1-0e63c722f365 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:42.880857 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b0f940cc-6c77-4d5e-b294-2bcfe593e36f req-df945ab4-ebbd-461d-99c1-0e63c722f365 service nova] Creating event network-vif-plugged:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h1-862404-2 Oct 28 19:03:42.884337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:42.888318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-b0f940cc-6c77-4d5e-b294-2bcfe593e36f req-df945ab4-ebbd-461d-99c1-0e63c722f365 service nova] Instance d09a012b-be60-47c3-b94b-ace29f339c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:03:42.900468 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b0f940cc-6c77-4d5e-b294-2bcfe593e36f req-df945ab4-ebbd-461d-99c1-0e63c722f365 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050194 Oct 28 19:03:42.901352 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2731/7129] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:03:43.249217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5cee1e04-916b-48cd-bf24-70b4aca75283 req-51cd57d8-0875-49ab-8ed6-02e83ccb2ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "name": "network-vif-unplugged", "status": "completed", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:43.259934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cee1e04-916b-48cd-bf24-70b4aca75283 req-51cd57d8-0875-49ab-8ed6-02e83ccb2ad9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:43.260406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cee1e04-916b-48cd-bf24-70b4aca75283 req-51cd57d8-0875-49ab-8ed6-02e83ccb2ad9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:43.260937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5cee1e04-916b-48cd-bf24-70b4aca75283 req-51cd57d8-0875-49ab-8ed6-02e83ccb2ad9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:43.276698 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5cee1e04-916b-48cd-bf24-70b4aca75283 req-51cd57d8-0875-49ab-8ed6-02e83ccb2ad9 service nova] Creating event network-vif-unplugged:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h1-862404-2 Oct 28 19:03:43.282710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-5cee1e04-916b-48cd-bf24-70b4aca75283 req-51cd57d8-0875-49ab-8ed6-02e83ccb2ad9 service nova] Instance d09a012b-be60-47c3-b94b-ace29f339c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:03:43.296422 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5cee1e04-916b-48cd-bf24-70b4aca75283 req-51cd57d8-0875-49ab-8ed6-02e83ccb2ad9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051422 Oct 28 19:03:43.297378 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4399/7130] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:43.585665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:43.586389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:43.593257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:43.593761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:43.594216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:43.594929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:43.595500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:43.595964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:43.843421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:43.852668 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-27c8446d-184a-4f2c-a40a-578d61bb5561 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1676 microversion: 2.1 time: 0.271474 Oct 28 19:03:43.853472 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2732/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:43 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1676 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:44.877356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:44.878077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:44.885536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:44.886009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:44.886456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:44.887160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:44.887623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:44.888104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:45.022693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:45.031030 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-17e1156a-9880-4416-a8df-745883fdae36 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1676 microversion: 2.1 time: 0.158085 Oct 28 19:03:45.031618 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4400/7132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:44 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:45.316726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a6e65954-1521-4d6b-8070-618196344bee req-8810e21a-e2ef-4e68-9393-5b36d2650095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:45.326308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a6e65954-1521-4d6b-8070-618196344bee req-8810e21a-e2ef-4e68-9393-5b36d2650095 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:45.326792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a6e65954-1521-4d6b-8070-618196344bee req-8810e21a-e2ef-4e68-9393-5b36d2650095 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:45.327231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a6e65954-1521-4d6b-8070-618196344bee req-8810e21a-e2ef-4e68-9393-5b36d2650095 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:45.338463 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a6e65954-1521-4d6b-8070-618196344bee req-8810e21a-e2ef-4e68-9393-5b36d2650095 service nova] Creating event network-changed:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h1-862404-2 Oct 28 19:03:45.343575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-a6e65954-1521-4d6b-8070-618196344bee req-8810e21a-e2ef-4e68-9393-5b36d2650095 service nova] Instance d09a012b-be60-47c3-b94b-ace29f339c4c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:03:45.355157 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a6e65954-1521-4d6b-8070-618196344bee req-8810e21a-e2ef-4e68-9393-5b36d2650095 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041915 Oct 28 19:03:45.355751 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2733/7133] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:46.055042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:46.055662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:46.062842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:46.063576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:46.064152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:46.065823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:46.066402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:46.067123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:46.071557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:46.198416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:46.206099 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3969741-a088-4963-8d70-9f4939586781 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1676 microversion: 2.1 time: 0.155675 Oct 28 19:03:46.206691 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4401/7134] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:46 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:47.231566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:47.232310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:47.234585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:47.248194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:47.249003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:47.249681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:47.250610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:47.251193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:47.251738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:47.636818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:47.644636 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2ff101c5-0a75-484a-8040-50a105f0552e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1669 microversion: 2.1 time: 0.418429 Oct 28 19:03:47.645216 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2734/7135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:47 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1669 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:47.667806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:47.668455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:47.671135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=39 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:47.677308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:47.677802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:47.678244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:47.679094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:47.679584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:47.680040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:47.817477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:47.825697 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8a7e2f4-8b53-4170-8d09-cc22f184f50c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1669 microversion: 2.1 time: 0.161843 Oct 28 19:03:47.826301 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4402/7136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:47 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:47.848779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:47.849397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:47.855445 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:47.855967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:47.856414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:47.857120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:47.857565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:47.857994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:47.989780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:47.997606 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-68c13da2-869d-4183-875e-1360d0323a44 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1669 microversion: 2.1 time: 0.153322 Oct 28 19:03:47.998188 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2735/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:47 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:48.020178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:48.020689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:48.026675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:48.027169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:48.027624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:48.028374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:48.028838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:48.029272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:48.054719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:03:48.131496 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e7a0365a-2cd2-45b7-b499-0ccfe4b4c90c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 204 len: 0 microversion: 2.1 time: 0.115654 Oct 28 19:03:48.132348 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4403/7138] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:03:48 2022] DELETE /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:03:48.140739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:48.141373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:48.148194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:48.148735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:48.149195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:48.149912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:48.150381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:48.150824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:48.278507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:48.286170 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f61d7fc7-2f6e-4ae8-9c50-e3a09ac0b262 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1675 microversion: 2.1 time: 0.149309 Oct 28 19:03:48.286750 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2736/7139] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:48 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:48.731097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-52a91ce3-045f-40e8-8521-f48ebdc5e571 req-6101bcb6-a1ed-440f-ae25-db63dc429602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "name": "network-vif-plugged", "status": "completed", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:48.743275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-52a91ce3-045f-40e8-8521-f48ebdc5e571 req-6101bcb6-a1ed-440f-ae25-db63dc429602 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:48.743765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-52a91ce3-045f-40e8-8521-f48ebdc5e571 req-6101bcb6-a1ed-440f-ae25-db63dc429602 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:48.744225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-52a91ce3-045f-40e8-8521-f48ebdc5e571 req-6101bcb6-a1ed-440f-ae25-db63dc429602 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:48.755618 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-52a91ce3-045f-40e8-8521-f48ebdc5e571 req-6101bcb6-a1ed-440f-ae25-db63dc429602 service nova] Creating event network-vif-plugged:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h1-862404-2 Oct 28 19:03:48.765600 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-52a91ce3-045f-40e8-8521-f48ebdc5e571 req-6101bcb6-a1ed-440f-ae25-db63dc429602 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038969 Oct 28 19:03:48.766241 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4404/7140] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:49.309338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:49.310097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:49.316976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:49.317414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:49.317861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:49.318561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:49.319025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:49.319463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:49.452822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:49.461565 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-63cc4f03-4c7a-4ff9-99ee-db6bd025e496 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1675 microversion: 2.1 time: 0.156099 Oct 28 19:03:49.462146 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2737/7141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:49 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:50.401875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-13423be5-9901-4613-98d4-8903903e6fff req-770166e0-4ded-4498-be7a-bb38b730a2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09a012b-be60-47c3-b94b-ace29f339c4c", "name": "network-vif-deleted", "tag": "a8f711db-3c0a-454f-8380-0e305ef8bb9d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:50.413299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13423be5-9901-4613-98d4-8903903e6fff req-770166e0-4ded-4498-be7a-bb38b730a2b7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:50.413543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13423be5-9901-4613-98d4-8903903e6fff req-770166e0-4ded-4498-be7a-bb38b730a2b7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:50.414057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-13423be5-9901-4613-98d4-8903903e6fff req-770166e0-4ded-4498-be7a-bb38b730a2b7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:50.427685 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-13423be5-9901-4613-98d4-8903903e6fff req-770166e0-4ded-4498-be7a-bb38b730a2b7 service nova] Creating event network-vif-deleted:a8f711db-3c0a-454f-8380-0e305ef8bb9d for instance d09a012b-be60-47c3-b94b-ace29f339c4c on n-h1-862404-2 Oct 28 19:03:50.432866 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-13423be5-9901-4613-98d4-8903903e6fff req-770166e0-4ded-4498-be7a-bb38b730a2b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036310 Oct 28 19:03:50.433486 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4405/7142] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:50.485385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:50.486130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:50.488622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:50.500465 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:50.500978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:50.501428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:50.502151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:50.502670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:50.503109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:50.537206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:50.537746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:50.538200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:50.538734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lazy-loading 'fault' on Instance uuid d09a012b-be60-47c3-b94b-ace29f339c4c {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:03:50.590770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:50.598601 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2c8bd7ee-c2ab-481e-85fd-e32ebc34a1d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 200 len: 1327 microversion: 2.1 time: 0.117109 Oct 28 19:03:50.599179 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2738/7143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:50 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:51.623294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:51.623950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:51.630387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:51.630878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:51.631321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:51.632044 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:51.632509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:51.632937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:51.646911 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c HTTP/1.1 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'd09a012b-be60-47c3-b94b-ace29f339c4c'} Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:03:51.648572 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01b22aab-a668-4290-a217-8ba963989c71 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 404 len: 111 microversion: 2.1 time: 0.031996 Oct 28 19:03:51.653436 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4406/7144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:51 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:03:51.669385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:51.670018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:51.677092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:51.677593 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:51.678045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:51.678751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:51.679220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:51.679660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:51.693254 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c HTTP/1.1 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'd09a012b-be60-47c3-b94b-ace29f339c4c'} Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:03:51.694910 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-70e2c1b7-382b-4161-a5e5-f3b914511847 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 404 len: 111 microversion: 2.1 time: 0.030844 Oct 28 19:03:51.699975 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2739/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:51 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:03:51.746499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1893217509", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "4fc1d561-9a43-49d0-aefe-c3016e1dfe36"}], "security_groups": [{"name": "tempest-securitygroup--175089784"}], "key_name": "tempest-keypair-91495993", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:51.863609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] validate_networks() for [('4fc1d561-9a43-49d0-aefe-c3016e1dfe36', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:03:52.328524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:03:52.328987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:03:52.329467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:03:52.329917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:03:52.330335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:03:52.341768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:52.342235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:52.342680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:52.343408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:52.343895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:52.344325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:52.364113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:03:52.369346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for user 037e2796b1384a2b8881c2396300b164 and project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:03:52.382210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:03:52.384536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:03:52.430933 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-546046e8-d863-46e0-a003-a556f6307e35 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688283 Oct 28 19:03:52.431617 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4407/7146] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:03:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:03:52.443920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-420fd216-2917-4abe-8302-f8321e5a9497 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:52.444679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-420fd216-2917-4abe-8302-f8321e5a9497 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:52.497908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-420fd216-2917-4abe-8302-f8321e5a9497 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:52.509934 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-420fd216-2917-4abe-8302-f8321e5a9497 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1237 microversion: 2.1 time: 0.070763 Oct 28 19:03:52.510555 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2740/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:52 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:53.532150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:53.533405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:53.541893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:53.542627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:53.543234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:53.543990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:53.544455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:53.545072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:53.614184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:53.622154 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7e3ad19-ff5a-45ec-aa88-a680ac4e24dd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1307 microversion: 2.1 time: 0.093933 Oct 28 19:03:53.622739 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4408/7148] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:53 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:54.648086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:54.648763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:54.657134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:54.657652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:54.658110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:54.658867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:54.659496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:54.660632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:54.866361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:54.874099 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-91ec6b73-7602-4fc7-9e6e-68ce72d79c63 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1362 microversion: 2.1 time: 0.232038 Oct 28 19:03:54.874876 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2741/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:54 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:54.921688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d8de17d6-8b20-4e0e-a262-872438a9f47c req-135de079-ca40-4378-b799-2be3121d9d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:54.936272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d8de17d6-8b20-4e0e-a262-872438a9f47c req-135de079-ca40-4378-b799-2be3121d9d73 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:54.936763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d8de17d6-8b20-4e0e-a262-872438a9f47c req-135de079-ca40-4378-b799-2be3121d9d73 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:54.937202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d8de17d6-8b20-4e0e-a262-872438a9f47c req-135de079-ca40-4378-b799-2be3121d9d73 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:54.949205 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d8de17d6-8b20-4e0e-a262-872438a9f47c req-135de079-ca40-4378-b799-2be3121d9d73 service nova] Creating event network-changed:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h1-862404-2 Oct 28 19:03:54.954418 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d8de17d6-8b20-4e0e-a262-872438a9f47c req-135de079-ca40-4378-b799-2be3121d9d73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036439 Oct 28 19:03:54.955032 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4409/7150] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:55.898136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:55.898817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:55.905636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:55.906129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:55.906578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:55.907282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:55.907749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:55.908211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:56.043353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:56.051586 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e88ac148-27b0-4258-a738-6d38356089c5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1362 microversion: 2.1 time: 0.157618 Oct 28 19:03:56.052196 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2742/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:55 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:57.076179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:57.076927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:57.083164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:57.083656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:57.084129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:57.084837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:57.085300 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:57.085738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:57.213242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:57.220930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e58a8dc7-7342-47fd-8f76-d70f15536557 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1362 microversion: 2.1 time: 0.149999 Oct 28 19:03:57.221519 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4410/7152] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:57 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:58.244763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:58.245390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:58.252218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:58.252712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:58.253159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:58.254472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:58.254939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:58.255489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:58.390063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:58.397702 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3031add6-9b86-4c89-a482-acc9ed1dd259 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1362 microversion: 2.1 time: 0.156816 Oct 28 19:03:58.398285 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2743/7153] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:58 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:59.421486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:59.422519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:03:59.429513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:59.429998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:59.430440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:59.431133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:59.431585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:59.432037 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:59.564798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:59.572995 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-700603b5-e0ca-43c5-8e8f-a6e8761247a2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1362 microversion: 2.1 time: 0.155799 Oct 28 19:03:59.573568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4411/7154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:59 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:00.596687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:00.598058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:04:00.605139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:00.605641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:00.606091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:00.606797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:00.607265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:00.607704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:00.738316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:00.746034 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-932ac4f7-86b7-4a32-a2f0-b3b438b7652d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1362 microversion: 2.1 time: 0.153244 Oct 28 19:04:00.746605 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2744/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:00 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:00.822911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-259ade2d-0399-4c9e-b56d-3610ff9384bf req-6f14ede6-85f5-48d6-b427-4014f408e9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "name": "network-vif-plugged", "status": "completed", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:04:00.834046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-259ade2d-0399-4c9e-b56d-3610ff9384bf req-6f14ede6-85f5-48d6-b427-4014f408e9d7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:00.834529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-259ade2d-0399-4c9e-b56d-3610ff9384bf req-6f14ede6-85f5-48d6-b427-4014f408e9d7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:00.834989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-259ade2d-0399-4c9e-b56d-3610ff9384bf req-6f14ede6-85f5-48d6-b427-4014f408e9d7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:00.847582 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-259ade2d-0399-4c9e-b56d-3610ff9384bf req-6f14ede6-85f5-48d6-b427-4014f408e9d7 service nova] Creating event network-vif-plugged:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h1-862404-2 Oct 28 19:04:00.853103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-259ade2d-0399-4c9e-b56d-3610ff9384bf req-6f14ede6-85f5-48d6-b427-4014f408e9d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033953 Oct 28 19:04:00.853938 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4412/7156] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:04:01.769887 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:01.770511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:04:01.777214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:01.777703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:01.778153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:01.778847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:01.779311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:01.779743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:01.915662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:01.923480 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3ec0aa7-dee6-4633-a611-d337ad6407f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1362 microversion: 2.1 time: 0.157559 Oct 28 19:04:01.924082 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2745/7157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:01 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:02.946413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:02.947268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:02.951475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:02.952201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:04:02.959708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:02.960225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:02.960661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:02.961360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:02.961818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:02.962247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:03.101791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:03.109858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0ccc34a-bad4-4721-945f-0b6fce9cc0b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1550 microversion: 2.1 time: 0.165288 Oct 28 19:04:03.110434 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4413/7158] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:02 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:03.133962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:03.134435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:04:03.136339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:03.145249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:03.145743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:03.146196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:03.146905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:03.147375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:03.147872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:03.225701 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40354fb7-715a-4525-b7ec-59db5630da97 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095670 Oct 28 19:04:03.226312 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2746/7159] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 19:04:03 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:04:04.148949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ae106258-a3d4-4e0b-a6e0-72c679ed8389 req-602080a2-b7d1-4eb3-b687-719bce87de24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:04:04.159110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ae106258-a3d4-4e0b-a6e0-72c679ed8389 req-602080a2-b7d1-4eb3-b687-719bce87de24 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:04.160296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ae106258-a3d4-4e0b-a6e0-72c679ed8389 req-602080a2-b7d1-4eb3-b687-719bce87de24 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:04.160824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ae106258-a3d4-4e0b-a6e0-72c679ed8389 req-602080a2-b7d1-4eb3-b687-719bce87de24 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:04.171729 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ae106258-a3d4-4e0b-a6e0-72c679ed8389 req-602080a2-b7d1-4eb3-b687-719bce87de24 service nova] Creating event network-changed:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h1-862404-2 Oct 28 19:04:04.177345 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ae106258-a3d4-4e0b-a6e0-72c679ed8389 req-602080a2-b7d1-4eb3-b687-719bce87de24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032201 Oct 28 19:04:04.178040 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4414/7160] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:17.503011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=29 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:17.503767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=78 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:17.504738 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:05:17.504738 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 (ip 10.222.0.16) !!! Oct 28 19:05:17.505988 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:05:17.506132 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 (ip 10.222.0.16) !!! Oct 28 19:05:17.511890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:17.512514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:17.522252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:17.522748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:17.523194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:17.523926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:17.524391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:17.524828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:17.654610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:17.662312 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9d41ac94-8c7c-49da-9eeb-43ff4f408f0e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1669 microversion: 2.1 time: 0.162445 Oct 28 19:05:17.662920 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2747/7161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:17 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:17.684358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:17.685099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:17.686498 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:05:17.686644 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/os-volume_attachments (ip 10.222.0.16) !!! Oct 28 19:05:17.695135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5f63be8-b636-429b-b2da-dd9a02c1855d"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:17.697643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:17.710806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:17.711296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:17.711734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:17.712469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:17.712942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:17.713367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:17.951654 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-83a204eb-ca50-4bec-940d-65641b0ebf66 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270160 Oct 28 19:05:17.952268 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4415/7162] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 19:05:17 2022] POST /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:28.674983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:28.677318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:28.679753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:28.680449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:28.686629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:28.687124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:28.687569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:28.688326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:28.688792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:28.689862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:28.729107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:28.735410 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Old instance type m1.heat2, new instance type m1.heat {{(pid=120679) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 19:05:28.742924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:05:28.743325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:05:28.743809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:05:28.744259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:05:28.744680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:05:28.809978 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad0a0c28-c2e7-4992-8480-876d3a742c4c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/action" status: 202 len: 0 microversion: 2.1 time: 0.139097 Oct 28 19:05:28.810523 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2748/7163] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:05:28 2022] POST /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:05:28.817498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:28.818345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:28.823209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:28.823943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:28.832041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:28.832626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:28.833130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:28.833912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:28.834373 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:28.834839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:28.999633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:29.009421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c1f16cd-dae3-4c06-8f21-24648874e323 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1724 microversion: 2.1 time: 0.193801 Oct 28 19:05:29.010114 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4416/7164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:28 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:30.034028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:30.034663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:30.041521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:30.042057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:30.042512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:30.043217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:30.043687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:30.044165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:30.192363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:30.201239 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-64c4deb6-26a5-4182-9aea-ccb450e791b7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1724 microversion: 2.1 time: 0.172787 Oct 28 19:05:30.201976 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2749/7165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:30 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:31.225250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:31.225878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:31.235773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:31.236427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:31.236879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:31.237586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:31.238053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:31.238490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:31.366567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:31.374729 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-108d78b7-0160-4550-b688-9caddbe140f5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.153441 Oct 28 19:05:31.375310 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4417/7166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:31 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:05:32.398426 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:32.399057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:32.405969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:32.406463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:32.406912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:32.407620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:32.408684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:32.409117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:32.770611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:32.778833 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d060c50a-aba6-496e-817c-e9fb30ea5f7d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.384782 Oct 28 19:05:32.779395 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2750/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:32 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:33.802545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:33.803161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:33.810212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:33.810699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:33.811137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:33.811845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:33.812905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:33.813337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:33.946144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:33.954275 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4d15c1a-88f1-4e1c-ade2-ad3441ce57f8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.156305 Oct 28 19:05:33.954849 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4418/7168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:33 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:34.977484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:34.978115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:34.985330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:34.985820 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:34.986271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:34.986969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:34.987434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:34.987895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:35.119550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:35.128502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-218a82dd-f333-4781-b164-def168e72ae7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.154174 Oct 28 19:05:35.129175 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2751/7169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:34 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:36.151787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:36.152428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:36.160140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:36.160625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:36.161063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:36.161790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:36.162247 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:36.162674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:36.292196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:36.300795 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c8c544d-a307-4b04-899f-22a2e46e8ee0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.152908 Oct 28 19:05:36.301382 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4419/7170] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:36 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:37.324291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:37.324921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:37.332366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:37.332868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:37.333317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:37.334032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:37.334497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:37.334937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:37.471222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:37.479547 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d0c0b753-70f9-4198-a90b-3ac5183b8c85 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.159333 Oct 28 19:05:37.480146 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2752/7171] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:37 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:38.505104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:38.505730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:38.512543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:38.513036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:38.513477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:38.514219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:38.514680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:38.515114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:38.651095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:38.659605 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51befe20-6cca-4467-b809-56231a46ce28 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.159359 Oct 28 19:05:38.660249 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4420/7172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:38 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:39.682860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:39.683523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:39.690670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:39.691169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:39.691617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:39.692395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:39.692883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:39.693566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:39.822757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:39.831462 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9e47cef1-9937-4659-a5ac-2b278e6e3645 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.152055 Oct 28 19:05:39.832248 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2753/7173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:39 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:40.856792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:40.857524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:40.865055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:40.865547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:40.865993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:40.866701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:40.867167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:40.867601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:40.995939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:41.004356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a19b0bcc-df61-4a8f-9521-2eba087271be tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.151877 Oct 28 19:05:41.004947 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4421/7174] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:40 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:42.028331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:42.028968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:42.035862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:42.036373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:42.036831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:42.037552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:42.038059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:42.038508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:42.172640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:42.181600 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-15b8ebe3-61dc-49cc-ab2b-4c1ba2b28ac5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.157233 Oct 28 19:05:42.182177 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2754/7175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:42 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:43.204919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:43.205572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:43.213427 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:43.213919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:43.214363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:43.215067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:43.215528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:43.216110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:43.361635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:43.370374 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-925dd1a7-3037-4bba-b8a6-219dc6f2c75d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.169456 Oct 28 19:05:43.370962 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4422/7176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:43 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:44.393198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:44.393831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:44.400716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:44.401227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:44.401665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:44.402370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:44.402837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:44.403276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:44.537134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:44.545852 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7934f744-f799-440e-a668-664a0ab16a75 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1729 microversion: 2.1 time: 0.156525 Oct 28 19:05:44.546444 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2755/7177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:44 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:45.570880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:45.571581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:45.579224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:45.579772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:45.580369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:45.581157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:45.581932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:45.582164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:45.583494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e0500bf7-216f-4670-af63-d5f8efed5aca req-1030d499-e300-471c-812d-a479c4696b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "name": "network-vif-unplugged", "status": "completed", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:45.593693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e0500bf7-216f-4670-af63-d5f8efed5aca req-1030d499-e300-471c-812d-a479c4696b18 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:45.594373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e0500bf7-216f-4670-af63-d5f8efed5aca req-1030d499-e300-471c-812d-a479c4696b18 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:45.594810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e0500bf7-216f-4670-af63-d5f8efed5aca req-1030d499-e300-471c-812d-a479c4696b18 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:45.607693 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e0500bf7-216f-4670-af63-d5f8efed5aca req-1030d499-e300-471c-812d-a479c4696b18 service nova] Creating event network-vif-unplugged:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h2-862404-2 Oct 28 19:05:45.614064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-e0500bf7-216f-4670-af63-d5f8efed5aca req-1030d499-e300-471c-812d-a479c4696b18 service nova] Instance 04385c25-3839-4390-884d-d1e70da56561 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:05:45.626480 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e0500bf7-216f-4670-af63-d5f8efed5aca req-1030d499-e300-471c-812d-a479c4696b18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046783 Oct 28 19:05:45.627313 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2756/7178] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:45.854024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:45.862520 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9fb04c1f-ac66-445e-a45d-49877b594784 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1728 microversion: 2.1 time: 0.296693 Oct 28 19:05:45.863624 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4423/7179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:45 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1728 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:46.887481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:46.888357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:46.896574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:46.897171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:46.897696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:46.898524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:46.899064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:46.899597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:47.038592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:47.047147 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40916346-ca62-44b1-96dc-b047553999fa tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.164002 Oct 28 19:05:47.047736 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2757/7180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:46 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:47.668491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-22f1caa9-6b12-420e-b67b-92cb984720f0 req-e1cfba82-147b-4230-bbb0-cf5ff9f97e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:47.680143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-22f1caa9-6b12-420e-b67b-92cb984720f0 req-e1cfba82-147b-4230-bbb0-cf5ff9f97e0b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:47.680631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-22f1caa9-6b12-420e-b67b-92cb984720f0 req-e1cfba82-147b-4230-bbb0-cf5ff9f97e0b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:47.681072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-22f1caa9-6b12-420e-b67b-92cb984720f0 req-e1cfba82-147b-4230-bbb0-cf5ff9f97e0b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:47.693074 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-22f1caa9-6b12-420e-b67b-92cb984720f0 req-e1cfba82-147b-4230-bbb0-cf5ff9f97e0b service nova] Creating event network-changed:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h2-862404-2 Oct 28 19:05:47.698417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-22f1caa9-6b12-420e-b67b-92cb984720f0 req-e1cfba82-147b-4230-bbb0-cf5ff9f97e0b service nova] Instance 04385c25-3839-4390-884d-d1e70da56561 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:05:47.709394 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-22f1caa9-6b12-420e-b67b-92cb984720f0 req-e1cfba82-147b-4230-bbb0-cf5ff9f97e0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044638 Oct 28 19:05:47.710014 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4424/7181] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:48.072318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:48.073561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:48.082275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:48.082966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:48.084002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:48.084747 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:48.085233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:48.085671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:48.307958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:48.321684 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e68fb368-995a-4388-9095-e25aee386472 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.253528 Oct 28 19:05:48.322462 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2758/7182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:48 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:49.348675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:49.349382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:49.355851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:49.356357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:49.356795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:49.357490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:49.357947 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:49.358369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:49.492358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:49.500735 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-27014ea8-0fb2-45b2-8334-558554aacd4b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.157273 Oct 28 19:05:49.501314 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4425/7183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:49 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:50.524822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:50.525552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:50.532641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:50.533152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:50.533632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:50.534392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:50.535404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:50.535962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:50.681627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:50.689937 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1e670d6-85fb-45a0-8ba1-58d390ef9913 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.169080 Oct 28 19:05:50.690520 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2759/7184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:50 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:51.713212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:51.713745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:51.720192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:51.720680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:51.721120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:51.721809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:51.722270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:51.722831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:51.858349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:51.867327 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4002457a-dc9c-4bbb-9f13-fa10d395c00f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.158346 Oct 28 19:05:51.867927 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4426/7185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:51 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:52.891474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:52.892140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:52.899857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:52.900358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:52.900810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:52.901517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:52.901988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:52.902436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:53.031533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:53.040333 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-87990389-6fee-4644-9f6e-d9ce289d7e96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.152761 Oct 28 19:05:53.040912 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2760/7186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:52 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:54.064012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:54.064670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:54.071808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:54.072323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:54.072760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:54.073454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:54.073910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:54.074333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:54.207347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:54.215544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd000cb9-bc59-4698-a66d-51106ac824bc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.155619 Oct 28 19:05:54.216171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4427/7187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:54 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:05:55.239748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:55.240408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:55.247221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:55.247776 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:55.248233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:55.248947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:55.249423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:55.249871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:55.378349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:55.386701 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7dd098b7-71b0-41e2-8d35-6b00b8a0a5a7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.151584 Oct 28 19:05:55.387270 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2761/7188] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:55 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:56.410261 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:56.411124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:56.418036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:56.418526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:56.418968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:56.419677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:56.420182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:56.420602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:56.559062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:56.567598 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ded5bc95-33e4-446a-b1eb-8c9ae14e8e13 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.161889 Oct 28 19:05:56.568220 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4428/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:56 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:57.590488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:57.591121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:57.597995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:57.598497 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:57.598947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:57.599655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:57.600150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:57.600591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:57.736045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:57.744798 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3b69b11e-1d21-4a8c-a109-262ae872a404 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.158195 Oct 28 19:05:57.745398 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2762/7190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:57 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:58.769088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:58.770094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:58.776999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:58.777486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:58.777920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:58.778628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:58.779121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:58.779549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:58.917690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:58.920203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=81 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:58.928399 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f53f817b-9add-4163-a5bf-ceecc38040fc tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1726 microversion: 2.1 time: 0.163509 Oct 28 19:05:58.929003 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4429/7191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:58 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:59.952696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:59.953337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:05:59.956165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=35 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:59.961815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:59.962318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:59.962769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:59.963495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:59.964002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:59.964443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:59.968605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:00.100454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:00.110246 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fc15ba37-e7a2-44ef-ac83-7b9bd984a248 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1723 microversion: 2.1 time: 0.161610 Oct 28 19:06:00.110867 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2763/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:59 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:00.133906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:00.134457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:00.137164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=29 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:00.142497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:00.143022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:00.143470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:00.144198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:00.144697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:00.145136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:00.185628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:00.186125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:00.186571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:00.187311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:00.187779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:00.188238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:00.211572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:00.216995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Getting quotas for user 037e2796b1384a2b8881c2396300b164 and project a7562b55d5e24852bdd2a347309a8799. Resources: {'cores', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:00.316811 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c52284e-ba1b-41e7-af42-dc80731197d4 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "POST /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/action" status: 202 len: 0 microversion: 2.1 time: 0.186660 Oct 28 19:06:00.317351 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4430/7193] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:06:00 2022] POST /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:06:00.325793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:00.326423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:00.332903 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:00.333539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:00.333873 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:00.334854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:00.335334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:00.336071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:00.477636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:00.486876 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-558259f5-5a8e-460a-a783-a003f4d48318 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.165179 Oct 28 19:06:00.487459 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2764/7194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:00 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:01.512949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:01.513923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:01.520918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:01.521415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:01.521856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:01.522564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:01.523007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:01.523434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:01.663784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:01.671683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ea8a7968-3fed-4e27-bb35-cb930b192fc7 req-756b65df-d558-45db-8d2b-22b9d6c8676c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "name": "network-vif-plugged", "status": "completed", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:01.683553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ea8a7968-3fed-4e27-bb35-cb930b192fc7 req-756b65df-d558-45db-8d2b-22b9d6c8676c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:01.683963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ea8a7968-3fed-4e27-bb35-cb930b192fc7 req-756b65df-d558-45db-8d2b-22b9d6c8676c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:01.684412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ea8a7968-3fed-4e27-bb35-cb930b192fc7 req-756b65df-d558-45db-8d2b-22b9d6c8676c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:01.686583 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87ebb720-973e-4a22-9c7a-7c641f881539 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.179015 Oct 28 19:06:01.687192 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4431/7195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:01 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:01.712352 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ea8a7968-3fed-4e27-bb35-cb930b192fc7 req-756b65df-d558-45db-8d2b-22b9d6c8676c service nova] Creating event network-vif-plugged:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h2-862404-2 Oct 28 19:06:01.717686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-ea8a7968-3fed-4e27-bb35-cb930b192fc7 req-756b65df-d558-45db-8d2b-22b9d6c8676c service nova] Instance 04385c25-3839-4390-884d-d1e70da56561 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:06:01.729418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ea8a7968-3fed-4e27-bb35-cb930b192fc7 req-756b65df-d558-45db-8d2b-22b9d6c8676c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061473 Oct 28 19:06:01.730043 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2765/7196] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:06:02.709916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:02.710556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:02.717610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:02.718031 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:02.718481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:02.719189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:02.719658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:02.720117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:02.862923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:02.872542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db294a1c-16bc-4c08-98e8-e14f1963cfc8 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.166644 Oct 28 19:06:02.875858 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4432/7197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:02 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:03.897775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:03.898502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:03.904861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:03.905365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:03.905824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:03.906547 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:03.907022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:03.907475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:04.041988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:04.051358 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-06e79c10-76dd-463d-bc6b-4dcab5060d50 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.158132 Oct 28 19:06:04.052199 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2766/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:03 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:05.075614 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:05.076286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:05.083762 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:05.084511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:05.085145 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:05.086015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:05.086644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:05.087077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:05.232091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:05.241356 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa44f47b-ad3a-4c7a-9ce7-b868202e01d0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.170298 Oct 28 19:06:05.241941 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4433/7199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:05 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:05.723269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e2115b43-e842-4a7b-962d-d541ddb2c7fc req-a3a56c69-afbc-43bc-9df7-e73309f2c4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "name": "network-vif-unplugged", "status": "completed", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:05.733975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2115b43-e842-4a7b-962d-d541ddb2c7fc req-a3a56c69-afbc-43bc-9df7-e73309f2c4c6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:05.734442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2115b43-e842-4a7b-962d-d541ddb2c7fc req-a3a56c69-afbc-43bc-9df7-e73309f2c4c6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:05.734904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e2115b43-e842-4a7b-962d-d541ddb2c7fc req-a3a56c69-afbc-43bc-9df7-e73309f2c4c6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:05.747522 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e2115b43-e842-4a7b-962d-d541ddb2c7fc req-a3a56c69-afbc-43bc-9df7-e73309f2c4c6 service nova] Creating event network-vif-unplugged:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h1-862404-2 Oct 28 19:06:05.753123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-e2115b43-e842-4a7b-962d-d541ddb2c7fc req-a3a56c69-afbc-43bc-9df7-e73309f2c4c6 service nova] Instance 04385c25-3839-4390-884d-d1e70da56561 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:06:05.765067 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e2115b43-e842-4a7b-962d-d541ddb2c7fc req-a3a56c69-afbc-43bc-9df7-e73309f2c4c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045587 Oct 28 19:06:05.766061 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2767/7200] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:06.266184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:06.266806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:06.273932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:06.274435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:06.274862 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:06.275568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:06.276053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:06.276550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:06.414584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:06.423055 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-638705a8-ae2b-4005-bde4-38c02657b7c7 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.160829 Oct 28 19:06:06.423635 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4434/7201] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:06 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:07.451752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:07.452495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:07.459307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:07.459807 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:07.460287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:07.460999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:07.461471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:07.461911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:07.594874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:07.604121 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-44cc3301-512f-4f7c-9f77-ec172a460441 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.157465 Oct 28 19:06:07.604785 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2768/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:07 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:07.781403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-69fc6b1f-ebb3-48dc-92b9-56f78ec94b7b req-f3de9563-ee70-42ff-a846-db1f1ffce6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:07.792320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-69fc6b1f-ebb3-48dc-92b9-56f78ec94b7b req-f3de9563-ee70-42ff-a846-db1f1ffce6a3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:07.792795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-69fc6b1f-ebb3-48dc-92b9-56f78ec94b7b req-f3de9563-ee70-42ff-a846-db1f1ffce6a3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:07.793222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-69fc6b1f-ebb3-48dc-92b9-56f78ec94b7b req-f3de9563-ee70-42ff-a846-db1f1ffce6a3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:07.805366 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-69fc6b1f-ebb3-48dc-92b9-56f78ec94b7b req-f3de9563-ee70-42ff-a846-db1f1ffce6a3 service nova] Creating event network-changed:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h1-862404-2 Oct 28 19:06:07.810680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-69fc6b1f-ebb3-48dc-92b9-56f78ec94b7b req-f3de9563-ee70-42ff-a846-db1f1ffce6a3 service nova] Instance 04385c25-3839-4390-884d-d1e70da56561 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:06:07.822241 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-69fc6b1f-ebb3-48dc-92b9-56f78ec94b7b req-f3de9563-ee70-42ff-a846-db1f1ffce6a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044630 Oct 28 19:06:07.823003 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4435/7203] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:08.627576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:08.628243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:08.635598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:08.636303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:08.636744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:08.637486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:08.637963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:08.638411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:08.778898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:08.788070 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-daa4fbe8-dbf1-456c-9212-5c02881edcae tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.164536 Oct 28 19:06:08.788666 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2769/7204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:08 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:09.813738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:09.814453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:09.820931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:09.821431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:09.821911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:09.822622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:09.823091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:09.823525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:09.958993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:09.967705 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cae7534c-a4be-4c8a-892c-e6b9f2197d1c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.159561 Oct 28 19:06:09.968342 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4436/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:09 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:10.992418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:10.993058 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:10.999948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:11.000450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:11.000904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:11.001620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:11.002090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:11.002534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:11.138994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:11.148352 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-54bee6f8-797d-4aab-9d4f-003713875ab0 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.160725 Oct 28 19:06:11.148947 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2770/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:10 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:12.173305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:12.173928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:12.176885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:12.183004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:12.183501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:12.183978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:12.184680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:12.185143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:12.185572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:12.322479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:12.330798 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-803228a0-3b51-4ffb-95a5-9c52ddf1a34c tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.161473 Oct 28 19:06:12.331383 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4437/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:12 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:13.356199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:13.356838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:13.363688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:13.364863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:13.365602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:13.366317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:13.366792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:13.367237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:13.501372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:13.510432 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3470e2fd-2930-4567-9e08-cb0f0554e6e2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.158494 Oct 28 19:06:13.511007 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2771/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:13 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:14.533469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:14.534087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:14.541346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:14.541833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:14.542272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:14.542967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:14.543428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:14.543877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:14.673647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:14.682102 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f181b450-a5aa-4aa0-b4d5-a99c8a405662 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.152616 Oct 28 19:06:14.682691 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4438/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:14 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:15.707492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:15.708181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:15.714664 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:15.715168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:15.715628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:15.716377 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:15.716857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:15.717305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:15.846866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:15.856108 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-33f1e1ff-a584-494e-8c05-d9b32b57b046 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.152741 Oct 28 19:06:15.856680 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2772/7210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:15 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:16.879307 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:16.880444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:16.887416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:16.887948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:16.888392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:16.889094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:16.889557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:16.889989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:17.023331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:17.031655 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3e3a96a-6d85-4785-9286-63b2398654d5 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.156301 Oct 28 19:06:17.032358 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4439/7211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:16 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:18.055310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:18.056049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:18.063001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:18.063507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:18.063990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:18.064710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:18.065179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:18.065619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:18.197418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:18.205684 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-373efbf4-6ec0-4591-b729-5364a6d7189e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.154470 Oct 28 19:06:18.206251 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2773/7212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:18 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:19.229276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:19.229897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:19.237068 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:19.237557 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:19.237996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:19.238695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:19.239942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:19.240456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:19.378878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:19.387195 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-27f99ab5-4101-49d8-9214-52b63a8fb364 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1722 microversion: 2.1 time: 0.161899 Oct 28 19:06:19.387785 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4440/7213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:19 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:20.411556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:20.412214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:20.419022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.419523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.420009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.420721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.421190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.421631 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.559751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:20.568090 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1a17083c-2328-4c21-8c83-0cb8af4c7e2a tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1715 microversion: 2.1 time: 0.160420 Oct 28 19:06:20.568675 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2774/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:20 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:20.590538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:20.591160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:20.597949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.598949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.599388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.600105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.600558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.600990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.730168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:20.738682 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31fa911c-0cdd-42c2-848a-ccc5e9a36728 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1715 microversion: 2.1 time: 0.152007 Oct 28 19:06:20.739764 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4441/7215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:20 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:20.761858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:20.762496 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:20.768409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.768910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.769364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.770110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.770735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.771179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.900961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:20.909051 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-95366ec9-e820-4f23-abd5-900dd7c7ee96 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1715 microversion: 2.1 time: 0.151049 Oct 28 19:06:20.909618 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2775/7216] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:20 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:20.931550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:20.932013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:20.937852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.938335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.938774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.939467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:20.939949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:20.940380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:20.965054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:06:20.997721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:21.043174 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0648f804-c71e-495f-bcff-9adbbb3e8067 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 204 len: 0 microversion: 2.1 time: 0.115265 Oct 28 19:06:21.043804 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4442/7217] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:06:20 2022] DELETE /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:06:21.052721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:21.053354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:21.059400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:21.059933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:21.060383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:21.061093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:21.061559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:21.061998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:21.197870 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:21.206151 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e11fe15-6f77-4a89-b0bf-20600708f07d tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1721 microversion: 2.1 time: 0.157909 Oct 28 19:06:21.206722 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2776/7218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:21 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:06:21.449558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c9d0d148-afaa-45a2-b0e3-aec78d5b8ce7 req-4378ad40-2f4b-4ab7-8a35-ebebf4c64ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "name": "network-vif-plugged", "status": "completed", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:21.460607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9d0d148-afaa-45a2-b0e3-aec78d5b8ce7 req-4378ad40-2f4b-4ab7-8a35-ebebf4c64ffe service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:21.461099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9d0d148-afaa-45a2-b0e3-aec78d5b8ce7 req-4378ad40-2f4b-4ab7-8a35-ebebf4c64ffe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:21.461535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9d0d148-afaa-45a2-b0e3-aec78d5b8ce7 req-4378ad40-2f4b-4ab7-8a35-ebebf4c64ffe service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:21.472979 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c9d0d148-afaa-45a2-b0e3-aec78d5b8ce7 req-4378ad40-2f4b-4ab7-8a35-ebebf4c64ffe service nova] Creating event network-vif-plugged:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h1-862404-2 Oct 28 19:06:21.478587 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c9d0d148-afaa-45a2-b0e3-aec78d5b8ce7 req-4378ad40-2f4b-4ab7-8a35-ebebf4c64ffe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034420 Oct 28 19:06:21.479198 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4443/7219] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:22.285165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:22.285902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:22.293024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:22.293515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:22.294021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:22.294727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:22.295194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:22.295634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:22.426576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:22.434821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-33f1afa1-7db4-4b05-a3e0-d2b7784850b2 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1721 microversion: 2.1 time: 0.153636 Oct 28 19:06:22.435400 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2777/7220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:22 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:23.461001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:23.461703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:23.467809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:23.468329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:23.468767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:23.469463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:23.469919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:23.470345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:23.609198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:23.618302 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ecfaa16-a34a-4ce6-9422-c9681fcfd257 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1721 microversion: 2.1 time: 0.163424 Oct 28 19:06:23.634851 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4444/7221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:23 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:23.871103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0c73f041-ed6c-4abd-ac5f-8d141390091d req-0d186460-a84f-475f-a2af-b02943840e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04385c25-3839-4390-884d-d1e70da56561", "name": "network-vif-deleted", "tag": "d4dc2726-128c-4b94-a7a0-99edabfaf564"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:23.882748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0c73f041-ed6c-4abd-ac5f-8d141390091d req-0d186460-a84f-475f-a2af-b02943840e87 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:23.883767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0c73f041-ed6c-4abd-ac5f-8d141390091d req-0d186460-a84f-475f-a2af-b02943840e87 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:23.883767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0c73f041-ed6c-4abd-ac5f-8d141390091d req-0d186460-a84f-475f-a2af-b02943840e87 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:23.897540 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0c73f041-ed6c-4abd-ac5f-8d141390091d req-0d186460-a84f-475f-a2af-b02943840e87 service nova] Creating event network-vif-deleted:d4dc2726-128c-4b94-a7a0-99edabfaf564 for instance 04385c25-3839-4390-884d-d1e70da56561 on n-h1-862404-2 Oct 28 19:06:23.905320 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0c73f041-ed6c-4abd-ac5f-8d141390091d req-0d186460-a84f-475f-a2af-b02943840e87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037923 Oct 28 19:06:23.906084 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2778/7222] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:24.642795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:24.643433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:24.650935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:24.651442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:24.651913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:24.652646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:24.653112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:24.653554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:24.724998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:24.734121 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2fa42f17-7eba-4799-acf8-40c2bb979c5b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1368 microversion: 2.1 time: 0.095172 Oct 28 19:06:24.735007 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4445/7223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:24 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:25.759244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:25.759996 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:25.766261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:25.766761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:25.767221 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:25.768090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:25.768572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:25.769015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:25.833201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:25.841914 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4bc8e566-1a1f-4cd1-a8a7-cafac179cc39 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1368 microversion: 2.1 time: 0.087814 Oct 28 19:06:25.842524 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2779/7224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:25 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:26.867089 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:26.867715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:26.874678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:26.875171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:26.875619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:26.876353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:26.876824 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:26.877255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:26.997094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:27.006144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed9d9c02-f427-42e7-8a55-183a4c2a0700 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1368 microversion: 2.1 time: 0.143799 Oct 28 19:06:27.006724 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4446/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:26 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:28.028486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:28.029119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:28.036514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.037415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.037871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.038597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.039065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.039504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.073330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:28.073983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:28.074437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:28.074898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lazy-loading 'fault' on Instance uuid 04385c25-3839-4390-884d-d1e70da56561 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:06:28.117879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037e2796b1384a2b8881c2396300b164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7562b55d5e24852bdd2a347309a8799', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:28.120152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:28.127658 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a34ad48e-4e36-4d91-b5cd-ae37dc6bdf3e tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 200 len: 1373 microversion: 2.1 time: 0.103081 Oct 28 19:06:28.128306 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2780/7226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:28 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 1373 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:29.151871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:29.152501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:29.159453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.159972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.160417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.161416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.161890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.162311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.175984 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 HTTP/1.1 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '04385c25-3839-4390-884d-d1e70da56561'} Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:29.178538 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d4a73921-de48-4b66-9134-561d733111df tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 404 len: 111 microversion: 2.1 time: 0.033430 Oct 28 19:06:29.183532 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4447/7227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:29 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:29.254202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:29.258334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:29.266333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.266836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.267400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.268161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:29.269005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:29.269808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:29.284502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/os-volume_attachments HTTP/1.1 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'server_id': '04385c25-3839-4390-884d-d1e70da56561'} Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:29.286830 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25434a4c-c405-4278-a03e-ae08995c9732 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039447 Oct 28 19:06:29.291748 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2781/7228] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:06:29 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.646523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.647114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:32.650085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:32.655390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.655918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.656368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.657076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.657539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.657968 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.672987 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 HTTP/1.1 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '04385c25-3839-4390-884d-d1e70da56561'} Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:32.674627 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba987440-64db-47b7-8092-d73bfefa38d3 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 404 len: 111 microversion: 2.1 time: 0.033522 Oct 28 19:06:32.679693 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4448/7229] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:06:32 2022] DELETE /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.685387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.686023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 04385c25-3839-4390-884d-d1e70da56561] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:32.692072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=40 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:32.697678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.698186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.698644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.699371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.699868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.700315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.714872 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 HTTP/1.1 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '04385c25-3839-4390-884d-d1e70da56561'} Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.716464 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance 04385c25-3839-4390-884d-d1e70da56561 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7bbacd94-625c-4c3b-902e-6f7866e4abb1 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561" status: 404 len: 111 microversion: 2.1 time: 0.036448 Oct 28 19:06:32.721252 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2782/7230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:32 2022] GET /compute/v2.1/servers/04385c25-3839-4390-884d-d1e70da56561 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.727827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.728354 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:32.734703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.735201 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.735645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.736453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.736920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.737355 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.752576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c HTTP/1.1 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'd09a012b-be60-47c3-b94b-ace29f339c4c'} Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:32.754574 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8007cff-2327-4d19-9060-aaa7dc196f9f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 404 len: 111 microversion: 2.1 time: 0.032975 Oct 28 19:06:32.759148 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4449/7231] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:06:32 2022] DELETE /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.765146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.765793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: d09a012b-be60-47c3-b94b-ace29f339c4c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:32.772860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.773391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.773841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.774575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.775057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.775536 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.792582 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c HTTP/1.1 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'd09a012b-be60-47c3-b94b-ace29f339c4c'} Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.794235 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance d09a012b-be60-47c3-b94b-ace29f339c4c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e693432-152f-431e-8263-7250403ede6b tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c" status: 404 len: 111 microversion: 2.1 time: 0.034639 Oct 28 19:06:32.798891 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2783/7232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:32 2022] GET /compute/v2.1/servers/d09a012b-be60-47c3-b94b-ace29f339c4c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.804494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.805003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:32.811252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.811747 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.812223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.812922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.813379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.813806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.829362 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c HTTP/1.1 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c'} Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:32.830949 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-46bbba67-21e8-47cd-8613-af56774726fd tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 404 len: 111 microversion: 2.1 time: 0.031901 Oct 28 19:06:32.835768 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4450/7233] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:06:32 2022] DELETE /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.842655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.843567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:32.850788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.851369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.851926 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.852708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.853279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.853789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.870656 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c HTTP/1.1 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c'} Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.872405 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance 0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:32.877031 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-432a4a95-f5e2-4b9e-90b9-471000f43761 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c" status: 404 len: 111 microversion: 2.1 time: 0.036577 Oct 28 19:06:32.878186 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2784/7234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:32 2022] GET /compute/v2.1/servers/0ca1bee6-5bb7-4e43-b7ce-5a8b2efc273c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.885682 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.886182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:32.892225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.892711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.893151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.893845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.894302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.895267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.909036 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 HTTP/1.1 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'ce0c9cd1-5939-4a11-a162-e6d897ba5ac6'} Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:32.911184 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2a7b924-113c-4d79-b132-ca7b88dbae41 tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 404 len: 111 microversion: 2.1 time: 0.030951 Oct 28 19:06:32.916479 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4451/7235] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:06:32 2022] DELETE /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.921795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.922428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] [instance: ce0c9cd1-5939-4a11-a162-e6d897ba5ac6] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:32.928549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.929049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.929503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.930882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:32.931359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:32.931804 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:32.945663 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] HTTP exception thrown: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Request method failure captured: Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 HTTP/1.1 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCZQF7vIaeCc1uSW87puTDZ9vlzm2iNhbi2UipX5SPHVOJmcIJk9cT8IIxGcvZTrqfYj-3AXEVFhTHJyDk44gdwhVJauB5Uh9rWI8wOWpOD_16Iu01u7MuL0vgnaK2Zeoq21GZfETfABWz3u_VMJgH7uEMsdU4jgq6bodKqGaCF3teM Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a7562b55d5e24852bdd2a347309a8799", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a7562b55d5e24852bdd2a347309a8799"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: a7562b55d5e24852bdd2a347309a8799 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerActionsTestJSON-1993462128 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 037e2796b1384a2b8881c2396300b164 Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServerActionsTestJSON-1993462128-project Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'ce0c9cd1-5939-4a11-a162-e6d897ba5ac6'} Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:06:32.947242 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Returning 404 to user: Instance ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f660c477-180a-407b-8210-1f81bc51d2db tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6" status: 404 len: 111 microversion: 2.1 time: 0.030851 Oct 28 19:06:32.951548 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2785/7236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:32 2022] GET /compute/v2.1/servers/ce0c9cd1-5939-4a11-a162-e6d897ba5ac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:06:32.958102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b38949e-ae91-4fdd-98ef-8c2ae1cc658f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] Calling method '.version_select at 0x7f78dc5da1f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:32.982584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b38949e-ae91-4fdd-98ef-8c2ae1cc658f tempest-ServerActionsTestJSON-1993462128 tempest-ServerActionsTestJSON-1993462128-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-91495993" status: 202 len: 0 microversion: 2.1 time: 0.028969 Oct 28 19:06:32.983179 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4452/7237] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Oct 28 19:06:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-91495993 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:06:42.229906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2009098273", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "432f8819-8059-41b4-aef3-77b8183bea54"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:42.288794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] validate_networks() for [('432f8819-8059-41b4-aef3-77b8183bea54', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:06:42.700035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:06:42.700481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:06:42.700976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:06:42.701414 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:06:42.701851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:06:42.711888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.712407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.712866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.713656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:42.714135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:42.714587 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:42.733397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Getting quotas for project ad30c0eed8c74ffbad10d296123dcc6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:42.739168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Getting quotas for user e64bb3a752224effa7ace212a5b1b49f and project ad30c0eed8c74ffbad10d296123dcc6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:42.752441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:06:42.754970 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:06:42.804485 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0c55ae18-144e-4a81-a3f6-79e2fb5d98a2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730072 Oct 28 19:06:42.805329 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2786/7238] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:06:42.818016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0db31aa5-970a-4eac-a97d-b47440509b6e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:42.818635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0db31aa5-970a-4eac-a97d-b47440509b6e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:42.877583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0db31aa5-970a-4eac-a97d-b47440509b6e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:42.886858 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0db31aa5-970a-4eac-a97d-b47440509b6e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1217 microversion: 2.1 time: 0.074397 Oct 28 19:06:42.888467 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4453/7239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:42 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:43.917123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:43.917905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:43.924829 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.925334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.926185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:43.927116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:43.927792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:43.928446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:44.411394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:44.423463 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-954e78c7-da52-4331-ba73-8a29b4b32661 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1287 microversion: 2.1 time: 0.516531 Oct 28 19:06:44.437084 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2787/7240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:43 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1287 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:45.450549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:45.451173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:45.453597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:45.460294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.461002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.461515 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.463109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.464012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.464624 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.613153 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:45.621758 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d9c6ef4-d066-4462-88fb-1ade89cfbe79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1317 microversion: 2.1 time: 0.175064 Oct 28 19:06:45.622506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4454/7241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:45 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:45.777333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-376c0216-9a61-4c08-9732-80cbf6068ac9 req-346c4aca-1ad9-4f3c-84ae-ebd7484a5ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73eb78dc-2c12-4f27-8dc3-ac848009ace0", "tag": "c7af048e-c588-4bc4-b6de-792bd1c25f5f"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:45.800543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-376c0216-9a61-4c08-9732-80cbf6068ac9 req-346c4aca-1ad9-4f3c-84ae-ebd7484a5ba5 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:45.801210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-376c0216-9a61-4c08-9732-80cbf6068ac9 req-346c4aca-1ad9-4f3c-84ae-ebd7484a5ba5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:45.801932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-376c0216-9a61-4c08-9732-80cbf6068ac9 req-346c4aca-1ad9-4f3c-84ae-ebd7484a5ba5 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:45.818959 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-376c0216-9a61-4c08-9732-80cbf6068ac9 req-346c4aca-1ad9-4f3c-84ae-ebd7484a5ba5 service nova] Creating event network-changed:c7af048e-c588-4bc4-b6de-792bd1c25f5f for instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 on n-h1-862404-2 Oct 28 19:06:45.825602 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-376c0216-9a61-4c08-9732-80cbf6068ac9 req-346c4aca-1ad9-4f3c-84ae-ebd7484a5ba5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052269 Oct 28 19:06:45.826264 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2788/7242] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:46.646498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:46.647147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:46.654015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.654502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.654944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.655637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:46.656124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:46.656550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:46.794140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:46.802915 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-94ffef35-6774-4906-bad4-aab504cb8bad tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1317 microversion: 2.1 time: 0.161146 Oct 28 19:06:46.803715 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4455/7243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:46 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:47.826738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:47.827474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:47.835422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:47.835952 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:47.836418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:47.837141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:47.837620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:47.838071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:47.975470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:47.983752 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-772b538a-6b25-47dd-81d6-93c5142d4d2f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1317 microversion: 2.1 time: 0.161321 Oct 28 19:06:47.984380 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2789/7244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:47 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:49.007290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:49.007864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:49.014645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:49.015132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:49.015568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:49.016285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:49.016768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:49.017195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:49.151621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:49.160433 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e5e665a7-0615-4913-8e8e-336ee1efd876 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1317 microversion: 2.1 time: 0.157463 Oct 28 19:06:49.161301 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4456/7245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:49 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:50.183662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:50.184434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:50.190927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:50.192041 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:50.192583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:50.193300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:50.193770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:50.194213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:50.326408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:50.334596 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a86aa871-dd98-4270-a17d-3aed0a692860 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1317 microversion: 2.1 time: 0.155105 Oct 28 19:06:50.335171 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2790/7246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:50 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:51.358132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:51.358760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:51.365669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.366164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.366609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.367315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.367778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.368238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.500074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:51.508659 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92ae28ad-4628-422f-a822-b005a6fe0fa9 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1317 microversion: 2.1 time: 0.154813 Oct 28 19:06:51.509250 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4457/7247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:51 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:51.654748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f777cd37-10f3-4979-b9c4-7f6b6c293ff3 req-1ee45bb6-5f56-416b-82eb-c29c54755ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73eb78dc-2c12-4f27-8dc3-ac848009ace0", "name": "network-vif-plugged", "status": "completed", "tag": "c7af048e-c588-4bc4-b6de-792bd1c25f5f"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:51.665714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f777cd37-10f3-4979-b9c4-7f6b6c293ff3 req-1ee45bb6-5f56-416b-82eb-c29c54755ec2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:51.666215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f777cd37-10f3-4979-b9c4-7f6b6c293ff3 req-1ee45bb6-5f56-416b-82eb-c29c54755ec2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:51.666670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f777cd37-10f3-4979-b9c4-7f6b6c293ff3 req-1ee45bb6-5f56-416b-82eb-c29c54755ec2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:51.678463 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f777cd37-10f3-4979-b9c4-7f6b6c293ff3 req-1ee45bb6-5f56-416b-82eb-c29c54755ec2 service nova] Creating event network-vif-plugged:c7af048e-c588-4bc4-b6de-792bd1c25f5f for instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 on n-h1-862404-2 Oct 28 19:06:51.683490 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f777cd37-10f3-4979-b9c4-7f6b6c293ff3 req-1ee45bb6-5f56-416b-82eb-c29c54755ec2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089895 Oct 28 19:06:51.684301 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2791/7248] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:52.530711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:52.531245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:52.538115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:52.538604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:52.539049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:52.539742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:52.540236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:52.540667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:52.674998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:52.682685 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8f564860-cbf1-42ad-8ddb-8f837f041dba tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1317 microversion: 2.1 time: 0.155997 Oct 28 19:06:52.683265 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4458/7249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:52 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:53.707982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:53.708701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:53.711456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:53.712180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:53.717942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:53.718436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:53.718884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:53.719586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:53.720072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:53.720512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:53.861191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:53.869008 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c5c6ce38-32cc-4ab4-a300-e30b521f26f3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1507 microversion: 2.1 time: 0.166002 Oct 28 19:06:53.869595 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2792/7250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:53 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:53.930483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-510141510", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "432f8819-8059-41b4-aef3-77b8183bea54"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:53.939078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:53.985527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] validate_networks() for [('432f8819-8059-41b4-aef3-77b8183bea54', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:06:54.365748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:06:54.366176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:06:54.366657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:06:54.367075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:06:54.367486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:06:54.376443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:54.376927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:54.377366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:54.378091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:54.378546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:54.379173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:54.395965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Getting quotas for project ad30c0eed8c74ffbad10d296123dcc6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:06:54.401119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Getting quotas for user e64bb3a752224effa7ace212a5b1b49f and project ad30c0eed8c74ffbad10d296123dcc6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:06:54.413916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:06:54.416239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:06:54.459400 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [3d43ae7f-a104-4149-a3dc-6f2c6f45d791] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:06:55.465803 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [3d43ae7f-a104-4149-a3dc-6f2c6f45d791] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34168. Oct 28 19:06:55.469709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f267591c-a47b-4298-bb0b-b77b467d0a9e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543167 Oct 28 19:06:55.470390 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4459/7251] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:06:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:06:55.481542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0de6ca6-76a0-4200-92fb-09206539d346 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:55.482171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c0de6ca6-76a0-4200-92fb-09206539d346 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:55.538764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0de6ca6-76a0-4200-92fb-09206539d346 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:55.545614 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c0de6ca6-76a0-4200-92fb-09206539d346 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1216 microversion: 2.1 time: 0.068247 Oct 28 19:06:55.546214 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2793/7252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:55 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:56.569995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:56.570669 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:56.577782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:56.578451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:56.578901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:56.579610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:56.580308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:56.580752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:56.654053 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:56.662709 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-789a4a1b-84e1-433d-aa0b-a052c4a61fee tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1268 microversion: 2.1 time: 0.097641 Oct 28 19:06:56.663308 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4460/7253] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:56 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:57.686913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:57.688193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:57.700211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:57.700721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:57.701201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:57.702131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:57.702610 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:57.703057 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:57.842934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:57.851481 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b10c7e3e-7331-4a90-ba8f-ee691c3d2a79 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1316 microversion: 2.1 time: 0.168921 Oct 28 19:06:57.852084 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2794/7254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:57 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:58.374632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f80abe72-ff03-4cae-996c-fe44ce1fd683 req-4e9eb2ca-e85c-4399-b8bd-ab20e0cd685a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f08596-2677-4c7d-afe1-2251f5095235", "tag": "e2496565-fb32-4511-8147-45725968314b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:58.386798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f80abe72-ff03-4cae-996c-fe44ce1fd683 req-4e9eb2ca-e85c-4399-b8bd-ab20e0cd685a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:58.387286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f80abe72-ff03-4cae-996c-fe44ce1fd683 req-4e9eb2ca-e85c-4399-b8bd-ab20e0cd685a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:58.387718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f80abe72-ff03-4cae-996c-fe44ce1fd683 req-4e9eb2ca-e85c-4399-b8bd-ab20e0cd685a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:58.398439 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f80abe72-ff03-4cae-996c-fe44ce1fd683 req-4e9eb2ca-e85c-4399-b8bd-ab20e0cd685a service nova] Creating event network-changed:e2496565-fb32-4511-8147-45725968314b for instance f5f08596-2677-4c7d-afe1-2251f5095235 on n-h2-862404-2 Oct 28 19:06:58.403708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f80abe72-ff03-4cae-996c-fe44ce1fd683 req-4e9eb2ca-e85c-4399-b8bd-ab20e0cd685a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097547 Oct 28 19:06:58.404362 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4461/7255] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:06:58.875065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:58.875696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:06:58.883046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:58.883543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:58.884032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:58.884733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:58.885198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:58.885636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:58.888190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=48 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:59.017826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:59.025722 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-65456753-241e-44df-9af2-11d5d0b60fc2 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1316 microversion: 2.1 time: 0.154535 Oct 28 19:06:59.026304 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2795/7256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:58 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:00.048375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:00.049097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:00.056410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:00.056913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:00.057364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:00.062931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:00.062931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:00.062931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:00.272789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:00.280584 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3dfb0b28-315f-4f2a-83e8-13b2716a19fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1316 microversion: 2.1 time: 0.236662 Oct 28 19:07:00.281209 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4462/7257] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:00 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:01.303114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:01.303746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:01.310635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:01.311133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:01.311586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:01.312320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:01.312792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:01.313237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:01.447210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:01.454942 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ce52af6c-e725-405b-8599-c148a232c2e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1316 microversion: 2.1 time: 0.156328 Oct 28 19:07:01.455513 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2796/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:01 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:02.478507 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:02.479126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:02.486758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:02.487249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:02.487685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:02.489048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:02.489599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:02.490030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:02.629359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:02.637162 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8658f8ec-9701-41fe-94aa-95d938277fc4 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1316 microversion: 2.1 time: 0.162826 Oct 28 19:07:02.637745 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4463/7259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:02 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:03.660209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:03.660841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:03.663526 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:03.669588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:03.670155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:03.670605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:03.671312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:03.671779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:03.672242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:03.810187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:03.818211 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11f18005-4055-4b3b-b8b3-aea1d63d3fa7 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1316 microversion: 2.1 time: 0.161972 Oct 28 19:07:03.818799 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2797/7260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:03 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:03.864400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c6f1d224-e105-4a44-977c-f1f789ede2a0 req-ac75ccfa-54ce-4661-b4b6-34ec77bbdfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f08596-2677-4c7d-afe1-2251f5095235", "name": "network-vif-plugged", "status": "completed", "tag": "e2496565-fb32-4511-8147-45725968314b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:03.870283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:03.876205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c6f1d224-e105-4a44-977c-f1f789ede2a0 req-ac75ccfa-54ce-4661-b4b6-34ec77bbdfbc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:03.876697 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c6f1d224-e105-4a44-977c-f1f789ede2a0 req-ac75ccfa-54ce-4661-b4b6-34ec77bbdfbc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:03.877138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c6f1d224-e105-4a44-977c-f1f789ede2a0 req-ac75ccfa-54ce-4661-b4b6-34ec77bbdfbc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:03.889869 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c6f1d224-e105-4a44-977c-f1f789ede2a0 req-ac75ccfa-54ce-4661-b4b6-34ec77bbdfbc service nova] Creating event network-vif-plugged:e2496565-fb32-4511-8147-45725968314b for instance f5f08596-2677-4c7d-afe1-2251f5095235 on n-h2-862404-2 Oct 28 19:07:03.895847 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c6f1d224-e105-4a44-977c-f1f789ede2a0 req-ac75ccfa-54ce-4661-b4b6-34ec77bbdfbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035491 Oct 28 19:07:03.896470 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4464/7261] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:04.841417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:04.842055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:04.849074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:04.849578 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:04.850034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:04.850753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:04.851229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:04.851675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:04.980813 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:04.989081 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a756f9f5-b975-47dc-968d-a5578137cd5e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1316 microversion: 2.1 time: 0.151632 Oct 28 19:07:04.989656 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2798/7262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:04 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:06.009892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:06.010696 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:06.015628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:06.016399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:06.026662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.027154 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.027601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.028336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.028797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.029229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.159416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:06.167366 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fbbbe60f-a972-41a0-93a0-7e1a21baa4ff tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1506 microversion: 2.1 time: 0.158426 Oct 28 19:07:06.167983 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4465/7263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:06 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:06.189081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:06.189606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:06.192320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:06.198334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.198834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.199287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.200063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.200539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.200979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.230440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:07:06.305764 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a200a18f-d78e-418b-b7dc-bc41c37669cf tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 204 len: 0 microversion: 2.1 time: 0.120271 Oct 28 19:07:06.306378 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2799/7264] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:07:06 2022] DELETE /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:07:06.315447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:06.316618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:06.322526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.323012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.323449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.324170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:06.324628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:06.325054 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:06.457303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:06.465165 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e79813fd-46b3-4962-a000-e90fef5cc31b tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1512 microversion: 2.1 time: 0.154520 Oct 28 19:07:06.465758 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4466/7265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:06 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:07.489928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:07.490690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:07.497603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:07.498110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:07.498574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:07.499289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:07.499767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:07.500239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:07.637937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:07.646106 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3affcdef-dd97-4739-b093-8db583853c2c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1512 microversion: 2.1 time: 0.161077 Oct 28 19:07:07.646682 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2800/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:07 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:08.129791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a3e4b589-48f0-4724-8a21-55a07b6c4395 req-bd2f2f3c-2085-49b1-8f26-f3ebb533508c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f08596-2677-4c7d-afe1-2251f5095235", "name": "network-vif-deleted", "tag": "e2496565-fb32-4511-8147-45725968314b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:08.141454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a3e4b589-48f0-4724-8a21-55a07b6c4395 req-bd2f2f3c-2085-49b1-8f26-f3ebb533508c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:08.142278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a3e4b589-48f0-4724-8a21-55a07b6c4395 req-bd2f2f3c-2085-49b1-8f26-f3ebb533508c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:08.143072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a3e4b589-48f0-4724-8a21-55a07b6c4395 req-bd2f2f3c-2085-49b1-8f26-f3ebb533508c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:08.162307 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a3e4b589-48f0-4724-8a21-55a07b6c4395 req-bd2f2f3c-2085-49b1-8f26-f3ebb533508c service nova] Creating event network-vif-deleted:e2496565-fb32-4511-8147-45725968314b for instance f5f08596-2677-4c7d-afe1-2251f5095235 on n-h2-862404-2 Oct 28 19:07:08.168300 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a3e4b589-48f0-4724-8a21-55a07b6c4395 req-bd2f2f3c-2085-49b1-8f26-f3ebb533508c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042740 Oct 28 19:07:08.169189 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4467/7267] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:08.669473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:08.670249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:08.677370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:08.677881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:08.678337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:08.679072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:08.679530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:08.680036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:08.713072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:08.713571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:08.714023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:08.714485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lazy-loading 'fault' on Instance uuid f5f08596-2677-4c7d-afe1-2251f5095235 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:07:08.761937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:08.769036 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e17da9fd-96a9-4109-9030-ddf53a66f5fb tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 200 len: 1306 microversion: 2.1 time: 0.103425 Oct 28 19:07:08.769884 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2801/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:08 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:09.796450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:09.797160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:09.803810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.804327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.804770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.805470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.805933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.806365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.819848 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] HTTP exception thrown: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Request method failure captured: Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 HTTP/1.1 Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXChBYqe8g-xIDpvHRjn8nWbI-vYdQc4XEIU9zdgu-eok6OmKTxi4szq5Zo-gxmdiWxdbiVMHhczzbhIU3gPgY3dlW6d87-zV9HVV_NLHDVie95OQgZ3VLqdcKs_At80qWLlZJ1qxSwAxAln2nvRqqeybKDY4nh92YCluDfWLGTYT_cU Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad30c0eed8c74ffbad10d296123dcc6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e64bb3a752224effa7ace212a5b1b49f Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f5f08596-2677-4c7d-afe1-2251f5095235'} Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:09.821476 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Returning 404 to user: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce795fee-5fdb-47ba-937f-d82d0256adae tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 404 len: 111 microversion: 2.1 time: 0.031623 Oct 28 19:07:09.826466 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4468/7269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:09 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:09.832876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:09.833515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:09.840291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.840790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.841247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.841955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:09.842428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:09.842872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:09.974439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:09.982412 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-585e2e45-c7df-44bd-a7b3-e19a13df73c8 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1507 microversion: 2.1 time: 0.154336 Oct 28 19:07:09.982991 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2802/7270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:09 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:10.005188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26b7d0c2-2701-45da-b6f1-5569e64b4748 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:10.007420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26b7d0c2-2701-45da-b6f1-5569e64b4748 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 17687d33-47c4-43f8-be6e-b1f473b0cea2] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:10.012857 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-26b7d0c2-2701-45da-b6f1-5569e64b4748 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] HTTP exception thrown: Instance 17687d33-47c4-43f8-be6e-b1f473b0cea2 could not be found. Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26b7d0c2-2701-45da-b6f1-5569e64b4748 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Request method failure captured: Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/17687d33-47c4-43f8-be6e-b1f473b0cea2/action HTTP/1.1 Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 32 Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXChBYqe8g-xIDpvHRjn8nWbI-vYdQc4XEIU9zdgu-eok6OmKTxi4szq5Zo-gxmdiWxdbiVMHhczzbhIU3gPgY3dlW6d87-zV9HVV_NLHDVie95OQgZ3VLqdcKs_At80qWLlZJ1qxSwAxAln2nvRqqeybKDY4nh92YCluDfWLGTYT_cU Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad30c0eed8c74ffbad10d296123dcc6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e64bb3a752224effa7ace212a5b1b49f Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: {"resize": {"flavorRef": "452"}} Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 17687d33-47c4-43f8-be6e-b1f473b0cea2 could not be found. Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '17687d33-47c4-43f8-be6e-b1f473b0cea2', 'body': {'resize': {'flavorRef': '452'}}} Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2955, in _get_instance Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17687d33-47c4-43f8-be6e-b1f473b0cea2 could not be found. Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:10.014404 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17687d33-47c4-43f8-be6e-b1f473b0cea2 could not be found. Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17687d33-47c4-43f8-be6e-b1f473b0cea2 could not be found. Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26b7d0c2-2701-45da-b6f1-5569e64b4748 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Returning 404 to user: Instance 17687d33-47c4-43f8-be6e-b1f473b0cea2 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26b7d0c2-2701-45da-b6f1-5569e64b4748 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "POST /compute/v2.1/servers/17687d33-47c4-43f8-be6e-b1f473b0cea2/action" status: 404 len: 111 microversion: 2.1 time: 0.015339 Oct 28 19:07:10.019331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4469/7271] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:07:09 2022] POST /compute/v2.1/servers/17687d33-47c4-43f8-be6e-b1f473b0cea2/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:10.024858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:10.025501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:10.031511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.032061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.032519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.033241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.033718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.034168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.169270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:10.177234 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f722f7d8-eafb-4dae-94d3-9b45620e9c28 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1507 microversion: 2.1 time: 0.156549 Oct 28 19:07:10.177827 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2803/7272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:10 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:10.200724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:10.201348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:10.208973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.209460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.209904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.210604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.211064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.211496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.346150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:10.354668 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da61ce0e-da1a-42be-a347-3feff27073e5 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1507 microversion: 2.1 time: 0.157944 Oct 28 19:07:10.355248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4470/7273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:10 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:10.377321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ea3e9e61-60ba-481e-aa1b-fd54d601b471"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:10.379958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:10.385861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.386358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.386814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.387522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.388034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.388477 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.417336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:10.422369 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] HTTP exception thrown: Flavor ea3e9e61-60ba-481e-aa1b-fd54d601b471 could not be found. Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Request method failure captured: Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0/action HTTP/1.1 Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 65 Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXChBYqe8g-xIDpvHRjn8nWbI-vYdQc4XEIU9zdgu-eok6OmKTxi4szq5Zo-gxmdiWxdbiVMHhczzbhIU3gPgY3dlW6d87-zV9HVV_NLHDVie95OQgZ3VLqdcKs_At80qWLlZJ1qxSwAxAln2nvRqqeybKDY4nh92YCluDfWLGTYT_cU Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad30c0eed8c74ffbad10d296123dcc6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e64bb3a752224effa7ace212a5b1b49f Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: {"resize": {"flavorRef": "ea3e9e61-60ba-481e-aa1b-fd54d601b471"}} Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: exception: Flavor ea3e9e61-60ba-481e-aa1b-fd54d601b471 could not be found. Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '73eb78dc-2c12-4f27-8dc3-ac848009ace0', 'body': {'resize': {'flavorRef': 'ea3e9e61-60ba-481e-aa1b-fd54d601b471'}}} Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4202, in resize Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:10.424304 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ea3e9e61-60ba-481e-aa1b-fd54d601b471 could not be found. Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ea3e9e61-60ba-481e-aa1b-fd54d601b471 could not be found. Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ea3e9e61-60ba-481e-aa1b-fd54d601b471 could not be found. Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Returning 400 to user: Flavor ea3e9e61-60ba-481e-aa1b-fd54d601b471 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f1a0ee2e-153e-4d4b-948f-6bb9a0075ba3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "POST /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0/action" status: 400 len: 107 microversion: 2.1 time: 0.052510 Oct 28 19:07:10.428894 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2804/7274] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:07:10 2022] POST /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:07:10.434688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:10.435378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:10.441452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.441950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.442400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.443101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.443567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.444047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.578063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:10.586402 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6cd7a1c-b0ea-44ef-bb33-1f2dfb9a2f3e tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1507 microversion: 2.1 time: 0.155608 Oct 28 19:07:10.586982 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4471/7275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:10 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:10.609956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:10.610588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:10.616706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.617208 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.617659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.618442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.618912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.619354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.749999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:10.758176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-14740416-e046-47f1-b245-5674bdd15c21 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1507 microversion: 2.1 time: 0.152457 Oct 28 19:07:10.758748 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2805/7276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:10 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:10.780734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26b43e2e-3f3f-4bbe-8fb3-563d69d1d170 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26b43e2e-3f3f-4bbe-8fb3-563d69d1d170 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Request method failure captured: Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0/action HTTP/1.1 Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 29 Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXChBYqe8g-xIDpvHRjn8nWbI-vYdQc4XEIU9zdgu-eok6OmKTxi4szq5Zo-gxmdiWxdbiVMHhczzbhIU3gPgY3dlW6d87-zV9HVV_NLHDVie95OQgZ3VLqdcKs_At80qWLlZJ1qxSwAxAln2nvRqqeybKDY4nh92YCluDfWLGTYT_cU Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad30c0eed8c74ffbad10d296123dcc6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e64bb3a752224effa7ace212a5b1b49f Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: {"resize": {"flavorRef": ""}} Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '73eb78dc-2c12-4f27-8dc3-ac848009ace0', 'body': {'resize': {'flavorRef': ''}}} Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '' Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.784341 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26b43e2e-3f3f-4bbe-8fb3-563d69d1d170 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26b43e2e-3f3f-4bbe-8fb3-563d69d1d170 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "POST /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0/action" status: 400 len: 113 microversion: 2.1 time: 0.009443 Oct 28 19:07:10.789537 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4472/7277] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:07:10 2022] POST /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 19:07:10.795340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:10.796005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:10.802467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.802967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.803420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.804207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.804689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.805132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.937540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:10.945841 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-495aff04-227c-4ea1-8387-3b7d0cd2986f tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1507 microversion: 2.1 time: 0.154350 Oct 28 19:07:10.946412 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2806/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:10 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:10.972649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:10.973151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:10.980268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.981030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.981474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.982173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:10.982633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:10.983066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:10.996542 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] HTTP exception thrown: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Request method failure captured: Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 HTTP/1.1 Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXChBYqe8g-xIDpvHRjn8nWbI-vYdQc4XEIU9zdgu-eok6OmKTxi4szq5Zo-gxmdiWxdbiVMHhczzbhIU3gPgY3dlW6d87-zV9HVV_NLHDVie95OQgZ3VLqdcKs_At80qWLlZJ1qxSwAxAln2nvRqqeybKDY4nh92YCluDfWLGTYT_cU Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad30c0eed8c74ffbad10d296123dcc6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e64bb3a752224effa7ace212a5b1b49f Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': 'f5f08596-2677-4c7d-afe1-2251f5095235'} Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:10.998098 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Returning 404 to user: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae359bbc-062e-4891-9ea1-acf7b78d76ca tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 404 len: 111 microversion: 2.1 time: 0.031858 Oct 28 19:07:11.002874 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4473/7279] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:07:10 2022] DELETE /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:11.008381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:11.009039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: f5f08596-2677-4c7d-afe1-2251f5095235] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:11.014992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:11.015482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:11.015951 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.016652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:11.017117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:11.017555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.032061 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] HTTP exception thrown: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Request method failure captured: Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 HTTP/1.1 Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXChBYqe8g-xIDpvHRjn8nWbI-vYdQc4XEIU9zdgu-eok6OmKTxi4szq5Zo-gxmdiWxdbiVMHhczzbhIU3gPgY3dlW6d87-zV9HVV_NLHDVie95OQgZ3VLqdcKs_At80qWLlZJ1qxSwAxAln2nvRqqeybKDY4nh92YCluDfWLGTYT_cU Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad30c0eed8c74ffbad10d296123dcc6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e64bb3a752224effa7ace212a5b1b49f Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f5f08596-2677-4c7d-afe1-2251f5095235'} Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:11.033666 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Returning 404 to user: Instance f5f08596-2677-4c7d-afe1-2251f5095235 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bf9cccc7-45f1-4477-93a9-20345e847df3 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235" status: 404 len: 111 microversion: 2.1 time: 0.031163 Oct 28 19:07:11.039123 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2807/7280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:11 2022] GET /compute/v2.1/servers/f5f08596-2677-4c7d-afe1-2251f5095235 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:11.044365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:11.044868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:11.050978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:11.051475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:11.052027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.052732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:11.053193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:11.053626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.079217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:07:11.130462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:11.158386 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42b4e00d-3858-4e32-92af-fe545fa2059c tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 204 len: 0 microversion: 2.1 time: 0.117276 Oct 28 19:07:11.158927 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4474/7281] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:07:11 2022] DELETE /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:07:11.167706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:11.168366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:11.174281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:11.174775 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:11.175765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.176517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:11.176987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:11.177423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:11.310458 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:11.318778 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8fdb59c6-ca3d-4430-9df3-c615b7cefe27 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1513 microversion: 2.1 time: 0.155004 Oct 28 19:07:11.319355 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2808/7282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:11 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:12.343026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:12.343662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:12.351131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:12.351621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:12.352090 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:12.352792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:12.353246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:12.353673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:12.493882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:12.501649 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc05eedf-9517-4e7e-97df-244c3140b787 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1513 microversion: 2.1 time: 0.163077 Oct 28 19:07:12.502427 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4475/7283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:12 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:07:13.132016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f5f2686a-931e-41ce-a07e-921442796aa4 req-3338dffa-67d1-425b-b877-891ab453d92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73eb78dc-2c12-4f27-8dc3-ac848009ace0", "name": "network-vif-deleted", "tag": "c7af048e-c588-4bc4-b6de-792bd1c25f5f"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:13.142240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f5f2686a-931e-41ce-a07e-921442796aa4 req-3338dffa-67d1-425b-b877-891ab453d92c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:13.142781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f5f2686a-931e-41ce-a07e-921442796aa4 req-3338dffa-67d1-425b-b877-891ab453d92c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:13.143181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f5f2686a-931e-41ce-a07e-921442796aa4 req-3338dffa-67d1-425b-b877-891ab453d92c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:13.156249 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f5f2686a-931e-41ce-a07e-921442796aa4 req-3338dffa-67d1-425b-b877-891ab453d92c service nova] Creating event network-vif-deleted:c7af048e-c588-4bc4-b6de-792bd1c25f5f for instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 on n-h1-862404-2 Oct 28 19:07:13.162526 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f5f2686a-931e-41ce-a07e-921442796aa4 req-3338dffa-67d1-425b-b877-891ab453d92c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102612 Oct 28 19:07:13.163506 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2809/7284] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:13.525581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:13.526311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:13.533258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:13.533755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:13.534203 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:13.535635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:13.536129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:13.536567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:13.571657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:13.572223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:13.572710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:13.573253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lazy-loading 'fault' on Instance uuid 73eb78dc-2c12-4f27-8dc3-ac848009ace0 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:07:13.616646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bb3a752224effa7ace212a5b1b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30c0eed8c74ffbad10d296123dcc6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:13.623753 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be087289-e3d7-45dd-8dfc-727aa1b94a25 tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 200 len: 1307 microversion: 2.1 time: 0.102176 Oct 28 19:07:13.624368 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4476/7285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:13 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:14.649467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:14.650217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] [instance: 73eb78dc-2c12-4f27-8dc3-ac848009ace0] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:14.656375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:14.656875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:14.657349 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:14.658567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:14.659047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:14.659676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:14.673045 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] HTTP exception thrown: Instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 could not be found. Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Request method failure captured: Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 HTTP/1.1 Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXChBYqe8g-xIDpvHRjn8nWbI-vYdQc4XEIU9zdgu-eok6OmKTxi4szq5Zo-gxmdiWxdbiVMHhczzbhIU3gPgY3dlW6d87-zV9HVV_NLHDVie95OQgZ3VLqdcKs_At80qWLlZJ1qxSwAxAln2nvRqqeybKDY4nh92YCluDfWLGTYT_cU Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad30c0eed8c74ffbad10d296123dcc6a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad30c0eed8c74ffbad10d296123dcc6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: ad30c0eed8c74ffbad10d296123dcc6a Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1800389624 Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e64bb3a752224effa7ace212a5b1b49f Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-ServersNegativeTestJSON-1800389624-project Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 could not be found. Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '73eb78dc-2c12-4f27-8dc3-ac848009ace0'} Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 could not be found. Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 could not be found. Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:07:14.674680 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 could not be found. Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] Returning 404 to user: Instance 73eb78dc-2c12-4f27-8dc3-ac848009ace0 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-45b26bd5-66a2-4b1c-bc82-ac1caa306cab tempest-ServersNegativeTestJSON-1800389624 tempest-ServersNegativeTestJSON-1800389624-project] 10.222.0.16 "GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0" status: 404 len: 111 microversion: 2.1 time: 0.032703 Oct 28 19:07:14.680198 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2810/7286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:14 2022] GET /compute/v2.1/servers/73eb78dc-2c12-4f27-8dc3-ac848009ace0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:07:45.835181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:45.836538 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=14 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:46.027941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5168cb62-c1d7-4a76-bbc9-478af99012c3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: .version_select at 0x7f78de239550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-59007731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAhMQfA21j/cUktqRtlSD5IO59IoxdSsLE+r2ncnAbplqykkjApS+nIRhAsVZ0koXl3964C/F9v+iR8uf2dXDis1ziyRow11JOZnMAamVS41CBVgEQuL2FLzmTOubzH9w=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:46.044239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5168cb62-c1d7-4a76-bbc9-478af99012c3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:07:46.050030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-5168cb62-c1d7-4a76-bbc9-478af99012c3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for user e819d847a40342f4b8dc5ab9058f7502 and project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:07:46.079320 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5168cb62-c1d7-4a76-bbc9-478af99012c3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.249512 Oct 28 19:07:46.081026 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4477/7287] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:07:45 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:46.135329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1418211841", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-59007731", "networks": [{"uuid": "f7eb6182-b599-4c44-ad1d-7cb30ec76c70"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:46.144719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:46.145402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:46.199231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] validate_networks() for [('f7eb6182-b599-4c44-ad1d-7cb30ec76c70', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:07:46.709488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:07:46.710040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:07:46.710660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:07:46.711201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:07:46.711695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:07:46.721577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.722171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.722723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.723515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:46.724029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:46.724480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:46.742618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:07:46.748266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for user e819d847a40342f4b8dc5ab9058f7502 and project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:07:46.761412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:07:46.763781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:07:46.812966 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b2832fa6-89aa-4414-a266-d5fb484fa5f8 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681902 Oct 28 19:07:46.813736 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2811/7288] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:07:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:07:46.825253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c1d06fc7-ae45-479f-ad2b-76eb1cab067e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:46.826735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c1d06fc7-ae45-479f-ad2b-76eb1cab067e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:46.899401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c1d06fc7-ae45-479f-ad2b-76eb1cab067e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:46.908292 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c1d06fc7-ae45-479f-ad2b-76eb1cab067e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1261 microversion: 2.1 time: 0.087185 Oct 28 19:07:46.909294 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4478/7289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:46 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:47.933055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:47.934378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:47.942573 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:47.943089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:47.943567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:47.944557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:47.945256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:47.945936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:48.045440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:48.060020 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96e30471-567d-4eaa-902b-5c46e481f7dd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1331 microversion: 2.1 time: 0.131895 Oct 28 19:07:48.060625 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2812/7290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:47 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:49.083415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:49.084813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:49.092572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.093328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.093772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.094494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.094953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.095446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.248586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:49.258410 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0e61f66-9dc2-4016-8604-d51d878b9ada tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1361 microversion: 2.1 time: 0.179586 Oct 28 19:07:49.260397 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4479/7291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:49 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:49.281900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-54d41177-0939-4b4e-8c2c-89b438de4769 req-53736077-9e42-4fb9-9e96-7ca306c6ffde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358108d3-5c9e-4592-adba-fc418a6b6e2e", "tag": "71c2986c-1593-4b8f-9d1b-ceb66f619eee"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:49.293307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-54d41177-0939-4b4e-8c2c-89b438de4769 req-53736077-9e42-4fb9-9e96-7ca306c6ffde service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:49.294243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-54d41177-0939-4b4e-8c2c-89b438de4769 req-53736077-9e42-4fb9-9e96-7ca306c6ffde service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:49.294886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-54d41177-0939-4b4e-8c2c-89b438de4769 req-53736077-9e42-4fb9-9e96-7ca306c6ffde service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:49.308269 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-54d41177-0939-4b4e-8c2c-89b438de4769 req-53736077-9e42-4fb9-9e96-7ca306c6ffde service nova] Creating event network-changed:71c2986c-1593-4b8f-9d1b-ceb66f619eee for instance 358108d3-5c9e-4592-adba-fc418a6b6e2e on n-h1-862404-2 Oct 28 19:07:49.314033 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-54d41177-0939-4b4e-8c2c-89b438de4769 req-53736077-9e42-4fb9-9e96-7ca306c6ffde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036100 Oct 28 19:07:49.315748 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2813/7292] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:50.282379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:50.282995 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:50.290445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:50.290933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:50.291578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:50.292303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:50.292758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:50.293182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:50.427399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:50.435210 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29225645-065d-4e3e-ad98-91a7a83df83c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1361 microversion: 2.1 time: 0.156860 Oct 28 19:07:50.435793 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4480/7293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:50 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:51.460508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:51.461220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:51.467396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.467922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.468375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.469073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:51.469665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:51.470180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:51.609334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:51.617527 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d9872261-ce82-4cca-9005-e999d86bf4b5 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1361 microversion: 2.1 time: 0.162842 Oct 28 19:07:51.618100 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2814/7294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:51 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:52.640395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:52.641017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:52.648343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.648826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.649266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.649956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:52.650417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:52.650846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:52.780169 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:52.787841 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b3ba8aa-80d1-432a-80b8-9de99dbf4250 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1361 microversion: 2.1 time: 0.151441 Oct 28 19:07:52.788427 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4481/7295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:52 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:53.811065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:53.811589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:53.818725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.819232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.819690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.820433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:53.820929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:53.821378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:53.959059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:53.966807 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6b028c0a-6350-4cb0-9c4f-cfc85cf30ae2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1361 microversion: 2.1 time: 0.159765 Oct 28 19:07:53.967394 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2815/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:53 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:53.994359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c782b141-d626-4e1a-9224-e7ba9ef674e8 req-79677e06-9564-4843-ac6f-67029f8f3970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358108d3-5c9e-4592-adba-fc418a6b6e2e", "name": "network-vif-plugged", "status": "completed", "tag": "71c2986c-1593-4b8f-9d1b-ceb66f619eee"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:54.006956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c782b141-d626-4e1a-9224-e7ba9ef674e8 req-79677e06-9564-4843-ac6f-67029f8f3970 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.007450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c782b141-d626-4e1a-9224-e7ba9ef674e8 req-79677e06-9564-4843-ac6f-67029f8f3970 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:54.007920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c782b141-d626-4e1a-9224-e7ba9ef674e8 req-79677e06-9564-4843-ac6f-67029f8f3970 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:54.019863 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c782b141-d626-4e1a-9224-e7ba9ef674e8 req-79677e06-9564-4843-ac6f-67029f8f3970 service nova] Creating event network-vif-plugged:71c2986c-1593-4b8f-9d1b-ceb66f619eee for instance 358108d3-5c9e-4592-adba-fc418a6b6e2e on n-h1-862404-2 Oct 28 19:07:54.025317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c782b141-d626-4e1a-9224-e7ba9ef674e8 req-79677e06-9564-4843-ac6f-67029f8f3970 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034732 Oct 28 19:07:54.026027 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4482/7297] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:07:54.990024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:54.990688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:54.997598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.998095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:54.998637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:54.999233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:54.999800 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:55.000166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:55.133562 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:55.141317 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5ceecb7d-9434-4f57-b99a-90c83ce2f5fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1361 microversion: 2.1 time: 0.155285 Oct 28 19:07:55.141880 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2816/7298] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:54 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:56.166691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:56.167401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:56.175072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.175574 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.176052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.176763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.177227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.177660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.310139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:56.318420 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1854eb99-0e3e-4d58-9eda-f2ca06a77187 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1552 microversion: 2.1 time: 0.156252 Oct 28 19:07:56.319079 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4483/7299] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:56 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:56.342003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:07:56.342698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:56.350560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.351070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.351530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.352281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:56.352779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:56.353248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:56.487313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:07:56.495083 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-66257056-95c6-44d8-bab6-6192ea6038a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1552 microversion: 2.1 time: 0.157056 Oct 28 19:07:56.495662 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2817/7300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:07:56 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:07:58.169687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "337a2976-2f0b-4863-97a2-f2a13bdbcbf8"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:07:58.172064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:07:58.174051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:07:58.180296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:58.180780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:58.181218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:58.181907 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:07:58.182364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:07:58.182782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:07:58.421046 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b66e65f-be64-46dc-873a-8f5d1faf51b6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255198 Oct 28 19:07:58.422084 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4484/7301] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 19:07:58 2022] POST /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:09.140443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:09.140973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:09.143089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:09.143780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:09.145423 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:09.146157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=34 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:09.153553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.154060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.154524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.155246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.155724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.156196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.237533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lazy-loading 'services' on Instance uuid 358108d3-5c9e-4592-adba-fc418a6b6e2e {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:09.308272 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-47810002-3f57-4ad8-bf28-5123444abdef tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments/337a2976-2f0b-4863-97a2-f2a13bdbcbf8" status: 202 len: 0 microversion: 2.1 time: 0.171479 Oct 28 19:08:09.308869 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2818/7302] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:08:09 2022] DELETE /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments/337a2976-2f0b-4863-97a2-f2a13bdbcbf8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:09.315241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:09.316204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:09.320386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:09.322775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:09.330322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.330817 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.331254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.331989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:09.332440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:09.332868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:09.368583 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-498d53df-224b-4209-80d5-74db953749c1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055137 Oct 28 19:08:09.369331 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4485/7303] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:09 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:10.383105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:10.385625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:10.392014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.393128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.393858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.394580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:10.395055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:10.395498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:10.427158 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-222179af-a6a8-4c5a-8eb3-7df29f9ce047 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049353 Oct 28 19:08:10.428030 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2819/7304] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:10 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:11.438898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:11.441611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:11.448400 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.448894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.449336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.450043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:11.450502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:11.450927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:11.481387 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bbd00bd8-055a-4667-99ae-a230f59d03e3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046312 Oct 28 19:08:11.481963 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4486/7305] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:11 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:12.493665 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:12.495784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:12.503381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.503899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.504348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.505065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:12.505534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:12.505977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:12.538264 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e67b8031-566f-44f7-971d-4172e34c768e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Oct 28 19:08:12.538853 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2820/7306] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:12 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:13.550969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:13.553199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:13.560107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.560607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.561046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.561745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:13.562202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:13.562631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:13.594022 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3d034461-bb89-41f9-95bb-fbd22d4fc9a6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Oct 28 19:08:13.594607 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4487/7307] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:13 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:14.607077 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:14.609378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:14.617594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.618092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.618541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.619247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.619713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.620211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.650342 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-246e12f7-3988-4ea5-ab36-a3a2dd6c4716 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047569 Oct 28 19:08:14.650924 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2821/7308] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:14 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:08:14.661672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:14.662167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:14.669216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.669712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.670192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.670925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:14.671391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:14.671849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:14.747641 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] HTTP exception thrown: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e is not attached to volume 337a2976-2f0b-4863-97a2-f2a13bdbcbf8 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Request method failure captured: Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments/337a2976-2f0b-4863-97a2-f2a13bdbcbf8 HTTP/1.1 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCh8rXKrAgh6UgLz6ZGFx_CXL_zQ6IO7SoN0BMh5P8bbBRw7N_ZiERhgtpCVAz4bjOa5jCgR39_t6kJcd5c5tqcM3k8SNZMjLZAbB3NdN_wirp1ncVo1Dh3OmfjYotEdl_6jkszHG7AQ1mDIEu2A34MbD-3WW5YF30SMOrLQU0Z38FI Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e00acb7ff2e94f25b625b0640dfb0600", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e819d847a40342f4b8dc5ab9058f7502 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e is not attached to volume 337a2976-2f0b-4863-97a2-f2a13bdbcbf8 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '358108d3-5c9e-4592-adba-fc418a6b6e2e', 'id': '337a2976-2f0b-4863-97a2-f2a13bdbcbf8'} Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 337a2976-2f0b-4863-97a2-f2a13bdbcbf8. Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e is not attached to volume 337a2976-2f0b-4863-97a2-f2a13bdbcbf8 Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:14.758414 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:14.763146 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:14.763146 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:14.763146 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e is not attached to volume 337a2976-2f0b-4863-97a2-f2a13bdbcbf8 Oct 28 19:08:14.763146 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:14.763146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Returning 404 to user: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e is not attached to volume 337a2976-2f0b-4863-97a2-f2a13bdbcbf8 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:14.763146 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac32f925-1378-45aa-8bf0-33c4e26e69fd tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments/337a2976-2f0b-4863-97a2-f2a13bdbcbf8" status: 404 len: 154 microversion: 2.1 time: 0.102425 Oct 28 19:08:14.763146 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4488/7309] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:08:14 2022] DELETE /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e/os-volume_attachments/337a2976-2f0b-4863-97a2-f2a13bdbcbf8 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:18.123264 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.123953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:18.131580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.132209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.132729 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.133512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.133987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.134429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.161067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:08:18.239318 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cb708f51-3ef1-4586-a4d2-3885b9acf564 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 204 len: 0 microversion: 2.1 time: 0.119755 Oct 28 19:08:18.240196 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2822/7310] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:08:18 2022] DELETE /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:08:18.248763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:18.249451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:18.258309 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.258808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.259254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.260019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:18.260485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:18.260924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:18.396780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:18.405529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52425ed1-c211-453f-8d46-5da92e7b7c7d tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1558 microversion: 2.1 time: 0.160767 Oct 28 19:08:18.406270 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4489/7311] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:18 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:19.430972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:19.431711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:19.438351 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.438858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.440165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.441048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:19.441523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:19.441971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:19.635584 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:19.643716 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b2036a3e-6554-473b-b140-c9c414057a21 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1558 microversion: 2.1 time: 0.217089 Oct 28 19:08:19.644320 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2823/7312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:19 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:20.324383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5144c8b8-a333-4084-a934-c5518ce0154e req-30b43f95-c1ef-4931-8150-3219df17aaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358108d3-5c9e-4592-adba-fc418a6b6e2e", "name": "network-vif-deleted", "tag": "71c2986c-1593-4b8f-9d1b-ceb66f619eee"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:20.338894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5144c8b8-a333-4084-a934-c5518ce0154e req-30b43f95-c1ef-4931-8150-3219df17aaf3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.339485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5144c8b8-a333-4084-a934-c5518ce0154e req-30b43f95-c1ef-4931-8150-3219df17aaf3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.341015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5144c8b8-a333-4084-a934-c5518ce0154e req-30b43f95-c1ef-4931-8150-3219df17aaf3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.356352 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5144c8b8-a333-4084-a934-c5518ce0154e req-30b43f95-c1ef-4931-8150-3219df17aaf3 service nova] Creating event network-vif-deleted:71c2986c-1593-4b8f-9d1b-ceb66f619eee for instance 358108d3-5c9e-4592-adba-fc418a6b6e2e on n-h1-862404-2 Oct 28 19:08:20.363953 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5144c8b8-a333-4084-a934-c5518ce0154e req-30b43f95-c1ef-4931-8150-3219df17aaf3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043389 Oct 28 19:08:20.364827 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4490/7313] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:20.666528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:20.667170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:20.674973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.675480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.675967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.676684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.677163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.677608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.711574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:20.712040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:20.712493 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:20.712960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lazy-loading 'fault' on Instance uuid 358108d3-5c9e-4592-adba-fc418a6b6e2e {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:20.754598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:20.762197 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5383303f-24df-4962-b6e5-7df67d141385 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 200 len: 1351 microversion: 2.1 time: 0.099665 Oct 28 19:08:20.762771 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2824/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:20 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:21.786472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.787219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: 358108d3-5c9e-4592-adba-fc418a6b6e2e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:21.794092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.794586 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.795032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.795732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:21.796232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:21.796667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:21.810639 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] HTTP exception thrown: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e could not be found. Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Request method failure captured: Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e HTTP/1.1 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCh8rXKrAgh6UgLz6ZGFx_CXL_zQ6IO7SoN0BMh5P8bbBRw7N_ZiERhgtpCVAz4bjOa5jCgR39_t6kJcd5c5tqcM3k8SNZMjLZAbB3NdN_wirp1ncVo1Dh3OmfjYotEdl_6jkszHG7AQ1mDIEu2A34MbD-3WW5YF30SMOrLQU0Z38FI Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e00acb7ff2e94f25b625b0640dfb0600", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: e819d847a40342f4b8dc5ab9058f7502 Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e could not be found. Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '358108d3-5c9e-4592-adba-fc418a6b6e2e'} Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e could not be found. Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e could not be found. Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:21.812342 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e could not be found. Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Returning 404 to user: Instance 358108d3-5c9e-4592-adba-fc418a6b6e2e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-90723e58-3458-4e77-b497-6cb6d8bf8c08 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e" status: 404 len: 111 microversion: 2.1 time: 0.032078 Oct 28 19:08:21.817792 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4491/7315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:21 2022] GET /compute/v2.1/servers/358108d3-5c9e-4592-adba-fc418a6b6e2e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:21.823333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c3d4f7fb-87ac-44f3-b3bb-a45d4828398a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '.version_select at 0x7f78dd76aa60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:21.828296 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3d4f7fb-87ac-44f3-b3bb-a45d4828398a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [db848e0d-f10a-4a4e-8dbc-0cb33444434d] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:08:22.835869 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3d4f7fb-87ac-44f3-b3bb-a45d4828398a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [db848e0d-f10a-4a4e-8dbc-0cb33444434d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34656. Oct 28 19:08:22.857176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c3d4f7fb-87ac-44f3-b3bb-a45d4828398a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-59007731" status: 202 len: 0 microversion: 2.1 time: 1.037703 Oct 28 19:08:22.857774 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2825/7316] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 19:08:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-59007731 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:22.875895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51554bba-93e2-4714-89d6-5b22d47715f4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: .version_select at 0x7f78de21bc10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-574930579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEivB08BCOcyZZAtbW1S95ccBIYLxu+0fuTeC2mGxNiL+nXOxMO/g5bnedRaHfEfdFq/ndypZa11+17a6OkXitLoDmig/FGy0btxB2adObL46q5RKhP4ev0w9PmqOF5ySA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:22.894463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-51554bba-93e2-4714-89d6-5b22d47715f4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:22.899649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-51554bba-93e2-4714-89d6-5b22d47715f4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for user e819d847a40342f4b8dc5ab9058f7502 and project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:22.922422 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51554bba-93e2-4714-89d6-5b22d47715f4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.050591 Oct 28 19:08:22.923021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4492/7317] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:08:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:22.974411 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-999981282", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-574930579", "networks": [{"uuid": "f7eb6182-b599-4c44-ad1d-7cb30ec76c70"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:23.028576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] validate_networks() for [('f7eb6182-b599-4c44-ad1d-7cb30ec76c70', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:23.411866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:23.412308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:23.412795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:23.413215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:23.413638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:23.422308 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.422798 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.423253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.424039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:23.424506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:23.424942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:23.441793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:23.447189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for user e819d847a40342f4b8dc5ab9058f7502 and project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:23.460381 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:23.462910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:23.508555 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a7ec278-6219-416a-9c48-d8cabf9790de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538059 Oct 28 19:08:23.509210 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2826/7318] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:08:23.520827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-143adf5d-7c70-4b2c-9dae-257d904a0997 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:23.521441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-143adf5d-7c70-4b2c-9dae-257d904a0997 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:23.583115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-143adf5d-7c70-4b2c-9dae-257d904a0997 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:23.590103 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-143adf5d-7c70-4b2c-9dae-257d904a0997 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1261 microversion: 2.1 time: 0.073716 Oct 28 19:08:23.590687 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4493/7319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:23 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1261 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:24.614836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:24.615471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:24.625198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.625706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.626188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.627643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:24.628149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:24.628604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:24.707638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:24.715415 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-289b304b-bb9d-4d53-b0cd-f187ef554980 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1319 microversion: 2.1 time: 0.106243 Oct 28 19:08:24.716039 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2827/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:24 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:25.740243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:25.740956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:25.747676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.748393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.748836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.749544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.750005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.750434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.843519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-247b4ece-da3b-445a-99b7-a0d75049f92c req-e54b7922-5853-4c4c-8145-8c3295c79ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8362ddc-d669-4109-ab14-2f615c6894e9", "tag": "5753ceca-c20b-4d98-83d3-e670179f794b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:25.877574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-247b4ece-da3b-445a-99b7-a0d75049f92c req-e54b7922-5853-4c4c-8145-8c3295c79ffa service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:25.878100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-247b4ece-da3b-445a-99b7-a0d75049f92c req-e54b7922-5853-4c4c-8145-8c3295c79ffa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:25.878551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-247b4ece-da3b-445a-99b7-a0d75049f92c req-e54b7922-5853-4c4c-8145-8c3295c79ffa service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:25.892668 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-247b4ece-da3b-445a-99b7-a0d75049f92c req-e54b7922-5853-4c4c-8145-8c3295c79ffa service nova] Creating event network-changed:5753ceca-c20b-4d98-83d3-e670179f794b for instance f8362ddc-d669-4109-ab14-2f615c6894e9 on n-h1-862404-2 Oct 28 19:08:25.897873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:25.898097 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-247b4ece-da3b-445a-99b7-a0d75049f92c req-e54b7922-5853-4c4c-8145-8c3295c79ffa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058175 Oct 28 19:08:25.898756 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2828/7321] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:25.905334 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3c47a408-3f11-47bc-91cb-a14947019ed1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1361 microversion: 2.1 time: 0.169356 Oct 28 19:08:25.905936 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4494/7322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:25 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:26.930869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:26.931588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:26.937836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.938334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.938808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:26.939510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:26.940696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:26.941145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:27.075258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:27.083041 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cf45b314-ebed-4951-b2d2-a3aa656b3c38 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1361 microversion: 2.1 time: 0.157262 Oct 28 19:08:27.083613 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2829/7323] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:26 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:28.106843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:28.107924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:28.116132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.116731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.117322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.118265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:28.118774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:28.119209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:28.253556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:28.261708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60aa7efc-0024-4afe-a74c-7ac66aeb28a9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1361 microversion: 2.1 time: 0.159116 Oct 28 19:08:28.262570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4495/7324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:28 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:29.285211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:29.285840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:29.292963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.293460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.293911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.294623 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:29.295093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:29.295531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:29.425078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:29.433155 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-34218c47-29f9-47ce-b815-87ca7137ebf3 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1361 microversion: 2.1 time: 0.151884 Oct 28 19:08:29.434220 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2830/7325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:29 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:30.232217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-43b6fd4f-ce81-46d6-92d1-5b4102ee84aa req-2057edc4-2335-4b4b-9b71-edd68e0a12ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8362ddc-d669-4109-ab14-2f615c6894e9", "name": "network-vif-plugged", "status": "completed", "tag": "5753ceca-c20b-4d98-83d3-e670179f794b"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:30.244195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-43b6fd4f-ce81-46d6-92d1-5b4102ee84aa req-2057edc4-2335-4b4b-9b71-edd68e0a12ce service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.244688 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-43b6fd4f-ce81-46d6-92d1-5b4102ee84aa req-2057edc4-2335-4b4b-9b71-edd68e0a12ce service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.245120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-43b6fd4f-ce81-46d6-92d1-5b4102ee84aa req-2057edc4-2335-4b4b-9b71-edd68e0a12ce service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.257833 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-43b6fd4f-ce81-46d6-92d1-5b4102ee84aa req-2057edc4-2335-4b4b-9b71-edd68e0a12ce service nova] Creating event network-vif-plugged:5753ceca-c20b-4d98-83d3-e670179f794b for instance f8362ddc-d669-4109-ab14-2f615c6894e9 on n-h1-862404-2 Oct 28 19:08:30.262916 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-43b6fd4f-ce81-46d6-92d1-5b4102ee84aa req-2057edc4-2335-4b4b-9b71-edd68e0a12ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034916 Oct 28 19:08:30.263568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4496/7326] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:30.457815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:30.458404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:30.465173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.465669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.466121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.466827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:30.467295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:30.467733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:30.596420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:30.604126 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42d7b763-e85a-4f86-abcc-b24c6dbbf408 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1361 microversion: 2.1 time: 0.151176 Oct 28 19:08:30.604711 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2831/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:30 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:31.630529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:31.631240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:31.637509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.638005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.638742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.639138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:31.639592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:31.640040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:31.779566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:31.788639 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e87bbbe8-ec99-40ef-8635-2fd440f3d14a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1361 microversion: 2.1 time: 0.164214 Oct 28 19:08:31.789228 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4497/7328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:31 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:32.812649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:32.813295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:32.824405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.824948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.825389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.826622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:32.826622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:32.827051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:32.964032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:32.972973 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6df541d4-3be3-4d78-b785-41b4df4c860e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1553 microversion: 2.1 time: 0.165024 Oct 28 19:08:32.973570 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2832/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:32 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:32.995773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:32.996421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:33.003399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.003929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.004379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.005087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:33.005548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:33.005983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:33.155539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:33.164514 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-957a9782-a24c-4fea-a2ca-31df18d9d843 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1553 microversion: 2.1 time: 0.172853 Oct 28 19:08:33.165106 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4498/7330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:32 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:34.667851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31fc9ce7-3f27-46b1-b855-093174705db7"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:34.670326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:34.672320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:34.673015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:34.680611 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.681120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.681582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.682301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:34.682778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:34.683227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:34.809066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:34.923211 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e5563c61-7508-4c9b-96b9-e7f681e2760c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259236 Oct 28 19:08:34.927989 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2833/7331] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 19:08:34 2022] POST /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:45.644705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.645240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:45.647333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:45.649440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:45.650085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=60 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:45.656983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.657480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.657930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.658648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.659698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.660158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.740706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lazy-loading 'services' on Instance uuid f8362ddc-d669-4109-ab14-2f615c6894e9 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:45.809508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1ea50bae-ebd0-42b6-94b6-572a17904fe6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments/31fc9ce7-3f27-46b1-b855-093174705db7" status: 202 len: 0 microversion: 2.1 time: 0.169362 Oct 28 19:08:45.810110 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4499/7332] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:08:45 2022] DELETE /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments/31fc9ce7-3f27-46b1-b855-093174705db7 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:45.817859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:45.818895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:45.823160 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:45.825594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:45.834638 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.835139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.835588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.836340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:45.836812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:45.837249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.871893 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9f5fba4d-0aa6-47a1-a1d5-a510c851cfe1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057131 Oct 28 19:08:45.872618 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2834/7333] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:45 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:46.886175 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.888702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:46.895645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.896174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.896647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.897359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.897822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.898259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.931963 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-036f1b57-c255-4bf3-9a66-2180f05b231a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051023 Oct 28 19:08:46.932556 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4500/7334] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:47.945519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.947849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:47.954941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.955447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.955925 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.956648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.957362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.957890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.989195 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79da99f0-a950-4bb3-b0ee-753b2214f181 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048034 Oct 28 19:08:47.989913 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2835/7335] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:49.001796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.005401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:49.012285 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.012779 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.013222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.013922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.014379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.014806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.047317 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65b760ab-e7d9-4065-9459-b8b09ad9b8de tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049637 Oct 28 19:08:49.047924 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4501/7336] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:50.060097 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:50.062451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:50.072688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.073473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.074197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.075144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.075624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.076098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.109282 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-506402d4-dfa8-4407-a380-1b99d70b84fa tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053331 Oct 28 19:08:50.109860 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2836/7337] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:50 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:51.122999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:51.125223 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:51.132639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.133134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.133575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.134275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.134736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.135166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.164455 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8ad15f5-1943-4046-a4d3-b94ebb479fce tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045848 Oct 28 19:08:51.165046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4502/7338] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:08:51 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:08:51.175898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:51.176530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:51.183452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.183999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.184467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.185185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.185662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.186109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.266067 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] HTTP exception thrown: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 is not attached to volume 31fc9ce7-3f27-46b1-b855-093174705db7 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Request method failure captured: Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments/31fc9ce7-3f27-46b1-b855-093174705db7 HTTP/1.1 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCh8rXKrAgh6UgLz6ZGFx_CXL_zQ6IO7SoN0BMh5P8bbBRw7N_ZiERhgtpCVAz4bjOa5jCgR39_t6kJcd5c5tqcM3k8SNZMjLZAbB3NdN_wirp1ncVo1Dh3OmfjYotEdl_6jkszHG7AQ1mDIEu2A34MbD-3WW5YF30SMOrLQU0Z38FI Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e00acb7ff2e94f25b625b0640dfb0600", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e819d847a40342f4b8dc5ab9058f7502 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 is not attached to volume 31fc9ce7-3f27-46b1-b855-093174705db7 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'server_id': 'f8362ddc-d669-4109-ab14-2f615c6894e9', 'id': '31fc9ce7-3f27-46b1-b855-093174705db7'} Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 31fc9ce7-3f27-46b1-b855-093174705db7. Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 is not attached to volume 31fc9ce7-3f27-46b1-b855-093174705db7 Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:51.268161 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:51.273273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:51.273273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:51.273273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 is not attached to volume 31fc9ce7-3f27-46b1-b855-093174705db7 Oct 28 19:08:51.273273 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:51.273273 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Returning 404 to user: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 is not attached to volume 31fc9ce7-3f27-46b1-b855-093174705db7 {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:51.273273 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c0816ce-906f-4405-86bb-e662efd75e89 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments/31fc9ce7-3f27-46b1-b855-093174705db7" status: 404 len: 154 microversion: 2.1 time: 0.098249 Oct 28 19:08:51.273273 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2837/7339] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:08:51 2022] DELETE /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9/os-volume_attachments/31fc9ce7-3f27-46b1-b855-093174705db7 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:54.682615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.683174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:54.690410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.691630 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.692499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.693301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.693831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.694327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.720828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:08:54.828484 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ba2e36a-f331-4932-b140-fbe7cdcc2038 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 204 len: 0 microversion: 2.1 time: 0.149240 Oct 28 19:08:54.829191 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4503/7340] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:08:54 2022] DELETE /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:08:54.837534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.838272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:54.845944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.846532 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.847618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.848773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.849362 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.849877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.988375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.996474 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-01640663-24f9-448e-9f0c-8e9d4e158c36 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1559 microversion: 2.1 time: 0.162960 Oct 28 19:08:54.997056 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2838/7341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:56.022359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:56.023070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:56.030119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.030590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.031029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.031734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.032221 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.032656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.171315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.179254 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c831d9e5-7d15-4ad1-a26b-e6825a5926fe tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1559 microversion: 2.1 time: 0.162008 Oct 28 19:08:56.179859 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4504/7342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:56 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:56.877788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-96eb1f78-4c97-4c03-91db-d89f88c1084b req-873bcaf9-022b-47ba-88e8-7b98061f55b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8362ddc-d669-4109-ab14-2f615c6894e9", "name": "network-vif-deleted", "tag": "5753ceca-c20b-4d98-83d3-e670179f794b"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:56.894294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-96eb1f78-4c97-4c03-91db-d89f88c1084b req-873bcaf9-022b-47ba-88e8-7b98061f55b8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:56.895102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-96eb1f78-4c97-4c03-91db-d89f88c1084b req-873bcaf9-022b-47ba-88e8-7b98061f55b8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:56.895554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-96eb1f78-4c97-4c03-91db-d89f88c1084b req-873bcaf9-022b-47ba-88e8-7b98061f55b8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.912736 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-96eb1f78-4c97-4c03-91db-d89f88c1084b req-873bcaf9-022b-47ba-88e8-7b98061f55b8 service nova] Creating event network-vif-deleted:5753ceca-c20b-4d98-83d3-e670179f794b for instance f8362ddc-d669-4109-ab14-2f615c6894e9 on n-h1-862404-2 Oct 28 19:08:56.919092 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-96eb1f78-4c97-4c03-91db-d89f88c1084b req-873bcaf9-022b-47ba-88e8-7b98061f55b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045327 Oct 28 19:08:56.920044 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2839/7343] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:57.202320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.202955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:57.210487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.210975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.211415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.212150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.212604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.213032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.244736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.245216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.245652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.246099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lazy-loading 'fault' on Instance uuid f8362ddc-d669-4109-ab14-2f615c6894e9 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:57.288832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.301848 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d17a0926-8ad0-4b59-a8e5-f53f42aba1d4 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 200 len: 1351 microversion: 2.1 time: 0.102038 Oct 28 19:08:57.308182 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4505/7344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:58.326831 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.327479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f8362ddc-d669-4109-ab14-2f615c6894e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:58.334881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.335383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.335853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.336576 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.337042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.337480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.350803 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] HTTP exception thrown: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 could not be found. Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Request method failure captured: Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 HTTP/1.1 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCh8rXKrAgh6UgLz6ZGFx_CXL_zQ6IO7SoN0BMh5P8bbBRw7N_ZiERhgtpCVAz4bjOa5jCgR39_t6kJcd5c5tqcM3k8SNZMjLZAbB3NdN_wirp1ncVo1Dh3OmfjYotEdl_6jkszHG7AQ1mDIEu2A34MbD-3WW5YF30SMOrLQU0Z38FI Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e00acb7ff2e94f25b625b0640dfb0600", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e819d847a40342f4b8dc5ab9058f7502 Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 could not be found. Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f8362ddc-d669-4109-ab14-2f615c6894e9'} Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 could not be found. Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 could not be found. Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:08:58.352487 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 could not be found. Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Returning 404 to user: Instance f8362ddc-d669-4109-ab14-2f615c6894e9 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3a34e83e-11d4-4fa8-9a22-6870b55f2d99 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9" status: 404 len: 111 microversion: 2.1 time: 0.031454 Oct 28 19:08:58.357765 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2840/7345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/f8362ddc-d669-4109-ab14-2f615c6894e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:08:58.364067 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e394d38b-4810-45a0-8f9b-de779333c827 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '.version_select at 0x7f78e2466160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.384439 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e394d38b-4810-45a0-8f9b-de779333c827 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-574930579" status: 202 len: 0 microversion: 2.1 time: 0.025154 Oct 28 19:08:58.385029 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4506/7346] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 19:08:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-574930579 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:58.401810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94a01701-0e51-4f0b-8761-9fafc9896821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: .version_select at 0x7f78de7c4280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1963552423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUrDn0sJbVis4gQDbNbMLPKc8m9SQCPYbl2tyJc8N2DKZMuqWE+WrFEUh5Fr3VHvmUHlhZ2Dg4O63pV+H80uykM3FaQ5p9VHnO1ytSeV1IWSYB1cYB8hR8jc++04kCMBg=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:58.416857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-94a01701-0e51-4f0b-8761-9fafc9896821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:58.422042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-94a01701-0e51-4f0b-8761-9fafc9896821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for user e819d847a40342f4b8dc5ab9058f7502 and project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:58.445902 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94a01701-0e51-4f0b-8761-9fafc9896821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.047964 Oct 28 19:08:58.446490 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2841/7347] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:08:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:58.495996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-70984197", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1963552423", "networks": [{"uuid": "f7eb6182-b599-4c44-ad1d-7cb30ec76c70"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:58.548039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] validate_networks() for [('f7eb6182-b599-4c44-ad1d-7cb30ec76c70', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:08:58.968835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:08:58.969259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:08:58.969737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:08:58.970163 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:08:58.970577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:08:58.979495 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.980011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.980445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.981434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.981888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.982312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.999442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:08:59.006128 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Getting quotas for user e819d847a40342f4b8dc5ab9058f7502 and project e00acb7ff2e94f25b625b0640dfb0600. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:08:59.019274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:08:59.021621 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:08:59.069505 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-baf900ad-dd17-4c5a-95ce-3bd369029dbf tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577350 Oct 28 19:08:59.070178 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4507/7348] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:08:59.081275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62a99ac5-4c84-430e-9818-6d18ff71619b tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.082861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62a99ac5-4c84-430e-9818-6d18ff71619b tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:08:59.138246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-62a99ac5-4c84-430e-9818-6d18ff71619b tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.146766 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62a99ac5-4c84-430e-9818-6d18ff71619b tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1261 microversion: 2.1 time: 0.069368 Oct 28 19:08:59.147420 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2842/7349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:00.172327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:00.181443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:00.203302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.204066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.204755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.206156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.206156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.206700 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.281359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.290163 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c049da40-beae-4536-b066-bfd71a6c7d64 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1331 microversion: 2.1 time: 0.123969 Oct 28 19:09:00.299851 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4508/7350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:00 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.314369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.315003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:01.322922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.323843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.324345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.325650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.326622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.327591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.527277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:01.536349 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-81dd6468-7086-43b4-92c1-c068236327c6 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1361 microversion: 2.1 time: 0.225929 Oct 28 19:09:01.536951 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2843/7351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:09:01.555531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0b6496b3-12b3-4d48-8dbc-c366d298cfb1 req-e82d88ee-7c19-4f2c-9c82-7af704619d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3560f1b-39bd-4db1-a022-c91e09115cc3", "tag": "3c28889b-32f5-4fdc-b7cc-4d4360c89572"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:01.574443 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b6496b3-12b3-4d48-8dbc-c366d298cfb1 req-e82d88ee-7c19-4f2c-9c82-7af704619d7a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.575324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b6496b3-12b3-4d48-8dbc-c366d298cfb1 req-e82d88ee-7c19-4f2c-9c82-7af704619d7a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.576168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0b6496b3-12b3-4d48-8dbc-c366d298cfb1 req-e82d88ee-7c19-4f2c-9c82-7af704619d7a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.598148 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0b6496b3-12b3-4d48-8dbc-c366d298cfb1 req-e82d88ee-7c19-4f2c-9c82-7af704619d7a service nova] Creating event network-changed:3c28889b-32f5-4fdc-b7cc-4d4360c89572 for instance f3560f1b-39bd-4db1-a022-c91e09115cc3 on n-h1-862404-2 Oct 28 19:09:01.605707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0b6496b3-12b3-4d48-8dbc-c366d298cfb1 req-e82d88ee-7c19-4f2c-9c82-7af704619d7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058396 Oct 28 19:09:01.606926 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4509/7352] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:02.561600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:02.562225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:02.569345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.569838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.570292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.570997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:02.571466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:02.572060 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.710542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.718379 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8fd06265-e30b-4e37-989f-707184ca8c14 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1361 microversion: 2.1 time: 0.160690 Oct 28 19:09:02.718869 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2844/7353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:02 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:03.743663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.744389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:03.750591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.751077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.751518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.752233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.752691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.753670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.884372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.892028 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0a4ff0de-d20a-4a6c-bf66-3aac80adb6d1 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1361 microversion: 2.1 time: 0.153761 Oct 28 19:09:03.892606 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4510/7354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:04.915180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:04.915720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:04.922519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.923016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.923472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.924211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.924685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.925624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.055384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.063322 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7f31b21c-68b1-4474-a76e-34e78be40f8c tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1361 microversion: 2.1 time: 0.152130 Oct 28 19:09:05.068254 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2845/7355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:06.086829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:06.087454 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:06.094521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.095032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.095479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.096216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.096678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.097879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.230681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:06.239687 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d04b9be2-7e31-4fc1-94b9-28ab0d2ab368 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1361 microversion: 2.1 time: 0.156802 Oct 28 19:09:06.240302 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4511/7356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:06 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:06.403030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-92567949-219b-48fb-849f-b8720cf566a3 req-0f7ebe53-11b4-448d-b657-385e47f5ad44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3560f1b-39bd-4db1-a022-c91e09115cc3", "name": "network-vif-plugged", "status": "completed", "tag": "3c28889b-32f5-4fdc-b7cc-4d4360c89572"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:06.415214 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-92567949-219b-48fb-849f-b8720cf566a3 req-0f7ebe53-11b4-448d-b657-385e47f5ad44 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.415719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-92567949-219b-48fb-849f-b8720cf566a3 req-0f7ebe53-11b4-448d-b657-385e47f5ad44 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.416191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-92567949-219b-48fb-849f-b8720cf566a3 req-0f7ebe53-11b4-448d-b657-385e47f5ad44 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.428337 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-92567949-219b-48fb-849f-b8720cf566a3 req-0f7ebe53-11b4-448d-b657-385e47f5ad44 service nova] Creating event network-vif-plugged:3c28889b-32f5-4fdc-b7cc-4d4360c89572 for instance f3560f1b-39bd-4db1-a022-c91e09115cc3 on n-h1-862404-2 Oct 28 19:09:06.433312 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-92567949-219b-48fb-849f-b8720cf566a3 req-0f7ebe53-11b4-448d-b657-385e47f5ad44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034056 Oct 28 19:09:06.433978 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2846/7357] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:07.262819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:07.263339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:07.270278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.270765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.271205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.271941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:07.272399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:07.272826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.405820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.414380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7ab18077-eb01-40aa-9943-73618c3a68be tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1361 microversion: 2.1 time: 0.155562 Oct 28 19:09:07.414960 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4512/7358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:07 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:08.438161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:08.438929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:08.446321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.446823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.447276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.448027 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.448507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.448947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.577219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.585800 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eec5f489-f822-4fc9-ad24-e92e12b950c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1553 microversion: 2.1 time: 0.152934 Oct 28 19:09:08.586388 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2847/7359] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:08 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:08.608513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:08.609148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:08.616174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.616676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.617144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.617839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.618306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.618745 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.751012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.758939 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ceaac80b-ec32-4c3a-9ced-1ad11f0473f2 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1553 microversion: 2.1 time: 0.154725 Oct 28 19:09:08.759527 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4513/7360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:08 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:10.254267 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab4a757a-8600-4bd7-899c-0e8d863fd0f0"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:10.256738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:10.258688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:10.264760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.265260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.265712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.266421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.266890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.267326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.506807 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b76fb75e-b4e7-43bc-9616-9e9cdff10c19 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "POST /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257029 Oct 28 19:09:10.507531 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2848/7361] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 19:09:10 2022] POST /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:21.217262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:21.217262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:21.219365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:21.220081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:21.220893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:21.221593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:21.228618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.229142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.229671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.230419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.230889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.231590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.319636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lazy-loading 'services' on Instance uuid f3560f1b-39bd-4db1-a022-c91e09115cc3 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:21.390556 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc34cdd2-e6c4-4ef9-ac0e-710101afddfc tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments/ab4a757a-8600-4bd7-899c-0e8d863fd0f0" status: 202 len: 0 microversion: 2.1 time: 0.177882 Oct 28 19:09:21.391184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4514/7362] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:09:21 2022] DELETE /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments/ab4a757a-8600-4bd7-899c-0e8d863fd0f0 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:21.398234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:21.399261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:21.403474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:21.405945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:21.414331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.414833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.415299 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.416054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.416522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.416962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.449368 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4dc9886d-d730-47d0-ba6a-fa550f9abe65 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052917 Oct 28 19:09:21.449942 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2849/7363] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:09:21 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:22.464222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:22.466534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:22.473582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.474075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.474518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.475230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.475692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.476161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.508121 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9a6c8af8-a38c-4484-9825-427806e21dd9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049283 Oct 28 19:09:22.508709 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4515/7364] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:09:22 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:23.521291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:23.523533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:23.530475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.530973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.531421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.532181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.532648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.533086 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.564501 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9d382e8-dba9-496b-be14-06f2e7619b77 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047931 Oct 28 19:09:23.565063 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2850/7365] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:09:23 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:24.577045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:24.579388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:24.586795 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:24.587283 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:24.587722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.588448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:24.588940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:24.589371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.620208 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b232bcf-12e5-4b49-8539-c0e685a8734a tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047175 Oct 28 19:09:24.620786 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4516/7366] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:09:24 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:25.633266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:25.635601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:25.642455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.642954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.643408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.644150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:25.645291 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:25.646066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:25.677118 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4064153-d100-4dd7-bdbf-08002965a7c9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048559 Oct 28 19:09:25.677694 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2851/7367] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:09:25 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:26.689597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:26.692052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:26.698929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.699421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.699891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.700589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.701048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.701475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.732931 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-717cafc0-072a-4ffd-ac61-431ba1082425 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047523 Oct 28 19:09:26.733514 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4517/7368] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:09:26 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:09:26.744509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:26.745047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:26.751861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.752395 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.752859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.753608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.754105 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.754553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.829700 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] HTTP exception thrown: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 is not attached to volume ab4a757a-8600-4bd7-899c-0e8d863fd0f0 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Request method failure captured: Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments/ab4a757a-8600-4bd7-899c-0e8d863fd0f0 HTTP/1.1 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCh8rXKrAgh6UgLz6ZGFx_CXL_zQ6IO7SoN0BMh5P8bbBRw7N_ZiERhgtpCVAz4bjOa5jCgR39_t6kJcd5c5tqcM3k8SNZMjLZAbB3NdN_wirp1ncVo1Dh3OmfjYotEdl_6jkszHG7AQ1mDIEu2A34MbD-3WW5YF30SMOrLQU0Z38FI Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e00acb7ff2e94f25b625b0640dfb0600", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e819d847a40342f4b8dc5ab9058f7502 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 is not attached to volume ab4a757a-8600-4bd7-899c-0e8d863fd0f0 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'server_id': 'f3560f1b-39bd-4db1-a022-c91e09115cc3', 'id': 'ab4a757a-8600-4bd7-899c-0e8d863fd0f0'} Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ab4a757a-8600-4bd7-899c-0e8d863fd0f0. Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 is not attached to volume ab4a757a-8600-4bd7-899c-0e8d863fd0f0 Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:26.831356 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:26.836840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:26.836840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:26.836840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 is not attached to volume ab4a757a-8600-4bd7-899c-0e8d863fd0f0 Oct 28 19:09:26.836840 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:26.836840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Returning 404 to user: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 is not attached to volume ab4a757a-8600-4bd7-899c-0e8d863fd0f0 {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:26.836840 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-973a9e97-1272-427a-be82-35f0aede0c2e tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments/ab4a757a-8600-4bd7-899c-0e8d863fd0f0" status: 404 len: 154 microversion: 2.1 time: 0.092398 Oct 28 19:09:26.836840 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2852/7369] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:09:26 2022] DELETE /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3/os-volume_attachments/ab4a757a-8600-4bd7-899c-0e8d863fd0f0 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:30.203592 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:30.204149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:30.210893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.211504 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.211834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.212534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.212989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.213414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.240429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:09:30.320705 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35b5790c-a832-4be4-a5ef-1a07a6ca69df tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 204 len: 0 microversion: 2.1 time: 0.120666 Oct 28 19:09:30.321893 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4518/7370] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:09:30 2022] DELETE /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:09:30.329998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:30.330723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:30.340434 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.341437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.341923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.342809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.343466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.343935 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.479007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:30.487068 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78b61b29-ef22-4c0f-8598-3409b0b0c833 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1559 microversion: 2.1 time: 0.161124 Oct 28 19:09:30.487645 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2853/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:30 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:31.511888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:31.512628 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:31.520372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.520970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.521409 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.522103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:31.522560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:31.522988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:31.660806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:31.668661 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd97a476-27d1-4f22-8134-362e63682a66 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1559 microversion: 2.1 time: 0.161129 Oct 28 19:09:31.669255 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4519/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:31 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:32.552711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0143f003-4912-4c4e-9735-6d1b9871bb88 req-ca20b28d-394b-43dd-b875-4a39b70f142a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3560f1b-39bd-4db1-a022-c91e09115cc3", "name": "network-vif-deleted", "tag": "3c28889b-32f5-4fdc-b7cc-4d4360c89572"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:32.564963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0143f003-4912-4c4e-9735-6d1b9871bb88 req-ca20b28d-394b-43dd-b875-4a39b70f142a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.565485 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0143f003-4912-4c4e-9735-6d1b9871bb88 req-ca20b28d-394b-43dd-b875-4a39b70f142a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.565917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0143f003-4912-4c4e-9735-6d1b9871bb88 req-ca20b28d-394b-43dd-b875-4a39b70f142a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.591779 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0143f003-4912-4c4e-9735-6d1b9871bb88 req-ca20b28d-394b-43dd-b875-4a39b70f142a service nova] Creating event network-vif-deleted:3c28889b-32f5-4fdc-b7cc-4d4360c89572 for instance f3560f1b-39bd-4db1-a022-c91e09115cc3 on n-h1-862404-2 Oct 28 19:09:32.598844 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0143f003-4912-4c4e-9735-6d1b9871bb88 req-ca20b28d-394b-43dd-b875-4a39b70f142a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050184 Oct 28 19:09:32.599601 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2854/7373] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:09:32.695386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:32.696450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:32.709143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.709760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.710536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.711338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.712279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.712279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.756711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:32.757122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:32.757571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:32.758041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lazy-loading 'fault' on Instance uuid f3560f1b-39bd-4db1-a022-c91e09115cc3 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:09:32.806009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e819d847a40342f4b8dc5ab9058f7502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00acb7ff2e94f25b625b0640dfb0600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:32.815771 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b07d607c-b3a4-4cc2-8b3c-ba978ef8def9 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 200 len: 1351 microversion: 2.1 time: 0.126960 Oct 28 19:09:32.816902 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4520/7374] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:32 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 1351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:33.842923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:33.843660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] [instance: f3560f1b-39bd-4db1-a022-c91e09115cc3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:09:33.850064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.850556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.851001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.851763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:33.852255 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:33.852693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:33.866070 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] HTTP exception thrown: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 could not be found. Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Request method failure captured: Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 HTTP/1.1 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCh8rXKrAgh6UgLz6ZGFx_CXL_zQ6IO7SoN0BMh5P8bbBRw7N_ZiERhgtpCVAz4bjOa5jCgR39_t6kJcd5c5tqcM3k8SNZMjLZAbB3NdN_wirp1ncVo1Dh3OmfjYotEdl_6jkszHG7AQ1mDIEu2A34MbD-3WW5YF30SMOrLQU0Z38FI Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e00acb7ff2e94f25b625b0640dfb0600", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e00acb7ff2e94f25b625b0640dfb0600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: e00acb7ff2e94f25b625b0640dfb0600 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-343956883 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: e819d847a40342f4b8dc5ab9058f7502 Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestEncryptedCinderVolumes-343956883-project Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 could not be found. Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'f3560f1b-39bd-4db1-a022-c91e09115cc3'} Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 could not be found. Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 could not be found. Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:09:33.867713 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 could not be found. Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Returning 404 to user: Instance f3560f1b-39bd-4db1-a022-c91e09115cc3 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5810199a-bff0-4510-9a12-e4ef8a24f821 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3" status: 404 len: 111 microversion: 2.1 time: 0.031407 Oct 28 19:09:33.873200 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2855/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:33 2022] GET /compute/v2.1/servers/f3560f1b-39bd-4db1-a022-c91e09115cc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:09:33.877855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac4c518e-f9d8-495a-a303-9ff0db4a7aa7 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] Calling method '.version_select at 0x7f78dd662dc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:33.898620 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac4c518e-f9d8-495a-a303-9ff0db4a7aa7 tempest-TestEncryptedCinderVolumes-343956883 tempest-TestEncryptedCinderVolumes-343956883-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1963552423" status: 202 len: 0 microversion: 2.1 time: 0.024536 Oct 28 19:09:33.899214 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4521/7376] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 19:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1963552423 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:00.988467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e48b3e5-310f-4127-b952-1bca3b364ade tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'create', calling method: .version_select at 0x7f78de561ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1440156299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnYI/HeE4IN5hvDVgKXaOFZ3eJHL4Si+lQ9BueRfh+meJIHudBKhhNWskuVVjDv7qGuSAaykSvtjDiIl0m8YkbzseouU3oyEd2xOWKT0cZaG+PkcGsQj7TrbvUGxQx3+Q=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:00.994419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=14 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:00.995095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=34 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:01.007667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-8e48b3e5-310f-4127-b952-1bca3b364ade tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Getting quotas for project b86654f4ca47447bbd7bf9692c204981. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:01.012806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-8e48b3e5-310f-4127-b952-1bca3b364ade tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Getting quotas for user fa6cc6c453864eeb88560c2e6a2545bf and project b86654f4ca47447bbd7bf9692c204981. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:01.036367 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e48b3e5-310f-4127-b952-1bca3b364ade tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051826 Oct 28 19:10:01.037056 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2856/7377] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:10:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:01.087017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:01.087845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:01.091945 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1864129934", "imageRef": "dfa68e1d-65c7-4e43-aae9-718160a56020", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1440156299", "networks": [{"uuid": "a7af669c-1f30-4971-9863-b8a78b095ba6"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:01.145597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] validate_networks() for [('a7af669c-1f30-4971-9863-b8a78b095ba6', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:10:01.524289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:10:01.524728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:10:01.525185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:10:01.525596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:10:01.526011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:10:01.534715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:01.535231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:01.536445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:01.537204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:01.537662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:01.538117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:01.555518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Getting quotas for project b86654f4ca47447bbd7bf9692c204981. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:10:01.561306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Getting quotas for user fa6cc6c453864eeb88560c2e6a2545bf and project b86654f4ca47447bbd7bf9692c204981. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:10:01.573906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:10:01.576189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfa68e1d-65c7-4e43-aae9-718160a56020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:10:01.625282 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e919a092-af38-41c9-9d6a-e4daebc07d5f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540340 Oct 28 19:10:01.625964 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4522/7378] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:10:01.636942 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bad81eb3-0007-47de-9047-015099c2ee4d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:01.637630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bad81eb3-0007-47de-9047-015099c2ee4d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:01.695380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bad81eb3-0007-47de-9047-015099c2ee4d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:01.704396 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bad81eb3-0007-47de-9047-015099c2ee4d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1259 microversion: 2.1 time: 0.071246 Oct 28 19:10:01.704984 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2857/7379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:01 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:02.731429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:02.734194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:02.744992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:02.745867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:02.746664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:02.747607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:02.748451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:02.749110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:02.820294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:02.830327 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6ed9c18-f8ff-4593-97bb-d4d71d80025d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1329 microversion: 2.1 time: 0.104581 Oct 28 19:10:02.835848 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4523/7380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:02 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1329 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:03.854960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:03.855606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:03.863408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:03.864941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:03.865396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:03.866132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:03.866608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:03.867053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:04.011468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:04.020589 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eaf8cc27-20b7-45ba-b680-3e79b4dc6d5e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.169450 Oct 28 19:10:04.021191 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2858/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:03 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:05.045013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:05.045569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:05.053895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.055792 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.056715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.057642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:05.058215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:05.058890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:05.232831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:05.241164 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22dc86a8-1bd4-4e96-b908-9fa0ebe52822 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.200154 Oct 28 19:10:05.241800 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4524/7382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:05 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:06.266207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:06.267040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:06.274922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.275435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.275927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.276874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:06.277519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:06.278220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:06.421579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:06.429636 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c936c0d-2592-4792-919d-b7fa0bcf9138 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.167446 Oct 28 19:10:06.430231 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2859/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:06 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:07.454465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:07.455436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:07.463687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:07.464418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:07.464939 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.465739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:07.466272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:07.466778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:07.615911 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:07.625368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b832e9b-9996-4d60-b517-788aa7b4260e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.174850 Oct 28 19:10:07.625981 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4525/7384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:07 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:08.649858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:08.651427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:08.659111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.659707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.660841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.661641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:08.662197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:08.662712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:08.802296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:08.810110 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-41aca66b-f494-4611-9b2d-e751a210566e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.164273 Oct 28 19:10:08.813031 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2860/7385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:08 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:09.834296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:09.835116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:09.842257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.842752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.843178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.844120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:09.844580 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:09.845010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:09.983918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:09.993566 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05383d4c-9592-4a59-8b48-57b48f2edb48 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.163927 Oct 28 19:10:09.994164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4526/7386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:09 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:11.016836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:11.017447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:11.025452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.025947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.026394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.027102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:11.027564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:11.028035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:11.162009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:11.169808 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2eb177e1-c3ee-4967-b1dc-fb5ea22606b8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.156965 Oct 28 19:10:11.170389 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2861/7387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:11 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:12.193741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:12.194359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:12.197078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:12.197848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:12.203318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:12.203802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:12.204264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:12.204957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:12.205410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:12.205836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:12.342139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:12.351065 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d12c8d91-25ab-43b8-b550-571db3043920 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.161572 Oct 28 19:10:12.351681 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4527/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:12 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:13.374481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:13.375118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:13.377006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:13.383403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.383931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.384385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.385096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:13.385570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:13.386011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:13.517416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:13.525760 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c4b645c3-98c8-46af-a9eb-1ff84c10b215 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.155245 Oct 28 19:10:13.526348 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2862/7389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:13 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:14.548785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:14.549477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:14.557051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.557540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.557972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.558674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:14.559127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:14.559555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:14.694732 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:14.702608 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-49cdd9c4-ede7-4d92-ab33-5af52ce2a2aa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.158072 Oct 28 19:10:14.703195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4528/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:14 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:15.094328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2b2a0ccb-a213-47e3-a089-3160f5a53f02 req-af07fb27-24bc-4c81-9c8a-42d5c1db0fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fbda09-b2f0-415c-8d31-715ce6985189", "tag": "b980d50c-4ea7-4290-be42-1f200cf839e8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:15.105051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2b2a0ccb-a213-47e3-a089-3160f5a53f02 req-af07fb27-24bc-4c81-9c8a-42d5c1db0fa2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.105614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2b2a0ccb-a213-47e3-a089-3160f5a53f02 req-af07fb27-24bc-4c81-9c8a-42d5c1db0fa2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.106059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2b2a0ccb-a213-47e3-a089-3160f5a53f02 req-af07fb27-24bc-4c81-9c8a-42d5c1db0fa2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.118184 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2b2a0ccb-a213-47e3-a089-3160f5a53f02 req-af07fb27-24bc-4c81-9c8a-42d5c1db0fa2 service nova] Creating event network-changed:b980d50c-4ea7-4290-be42-1f200cf839e8 for instance 56fbda09-b2f0-415c-8d31-715ce6985189 on n-h1-862404-2 Oct 28 19:10:15.123358 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2b2a0ccb-a213-47e3-a089-3160f5a53f02 req-af07fb27-24bc-4c81-9c8a-42d5c1db0fa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033245 Oct 28 19:10:15.124223 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2863/7391] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:10:15.726485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:15.727029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:15.734242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.734733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.735183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.735913 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:15.736378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:15.736812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:15.873684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:15.882568 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffb621d7-1c46-49ae-ab21-35e9a4f3ad01 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.160686 Oct 28 19:10:15.883167 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4529/7392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:15 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:16.906481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:16.907195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:16.914290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.914784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.915228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:16.915955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:16.916422 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:16.916851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:17.050451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:17.058780 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3106db1d-f9b7-4adb-b1f5-48476e14829f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.156514 Oct 28 19:10:17.059362 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2864/7393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:16 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:18.082805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:18.083418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:18.090332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.090841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.091280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.092001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:18.092453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:18.092877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:18.223807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:18.231663 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-607213ed-aa71-4e1d-bbaa-9c1acb63947d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.153251 Oct 28 19:10:18.232267 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4530/7394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:18 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:19.254540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:19.255506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:19.262335 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.262836 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.263295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.264034 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:19.264509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:19.264955 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:19.399078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:19.406857 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9f9fd731-c957-4e2b-87c9-89dab7db1313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.156316 Oct 28 19:10:19.407435 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2865/7395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:19 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:20.430064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:20.430687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:20.437582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.438076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.438550 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.439282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:20.439746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:20.440208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:20.573017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:20.580697 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-28d07422-63d3-408f-a077-b169637730dc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.154720 Oct 28 19:10:20.581389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4531/7396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:20 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:21.605452 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:21.606082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:21.613032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.613525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.613975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.614907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:21.615370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:21.615808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:21.744574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:21.752174 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1f918f67-d489-47f2-8da6-8970648f5b54 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.150637 Oct 28 19:10:21.752749 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2866/7397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:21 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:22.740465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-573d9f86-4e04-47ef-b47d-b09457cdaa22 req-b133f96a-ddc9-4061-b67c-45f99fb724d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56fbda09-b2f0-415c-8d31-715ce6985189", "name": "network-vif-plugged", "status": "completed", "tag": "b980d50c-4ea7-4290-be42-1f200cf839e8"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:22.752006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-573d9f86-4e04-47ef-b47d-b09457cdaa22 req-b133f96a-ddc9-4061-b67c-45f99fb724d0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.752487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-573d9f86-4e04-47ef-b47d-b09457cdaa22 req-b133f96a-ddc9-4061-b67c-45f99fb724d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.753294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-573d9f86-4e04-47ef-b47d-b09457cdaa22 req-b133f96a-ddc9-4061-b67c-45f99fb724d0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.765501 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-573d9f86-4e04-47ef-b47d-b09457cdaa22 req-b133f96a-ddc9-4061-b67c-45f99fb724d0 service nova] Creating event network-vif-plugged:b980d50c-4ea7-4290-be42-1f200cf839e8 for instance 56fbda09-b2f0-415c-8d31-715ce6985189 on n-h1-862404-2 Oct 28 19:10:22.772396 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-573d9f86-4e04-47ef-b47d-b09457cdaa22 req-b133f96a-ddc9-4061-b67c-45f99fb724d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035953 Oct 28 19:10:22.773274 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4532/7398] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:22.776317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:22.776881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:22.784016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.784523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.784978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.785706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:22.786818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:22.787307 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:22.979589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:22.987586 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-71e55d9e-46ce-4a8e-9df2-8daa9f0fdbaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.216761 Oct 28 19:10:22.988196 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2867/7399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:22 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:10:24.017478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:24.018218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:24.025267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.025759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.026204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.026905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:24.027360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:24.027789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:24.163735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:24.172820 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5daae68-ab19-4a54-9075-b464d7c00d18 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1359 microversion: 2.1 time: 0.160442 Oct 28 19:10:24.173415 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4533/7400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:24 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:25.194766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.195404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:25.202419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.202866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.203315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.204065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.204538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.204981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.343979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.352613 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-deb88b97-f462-4d12-aafb-696ddb1c0655 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1550 microversion: 2.1 time: 0.161746 Oct 28 19:10:25.353203 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2868/7401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:25.375027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.375667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:25.383772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.384319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.384750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.385457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.385910 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.386336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.524662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.532452 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5fb6f074-cf55-43c6-a398-309c265eb42d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1550 microversion: 2.1 time: 0.161469 Oct 28 19:10:25.533044 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4534/7402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:25.555265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.560110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.560889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Searching by: {'deleted': False, 'project_id': 'b86654f4ca47447bbd7bf9692c204981'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 19:10:25.566162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.566649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.567094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.567842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.568317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.568751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.591793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:10:25.621598 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1d3029ff-4bc0-4e54-b3b5-2b9030fa5e34 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070881 Oct 28 19:10:25.622172 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2869/7403] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:25.634836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:25.635461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:25.641553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.642035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.642467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.643158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:25.643610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:25.644064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:25.778146 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:25.786016 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1608b81c-eca3-4f1f-a471-5aa5f799cfbe tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1550 microversion: 2.1 time: 0.156204 Oct 28 19:10:25.786591 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4535/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:25 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:27.336527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "611dbaa8-9f61-4394-b462-8f79f7ef3a4b"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:27.338916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:27.346340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.346833 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.347277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.348039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:27.348505 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:27.348938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:27.584011 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8d8035db-65cb-4bc3-b9d3-2ba2eb460f4f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251091 Oct 28 19:10:27.585118 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2870/7405] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 19:10:27 2022] POST /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:40.630371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:40.631000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:40.634690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:40.635390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=76 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:40.641884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.642398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.642828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.643534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:40.644035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:40.644470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:40.776701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:40.785183 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7550beb2-8cb1-45bf-b012-aa2655043279 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1596 microversion: 2.1 time: 0.158741 Oct 28 19:10:40.785769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4536/7406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:40 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1596 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:42.905504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:42.906570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:42.907234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:10:42.911685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5d78bd40-25ca-4208-9d82-c1258d85b6e9 req-6832133d-97f2-45a7-a248-8973c2a6e8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fbda09-b2f0-415c-8d31-715ce6985189", "tag": "b980d50c-4ea7-4290-be42-1f200cf839e8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:42.924796 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d78bd40-25ca-4208-9d82-c1258d85b6e9 req-6832133d-97f2-45a7-a248-8973c2a6e8c9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:42.925453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d78bd40-25ca-4208-9d82-c1258d85b6e9 req-6832133d-97f2-45a7-a248-8973c2a6e8c9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:42.926001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d78bd40-25ca-4208-9d82-c1258d85b6e9 req-6832133d-97f2-45a7-a248-8973c2a6e8c9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:42.940807 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5d78bd40-25ca-4208-9d82-c1258d85b6e9 req-6832133d-97f2-45a7-a248-8973c2a6e8c9 service nova] Creating event network-changed:b980d50c-4ea7-4290-be42-1f200cf839e8 for instance 56fbda09-b2f0-415c-8d31-715ce6985189 on n-h1-862404-2 Oct 28 19:10:42.947396 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5d78bd40-25ca-4208-9d82-c1258d85b6e9 req-6832133d-97f2-45a7-a248-8973c2a6e8c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043272 Oct 28 19:10:42.948039 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2871/7407] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:10:44.151038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1799162383"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:44.151578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:44.158692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.159208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.159653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.160529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.160873 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.161306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.297583 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Adding security group 90fa7486-b282-4275-ab29-87cee0ab5479 to port b980d50c-4ea7-4290-be42-1f200cf839e8 Oct 28 19:10:44.620023 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f1a99dd5-a8fd-49fd-a9a3-9795a498f968 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/action" status: 202 len: 0 microversion: 2.1 time: 0.472995 Oct 28 19:10:44.623756 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4537/7408] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:10:44 2022] POST /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:10:44.629642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:10:44.630487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:10:44.639119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.639754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.641223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.642056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.643456 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.644231 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.799089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:10:44.808222 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f485911-8ae2-4830-9127-3d81d02af5b1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1761 microversion: 2.1 time: 0.182844 Oct 28 19:10:44.808805 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2872/7409] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:10:44 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1761 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:10:44.962668 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3468ff73-8fe7-46ff-a1e7-93cad42738d9 req-44602911-f13d-4e41-b3ad-d7840d3c1033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fbda09-b2f0-415c-8d31-715ce6985189", "tag": "b980d50c-4ea7-4290-be42-1f200cf839e8"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:10:44.972408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3468ff73-8fe7-46ff-a1e7-93cad42738d9 req-44602911-f13d-4e41-b3ad-d7840d3c1033 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:10:44.972891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3468ff73-8fe7-46ff-a1e7-93cad42738d9 req-44602911-f13d-4e41-b3ad-d7840d3c1033 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:10:44.973334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3468ff73-8fe7-46ff-a1e7-93cad42738d9 req-44602911-f13d-4e41-b3ad-d7840d3c1033 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:10:44.985131 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3468ff73-8fe7-46ff-a1e7-93cad42738d9 req-44602911-f13d-4e41-b3ad-d7840d3c1033 service nova] Creating event network-changed:b980d50c-4ea7-4290-be42-1f200cf839e8 for instance 56fbda09-b2f0-415c-8d31-715ce6985189 on n-h1-862404-2 Oct 28 19:10:44.990218 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3468ff73-8fe7-46ff-a1e7-93cad42738d9 req-44602911-f13d-4e41-b3ad-d7840d3c1033 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031538 Oct 28 19:10:44.991117 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4538/7410] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:12:56.712535 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:12:56.713268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:56.714201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:56.716017 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:12:56.716227 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/action (ip 10.222.0.16) !!! Oct 28 19:12:56.720597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:12:56.722822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:12:56.731757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:56.732534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:56.732981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:56.733684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:56.734148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:56.734583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:56.806035 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-502df3a0-3246-46a3-a06a-807b9f00d8ba tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/action" status: 202 len: 0 microversion: 2.1 time: 0.095380 Oct 28 19:12:56.806912 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2873/7411] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:12:56 2022] POST /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:12:56.813179 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:12:56.814044 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:12:56.814851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:56.815783 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:12:56.816734 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:12:56.816901 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 (ip 10.222.0.16) !!! Oct 28 19:12:56.818181 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:12:56.818305 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 (ip 10.222.0.16) !!! Oct 28 19:12:56.825225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:56.826326 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:12:56.838245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:56.838734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:56.839182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:56.840590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:56.841205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:56.841634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:57.271568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:57.280708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c1e8302-eb06-41b8-9971-7cffbcdfb3e2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1763 microversion: 2.1 time: 0.469324 Oct 28 19:12:57.281307 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4539/7412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:56 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1763 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:58.306906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:58.307634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:12:58.315986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.316361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.316817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.317533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:58.318008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:58.318451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:58.322826 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35356. Oct 28 19:12:58.466225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:58.474494 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1f510c94-a88d-413c-8e12-dc362523eabd tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1768 microversion: 2.1 time: 0.173098 Oct 28 19:12:58.475069 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2874/7413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:58 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1768 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:12:59.499063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:12:59.499683 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:12:59.509658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.510157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.510607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.511320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:12:59.511869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:12:59.512292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:12:59.529778 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35360. Oct 28 19:12:59.530503 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35362. Oct 28 19:12:59.662635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:12:59.672144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-85f3db5b-14ef-4b2b-9798-e4c8ec9faf20 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1768 microversion: 2.1 time: 0.177241 Oct 28 19:12:59.672744 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4540/7414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:12:59 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1768 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:13:00.695468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:00.696133 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:13:00.703617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:00.704146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:00.704600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:00.705301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:00.705767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:00.706204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:00.850668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:00.860006 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2f99895a-adfb-42af-b169-899c7f521701 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1768 microversion: 2.1 time: 0.168421 Oct 28 19:13:00.860585 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2875/7415] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:00 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1768 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:01.884017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:01.884644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:13:01.892284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:01.892780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:01.893224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:01.893931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:01.894673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:01.895101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:02.047132 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:02.056543 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36483a51-ccc3-43b4-a9c9-9103f8b23092 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1768 microversion: 2.1 time: 0.176224 Oct 28 19:13:02.057361 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4541/7416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:01 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1768 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:03.082585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:03.083251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:13:03.090682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:03.091182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:03.091635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:03.092370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:03.092844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:03.093284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:03.235894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:03.244378 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1263f00-eee7-4b3c-8f7f-9ff5ad8b355f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1761 microversion: 2.1 time: 0.165741 Oct 28 19:13:03.244958 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2876/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:03 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:35.635401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:35.636180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=18 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:35.640966 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1799162383"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:35.641506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:35.649029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.649513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.649949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.650640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.651093 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.651521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.785402 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Removing security group 90fa7486-b282-4275-ab29-87cee0ab5479 from port b980d50c-4ea7-4290-be42-1f200cf839e8 Oct 28 19:14:36.087841 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-775d62f6-3a93-45e8-9e85-64cf674d70fa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/action" status: 202 len: 0 microversion: 2.1 time: 0.454257 Oct 28 19:14:36.091903 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4542/7418] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:14:35 2022] POST /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:36.094482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:36.095182 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:36.183244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3196b7e5-3e2f-440c-af37-0fb6a0048c1e req-97f55dfd-07a5-4e54-85ab-66d81fd4787f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fbda09-b2f0-415c-8d31-715ce6985189", "tag": "b980d50c-4ea7-4290-be42-1f200cf839e8"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:36.193878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3196b7e5-3e2f-440c-af37-0fb6a0048c1e req-97f55dfd-07a5-4e54-85ab-66d81fd4787f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:36.194690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3196b7e5-3e2f-440c-af37-0fb6a0048c1e req-97f55dfd-07a5-4e54-85ab-66d81fd4787f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:36.195373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3196b7e5-3e2f-440c-af37-0fb6a0048c1e req-97f55dfd-07a5-4e54-85ab-66d81fd4787f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:36.209055 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3196b7e5-3e2f-440c-af37-0fb6a0048c1e req-97f55dfd-07a5-4e54-85ab-66d81fd4787f service nova] Creating event network-changed:b980d50c-4ea7-4290-be42-1f200cf839e8 for instance 56fbda09-b2f0-415c-8d31-715ce6985189 on n-h1-862404-2 Oct 28 19:14:36.215224 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3196b7e5-3e2f-440c-af37-0fb6a0048c1e req-97f55dfd-07a5-4e54-85ab-66d81fd4787f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122916 Oct 28 19:14:36.216058 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2877/7419] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:37.551010 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:14:37.551503 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments/611dbaa8-9f61-4394-b462-8f79f7ef3a4b (ip 10.222.0.16) !!! Oct 28 19:14:37.558277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:37.558774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:37.571402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.571944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.572387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.573101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.573558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.573986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.662537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lazy-loading 'services' on Instance uuid 56fbda09-b2f0-415c-8d31-715ce6985189 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:14:37.737866 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86a4fc3d-f323-47a1-878b-db033c735b25 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "DELETE /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments/611dbaa8-9f61-4394-b462-8f79f7ef3a4b" status: 202 len: 0 microversion: 2.1 time: 0.188717 Oct 28 19:14:37.738954 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4543/7420] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:14:37 2022] DELETE /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments/611dbaa8-9f61-4394-b462-8f79f7ef3a4b => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:37.748279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:37.752145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:37.754928 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:14:37.755090 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments (ip 10.222.0.16) !!! Oct 28 19:14:37.765045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.765551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.766011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.766734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:37.767834 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:37.768731 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:37.803969 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3e1d82cb-0d6a-4a6f-bf17-1ead5f5f491d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060285 Oct 28 19:14:37.804850 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2878/7421] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:14:37 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:14:38.232040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4ccf8586-aaeb-4cf2-9241-84e6ce6a0ce7 req-8c976729-2134-4925-94f5-2d8b23829be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56fbda09-b2f0-415c-8d31-715ce6985189", "tag": "b980d50c-4ea7-4290-be42-1f200cf839e8"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:38.243288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4ccf8586-aaeb-4cf2-9241-84e6ce6a0ce7 req-8c976729-2134-4925-94f5-2d8b23829be8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:38.243785 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4ccf8586-aaeb-4cf2-9241-84e6ce6a0ce7 req-8c976729-2134-4925-94f5-2d8b23829be8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:38.244254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4ccf8586-aaeb-4cf2-9241-84e6ce6a0ce7 req-8c976729-2134-4925-94f5-2d8b23829be8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:38.257063 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4ccf8586-aaeb-4cf2-9241-84e6ce6a0ce7 req-8c976729-2134-4925-94f5-2d8b23829be8 service nova] Creating event network-changed:b980d50c-4ea7-4290-be42-1f200cf839e8 for instance 56fbda09-b2f0-415c-8d31-715ce6985189 on n-h1-862404-2 Oct 28 19:14:38.264534 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4ccf8586-aaeb-4cf2-9241-84e6ce6a0ce7 req-8c976729-2134-4925-94f5-2d8b23829be8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037024 Oct 28 19:14:38.265510 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4544/7422] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:38.817282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:38.819419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:38.826195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:38.826686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:38.827128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:38.827845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:38.828315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:38.828746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:38.860226 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cfcdc323-b62d-4c2f-bddc-d69ee5edd2e5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047073 Oct 28 19:14:38.861433 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2879/7423] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:14:38 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:39.877753 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:39.881567 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:39.887399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:39.887929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:39.888372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:39.889075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:39.889533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:39.889967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:39.919714 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34e58aad-ca7b-4b2e-bf46-77405011a15b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048060 Oct 28 19:14:39.920319 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4545/7424] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:14:39 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:40.934540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:40.936793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:40.944375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:40.944871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:40.945481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:40.946196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:40.946660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:40.947098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:40.977167 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-99d9cb03-b68a-4aa1-b9d5-31d3b1e80926 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046748 Oct 28 19:14:40.977736 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2880/7425] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:14:40 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:41.990549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:41.992823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:41.999611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.000121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.000562 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.001958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:42.002421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:42.002850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:42.032219 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc3b3def-26ab-496f-9162-16ff934007c5 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046322 Oct 28 19:14:42.033225 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4546/7426] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:14:41 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:43.045040 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.047245 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:43.054230 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.054725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.055173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.055898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.056370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.056805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.089502 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7a0dbce5-46ff-479c-b003-325b8191d9a0 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048443 Oct 28 19:14:43.090064 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2881/7427] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:14:43 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:14:43.101822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:43.102335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:43.109426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.109923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.110371 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.111213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:43.111678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:43.112214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:43.186985 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] HTTP exception thrown: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 is not attached to volume 611dbaa8-9f61-4394-b462-8f79f7ef3a4b Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Request method failure captured: Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments/611dbaa8-9f61-4394-b462-8f79f7ef3a4b HTTP/1.1 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCj6BEMNzFwrCNWqdgOU4GqGJmYGzI9QCCX9YpkvQN6PmGgW-XN_Ck7dc5DokZJzCCbUOT6KIDBwVQa4a5VMhLv2r_6dtHEvWCD90szWo9R-ENA6qBLxrOkTQ0ttBjDA9Dkcld61xIkLTAhXc2TEf1Ylw5sBxhDMVTOWiNPbnqOimYg Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b86654f4ca47447bbd7bf9692c204981 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b86654f4ca47447bbd7bf9692c204981", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b86654f4ca47447bbd7bf9692c204981 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestMinimumBasicScenario-2096850368-project Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: fa6cc6c453864eeb88560c2e6a2545bf Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestMinimumBasicScenario-2096850368-project Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 is not attached to volume 611dbaa8-9f61-4394-b462-8f79f7ef3a4b Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': '56fbda09-b2f0-415c-8d31-715ce6985189', 'id': '611dbaa8-9f61-4394-b462-8f79f7ef3a4b'} Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 611dbaa8-9f61-4394-b462-8f79f7ef3a4b. Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 is not attached to volume 611dbaa8-9f61-4394-b462-8f79f7ef3a4b Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:43.189338 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:43.194222 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:43.194222 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:43.194222 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 is not attached to volume 611dbaa8-9f61-4394-b462-8f79f7ef3a4b Oct 28 19:14:43.194222 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:43.194222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Returning 404 to user: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 is not attached to volume 611dbaa8-9f61-4394-b462-8f79f7ef3a4b {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:43.194222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2861f186-74f5-4fc2-b6f1-56a952f975ef tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "DELETE /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments/611dbaa8-9f61-4394-b462-8f79f7ef3a4b" status: 404 len: 154 microversion: 2.1 time: 0.093045 Oct 28 19:14:43.194222 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4547/7428] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:14:43 2022] DELETE /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189/os-volume_attachments/611dbaa8-9f61-4394-b462-8f79f7ef3a4b => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:46.449555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:46.450103 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:46.457984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.458490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.458940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.459658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.460154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.460591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.487015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:14:46.565064 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-83f28893-5062-4c01-b9d2-7e096bbecc2f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "DELETE /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 204 len: 0 microversion: 2.1 time: 0.119033 Oct 28 19:14:46.565669 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2882/7429] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:14:46 2022] DELETE /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:14:46.574200 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:46.575437 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:46.583784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.584316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.584750 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.585461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:46.585924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:46.586356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:46.721255 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:46.729357 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a7e5f002-14b1-440d-8f6e-7c0fea959bfc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1556 microversion: 2.1 time: 0.159214 Oct 28 19:14:46.729947 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4548/7430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:46 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:47.754515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:47.755350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:47.762145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:47.762642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:47.763095 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.763801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:47.764296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:47.764739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:47.952409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:47.960934 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fae03c76-5215-4970-a9d0-f509d82cfbc2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1556 microversion: 2.1 time: 0.211743 Oct 28 19:14:47.961511 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2883/7431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:47 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1556 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:48.983918 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:48.984557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:48.993052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:48.993614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:48.994151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:48.995106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:48.995579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:48.996053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.016343 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-34326f6c-c9aa-4134-99a2-dc00a80020f2 req-c3043691-88fa-4933-a886-70767a0bb43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56fbda09-b2f0-415c-8d31-715ce6985189", "name": "network-vif-deleted", "tag": "b980d50c-4ea7-4290-be42-1f200cf839e8"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:49.027232 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-34326f6c-c9aa-4134-99a2-dc00a80020f2 req-c3043691-88fa-4933-a886-70767a0bb43c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:49.027718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-34326f6c-c9aa-4134-99a2-dc00a80020f2 req-c3043691-88fa-4933-a886-70767a0bb43c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:49.028176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-34326f6c-c9aa-4134-99a2-dc00a80020f2 req-c3043691-88fa-4933-a886-70767a0bb43c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:49.040829 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-34326f6c-c9aa-4134-99a2-dc00a80020f2 req-c3043691-88fa-4933-a886-70767a0bb43c service nova] Creating event network-vif-deleted:b980d50c-4ea7-4290-be42-1f200cf839e8 for instance 56fbda09-b2f0-415c-8d31-715ce6985189 on n-h1-862404-2 Oct 28 19:14:49.046460 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-34326f6c-c9aa-4134-99a2-dc00a80020f2 req-c3043691-88fa-4933-a886-70767a0bb43c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106725 Oct 28 19:14:49.047431 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4549/7432] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:49.073915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:49.082959 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e093ab2c-d0e4-4cbf-acd7-fb08b03837f7 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 200 len: 1344 microversion: 2.1 time: 0.103290 Oct 28 19:14:49.083541 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2884/7433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:48 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 1344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:14:50.108002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:50.108739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: 56fbda09-b2f0-415c-8d31-715ce6985189] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:14:50.114946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.115430 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.115887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.116577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:50.117032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:50.117456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:50.133673 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] HTTP exception thrown: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 could not be found. Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Request method failure captured: Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 HTTP/1.1 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCj6BEMNzFwrCNWqdgOU4GqGJmYGzI9QCCX9YpkvQN6PmGgW-XN_Ck7dc5DokZJzCCbUOT6KIDBwVQa4a5VMhLv2r_6dtHEvWCD90szWo9R-ENA6qBLxrOkTQ0ttBjDA9Dkcld61xIkLTAhXc2TEf1Ylw5sBxhDMVTOWiNPbnqOimYg Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b86654f4ca47447bbd7bf9692c204981 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b86654f4ca47447bbd7bf9692c204981", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b86654f4ca47447bbd7bf9692c204981 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestMinimumBasicScenario-2096850368-project Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: fa6cc6c453864eeb88560c2e6a2545bf Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestMinimumBasicScenario-2096850368-project Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 could not be found. Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '56fbda09-b2f0-415c-8d31-715ce6985189'} Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 could not be found. Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 could not be found. Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:14:50.135291 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 could not be found. Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Returning 404 to user: Instance 56fbda09-b2f0-415c-8d31-715ce6985189 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b482aa72-11a4-4c0c-bc06-0cf5284fc769 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189" status: 404 len: 111 microversion: 2.1 time: 0.034127 Oct 28 19:14:50.140519 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4550/7434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:50 2022] GET /compute/v2.1/servers/56fbda09-b2f0-415c-8d31-715ce6985189 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:14:50.146435 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c47d26b6-9ed9-4321-981a-7973ff28b42e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '.version_select at 0x7f78dead9af0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:50.170115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c47d26b6-9ed9-4321-981a-7973ff28b42e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1440156299" status: 202 len: 0 microversion: 2.1 time: 0.028444 Oct 28 19:14:50.170694 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2885/7435] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 19:14:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1440156299 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:59.217690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff18c7f7-7db4-4efb-b176-109e930d8e2e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'create', calling method: .version_select at 0x7f78e23c44c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1779714077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFulDL9EtL9FAfweHafFp1vLojbgTerP2lHH3ymTguvnpuD50LWCEytlWy1QduX16NpSFx3Nh9tJKxG6SnRkuQmbODoKWXXCZ88838NOhFpPSDz2R/i1mUk0zZlkFLjog=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:59.233010 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ff18c7f7-7db4-4efb-b176-109e930d8e2e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Getting quotas for project b86654f4ca47447bbd7bf9692c204981. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:14:59.239636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-ff18c7f7-7db4-4efb-b176-109e930d8e2e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Getting quotas for user fa6cc6c453864eeb88560c2e6a2545bf and project b86654f4ca47447bbd7bf9692c204981. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:14:59.266707 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff18c7f7-7db4-4efb-b176-109e930d8e2e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.099741 Oct 28 19:14:59.267324 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4551/7436] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:14:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:59.316123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:59.320390 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-837193701", "imageRef": "64552ff2-d7d8-4761-addb-3c06b493d32d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1779714077", "networks": [{"uuid": "a7af669c-1f30-4971-9863-b8a78b095ba6"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:59.373637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] validate_networks() for [('a7af669c-1f30-4971-9863-b8a78b095ba6', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:15:00.132344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:15:00.132793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:15:00.133290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:15:00.133794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:15:00.134263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:15:00.143275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:00.143767 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:00.144268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:00.145000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:00.145463 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:00.145894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:00.162653 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Getting quotas for project b86654f4ca47447bbd7bf9692c204981. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:15:00.167724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Getting quotas for user fa6cc6c453864eeb88560c2e6a2545bf and project b86654f4ca47447bbd7bf9692c204981. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:15:00.181162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:15:00.183457 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64552ff2-d7d8-4761-addb-3c06b493d32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:15:00.230877 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1660d593-2a67-493b-8fea-b5658f7ca424 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917460 Oct 28 19:15:00.231533 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2886/7437] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:15:00.240480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:00.245439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d3a695fe-8549-4329-b34f-08fe7cd56546 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:00.246081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d3a695fe-8549-4329-b34f-08fe7cd56546 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:00.308837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d3a695fe-8549-4329-b34f-08fe7cd56546 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:00.317579 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d3a695fe-8549-4329-b34f-08fe7cd56546 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1258 microversion: 2.1 time: 0.077881 Oct 28 19:15:00.318246 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4552/7438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:00 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:01.342300 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:01.343459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:01.354358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:01.354967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:01.355483 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:01.356315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:01.356844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:01.357644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:01.452028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:01.462643 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2d47eb25-d274-4660-a2af-f16bfc0e013f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1328 microversion: 2.1 time: 0.124909 Oct 28 19:15:01.463411 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2887/7439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:01 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1328 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:02.487039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:02.487914 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:02.496066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.496857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.497372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.498051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:02.498519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:02.498953 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:02.643546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:02.651593 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dfbdedd5-f2bb-4bad-a05c-1901065c90c4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.169416 Oct 28 19:15:02.659863 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4553/7440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:02 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:03.675066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:03.675859 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:03.683495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.684297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.684936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.686049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:03.686684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:03.687296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:03.850981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:03.861648 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1c59361-99d5-4c37-974f-110744e96e15 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.190479 Oct 28 19:15:03.862269 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2888/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:03 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:04.885636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:04.886390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:04.894535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.895029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.895471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:04.896208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:04.896671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:04.897105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:05.043625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:05.054033 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8ea98e2-23cf-413a-b0b7-3550237c0d7d tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.172227 Oct 28 19:15:05.054683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4554/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:04 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:06.083035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:06.083853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:06.091404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:06.091993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:06.092450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:06.093239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:06.093707 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:06.094223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:06.241702 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:06.262584 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9eba1170-30d0-4372-8f83-fc0ce6839313 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.183955 Oct 28 19:15:06.263400 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2889/7443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:06 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:07.295222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:07.295879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:07.299131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:07.304692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.305219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.305673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.306376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:07.306831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:07.307258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:07.451759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:07.462991 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec32869e-7316-468f-b882-2494cfc1bd1f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.171916 Oct 28 19:15:07.463598 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4555/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:07 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:08.486076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:08.486636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:08.489309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:08.494494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.494997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.495443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.496171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:08.496636 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:08.497092 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:08.627102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:08.634829 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-139aa079-dab0-46ff-9f58-c7a87f12b2fc tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.153026 Oct 28 19:15:08.635411 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2890/7445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:08 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:09.659103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:09.659724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:09.666653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.667139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:09.667572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:09.668293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:09.668749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:09.669176 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:09.797866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:09.805663 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8bf2edf5-002c-4edf-ab0a-948aa533f605 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.151420 Oct 28 19:15:09.806248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4556/7446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:09 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:10.829385 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:10.830024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:10.833196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:10.833544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:10.839391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.839914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.840372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.841080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:10.841557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:10.842000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:10.975029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:10.982956 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-76e1d341-2328-460a-914b-e7126df97513 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.157922 Oct 28 19:15:10.983542 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2891/7447] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:10 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:12.007462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:12.008137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:12.009993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:12.016256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.017057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.017510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.018213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:12.018674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:12.019114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:12.154271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:12.162325 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c1e6030-c7cf-47e5-b0d6-4bcf41550fe8 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.158903 Oct 28 19:15:12.162911 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4557/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:12 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:13.186421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:13.187008 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:13.196278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:13.196278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:13.196278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:13.196724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:13.205677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:13.205677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:13.439187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:13.446928 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b21d1641-66cd-40ce-ad03-5c0b94924dee tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.264643 Oct 28 19:15:13.447519 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2892/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:13 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:13.915666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-11e9f8a3-5023-486c-92a6-f3c6991eee7f req-dbacf9de-4bef-45f5-941b-1e58a5eb9cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc4f3b1-624c-475b-9ce8-35b50994e6e9", "tag": "6aa2e78f-9a3d-48c8-af79-b257c6894042"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:13.928793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11e9f8a3-5023-486c-92a6-f3c6991eee7f req-dbacf9de-4bef-45f5-941b-1e58a5eb9cf6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:13.929289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11e9f8a3-5023-486c-92a6-f3c6991eee7f req-dbacf9de-4bef-45f5-941b-1e58a5eb9cf6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:13.929786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11e9f8a3-5023-486c-92a6-f3c6991eee7f req-dbacf9de-4bef-45f5-941b-1e58a5eb9cf6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:13.945905 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-11e9f8a3-5023-486c-92a6-f3c6991eee7f req-dbacf9de-4bef-45f5-941b-1e58a5eb9cf6 service nova] Creating event network-changed:6aa2e78f-9a3d-48c8-af79-b257c6894042 for instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 on n-h1-862404-2 Oct 28 19:15:13.950854 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-11e9f8a3-5023-486c-92a6-f3c6991eee7f req-dbacf9de-4bef-45f5-941b-1e58a5eb9cf6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039855 Oct 28 19:15:13.951485 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4558/7450] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:14.471487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:14.472152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:14.478976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:14.479487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:14.479981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:14.480743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:14.481172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:14.481615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:14.621643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:14.629872 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fa9d6f45-b37b-49fc-88c7-35a7134940b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.163228 Oct 28 19:15:14.630470 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2893/7451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:14 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:15.655028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:15.655734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:15.661976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:15.662465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:15.662901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:15.663594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:15.664080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:15.664511 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:15.794742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:15.803100 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-762551dd-f0bf-4227-9278-0568d0f34611 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.153260 Oct 28 19:15:15.803679 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4559/7452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:15 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:16.826531 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:16.827198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:16.835204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:16.835698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:16.836169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:16.836872 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:16.837337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:16.837771 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:16.975369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:16.983360 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-63ee5cb0-049a-4487-b14b-ec31c191fbe6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.160875 Oct 28 19:15:16.983967 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2894/7453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:16 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:18.009641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:18.010249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:18.017417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:18.017909 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:18.018350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:18.019050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:18.019508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:18.019969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:18.152553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:18.160247 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9b9c0c1c-2200-4ea3-9b4f-d08495171da1 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.156067 Oct 28 19:15:18.160855 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4560/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:18 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:19.182618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:19.183241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:19.190699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:19.191215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:19.191661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:19.192387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:19.192849 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:19.193279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:19.323033 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:19.331487 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b042e27-c7ad-4621-884f-ea13e720412c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.152828 Oct 28 19:15:19.332084 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2895/7455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:19 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:20.288870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7bbfe217-bef9-4289-a4f2-04bf47b583ed req-91a1c828-656c-48ec-8cc9-0474ca9acd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc4f3b1-624c-475b-9ce8-35b50994e6e9", "name": "network-vif-plugged", "status": "completed", "tag": "6aa2e78f-9a3d-48c8-af79-b257c6894042"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:20.300708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7bbfe217-bef9-4289-a4f2-04bf47b583ed req-91a1c828-656c-48ec-8cc9-0474ca9acd67 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:20.301171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7bbfe217-bef9-4289-a4f2-04bf47b583ed req-91a1c828-656c-48ec-8cc9-0474ca9acd67 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:20.301603 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7bbfe217-bef9-4289-a4f2-04bf47b583ed req-91a1c828-656c-48ec-8cc9-0474ca9acd67 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:20.314211 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7bbfe217-bef9-4289-a4f2-04bf47b583ed req-91a1c828-656c-48ec-8cc9-0474ca9acd67 service nova] Creating event network-vif-plugged:6aa2e78f-9a3d-48c8-af79-b257c6894042 for instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 on n-h1-862404-2 Oct 28 19:15:20.319616 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7bbfe217-bef9-4289-a4f2-04bf47b583ed req-91a1c828-656c-48ec-8cc9-0474ca9acd67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091761 Oct 28 19:15:20.320358 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4561/7456] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:20.356793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:20.357690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:20.365519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:20.366011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:20.366455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:20.368149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:20.368635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:20.369549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:20.549000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:20.556677 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c66ec14-ef57-4923-ac0b-2d0d532918a6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.206138 Oct 28 19:15:20.557255 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2896/7457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:20 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:21.580284 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:21.580998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:21.587246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.587733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.588198 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.588896 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:21.589357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:21.589787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:21.727617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:21.736210 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1e29676b-8795-454a-bdc9-93ed1c04396f tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1358 microversion: 2.1 time: 0.160983 Oct 28 19:15:21.736867 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4562/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:21 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:22.759865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:22.760408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:22.768014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.768512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.768956 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.769654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.770118 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.770556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.904229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:22.912518 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e613165d-1374-425a-9c4b-8bca11a76a19 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1549 microversion: 2.1 time: 0.156713 Oct 28 19:15:22.913097 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2897/7459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:22 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:22.934919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:22.935559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:22.942479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.942962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.943424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:22.944143 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:22.944598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:22.945020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.077020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:23.085569 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e1e13a8-5410-440e-b008-a4e44a5ecdaa tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1549 microversion: 2.1 time: 0.154511 Oct 28 19:15:23.086156 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4563/7460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:22 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:23.107100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:23.112301 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:23.113083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Searching by: {'deleted': False, 'project_id': 'b86654f4ca47447bbd7bf9692c204981'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3019}} Oct 28 19:15:23.118554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.119054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.119506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.120283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.120759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.121203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.145719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 19:15:23.171929 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7a5b62f0-b286-48af-89fd-a8c1f909447a tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068561 Oct 28 19:15:23.172601 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2898/7461] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 19:15:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:23.184367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:23.184994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:23.191667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.192240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.192685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.193401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:23.193868 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:23.194298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:23.326485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:23.334565 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b13759b3-dc1a-4371-a8a0-ed47920985ed tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1549 microversion: 2.1 time: 0.154194 Oct 28 19:15:23.335150 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4564/7462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:23 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:24.848350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fea86fc5-78c2-4acf-93b0-6291a18c35dd"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:24.850795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:24.857315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.858066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.858520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:24.859224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:24.859782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:24.860249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:25.110309 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-415f9da5-def1-4dfc-ba6e-6718125776d4 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265690 Oct 28 19:15:25.110943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2899/7463] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 19:15:24 2022] POST /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:35.893387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:35.894013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:35.896497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=19 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:35.897185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=64 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:35.903222 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.903715 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.904180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:35.904882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:35.905346 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:35.905782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:36.034535 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:36.042823 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-27f2c654-ad1e-4d41-bb36-145a8b99401c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1595 microversion: 2.1 time: 0.154103 Oct 28 19:15:36.043406 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4565/7464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:35 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:37.646994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:37.648450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=19 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:37.649451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:37.653730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4d7080ba-ff36-49c6-adda-96348c292643 req-96458937-2b4d-4fb5-b734-b220e22ad661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc4f3b1-624c-475b-9ce8-35b50994e6e9", "tag": "6aa2e78f-9a3d-48c8-af79-b257c6894042"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:37.666933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d7080ba-ff36-49c6-adda-96348c292643 req-96458937-2b4d-4fb5-b734-b220e22ad661 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:37.667522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d7080ba-ff36-49c6-adda-96348c292643 req-96458937-2b4d-4fb5-b734-b220e22ad661 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:37.668136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d7080ba-ff36-49c6-adda-96348c292643 req-96458937-2b4d-4fb5-b734-b220e22ad661 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:37.680393 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4d7080ba-ff36-49c6-adda-96348c292643 req-96458937-2b4d-4fb5-b734-b220e22ad661 service nova] Creating event network-changed:6aa2e78f-9a3d-48c8-af79-b257c6894042 for instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 on n-h1-862404-2 Oct 28 19:15:37.685818 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4d7080ba-ff36-49c6-adda-96348c292643 req-96458937-2b4d-4fb5-b734-b220e22ad661 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040697 Oct 28 19:15:37.686427 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2900/7465] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:38.776632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-818871256"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:38.777187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:38.785386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:38.785874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:38.786311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:38.787017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:38.787472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:38.788022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:38.921328 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Adding security group 47a54fd9-993c-40e3-8ba1-5a9ec4ab6b35 to port 6aa2e78f-9a3d-48c8-af79-b257c6894042 Oct 28 19:15:39.234803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1401e10f-9077-4f89-811d-7e7e998eac7e tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/action" status: 202 len: 0 microversion: 2.1 time: 0.462046 Oct 28 19:15:39.235551 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4566/7466] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:15:38 2022] POST /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:15:39.245225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:39.245947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:15:39.252467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.253084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.253637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.254419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.255036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.255551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.411640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:39.419981 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-327b9594-cfbd-4542-aa86-b946eb002d95 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1760 microversion: 2.1 time: 0.180017 Oct 28 19:15:39.420581 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2901/7467] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:39 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:39.700634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f0b24bf0-3dde-45a9-aff1-4a7405fa9224 req-92593092-7a0f-4ab4-a19d-2442c592b978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc4f3b1-624c-475b-9ce8-35b50994e6e9", "tag": "6aa2e78f-9a3d-48c8-af79-b257c6894042"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:39.710876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f0b24bf0-3dde-45a9-aff1-4a7405fa9224 req-92593092-7a0f-4ab4-a19d-2442c592b978 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:39.711359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f0b24bf0-3dde-45a9-aff1-4a7405fa9224 req-92593092-7a0f-4ab4-a19d-2442c592b978 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:39.711788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f0b24bf0-3dde-45a9-aff1-4a7405fa9224 req-92593092-7a0f-4ab4-a19d-2442c592b978 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:39.723614 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f0b24bf0-3dde-45a9-aff1-4a7405fa9224 req-92593092-7a0f-4ab4-a19d-2442c592b978 service nova] Creating event network-changed:6aa2e78f-9a3d-48c8-af79-b257c6894042 for instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 on n-h1-862404-2 Oct 28 19:15:39.728852 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f0b24bf0-3dde-45a9-aff1-4a7405fa9224 req-92593092-7a0f-4ab4-a19d-2442c592b978 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032106 Oct 28 19:15:39.729460 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4567/7468] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:27.543944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:27.546282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:27.548401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:27.549069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:27.556402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.556892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.557343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.558045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.558510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.558947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.629670 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-235a4485-1f5c-46b9-b505-db6ace9e74ff tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/action" status: 202 len: 0 microversion: 2.1 time: 0.089761 Oct 28 19:16:27.630941 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2902/7469] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:16:27 2022] POST /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:27.638397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:27.639231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:27.640244 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:16:27.640373 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:16:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 (ip 10.222.0.16) !!! Oct 28 19:16:27.645218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:27.645983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:27.658050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.658554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.658976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.659691 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.660171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.660602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.815653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:27.824442 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31e2923a-99c5-4e52-b798-9784b8443c14 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1752 microversion: 2.1 time: 0.188654 Oct 28 19:16:27.825673 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4568/7470] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:27 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:28.850947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:28.851668 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:28.858100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.858592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.859042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:28.859745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.860242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.860679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:29.003132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:29.012233 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a745855-a617-4364-abd6-9d9bdd943318 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.167094 Oct 28 19:16:29.012811 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2903/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:28 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:30.037617 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:30.038270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:30.044262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.044746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.045181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.045872 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.046329 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.046757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.189623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:30.198759 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b43badda-45f9-4310-a454-aee51c6fdf53 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.166111 Oct 28 19:16:30.199347 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4569/7472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:30 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:31.222515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:31.223189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:31.230746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:31.231246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:31.231700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:31.232438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:31.233181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:31.233628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:31.384330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:31.392516 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-98208452-d9d4-4fff-8ecd-8310fc06a498 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.173986 Oct 28 19:16:31.393092 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2904/7473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:31 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:32.417667 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:32.418296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:32.425423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:32.425917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:32.426364 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:32.427312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:32.427915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:32.428245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:32.574338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:32.582695 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02e22e77-1934-43ef-b9d8-80e8e9f0004b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.169026 Oct 28 19:16:32.583870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4570/7474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:32 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:33.607343 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:33.608353 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:33.619162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:33.619673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:33.620151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:33.620948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:33.621440 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:33.621879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:33.805640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:33.817856 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e96d0eb-c4c9-44bb-b893-b5fd35c00831 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.214335 Oct 28 19:16:33.818771 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2905/7475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:33 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:34.846372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:34.846997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:34.853929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.854404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.854847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:34.855537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.856017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.856448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:34.999324 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:35.008306 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba6b9acf-c8cf-4b95-9e2d-64f9d7321a5c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.165882 Oct 28 19:16:35.008888 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4571/7476] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:34 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:36.032714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:36.033322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:36.040194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:36.040696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:36.041161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:36.041881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:36.042365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:36.042814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:36.189274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:36.198877 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f6c0f19e-e344-4e03-9572-b5acc4a298ac tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.170192 Oct 28 19:16:36.199929 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2906/7477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:36 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:37.224055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:37.224724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:37.231451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:37.232091 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:37.232531 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:37.233488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:37.233946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:37.234372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:37.388921 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:37.397803 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e913fe2-ad3c-4429-9db2-9577f20a7c50 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.178874 Oct 28 19:16:37.398389 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4572/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:37 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:38.423201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:38.423866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:38.432075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:38.432591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:38.433050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:38.433774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:38.434246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:38.434691 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:38.600298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:38.608973 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86ea60c9-2e6b-448d-a590-2b42f40d4619 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1757 microversion: 2.1 time: 0.190558 Oct 28 19:16:38.609585 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2907/7479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:38 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:39.634325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:39.634983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:16:39.641999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:39.642488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:39.642932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:39.643639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:39.644131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:39.644565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:39.798867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:39.807940 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da569779-588a-42e6-b3b2-9f62cc4afd71 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1760 microversion: 2.1 time: 0.178177 Oct 28 19:16:39.808558 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4573/7480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:39 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1760 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:28.444978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-818871256"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:28.445602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:28.447877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=12 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:28.448606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:28.458474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:28.458987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:28.459439 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:28.460206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:28.460675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:28.461117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:28.606655 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.network.security_group_api [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Removing security group 47a54fd9-993c-40e3-8ba1-5a9ec4ab6b35 from port 6aa2e78f-9a3d-48c8-af79-b257c6894042 Oct 28 19:17:28.972894 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9f6c4682-fb00-45b2-b3b2-67c7f6634a4c tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "POST /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/action" status: 202 len: 0 microversion: 2.1 time: 0.532224 Oct 28 19:17:28.974259 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2908/7481] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:17:28 2022] POST /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:28.984077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4c6a607a-b25d-4b21-b16c-e133fa256782 req-79cc8959-146c-4bd6-bb88-818ee1dec409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc4f3b1-624c-475b-9ce8-35b50994e6e9", "tag": "6aa2e78f-9a3d-48c8-af79-b257c6894042"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:28.995797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:28.997323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=36 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:29.001097 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4c6a607a-b25d-4b21-b16c-e133fa256782 req-79cc8959-146c-4bd6-bb88-818ee1dec409 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:29.002224 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4c6a607a-b25d-4b21-b16c-e133fa256782 req-79cc8959-146c-4bd6-bb88-818ee1dec409 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:29.003179 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4c6a607a-b25d-4b21-b16c-e133fa256782 req-79cc8959-146c-4bd6-bb88-818ee1dec409 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:29.018144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4c6a607a-b25d-4b21-b16c-e133fa256782 req-79cc8959-146c-4bd6-bb88-818ee1dec409 service nova] Creating event network-changed:6aa2e78f-9a3d-48c8-af79-b257c6894042 for instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 on n-h1-862404-2 Oct 28 19:17:29.028821 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4c6a607a-b25d-4b21-b16c-e133fa256782 req-79cc8959-146c-4bd6-bb88-818ee1dec409 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048892 Oct 28 19:17:29.029986 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4574/7482] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:17:30.477323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:30.478076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:30.479040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0d386816-275a-4f1e-bd11-a4b77e9ec735 req-1794d12a-f886-43e8-8a17-fe6d0d0f398f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc4f3b1-624c-475b-9ce8-35b50994e6e9", "tag": "6aa2e78f-9a3d-48c8-af79-b257c6894042"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:30.488297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:30.488917 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:30.489546 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:30.490583 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:30.491302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:30.491879 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:30.492833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d386816-275a-4f1e-bd11-a4b77e9ec735 req-1794d12a-f886-43e8-8a17-fe6d0d0f398f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:30.493393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d386816-275a-4f1e-bd11-a4b77e9ec735 req-1794d12a-f886-43e8-8a17-fe6d0d0f398f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:30.494622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0d386816-275a-4f1e-bd11-a4b77e9ec735 req-1794d12a-f886-43e8-8a17-fe6d0d0f398f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:30.508312 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0d386816-275a-4f1e-bd11-a4b77e9ec735 req-1794d12a-f886-43e8-8a17-fe6d0d0f398f service nova] Creating event network-changed:6aa2e78f-9a3d-48c8-af79-b257c6894042 for instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 on n-h1-862404-2 Oct 28 19:17:30.515713 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0d386816-275a-4f1e-bd11-a4b77e9ec735 req-1794d12a-f886-43e8-8a17-fe6d0d0f398f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041493 Oct 28 19:17:30.516652 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4575/7483] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:30.594596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lazy-loading 'services' on Instance uuid ecc4f3b1-624c-475b-9ce8-35b50994e6e9 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:17:30.697865 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-258c5a1e-92ed-4886-bdc9-7c011b2ea536 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments/fea86fc5-78c2-4acf-93b0-6291a18c35dd" status: 202 len: 0 microversion: 2.1 time: 0.225345 Oct 28 19:17:30.711484 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2909/7484] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:17:30 2022] DELETE /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments/fea86fc5-78c2-4acf-93b0-6291a18c35dd => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:30.722124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:30.724927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:30.737312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:30.738693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:30.739419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:30.740363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:30.740998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:30.741600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:30.796434 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dde32cc3-a2ff-4efc-803f-3954efacabd6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079855 Oct 28 19:17:30.803346 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4576/7485] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:17:30 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:31.812327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:31.815204 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:31.827480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:31.828338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:31.828709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:31.829521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:31.830239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:31.830898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:31.866499 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f9552b79-8e14-47ce-80ee-ecaec7058784 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059708 Oct 28 19:17:31.867094 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2910/7486] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:17:31 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:32.881254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:32.883690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:32.892101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:32.892766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:32.893216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:32.893987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:32.894737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:32.895207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:32.932729 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa63c382-9601-4cee-92a4-fddd34e9ddf3 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056614 Oct 28 19:17:32.933457 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4577/7487] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:17:32 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:33.946690 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:33.949001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:33.956061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:33.957254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:33.957254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:33.958339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:33.958812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:33.959257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:33.990811 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a3bf7df7-7f88-4c96-9e63-4f37d102e1e6 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048219 Oct 28 19:17:33.991399 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2911/7488] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:17:33 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:17:35.003075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:35.005532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:35.014484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:35.015268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:35.015719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:35.016590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:35.017440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:35.018138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:35.069521 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c2961f2c-d8fe-4296-b866-2af63fae6875 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070141 Oct 28 19:17:35.080289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4578/7489] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:17:34 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:36.089158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:36.091730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:36.099475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:36.100053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:36.100553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:36.101364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:36.101866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:36.102354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:36.134681 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6b001ecc-b198-43e1-b391-cab57e429dc9 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049757 Oct 28 19:17:36.135323 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2912/7490] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 19:17:36 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 19:17:36.146719 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:36.147235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:36.154104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:36.154597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:36.155046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:36.155754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:36.156243 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:36.156678 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:36.238901 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] HTTP exception thrown: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 is not attached to volume fea86fc5-78c2-4acf-93b0-6291a18c35dd Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Request method failure captured: Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments/fea86fc5-78c2-4acf-93b0-6291a18c35dd HTTP/1.1 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCj6BEMNzFwrCNWqdgOU4GqGJmYGzI9QCCX9YpkvQN6PmGgW-XN_Ck7dc5DokZJzCCbUOT6KIDBwVQa4a5VMhLv2r_6dtHEvWCD90szWo9R-ENA6qBLxrOkTQ0ttBjDA9Dkcld61xIkLTAhXc2TEf1Ylw5sBxhDMVTOWiNPbnqOimYg Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: b86654f4ca47447bbd7bf9692c204981 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b86654f4ca47447bbd7bf9692c204981", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: b86654f4ca47447bbd7bf9692c204981 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestMinimumBasicScenario-2096850368-project Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: fa6cc6c453864eeb88560c2e6a2545bf Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestMinimumBasicScenario-2096850368-project Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 is not attached to volume fea86fc5-78c2-4acf-93b0-6291a18c35dd Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'server_id': 'ecc4f3b1-624c-475b-9ce8-35b50994e6e9', 'id': 'fea86fc5-78c2-4acf-93b0-6291a18c35dd'} Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fea86fc5-78c2-4acf-93b0-6291a18c35dd. Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 is not attached to volume fea86fc5-78c2-4acf-93b0-6291a18c35dd Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:36.240990 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:36.246064 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:36.246064 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:36.246064 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 is not attached to volume fea86fc5-78c2-4acf-93b0-6291a18c35dd Oct 28 19:17:36.246064 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:17:36.246064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Returning 404 to user: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 is not attached to volume fea86fc5-78c2-4acf-93b0-6291a18c35dd {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:36.246064 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3421b0f-fb40-45b8-91a8-f6cf63201fab tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments/fea86fc5-78c2-4acf-93b0-6291a18c35dd" status: 404 len: 154 microversion: 2.1 time: 0.100062 Oct 28 19:17:36.246064 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4579/7491] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 19:17:36 2022] DELETE /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9/os-volume_attachments/fea86fc5-78c2-4acf-93b0-6291a18c35dd => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:39.526902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:39.527488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:39.540744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:39.541367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:39.541923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.542697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:39.543172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:39.543621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.571187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:17:39.661680 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-559645b2-9135-4f67-8b9f-f1807e18f2b2 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 204 len: 0 microversion: 2.1 time: 0.139696 Oct 28 19:17:39.666213 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2913/7492] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:17:39 2022] DELETE /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:17:39.672177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:39.673877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:39.683016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:39.683549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:39.684030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.684765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:39.685233 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:39.685670 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:39.839530 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:39.849353 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8657ea57-75e6-4514-8885-d28a1af15529 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1555 microversion: 2.1 time: 0.181717 Oct 28 19:17:39.849961 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4580/7493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:39 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:40.875337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:40.876104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:40.886663 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:40.887222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:40.887670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:40.888433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:40.888907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:40.889345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:41.384652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6cc6c453864eeb88560c2e6a2545bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86654f4ca47447bbd7bf9692c204981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:17:41.392780 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7da4f46c-00c3-455a-ad06-fa076b0a3e08 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 200 len: 1555 microversion: 2.1 time: 0.521669 Oct 28 19:17:41.393390 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2914/7494] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:40 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 1555 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:17:41.907790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-4ce81e76-fcfc-4dc7-91f0-8e269eedff1b req-5c73c0e8-5e11-447f-b57e-7db1cbaebc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc4f3b1-624c-475b-9ce8-35b50994e6e9", "name": "network-vif-deleted", "tag": "6aa2e78f-9a3d-48c8-af79-b257c6894042"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:41.926714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4ce81e76-fcfc-4dc7-91f0-8e269eedff1b req-5c73c0e8-5e11-447f-b57e-7db1cbaebc97 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:41.927705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4ce81e76-fcfc-4dc7-91f0-8e269eedff1b req-5c73c0e8-5e11-447f-b57e-7db1cbaebc97 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:41.929002 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-4ce81e76-fcfc-4dc7-91f0-8e269eedff1b req-5c73c0e8-5e11-447f-b57e-7db1cbaebc97 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:41.945601 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-4ce81e76-fcfc-4dc7-91f0-8e269eedff1b req-5c73c0e8-5e11-447f-b57e-7db1cbaebc97 service nova] Creating event network-vif-deleted:6aa2e78f-9a3d-48c8-af79-b257c6894042 for instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 on n-h1-862404-2 Oct 28 19:17:41.950534 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-4ce81e76-fcfc-4dc7-91f0-8e269eedff1b req-5c73c0e8-5e11-447f-b57e-7db1cbaebc97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049769 Oct 28 19:17:41.951142 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4581/7495] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:17:42.419096 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:42.420197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] [instance: ecc4f3b1-624c-475b-9ce8-35b50994e6e9] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:17:42.428673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.429225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.429676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:42.430607 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:17:42.431121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:17:42.431715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:17:42.450786 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] HTTP exception thrown: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 could not be found. Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Request method failure captured: Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 HTTP/1.1 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCj6BEMNzFwrCNWqdgOU4GqGJmYGzI9QCCX9YpkvQN6PmGgW-XN_Ck7dc5DokZJzCCbUOT6KIDBwVQa4a5VMhLv2r_6dtHEvWCD90szWo9R-ENA6qBLxrOkTQ0ttBjDA9Dkcld61xIkLTAhXc2TEf1Ylw5sBxhDMVTOWiNPbnqOimYg Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: b86654f4ca47447bbd7bf9692c204981 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b86654f4ca47447bbd7bf9692c204981", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b86654f4ca47447bbd7bf9692c204981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: b86654f4ca47447bbd7bf9692c204981 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2096850368 Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestMinimumBasicScenario-2096850368-project Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: fa6cc6c453864eeb88560c2e6a2545bf Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestMinimumBasicScenario-2096850368-project Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 could not be found. Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'ecc4f3b1-624c-475b-9ce8-35b50994e6e9'} Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 could not be found. Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 could not be found. Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:17:42.452938 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 could not be found. Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Returning 404 to user: Instance ecc4f3b1-624c-475b-9ce8-35b50994e6e9 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6207fd7b-6dfb-4cd1-ae5f-f55ab7b36066 tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9" status: 404 len: 111 microversion: 2.1 time: 0.040283 Oct 28 19:17:42.459176 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2915/7496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:17:42 2022] GET /compute/v2.1/servers/ecc4f3b1-624c-475b-9ce8-35b50994e6e9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:17:42.466059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61615001-4156-438f-8363-f7182017e96b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] Calling method '.version_select at 0x7f78dd665a60>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:17:42.487785 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61615001-4156-438f-8363-f7182017e96b tempest-TestMinimumBasicScenario-2096850368 tempest-TestMinimumBasicScenario-2096850368-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1779714077" status: 202 len: 0 microversion: 2.1 time: 0.026779 Oct 28 19:17:42.492066 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4582/7497] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 19:17:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1779714077 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:17:52.656433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:52.657197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:17:52.825418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-270a023f-0075-4e47-8ca9-febe1f4fdaf5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: .version_select at 0x7f78de819790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-133711207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+8OfDVH9BOcAIysMCaW4cTHOQcXLFCaNAxAMMnZF4NxzI0PZHBQhL7O4zp5Nt+/y4rmOXWFKZbsAjFfv92Qv71BSlYjJJ4Gb38wpRIebrfpAjSiCLtSld2fztf21F+OQ=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:17:52.841621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-270a023f-0075-4e47-8ca9-febe1f4fdaf5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:17:52.846938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-270a023f-0075-4e47-8ca9-febe1f4fdaf5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:17:52.861970 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-270a023f-0075-4e47-8ca9-febe1f4fdaf5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [db848e0d-f10a-4a4e-8dbc-0cb33444434d] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:17:53.870867 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [None req-270a023f-0075-4e47-8ca9-febe1f4fdaf5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [db848e0d-f10a-4a4e-8dbc-0cb33444434d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36034. Oct 28 19:17:53.887651 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-270a023f-0075-4e47-8ca9-febe1f4fdaf5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.236883 Oct 28 19:17:53.888345 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2916/7498] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:17:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:00.183170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-103343697", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "d004dfe7-e572-4f6c-bee7-a8591214a483"}], "key_name": "tempest-TestNetworkAdvancedServerOps-133711207", "security_groups": [{"name": "tempest-secgroup-smoke-28145823"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:00.210006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=36 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:00.211375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:00.484942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] validate_networks() for [('d004dfe7-e572-4f6c-bee7-a8591214a483', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:18:00.989680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:18:00.990119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:18:00.990605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:18:00.991022 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:18:00.991472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:18:01.000827 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:01.001325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:01.001776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:01.002525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:01.002983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:01.003937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:01.023186 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:18:01.031446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:18:01.047426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:18:01.050927 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:18:01.106097 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87fba1ba-1cd5-4241-bfb8-3f6cacdc5202 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.928375 Oct 28 19:18:01.106781 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4583/7499] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:18:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:18:01.119433 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d3a2711-2d17-47bd-a097-a67c5608a5f1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:01.121564 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4d3a2711-2d17-47bd-a097-a67c5608a5f1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:01.183062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4d3a2711-2d17-47bd-a097-a67c5608a5f1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:01.190432 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d3a2711-2d17-47bd-a097-a67c5608a5f1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1265 microversion: 2.1 time: 0.074958 Oct 28 19:18:01.193046 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2917/7500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:01 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:02.217231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:02.217860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:02.230094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.230946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.231421 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.232275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:02.232923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:02.233684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:02.319331 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:02.334688 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e84be5e-a4f4-4cc8-9515-c03b38dce30e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1317 microversion: 2.1 time: 0.122577 Oct 28 19:18:02.335870 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4584/7501] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:02 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1317 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:03.361902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:03.364597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:03.376184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.376704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.377198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.377974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:03.378998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:03.379502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:03.459963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:03.469207 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e1f1e75-7c35-453c-8713-44ed3f80f2bf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1323 microversion: 2.1 time: 0.114357 Oct 28 19:18:03.470869 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2918/7502] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:03 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1323 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:04.373813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a0b10369-4789-4211-9b09-49e174116c19 req-0eda7037-d615-4458-978d-a8019841ce67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a888c0-dd01-4ef4-9d24-28c99e3e76f4", "tag": "e5b1185b-f85b-42c5-9292-0cece1424496"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:04.386356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0b10369-4789-4211-9b09-49e174116c19 req-0eda7037-d615-4458-978d-a8019841ce67 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.386976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0b10369-4789-4211-9b09-49e174116c19 req-0eda7037-d615-4458-978d-a8019841ce67 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.387522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a0b10369-4789-4211-9b09-49e174116c19 req-0eda7037-d615-4458-978d-a8019841ce67 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.400167 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a0b10369-4789-4211-9b09-49e174116c19 req-0eda7037-d615-4458-978d-a8019841ce67 service nova] Creating event network-changed:e5b1185b-f85b-42c5-9292-0cece1424496 for instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 on n-h2-862404-2 Oct 28 19:18:04.410561 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a0b10369-4789-4211-9b09-49e174116c19 req-0eda7037-d615-4458-978d-a8019841ce67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040568 Oct 28 19:18:04.412032 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4585/7503] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:04.495542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:04.496223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:04.506066 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.506580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.507036 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.507766 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:04.508275 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:04.508720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:04.658712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:04.668611 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bfecf89c-5a66-47ce-9c29-05707d42d6b5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1389 microversion: 2.1 time: 0.176930 Oct 28 19:18:04.669461 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2919/7504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:04 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1389 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:05.693590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:05.694301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:05.700676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:05.701164 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:05.701602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:05.702306 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:05.702765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:05.703194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:05.841455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:05.849820 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a91a11f3-8ab3-487e-acba-fea229aca5bb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1389 microversion: 2.1 time: 0.161897 Oct 28 19:18:05.850424 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4586/7505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:05 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:06.874281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:06.874920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:06.883070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.883585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.884080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:06.884823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:06.885309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:06.885759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:07.023108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:07.034099 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-83862f02-1465-43e7-bc29-c28bb36fbaae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1389 microversion: 2.1 time: 0.163416 Oct 28 19:18:07.035578 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2920/7506] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:06 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:08.058848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:08.059609 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:08.067634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.068160 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.068605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.069321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:08.069780 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:08.070210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:08.206075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:08.214518 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e045d243-4049-4b4d-9f90-811f3e324018 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1389 microversion: 2.1 time: 0.159741 Oct 28 19:18:08.215099 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4587/7507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:08 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:09.238791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:09.239542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:09.242420 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:18:09.242575 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:18:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 (ip 10.222.0.16) !!! Oct 28 19:18:09.250499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.251007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.251459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.252210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:09.252682 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:09.253438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:09.411779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:09.420849 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3b9e6509-a1ee-404d-96a3-b7171209076c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1389 microversion: 2.1 time: 0.186019 Oct 28 19:18:09.421470 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2921/7508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:09 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1389 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:10.449066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:10.449692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:10.457235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.457937 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.458394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:10.459107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.459579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.460052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:10.601615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:10.609754 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0ca45b1e-a3d0-4ba7-ac92-067a00faebbb tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1389 microversion: 2.1 time: 0.164725 Oct 28 19:18:10.610345 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4588/7509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:10 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:10.949962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b07c3acc-6cbd-4067-8b7c-9d1d68025b7d req-667a2635-2635-4312-b678-af505a1b8c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a888c0-dd01-4ef4-9d24-28c99e3e76f4", "name": "network-vif-plugged", "status": "completed", "tag": "e5b1185b-f85b-42c5-9292-0cece1424496"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:10.966212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b07c3acc-6cbd-4067-8b7c-9d1d68025b7d req-667a2635-2635-4312-b678-af505a1b8c21 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:10.966715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b07c3acc-6cbd-4067-8b7c-9d1d68025b7d req-667a2635-2635-4312-b678-af505a1b8c21 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:10.967352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b07c3acc-6cbd-4067-8b7c-9d1d68025b7d req-667a2635-2635-4312-b678-af505a1b8c21 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:10.982381 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b07c3acc-6cbd-4067-8b7c-9d1d68025b7d req-667a2635-2635-4312-b678-af505a1b8c21 service nova] Creating event network-vif-plugged:e5b1185b-f85b-42c5-9292-0cece1424496 for instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 on n-h2-862404-2 Oct 28 19:18:10.988026 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b07c3acc-6cbd-4067-8b7c-9d1d68025b7d req-667a2635-2635-4312-b678-af505a1b8c21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041664 Oct 28 19:18:10.988779 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2922/7510] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:11.634086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:11.634701 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:11.636856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:11.638008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:11.644689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:11.645178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:11.645619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:11.646328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:11.646782 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:11.647209 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:11.787976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:11.795875 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e1777fab-16ec-4991-b9fd-a8097e8369da tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1389 microversion: 2.1 time: 0.165789 Oct 28 19:18:11.796459 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4589/7511] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:11 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:12.817030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:12.823073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:12.823787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:12.830451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:12.830944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:12.831394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:12.832121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:12.833167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:12.833605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:12.972441 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:12.981031 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e04b21b-741e-4376-8c92-cec57eb4fabe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1560 microversion: 2.1 time: 0.165038 Oct 28 19:18:12.981635 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2923/7512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:12 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:13.006512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:13.007127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:13.014280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.014767 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.015207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.015960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:13.016420 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:13.016848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:13.162410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:13.170458 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f1a6b869-7481-43a8-a99b-8ffd0d4132d1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1560 microversion: 2.1 time: 0.168360 Oct 28 19:18:13.171057 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4590/7513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:13 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:15.265888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-bbc3a88a-cc7a-4a69-9792-bf6a33115352 req-695bd5ed-dc57-4e5f-a2bf-b213883c8fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a888c0-dd01-4ef4-9d24-28c99e3e76f4", "tag": "e5b1185b-f85b-42c5-9292-0cece1424496"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:15.276572 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:15.277567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:15.285385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bbc3a88a-cc7a-4a69-9792-bf6a33115352 req-695bd5ed-dc57-4e5f-a2bf-b213883c8fd1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.286414 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bbc3a88a-cc7a-4a69-9792-bf6a33115352 req-695bd5ed-dc57-4e5f-a2bf-b213883c8fd1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.287181 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.287449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bbc3a88a-cc7a-4a69-9792-bf6a33115352 req-695bd5ed-dc57-4e5f-a2bf-b213883c8fd1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.287853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.288392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.289213 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:15.289762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:15.290296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:15.304445 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-bbc3a88a-cc7a-4a69-9792-bf6a33115352 req-695bd5ed-dc57-4e5f-a2bf-b213883c8fd1 service nova] Creating event network-changed:e5b1185b-f85b-42c5-9292-0cece1424496 for instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 on n-h2-862404-2 Oct 28 19:18:15.309675 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-bbc3a88a-cc7a-4a69-9792-bf6a33115352 req-695bd5ed-dc57-4e5f-a2bf-b213883c8fd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047454 Oct 28 19:18:15.310708 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4591/7514] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:15.461312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:15.475423 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-560394d1-f3ff-4f25-88a5-651853b950e4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1560 microversion: 2.1 time: 0.215807 Oct 28 19:18:15.476630 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2924/7515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:15 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:38.813716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:38.814487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=42 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:38.819121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:38.821431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:38.829339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:38.829832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:38.830273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:38.830969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:38.831434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:38.831887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:38.887669 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-004279c8-6920-4b56-9b56-3b5e7eef3103 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action" status: 200 len: 24572 microversion: 2.1 time: 0.075876 Oct 28 19:18:38.888364 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4592/7516] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:38 2022] POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:18:49.784965 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:49.785928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:49.788570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:49.789352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=38 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:49.796891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:49.797613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:49.798218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:49.799014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:49.799524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:49.800104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:49.878331 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-286b5b1b-2af8-48a7-8f0f-0b2fb1482f09 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action" status: 202 len: 0 microversion: 2.1 time: 0.097603 Oct 28 19:18:49.879023 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2925/7517] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:49 2022] POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:18:49.886798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:49.887569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:18:49.892876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:49.893598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:49.904360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:49.905351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:49.905822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:49.906563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:49.907033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:49.907471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:50.067336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:50.077900 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87a15ce7-161e-414d-afef-ed61e948b312 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1684 microversion: 2.1 time: 0.192840 Oct 28 19:18:50.078879 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4593/7518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:49 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:51.104523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:51.106137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:51.113134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:51.113662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:51.114166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:51.114884 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:51.115354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:51.115789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:51.279598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:51.288233 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aec92071-f1db-417c-9b61-67201c0060dd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1664 microversion: 2.1 time: 0.189160 Oct 28 19:18:51.288831 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2926/7519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:51 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1664 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:52.406544 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:52.408859 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:52.417449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.418129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.418649 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.419363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.419845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.420272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.650817 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-281edf7b-d84d-4e5c-a8c1-32e92b0a3e16 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action" status: 200 len: 32641 microversion: 2.1 time: 0.253854 Oct 28 19:18:52.652111 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4594/7520] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:52 2022] POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action => generated 32641 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:18:52.669147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:52.669987 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:52.681675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.682446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.683150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.684287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.685010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.685679 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.763252 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7484186d-c44e-4c79-b2fb-6741c888ec45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action" status: 202 len: 0 microversion: 2.1 time: 0.100681 Oct 28 19:18:52.764121 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2927/7521] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:52 2022] POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:18:52.776481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:52.777188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:52.785949 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.787317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.787777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.788522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:52.789576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:52.790008 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:52.942279 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:52.950925 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-539b97af-ee1c-45a8-869f-5c55d5e784ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1671 microversion: 2.1 time: 0.179262 Oct 28 19:18:52.951829 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4595/7522] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:52 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:53.978507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:53.979246 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:53.986339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:53.986844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:53.987297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:53.988056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:53.988529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:53.988968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:54.144637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:54.154236 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1bba6669-fbcd-409a-890f-acde237b80af tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1679 microversion: 2.1 time: 0.180867 Oct 28 19:18:54.154973 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2928/7523] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:53 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:54.259528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:54.261798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:54.271605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:54.272527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:54.272986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:54.274236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:54.274892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:54.275648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:54.341856 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6b09c73-7002-453c-9379-dc03322e2606 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action" status: 200 len: 37528 microversion: 2.1 time: 0.086319 Oct 28 19:18:54.342639 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4596/7524] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:18:54 2022] POST /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4/action => generated 37528 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:18:55.422927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:55.423966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:55.424905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8bfb6945-e165-4fc4-bb81-c93a9aa407d0 req-a60ecf03-2f17-4324-b040-0147badca5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a888c0-dd01-4ef4-9d24-28c99e3e76f4", "tag": "e5b1185b-f85b-42c5-9292-0cece1424496"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:55.430979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.431588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.432328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.433442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.433994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.434792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.437663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8bfb6945-e165-4fc4-bb81-c93a9aa407d0 req-a60ecf03-2f17-4324-b040-0147badca5c9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.438452 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8bfb6945-e165-4fc4-bb81-c93a9aa407d0 req-a60ecf03-2f17-4324-b040-0147badca5c9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.439147 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8bfb6945-e165-4fc4-bb81-c93a9aa407d0 req-a60ecf03-2f17-4324-b040-0147badca5c9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.451611 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8bfb6945-e165-4fc4-bb81-c93a9aa407d0 req-a60ecf03-2f17-4324-b040-0147badca5c9 service nova] Creating event network-changed:e5b1185b-f85b-42c5-9292-0cece1424496 for instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 on n-h2-862404-2 Oct 28 19:18:55.462474 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8bfb6945-e165-4fc4-bb81-c93a9aa407d0 req-a60ecf03-2f17-4324-b040-0147badca5c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041931 Oct 28 19:18:55.463844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4597/7525] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:55.473566 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:18:55.571025 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d70642e3-12ae-42eb-812a-2ec34ee8f89d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 204 len: 0 microversion: 2.1 time: 0.152709 Oct 28 19:18:55.572084 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2929/7526] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:18:55 2022] DELETE /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:18:55.585005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:55.585738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:55.594249 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.595062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.595775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.596788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:55.597403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:55.598134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:55.779341 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:55.788978 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5001acd8-dbce-431e-8ae3-5541e6b1c7ac tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1685 microversion: 2.1 time: 0.210724 Oct 28 19:18:55.789583 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4598/7527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:55 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1685 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:18:56.815051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:56.815761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:56.823004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.823510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.824009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:56.824734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:56.825211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:56.825650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:56.976802 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:56.985845 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2d9b6ab9-c137-4b86-8661-0a0c54856583 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1685 microversion: 2.1 time: 0.175566 Oct 28 19:18:56.986437 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2930/7528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:56 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:57.921455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-aaf30a85-8f42-4a73-9831-6ca3db7c8f63 req-4e865fb0-c6aa-42da-bc64-accc60802341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a888c0-dd01-4ef4-9d24-28c99e3e76f4", "name": "network-vif-deleted", "tag": "e5b1185b-f85b-42c5-9292-0cece1424496"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:18:57.932155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aaf30a85-8f42-4a73-9831-6ca3db7c8f63 req-4e865fb0-c6aa-42da-bc64-accc60802341 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:57.932871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aaf30a85-8f42-4a73-9831-6ca3db7c8f63 req-4e865fb0-c6aa-42da-bc64-accc60802341 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:57.933540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-aaf30a85-8f42-4a73-9831-6ca3db7c8f63 req-4e865fb0-c6aa-42da-bc64-accc60802341 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:57.948925 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-aaf30a85-8f42-4a73-9831-6ca3db7c8f63 req-4e865fb0-c6aa-42da-bc64-accc60802341 service nova] Creating event network-vif-deleted:e5b1185b-f85b-42c5-9292-0cece1424496 for instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 on n-h2-862404-2 Oct 28 19:18:57.957732 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-aaf30a85-8f42-4a73-9831-6ca3db7c8f63 req-4e865fb0-c6aa-42da-bc64-accc60802341 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041044 Oct 28 19:18:57.958970 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4599/7529] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:18:58.015290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:58.016380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:58.028535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:58.029563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:58.031091 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:58.033293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:58.033907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:58.034416 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:58.079031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:58.080635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:58.081249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:58.081897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lazy-loading 'fault' on Instance uuid 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:18:58.134314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:18:58.143121 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e40e9760-1637-4f37-a024-5bd02ffc1162 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 200 len: 1355 microversion: 2.1 time: 0.136128 Oct 28 19:18:58.143719 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2931/7530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:58 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 1355 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:18:59.168205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:18:59.169025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 17a888c0-dd01-4ef4-9d24-28c99e3e76f4] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:18:59.177385 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.177884 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.178325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.179028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:18:59.179482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:18:59.179940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:18:59.196162 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] HTTP exception thrown: Instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 could not be found. Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Request method failure captured: Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 HTTP/1.1 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCrfJK2_86pJoFF-L-abEgPMPnTr5coqdbjFvKlNNC16w2czEKQG51gSYBJf6skaBNTAau0NKRX3EGTgJ_sovOfLU-taTPpqxL5RHjIxCR0ltRJVY78r0ZRNn1L5t_yl3ao_4JNfyLTX8miyEoVCGHbNxE5O2Bmekrpk6L0ugIltu4E Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_729fa838797f4100870d862d8aad5482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/729fa838797f4100870d862d8aad5482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2984f8cec6df45f4a5ecb582ed7e9016 Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 could not be found. Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '17a888c0-dd01-4ef4-9d24-28c99e3e76f4'} Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 could not be found. Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 could not be found. Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:18:59.197852 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 could not be found. Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Returning 404 to user: Instance 17a888c0-dd01-4ef4-9d24-28c99e3e76f4 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9373b80-d6d2-4cfc-88de-6a40e8193708 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4" status: 404 len: 111 microversion: 2.1 time: 0.035679 Oct 28 19:18:59.204999 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4600/7531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:18:59 2022] GET /compute/v2.1/servers/17a888c0-dd01-4ef4-9d24-28c99e3e76f4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:19:03.121999 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5224262-3254-4080-8c81-aca7ab8ab353 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '.version_select at 0x7f78dead91f0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:03.162442 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c5224262-3254-4080-8c81-aca7ab8ab353 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-133711207" status: 202 len: 0 microversion: 2.1 time: 0.045099 Oct 28 19:19:03.163437 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2932/7532] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 19:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-133711207 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:19:03.194581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a90e7bc0-863e-406d-8cad-6952eee03063 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: .version_select at 0x7f78dc9d0040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1927120672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+nPUs9vLKj5XYgIxVfYPsG0Vti7s9CqS2cQdfZHi2mkRBhpH5AMt2ay0FvIKBK3iGfS55X/xiwgRqxrGPZSImcjJeMEgg8RfH22auIsQ+EYdRYwWvwdKRnjnYGTNd83w=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:03.212831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a90e7bc0-863e-406d-8cad-6952eee03063 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:19:03.218965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-a90e7bc0-863e-406d-8cad-6952eee03063 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:19:03.246988 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a90e7bc0-863e-406d-8cad-6952eee03063 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057190 Oct 28 19:19:03.247731 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4601/7533] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:19:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:09.398274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1530543352", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "10add9a3-b785-4f90-a0a3-95c4073819e7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1927120672", "security_groups": [{"name": "tempest-secgroup-smoke-1139659289"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:09.415500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:09.551466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] validate_networks() for [('10add9a3-b785-4f90-a0a3-95c4073819e7', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:19:10.443561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:19:10.444207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:19:10.444843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:19:10.445279 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:19:10.445719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:19:10.458407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:10.459511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:10.460590 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:10.461632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:10.462277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:10.463602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:10.482706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:19:10.489207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:19:10.504222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:19:10.507216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:19:10.599153 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aa0a15ef-6c75-47d4-a896-e99149b9cf94 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.205867 Oct 28 19:19:10.600390 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2933/7534] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:19:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:19:10.617577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6eb033a6-760c-43a7-8d1c-6dc633322432 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:10.618526 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6eb033a6-760c-43a7-8d1c-6dc633322432 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:10.629541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=32 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:10.721061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6eb033a6-760c-43a7-8d1c-6dc633322432 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:10.735208 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6eb033a6-760c-43a7-8d1c-6dc633322432 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1267 microversion: 2.1 time: 0.123402 Oct 28 19:19:10.737224 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4602/7535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:10 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1267 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:11.762078 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:11.763378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:11.770866 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:11.771374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:11.772099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:11.772842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:11.773316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:11.773761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:11.851794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:11.865177 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-426b53b3-eb13-4af5-b41e-fd836d7b33e5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1319 microversion: 2.1 time: 0.107776 Oct 28 19:19:11.866914 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2934/7536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:11 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1319 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:12.906013 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:12.907350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:12.919295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:12.920208 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:12.921664 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:12.923466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:12.924768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:12.925717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.149607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:13.158992 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e0c96eaa-61d8-44e9-8d1c-dc47dd85b396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1393 microversion: 2.1 time: 0.263363 Oct 28 19:19:13.159609 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4603/7537] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:12 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:13.892920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3b9ee2a0-f976-42fb-a1fe-e7c0b20ad551 req-658c5d86-de1d-4534-9173-155496bf01a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594695e9-e89e-413a-94b0-9db938aaec95", "tag": "0cb20071-66e9-4ff0-90e2-7317a4ce9220"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:13.908552 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3b9ee2a0-f976-42fb-a1fe-e7c0b20ad551 req-658c5d86-de1d-4534-9173-155496bf01a0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:13.909392 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3b9ee2a0-f976-42fb-a1fe-e7c0b20ad551 req-658c5d86-de1d-4534-9173-155496bf01a0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:13.910138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3b9ee2a0-f976-42fb-a1fe-e7c0b20ad551 req-658c5d86-de1d-4534-9173-155496bf01a0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:13.929078 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3b9ee2a0-f976-42fb-a1fe-e7c0b20ad551 req-658c5d86-de1d-4534-9173-155496bf01a0 service nova] Creating event network-changed:0cb20071-66e9-4ff0-90e2-7317a4ce9220 for instance 594695e9-e89e-413a-94b0-9db938aaec95 on n-h1-862404-2 Oct 28 19:19:13.935450 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3b9ee2a0-f976-42fb-a1fe-e7c0b20ad551 req-658c5d86-de1d-4534-9173-155496bf01a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047431 Oct 28 19:19:13.936301 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2935/7538] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:14.189776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:14.190396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:14.200086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:14.200989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:14.201497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:14.202432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:14.203050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:14.203518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:14.385548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:14.394032 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8df6444-18ab-4439-98b5-95447f3c9a0e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1393 microversion: 2.1 time: 0.209569 Oct 28 19:19:14.394740 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4604/7539] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:14 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1393 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:15.419791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:15.420927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:15.427649 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:15.428188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:15.428639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:15.429356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:15.429865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:15.430292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:15.574838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:15.583400 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-639358eb-4aab-4c38-8a10-f57c2e853b62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1393 microversion: 2.1 time: 0.168083 Oct 28 19:19:15.584051 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2936/7540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:15 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:16.607958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:16.608942 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:16.615681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:16.616210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:16.616657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:16.617378 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:16.617842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:16.618276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:16.763017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:16.772076 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-52bdd3fb-eae1-4456-8cd5-e1a67f340d61 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1393 microversion: 2.1 time: 0.168105 Oct 28 19:19:16.772695 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4605/7541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:16 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:17.794625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:17.795383 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:17.802209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:17.802745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:17.803281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:17.804052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:17.804541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:17.804994 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:17.940685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:17.948571 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-be1ae7d7-77b5-4833-a7f5-37c69d4b7fff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1393 microversion: 2.1 time: 0.157899 Oct 28 19:19:17.949158 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2937/7542] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:17 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:18.972730 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:18.973344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:18.980259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:18.980738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:18.981177 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:18.981875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:18.982327 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:18.982752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.122000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:19.130164 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c0c78d6-4254-45cc-baa9-786d0849fc34 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1393 microversion: 2.1 time: 0.161410 Oct 28 19:19:19.130814 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4606/7543] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:18 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:19.290675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-dd72fb08-e16a-4ff9-a04d-65c07df91b3c req-064a26e2-d9d3-4fcf-84e1-69af1b0c7623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594695e9-e89e-413a-94b0-9db938aaec95", "name": "network-vif-plugged", "status": "completed", "tag": "0cb20071-66e9-4ff0-90e2-7317a4ce9220"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:19.302003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-dd72fb08-e16a-4ff9-a04d-65c07df91b3c req-064a26e2-d9d3-4fcf-84e1-69af1b0c7623 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.302507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-dd72fb08-e16a-4ff9-a04d-65c07df91b3c req-064a26e2-d9d3-4fcf-84e1-69af1b0c7623 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.302954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-dd72fb08-e16a-4ff9-a04d-65c07df91b3c req-064a26e2-d9d3-4fcf-84e1-69af1b0c7623 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.315196 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-dd72fb08-e16a-4ff9-a04d-65c07df91b3c req-064a26e2-d9d3-4fcf-84e1-69af1b0c7623 service nova] Creating event network-vif-plugged:0cb20071-66e9-4ff0-90e2-7317a4ce9220 for instance 594695e9-e89e-413a-94b0-9db938aaec95 on n-h1-862404-2 Oct 28 19:19:19.320821 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-dd72fb08-e16a-4ff9-a04d-65c07df91b3c req-064a26e2-d9d3-4fcf-84e1-69af1b0c7623 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033905 Oct 28 19:19:19.321428 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2938/7544] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:20.152775 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:20.153391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:20.156863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:20.162712 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:20.163204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:20.163643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:20.164370 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:20.164823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:20.165250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:20.308029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:20.318220 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b0a8ae69-e39c-40f9-8f7b-6a6e0366e4fc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1393 microversion: 2.1 time: 0.169238 Oct 28 19:19:20.318745 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4607/7545] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:20 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:21.340084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:21.340797 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:21.346130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:21.346895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:21.348795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:21.355268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.355770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.356253 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.356976 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.357454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.357905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.499292 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:21.507839 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2c19070e-f520-4e09-b5da-94e9eff80d25 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1565 microversion: 2.1 time: 0.169764 Oct 28 19:19:21.508682 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2939/7546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:21 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:21.531923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:21.532552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:21.534546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:21.540924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.541418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.541865 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.542589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:21.543045 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:21.543484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:21.682772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:21.690668 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-42601bf6-deb0-43ba-90b7-f6d0d6e5e8a5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1565 microversion: 2.1 time: 0.163385 Oct 28 19:19:21.691267 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4608/7547] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:21 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:23.681005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:23.681684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:23.684005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7870cbe7-1c37-4c2b-b740-52c077130d90 req-56451aae-e4e5-48d7-b049-73ad97921933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594695e9-e89e-413a-94b0-9db938aaec95", "tag": "0cb20071-66e9-4ff0-90e2-7317a4ce9220"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:23.689144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.689907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.690370 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.691298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.692069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.692694 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.696379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7870cbe7-1c37-4c2b-b740-52c077130d90 req-56451aae-e4e5-48d7-b049-73ad97921933 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.696625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7870cbe7-1c37-4c2b-b740-52c077130d90 req-56451aae-e4e5-48d7-b049-73ad97921933 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.697155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7870cbe7-1c37-4c2b-b740-52c077130d90 req-56451aae-e4e5-48d7-b049-73ad97921933 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.709510 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7870cbe7-1c37-4c2b-b740-52c077130d90 req-56451aae-e4e5-48d7-b049-73ad97921933 service nova] Creating event network-changed:0cb20071-66e9-4ff0-90e2-7317a4ce9220 for instance 594695e9-e89e-413a-94b0-9db938aaec95 on n-h1-862404-2 Oct 28 19:19:23.715514 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7870cbe7-1c37-4c2b-b740-52c077130d90 req-56451aae-e4e5-48d7-b049-73ad97921933 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035918 Oct 28 19:19:23.716297 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4609/7548] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:23.941112 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:23.950366 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dabdf855-59a0-4232-819b-661b0e37c798 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1565 microversion: 2.1 time: 0.273358 Oct 28 19:19:23.951186 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2940/7549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:23 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1565 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:57.298556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=5 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:57.299310 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=38 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:57.304739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:57.307181 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:19:57.314841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:57.315389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:57.315772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:57.316513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:57.316979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:57.317423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:57.379344 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-364f2be9-c0c6-4f01-9adf-d707b94ae5a4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95/action" status: 200 len: 24571 microversion: 2.1 time: 0.082989 Oct 28 19:19:57.380131 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4610/7550] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:19:57 2022] POST /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95/action => generated 24571 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:20:27.818184 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:27.819567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=36 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:27.824604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:20:27.826855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:27.834048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:27.835272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:27.836047 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:27.836811 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:27.837323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:27.837769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:27.952861 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1a429b7f-8e01-4a20-9dcd-8520a0992f6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95/action" status: 202 len: 0 microversion: 2.1 time: 0.135825 Oct 28 19:20:27.958633 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2941/7551] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:20:27 2022] POST /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:20:27.964885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:27.965717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:27.968653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:27.969359 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:20:27.974994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:27.975636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:27.976196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:27.976981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:27.977388 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:27.977822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:28.143020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:28.146544 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a8e33a0-0a0b-4568-8096-b9e09d46f1f6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1676 microversion: 2.1 time: 0.186502 Oct 28 19:20:28.147352 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4611/7552] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:27 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:29.171212 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:29.171992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:29.180018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:29.180530 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:29.181024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:29.181751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:29.182229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:29.182677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:29.387877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:29.395874 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1e9be565-37fe-458b-86ff-f671e06ad6e2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.229145 Oct 28 19:20:29.396490 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2942/7553] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:29 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:30.422269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:30.422962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:30.430707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:30.431202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:30.431641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:30.432393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:30.432856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:30.433282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:30.573555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:30.581775 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-38cdfe70-b54b-4c43-86a6-e2845fcf5ad1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.164045 Oct 28 19:20:30.582370 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4612/7554] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:30 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:31.605223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:31.605863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:31.613364 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:31.613869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:31.614332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:31.615065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:31.615808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:31.616085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:31.752507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:31.762385 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b8ed082-ceef-429a-b6e2-996b40c3101c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.160620 Oct 28 19:20:31.762734 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2943/7555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:31 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:20:32.786125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:32.786770 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:32.794489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:32.794979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:32.795415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:32.796148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:32.796600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:32.797023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:32.939758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:32.948078 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-224f6a82-6577-458e-b6c0-b06481a70111 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.165879 Oct 28 19:20:32.948694 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4613/7556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:32 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:33.974616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:33.976101 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:33.984228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:33.984730 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:33.985447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:33.986173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:33.986641 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:33.987084 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:34.132049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:34.140063 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c28ba198-ce78-49ef-9f6b-c3b1793239c0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.169849 Oct 28 19:20:34.140661 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2944/7557] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:33 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:35.164542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:35.165270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:35.172623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:35.173121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:35.173569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:35.174304 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:35.174801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:35.175240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:35.334212 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:35.342443 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7bf4eae9-3cbc-4107-a0b3-517f9d2f5404 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.182429 Oct 28 19:20:35.343046 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4614/7558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:35 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:36.368259 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:36.368913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:36.378156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:36.378669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:36.379126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:36.379892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:36.380365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:36.380809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:36.551805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:36.563685 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8bdd51df-92ec-4505-b33f-3a52a230e93b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.200945 Oct 28 19:20:36.564322 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2945/7559] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:36 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:37.588152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:37.588810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:37.596374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:37.596877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:37.597330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:37.598050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:37.598514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:37.598954 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:37.743387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:37.751581 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08d6c61a-25c5-4b6d-89a2-ea4d43f7104b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.167553 Oct 28 19:20:37.752226 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4615/7560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:37 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:38.776535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:38.777167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:38.784357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.784863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.785321 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.786051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:38.786520 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:38.786963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:38.925206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:38.934574 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e8f13db-8156-4e19-91da-5613ddfa84ee tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1681 microversion: 2.1 time: 0.162561 Oct 28 19:20:38.935473 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2946/7561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:38 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:20:39.958965 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:20:39.959734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:20:39.967000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.967491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.967977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:39.968693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:20:39.969156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:20:39.969593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:20:40.113349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:20:40.121969 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0844af37-f21e-4d4a-9d0d-e2300a48c7b4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1684 microversion: 2.1 time: 0.166989 Oct 28 19:20:40.122557 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4616/7562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:20:39 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:12.359295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:12.361830 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:12.364132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=12 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:12.364823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:12.371846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:12.372357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:12.372814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:12.373537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:12.374010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:12.374453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:12.445488 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f216cb86-7953-48dd-be31-10240dd638e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95/action" status: 200 len: 69125 microversion: 2.1 time: 0.093143 Oct 28 19:21:12.446189 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2947/7563] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:21:12 2022] POST /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95/action => generated 69125 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:21:29.844964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:29.846207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:29.846969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:29.847710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:29.855705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:29.856541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=36 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:29.864075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.864590 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.865118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.866392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.867080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.868011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.902641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:21:29.907628 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0fc644d2-c22b-4af4-9217-4f5bf8f4eb02 req-4c79ee18-dbbb-44d8-a069-6e4d97a5711b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594695e9-e89e-413a-94b0-9db938aaec95", "tag": "0cb20071-66e9-4ff0-90e2-7317a4ce9220"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:29.922357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0fc644d2-c22b-4af4-9217-4f5bf8f4eb02 req-4c79ee18-dbbb-44d8-a069-6e4d97a5711b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:29.922968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0fc644d2-c22b-4af4-9217-4f5bf8f4eb02 req-4c79ee18-dbbb-44d8-a069-6e4d97a5711b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:29.923495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0fc644d2-c22b-4af4-9217-4f5bf8f4eb02 req-4c79ee18-dbbb-44d8-a069-6e4d97a5711b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:29.935373 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0fc644d2-c22b-4af4-9217-4f5bf8f4eb02 req-4c79ee18-dbbb-44d8-a069-6e4d97a5711b service nova] Creating event network-changed:0cb20071-66e9-4ff0-90e2-7317a4ce9220 for instance 594695e9-e89e-413a-94b0-9db938aaec95 on n-h1-862404-2 Oct 28 19:21:29.941062 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0fc644d2-c22b-4af4-9217-4f5bf8f4eb02 req-4c79ee18-dbbb-44d8-a069-6e4d97a5711b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099707 Oct 28 19:21:29.942031 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2948/7564] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:30.007445 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-358e7d5b-8ccd-44ff-a292-8f7781a94cc4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 204 len: 0 microversion: 2.1 time: 0.165237 Oct 28 19:21:30.008695 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4617/7565] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:21:29 2022] DELETE /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:21:30.020672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:30.022689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:30.029661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:30.030163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:30.030616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.031368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:30.031861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:30.032332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:30.187693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:30.196265 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7cc6c394-abea-4527-abd4-5cbabc6c083d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1690 microversion: 2.1 time: 0.181775 Oct 28 19:21:30.211843 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2949/7566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:30 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:31.221271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:31.222138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:31.229235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.229739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.230184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.230899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:31.231406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:31.232028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:31.376886 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:31.385578 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cf638f32-94c8-4370-bea7-d0699c6facbc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1690 microversion: 2.1 time: 0.168666 Oct 28 19:21:31.386184 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4618/7567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:31 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:32.211921 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c9d21434-c795-442f-b63a-b9f5165f6224 req-192a1bfc-04d1-4b3a-9b93-7fe0f2e55f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594695e9-e89e-413a-94b0-9db938aaec95", "name": "network-vif-deleted", "tag": "0cb20071-66e9-4ff0-90e2-7317a4ce9220"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:32.222709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c9d21434-c795-442f-b63a-b9f5165f6224 req-192a1bfc-04d1-4b3a-9b93-7fe0f2e55f3c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.223200 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c9d21434-c795-442f-b63a-b9f5165f6224 req-192a1bfc-04d1-4b3a-9b93-7fe0f2e55f3c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.223672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c9d21434-c795-442f-b63a-b9f5165f6224 req-192a1bfc-04d1-4b3a-9b93-7fe0f2e55f3c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.235192 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c9d21434-c795-442f-b63a-b9f5165f6224 req-192a1bfc-04d1-4b3a-9b93-7fe0f2e55f3c service nova] Creating event network-vif-deleted:0cb20071-66e9-4ff0-90e2-7317a4ce9220 for instance 594695e9-e89e-413a-94b0-9db938aaec95 on n-h1-862404-2 Oct 28 19:21:32.240606 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c9d21434-c795-442f-b63a-b9f5165f6224 req-192a1bfc-04d1-4b3a-9b93-7fe0f2e55f3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Oct 28 19:21:32.241212 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2950/7568] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:32.410854 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:32.411377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:32.418838 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.419336 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.419778 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.420523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:32.420986 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:32.421424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:32.493885 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:32.502496 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a4a6e1c8-9b71-41bb-b095-8fa61eecb17b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 200 len: 1352 microversion: 2.1 time: 0.095582 Oct 28 19:21:32.503197 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4619/7569] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:32 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:33.528168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:33.528891 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 594695e9-e89e-413a-94b0-9db938aaec95] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:33.535132 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:33.535639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:33.536136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:33.536875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:33.537406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:33.537856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:33.551289 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] HTTP exception thrown: Instance 594695e9-e89e-413a-94b0-9db938aaec95 could not be found. Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Request method failure captured: Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 HTTP/1.1 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCrfJK2_86pJoFF-L-abEgPMPnTr5coqdbjFvKlNNC16w2czEKQG51gSYBJf6skaBNTAau0NKRX3EGTgJ_sovOfLU-taTPpqxL5RHjIxCR0ltRJVY78r0ZRNn1L5t_yl3ao_4JNfyLTX8miyEoVCGHbNxE5O2Bmekrpk6L0ugIltu4E Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_729fa838797f4100870d862d8aad5482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/729fa838797f4100870d862d8aad5482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 2984f8cec6df45f4a5ecb582ed7e9016 Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 594695e9-e89e-413a-94b0-9db938aaec95 could not be found. Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '594695e9-e89e-413a-94b0-9db938aaec95'} Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594695e9-e89e-413a-94b0-9db938aaec95 could not be found. Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594695e9-e89e-413a-94b0-9db938aaec95 could not be found. Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.553537 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594695e9-e89e-413a-94b0-9db938aaec95 could not be found. Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Returning 404 to user: Instance 594695e9-e89e-413a-94b0-9db938aaec95 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-19ca79db-6558-4081-b129-d29c022f5655 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95" status: 404 len: 111 microversion: 2.1 time: 0.032025 Oct 28 19:21:33.558743 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2951/7570] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:33 2022] GET /compute/v2.1/servers/594695e9-e89e-413a-94b0-9db938aaec95 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:21:36.825199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fda57a4e-125e-446c-ad43-0ce6542ca9ef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '.version_select at 0x7f78dc8aa310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:36.850048 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fda57a4e-125e-446c-ad43-0ce6542ca9ef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1927120672" status: 202 len: 0 microversion: 2.1 time: 0.027997 Oct 28 19:21:36.850800 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4620/7571] 10.222.0.16 () {58 vars in 1284 bytes} [Fri Oct 28 19:21:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1927120672 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:21:36.873185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0864a4c2-5ec9-4204-9614-ba8f7f4faf12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: .version_select at 0x7f78dd4bc040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-937772490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKReZz98ibH/A0xGoh6Pm1PU4JZhCLoyaMxeywG0VbeMhKalXY4yXm1CtKlRzroB7LzzEw3GlyGzDMGGyCJK5Rv5ov5ppzJIWd9GxSGNJmfjpnd8dhYX3mWPUyDYOOv/dg=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:36.890770 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0864a4c2-5ec9-4204-9614-ba8f7f4faf12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:21:36.897460 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-0864a4c2-5ec9-4204-9614-ba8f7f4faf12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:21:36.928471 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0864a4c2-5ec9-4204-9614-ba8f7f4faf12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058445 Oct 28 19:21:36.929018 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2952/7572] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:21:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:42.981017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1593251757", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "be614bbc-602b-4eaf-be12-edf0c6ac9434"}], "key_name": "tempest-TestNetworkAdvancedServerOps-937772490", "security_groups": [{"name": "tempest-secgroup-smoke-886779608"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:43.008863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:43.135541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] validate_networks() for [('be614bbc-602b-4eaf-be12-edf0c6ac9434', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:21:43.620994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:21:43.621470 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:21:43.622140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:21:43.622616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:21:43.623234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:21:43.633599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:43.634092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:43.634525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:43.635564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:43.636049 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:43.636476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:43.656662 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:21:43.662410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:21:43.679122 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:21:43.682407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:21:43.742902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f421897-6ada-4d67-9414-b518437f2228 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.765278 Oct 28 19:21:43.743886 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4621/7573] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:21:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:21:43.754979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-63cb6c5b-b4e2-48d4-8aef-29f18d08a80f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:43.755768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-63cb6c5b-b4e2-48d4-8aef-29f18d08a80f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:43.761744 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=12 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:43.843739 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-63cb6c5b-b4e2-48d4-8aef-29f18d08a80f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:43.853569 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-63cb6c5b-b4e2-48d4-8aef-29f18d08a80f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1266 microversion: 2.1 time: 0.101901 Oct 28 19:21:43.868049 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2953/7574] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:43 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:44.881258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:44.883138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:44.901581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:44.902615 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:44.903423 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:44.905661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:44.906543 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:44.908012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:44.983972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:44.993674 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2b3e477-f467-4924-bd90-ad897ea8c26c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1336 microversion: 2.1 time: 0.121075 Oct 28 19:21:44.994298 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4622/7575] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:44 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:46.020719 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:46.021762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:46.029332 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:46.029945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:46.030466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:46.031613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:46.032314 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:46.032840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:46.282005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:46.290638 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74eae17c-6e61-46cf-9e3e-710ead61e4a0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1391 microversion: 2.1 time: 0.274749 Oct 28 19:21:46.291961 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2954/7576] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:46 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:46.589380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-864382a3-69d6-4100-9fed-e0ca07052dd1 req-1fb6ba59-99f2-4a1d-8299-afbb647d0bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a670274-c0c9-4c31-b6f4-7f1b42a7de72", "tag": "16895a74-d3b9-4773-aa43-113fc2fe7bd7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:46.631976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-864382a3-69d6-4100-9fed-e0ca07052dd1 req-1fb6ba59-99f2-4a1d-8299-afbb647d0bed service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:46.632806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-864382a3-69d6-4100-9fed-e0ca07052dd1 req-1fb6ba59-99f2-4a1d-8299-afbb647d0bed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:46.633253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-864382a3-69d6-4100-9fed-e0ca07052dd1 req-1fb6ba59-99f2-4a1d-8299-afbb647d0bed service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:46.659088 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-864382a3-69d6-4100-9fed-e0ca07052dd1 req-1fb6ba59-99f2-4a1d-8299-afbb647d0bed service nova] Creating event network-changed:16895a74-d3b9-4773-aa43-113fc2fe7bd7 for instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 on n-h1-862404-2 Oct 28 19:21:46.665105 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-864382a3-69d6-4100-9fed-e0ca07052dd1 req-1fb6ba59-99f2-4a1d-8299-afbb647d0bed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081050 Oct 28 19:21:46.665742 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4623/7577] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:47.314810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:47.315350 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:47.323412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:47.323962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:47.324419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:47.325149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:47.325624 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:47.326072 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:47.478881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:47.487049 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6a75370f-4a95-4f9a-a99c-256c7008c740 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1391 microversion: 2.1 time: 0.176017 Oct 28 19:21:47.487637 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2955/7578] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:47 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:48.512442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:48.513157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:48.519520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:48.520051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:48.520498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:48.521723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:48.522214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:48.522665 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:48.667078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:48.675133 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e877114-eb40-4b11-a7e7-5f49f44ddb44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1391 microversion: 2.1 time: 0.167965 Oct 28 19:21:48.675734 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4624/7579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:48 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:49.699402 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:49.700065 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:49.710721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:49.711239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:49.711693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:49.712476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:49.712945 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:49.713386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:49.861519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:49.870045 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-067fe9b9-2e79-4901-85a7-d89d81fd5f70 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1391 microversion: 2.1 time: 0.174783 Oct 28 19:21:49.870727 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2956/7580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:49 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:21:50.893465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:50.894024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:50.902076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:50.902581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:50.903027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:50.903751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:50.904240 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:50.904677 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:51.044735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:51.053099 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-30238ace-accb-44ea-8ca2-41d3f2f9dd12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1391 microversion: 2.1 time: 0.163635 Oct 28 19:21:51.053955 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4625/7581] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:50 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:51.950793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-781fe4ad-d35b-4431-84ae-11f96500770c req-31bb0b85-b5bd-4ba8-b024-b725ec27f575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a670274-c0c9-4c31-b6f4-7f1b42a7de72", "name": "network-vif-plugged", "status": "completed", "tag": "16895a74-d3b9-4773-aa43-113fc2fe7bd7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:51.961186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-781fe4ad-d35b-4431-84ae-11f96500770c req-31bb0b85-b5bd-4ba8-b024-b725ec27f575 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:51.961685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-781fe4ad-d35b-4431-84ae-11f96500770c req-31bb0b85-b5bd-4ba8-b024-b725ec27f575 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:51.962140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-781fe4ad-d35b-4431-84ae-11f96500770c req-31bb0b85-b5bd-4ba8-b024-b725ec27f575 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:51.977014 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-781fe4ad-d35b-4431-84ae-11f96500770c req-31bb0b85-b5bd-4ba8-b024-b725ec27f575 service nova] Creating event network-vif-plugged:16895a74-d3b9-4773-aa43-113fc2fe7bd7 for instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 on n-h1-862404-2 Oct 28 19:21:51.982222 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-781fe4ad-d35b-4431-84ae-11f96500770c req-31bb0b85-b5bd-4ba8-b024-b725ec27f575 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115415 Oct 28 19:21:51.982866 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2957/7582] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:52.076138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:52.076758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:52.084337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:52.084836 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:52.085522 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:52.085989 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:52.086446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:52.086948 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:52.234901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:52.244293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04108d70-d7d9-4245-aa3e-db52b4b8cf63 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1391 microversion: 2.1 time: 0.172213 Oct 28 19:21:52.244904 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4626/7583] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:52 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:53.269617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:53.270323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:53.277883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:53.278486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:53.279020 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:53.279856 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:53.280399 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:53.280907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:53.458017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:53.466464 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-304400aa-b4da-42fb-bf24-333ab52cb36b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1391 microversion: 2.1 time: 0.202102 Oct 28 19:21:53.466982 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2958/7584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:53 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:54.490938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:54.491508 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:54.494291 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:54.494983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:54.500787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:54.501273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:54.501710 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:54.502406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:54.502863 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:54.503290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:54.639518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:54.649489 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0ebdd690-56cf-4171-88b7-c6f5111ef915 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1562 microversion: 2.1 time: 0.162985 Oct 28 19:21:54.650093 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4627/7585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:54 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:54.672344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:54.672978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:54.675000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:54.682073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:54.682575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:54.683025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:54.683742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:54.684234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:54.684674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:54.820991 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:54.829118 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4cfdde1f-6aab-4600-a9f6-0a746e53edc0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1562 microversion: 2.1 time: 0.160796 Oct 28 19:21:54.829710 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2959/7586] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:54 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:21:56.866185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:21:56.866814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:21:56.868709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0868d257-d0e4-444b-844d-b6b19685abee req-67bd1844-5ba6-4f83-b5a0-2f22153ea452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a670274-c0c9-4c31-b6f4-7f1b42a7de72", "tag": "16895a74-d3b9-4773-aa43-113fc2fe7bd7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:56.873941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:56.874451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:56.875282 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:56.876434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:56.877369 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:56.878062 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:56.881256 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0868d257-d0e4-444b-844d-b6b19685abee req-67bd1844-5ba6-4f83-b5a0-2f22153ea452 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:56.881883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0868d257-d0e4-444b-844d-b6b19685abee req-67bd1844-5ba6-4f83-b5a0-2f22153ea452 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:56.882450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0868d257-d0e4-444b-844d-b6b19685abee req-67bd1844-5ba6-4f83-b5a0-2f22153ea452 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:56.896813 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0868d257-d0e4-444b-844d-b6b19685abee req-67bd1844-5ba6-4f83-b5a0-2f22153ea452 service nova] Creating event network-changed:16895a74-d3b9-4773-aa43-113fc2fe7bd7 for instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 on n-h1-862404-2 Oct 28 19:21:56.902731 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0868d257-d0e4-444b-844d-b6b19685abee req-67bd1844-5ba6-4f83-b5a0-2f22153ea452 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038486 Oct 28 19:21:56.904010 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2960/7587] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:57.024738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:21:57.034444 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b07790ba-32b7-47db-8ac5-f04ee0be8f0a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1562 microversion: 2.1 time: 0.173908 Oct 28 19:21:57.035060 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4628/7588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:21:56 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:28.337219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:28.338002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=34 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:28.339161 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:22:28.339302 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:22:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action (ip 10.222.0.16) !!! Oct 28 19:22:28.344277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:28.346616 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:22:28.357601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:28.358116 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:28.358575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:28.359317 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:28.359803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:28.360284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:28.417904 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-19dbd3b7-371c-44e2-836b-e38956247ff2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action" status: 200 len: 24568 microversion: 2.1 time: 0.083250 Oct 28 19:22:28.425326 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2961/7589] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:22:28 2022] POST /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action => generated 24568 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:22:58.850229 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:58.850990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=40 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:58.938029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:58.940490 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:22:58.947320 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:58.947842 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:58.948289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:58.949006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:58.949477 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:58.949915 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:58.992140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:58.999449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Old instance type m1.heat2, new instance type m1.heat {{(pid=120680) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 28 19:22:59.006288 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:22:59.006703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:22:59.007172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:22:59.007579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:22:59.008026 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:22:59.078435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1e4b023e-2883-497e-b12d-50b3ca1f7006 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action" status: 202 len: 0 microversion: 2.1 time: 0.230059 Oct 28 19:22:59.079391 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4629/7590] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:22:58 2022] POST /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:22:59.088716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:59.092174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:22:59.098692 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:59.099461 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:59.101619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:59.102818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:59.103428 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:59.104215 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:59.104697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:59.105145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:59.263595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:59.271936 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bcce05da-220a-45df-9a54-f23b71172613 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1690 microversion: 2.1 time: 0.187897 Oct 28 19:22:59.272556 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2962/7591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:59 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:00.295852 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:00.296479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:00.302905 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:00.303402 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:00.303887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:00.304596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:00.305582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:00.306234 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:00.513085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:00.521466 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a751ee40-9d57-437c-beac-320100f9cef5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1690 microversion: 2.1 time: 0.230464 Oct 28 19:23:00.522072 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4630/7592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:00 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:23:01.546889 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:01.547519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:01.555209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.555712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.556191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.556907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:01.557380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:01.557824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:01.761753 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:01.770030 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4bd6397-7b6d-4745-8d57-9d70b864a01c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1690 microversion: 2.1 time: 0.227353 Oct 28 19:23:01.770635 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2963/7593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:01 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:02.794929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:02.795474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:02.802728 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.803215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.803651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.804372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:02.804831 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:02.805257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:02.952149 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:02.961238 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5059b6b7-d72f-4af6-891b-9e1924f98442 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.170208 Oct 28 19:23:02.962016 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4631/7594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:02 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:03.986163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:03.986832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:03.994661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.995164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.995619 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:03.996371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:03.996845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:03.997289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:04.137654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:04.145605 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4185ebbb-f0d4-4b49-9c71-957d68cbac6c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.163374 Oct 28 19:23:04.146208 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2964/7595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:03 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:05.171961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:05.172864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:05.183426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.184168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.184759 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.185794 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:05.186436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:05.187087 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:05.344105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:05.352365 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2cf7311-b88e-42f4-b730-35bc8e046374 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.186048 Oct 28 19:23:05.352971 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4632/7596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:05 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:06.375597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:06.376348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:06.383174 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:06.383684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:06.384176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:06.384896 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:06.385368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:06.385812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:06.521717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:06.530511 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a2043f5-1a58-4b0b-815b-928bd5deddd3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.158740 Oct 28 19:23:06.531105 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2965/7597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:06 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:07.554676 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:07.555674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:07.562651 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:07.563140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:07.563582 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:07.564312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:07.564776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:07.565213 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:07.706155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:07.714573 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d06f403-3b04-4ecb-a551-198f5a53790b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.163886 Oct 28 19:23:07.715164 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4633/7598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:07 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:08.738824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:08.739453 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:08.746446 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:08.746949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:08.747404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:08.748170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:08.748643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:08.749087 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:08.887156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:08.895198 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3289db87-609f-44ce-9448-a48eebeef8c1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.160533 Oct 28 19:23:08.895711 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2966/7599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:08 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:09.919689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:09.920269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:09.927301 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:09.927801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:09.928317 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:09.929019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:09.929487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:09.930542 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:10.066433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:10.075045 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-74a2dccf-d856-4828-b63c-612e7d795121 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.159396 Oct 28 19:23:10.075636 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4634/7600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:09 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:11.100595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:11.101222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:11.108524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:11.109023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:11.109470 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:11.110176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:11.110643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:11.111082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:11.244090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:11.252298 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-48a51182-ef2a-4bfa-893a-028768e43475 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.155558 Oct 28 19:23:11.252886 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2967/7601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:11 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:12.276849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:12.277474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:12.284384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.284877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.285323 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.286024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:12.286487 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:12.286918 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:12.422929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:12.431410 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e2c67b3-be83-4395-8776-36e9da4a854c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.159148 Oct 28 19:23:12.432023 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4635/7602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:12 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:13.454968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:13.455706 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:13.462883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:13.463491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:13.463974 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:13.464688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:13.465155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:13.465595 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:13.603241 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:13.611983 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-12082c69-75bd-4d40-a813-7d70c8515af6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1695 microversion: 2.1 time: 0.160919 Oct 28 19:23:13.612566 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2968/7603] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:13 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:14.474506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d6e24716-c4f1-4592-be8f-6716d852eb13 req-eea111ce-c79b-411d-bcc6-73772fa4ab43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a670274-c0c9-4c31-b6f4-7f1b42a7de72", "name": "network-vif-unplugged", "status": "completed", "tag": "16895a74-d3b9-4773-aa43-113fc2fe7bd7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:14.485749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d6e24716-c4f1-4592-be8f-6716d852eb13 req-eea111ce-c79b-411d-bcc6-73772fa4ab43 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:14.486245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d6e24716-c4f1-4592-be8f-6716d852eb13 req-eea111ce-c79b-411d-bcc6-73772fa4ab43 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:14.486720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d6e24716-c4f1-4592-be8f-6716d852eb13 req-eea111ce-c79b-411d-bcc6-73772fa4ab43 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:14.504222 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d6e24716-c4f1-4592-be8f-6716d852eb13 req-eea111ce-c79b-411d-bcc6-73772fa4ab43 service nova] Creating event network-vif-unplugged:16895a74-d3b9-4773-aa43-113fc2fe7bd7 for instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 on n-h2-862404-2 Oct 28 19:23:14.510358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [req-d6e24716-c4f1-4592-be8f-6716d852eb13 req-eea111ce-c79b-411d-bcc6-73772fa4ab43 service nova] Instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120680) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:23:14.523583 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d6e24716-c4f1-4592-be8f-6716d852eb13 req-eea111ce-c79b-411d-bcc6-73772fa4ab43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053043 Oct 28 19:23:14.524248 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4636/7604] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:23:14.637601 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:14.638305 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:14.645933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:14.646455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:14.646922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:14.648006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:14.648554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:14.649013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:14.875741 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:14.883625 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f716d33b-1bf4-4875-bdc8-8208c2aaac45 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1694 microversion: 2.1 time: 0.250847 Oct 28 19:23:14.884259 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2969/7605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:14 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1694 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:15.909426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:15.910142 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:15.917377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.918448 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.918933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:15.919681 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:15.920236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:15.920726 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:16.062238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:16.070182 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-583d7248-bc34-490a-9117-80b570846bd8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1692 microversion: 2.1 time: 0.165003 Oct 28 19:23:16.070769 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4637/7606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:15 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:16.563768 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0e411272-5248-4c90-bdd3-943e905dbf28 req-05378033-2eb4-4991-b708-dcaa27510cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a670274-c0c9-4c31-b6f4-7f1b42a7de72", "tag": "16895a74-d3b9-4773-aa43-113fc2fe7bd7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:16.574635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e411272-5248-4c90-bdd3-943e905dbf28 req-05378033-2eb4-4991-b708-dcaa27510cdc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:16.575131 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e411272-5248-4c90-bdd3-943e905dbf28 req-05378033-2eb4-4991-b708-dcaa27510cdc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:16.575582 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0e411272-5248-4c90-bdd3-943e905dbf28 req-05378033-2eb4-4991-b708-dcaa27510cdc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:16.590905 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0e411272-5248-4c90-bdd3-943e905dbf28 req-05378033-2eb4-4991-b708-dcaa27510cdc service nova] Creating event network-changed:16895a74-d3b9-4773-aa43-113fc2fe7bd7 for instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 on n-h2-862404-2 Oct 28 19:23:16.596375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [req-0e411272-5248-4c90-bdd3-943e905dbf28 req-05378033-2eb4-4991-b708-dcaa27510cdc service nova] Instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-862404-2', 'n-h2-862404-2'} {{(pid=120679) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 28 19:23:16.607523 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0e411272-5248-4c90-bdd3-943e905dbf28 req-05378033-2eb4-4991-b708-dcaa27510cdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047431 Oct 28 19:23:16.608176 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2970/7607] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:17.093533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:17.094056 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:17.101103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:17.101594 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:17.102040 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:17.102749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:17.103206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:17.103634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:17.258655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:17.266959 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aeb2e056-a2b8-4d3d-91c2-0005773f3840 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1692 microversion: 2.1 time: 0.177474 Oct 28 19:23:17.267562 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4638/7608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:17 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:18.296198 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:18.296912 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:18.303222 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.303725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.304211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.304949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.305418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.305858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.459247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:18.468522 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f7fd346-c2bf-4443-8ceb-bfc925c77cbf tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1689 microversion: 2.1 time: 0.177995 Oct 28 19:23:18.469117 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2971/7609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:18 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:23:18.492432 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:18.493178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:18.503017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.504133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.504133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.504704 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.505260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.505690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.576017 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41d89e50-c921-48db-b210-6b3e86668c62 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action" status: 204 len: 0 microversion: 2.1 time: 0.087521 Oct 28 19:23:18.577569 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4639/7610] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:23:18 2022] POST /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:23:18.587371 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:18.589487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:18.596225 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.596995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.597551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.598489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.599054 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.599559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.831559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:18.841646 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f5d638d3-ac1e-432c-ae50-c4419a5743a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1689 microversion: 2.1 time: 0.258569 Oct 28 19:23:18.842352 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2972/7611] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:18 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1689 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:18.872204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:18.873237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:18.880051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.880558 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.881009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:18.881731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:18.882251 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:18.882634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:19.048099 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:19.057230 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b15ff07f-0c3e-4e66-8be8-6a5ed6f93811 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1689 microversion: 2.1 time: 0.189266 Oct 28 19:23:19.058383 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4640/7612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:18 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:20.086258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:20.086869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:20.093419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:20.093927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:20.094598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:20.095325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:20.096140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:20.096289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:20.116813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9cb65924-066b-4f04-a433-bba320c0df9d req-5fa0511f-fb78-40fe-81a1-d6221219867f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a670274-c0c9-4c31-b6f4-7f1b42a7de72", "name": "network-vif-plugged", "status": "completed", "tag": "16895a74-d3b9-4773-aa43-113fc2fe7bd7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:20.134380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9cb65924-066b-4f04-a433-bba320c0df9d req-5fa0511f-fb78-40fe-81a1-d6221219867f service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:20.135345 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9cb65924-066b-4f04-a433-bba320c0df9d req-5fa0511f-fb78-40fe-81a1-d6221219867f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:20.135923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9cb65924-066b-4f04-a433-bba320c0df9d req-5fa0511f-fb78-40fe-81a1-d6221219867f service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:20.164517 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9cb65924-066b-4f04-a433-bba320c0df9d req-5fa0511f-fb78-40fe-81a1-d6221219867f service nova] Creating event network-vif-plugged:16895a74-d3b9-4773-aa43-113fc2fe7bd7 for instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 on n-h2-862404-2 Oct 28 19:23:20.171251 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9cb65924-066b-4f04-a433-bba320c0df9d req-5fa0511f-fb78-40fe-81a1-d6221219867f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060216 Oct 28 19:23:20.172639 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4641/7613] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:23:20.263017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:20.271379 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f7c61fe-3e6c-4389-b870-bfcd5ef65711 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1689 microversion: 2.1 time: 0.189305 Oct 28 19:23:20.272387 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2973/7614] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:20 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:21.298412 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:21.299125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:21.311699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:21.312579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:21.313028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:21.313757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:21.314220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:21.314655 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:21.452706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:21.460529 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3466bac9-32c2-4d58-bcd9-375e6963ac80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1681 microversion: 2.1 time: 0.167339 Oct 28 19:23:21.461118 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4642/7615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:21 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:43.656758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:43.659762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:43.662630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=24 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:43.663316 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=70 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:43.669758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.670266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.670721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.671443 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:43.671966 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:43.672407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:43.732578 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2a64e0f-33ce-46b8-80c5-98830a19ee35 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action" status: 200 len: 24561 microversion: 2.1 time: 0.081902 Oct 28 19:23:43.733513 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2974/7616] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:23:43 2022] POST /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72/action => generated 24561 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:23:51.206584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:51.207161 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:51.208685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-b5014961-6668-4449-a7b1-5d91c37c74d7 req-dfaa0d95-8079-43e5-9e12-fd97fa3c6e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a670274-c0c9-4c31-b6f4-7f1b42a7de72", "tag": "16895a74-d3b9-4773-aa43-113fc2fe7bd7"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:51.209938 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 19:23:51.211183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=32 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:51.211944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:23:51.219407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:51.220482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:51.220971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:51.221740 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:51.222269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:51.222761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:51.226203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b5014961-6668-4449-a7b1-5d91c37c74d7 req-dfaa0d95-8079-43e5-9e12-fd97fa3c6e09 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:51.226693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b5014961-6668-4449-a7b1-5d91c37c74d7 req-dfaa0d95-8079-43e5-9e12-fd97fa3c6e09 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:51.227128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-b5014961-6668-4449-a7b1-5d91c37c74d7 req-dfaa0d95-8079-43e5-9e12-fd97fa3c6e09 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:51.244097 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-b5014961-6668-4449-a7b1-5d91c37c74d7 req-dfaa0d95-8079-43e5-9e12-fd97fa3c6e09 service nova] Creating event network-changed:16895a74-d3b9-4773-aa43-113fc2fe7bd7 for instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 on n-h2-862404-2 Oct 28 19:23:51.251236 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-b5014961-6668-4449-a7b1-5d91c37c74d7 req-dfaa0d95-8079-43e5-9e12-fd97fa3c6e09 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046783 Oct 28 19:23:51.252770 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2975/7617] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:23:51.254268 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:23:51.341098 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e97cd8b-fc13-4097-aaaf-6df16b68d3ba tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 204 len: 0 microversion: 2.1 time: 0.138506 Oct 28 19:23:51.345667 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4643/7618] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:23:51 2022] DELETE /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:23:51.352124 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:51.354090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:51.362421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:51.363076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:51.363528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:51.364565 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:51.365289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:51.365938 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:51.532778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:51.544945 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8d950eb4-239f-4866-8755-fcc6b8f9aab6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1687 microversion: 2.1 time: 0.197234 Oct 28 19:23:51.545588 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2976/7619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:51 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1687 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:52.570560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:52.571214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:52.578892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:52.579383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:52.579843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:52.580548 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:52.581006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:52.581431 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:52.726541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:52.735658 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c4ad4562-ce68-4d33-89dc-48f56f04dc8b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1687 microversion: 2.1 time: 0.169455 Oct 28 19:23:52.736284 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4644/7620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:52 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:53.762759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:53.763543 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:53.771265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:53.771961 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:53.772715 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:53.773711 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:53.774201 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:53.774637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:53.832601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ceabc687-a6df-4386-88e9-6dd5197e90c3 req-06c045fe-7c77-4657-9bc4-4d1e7fb790c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a670274-c0c9-4c31-b6f4-7f1b42a7de72", "name": "network-vif-deleted", "tag": "16895a74-d3b9-4773-aa43-113fc2fe7bd7"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:53.843776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ceabc687-a6df-4386-88e9-6dd5197e90c3 req-06c045fe-7c77-4657-9bc4-4d1e7fb790c6 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:53.844289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ceabc687-a6df-4386-88e9-6dd5197e90c3 req-06c045fe-7c77-4657-9bc4-4d1e7fb790c6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:53.845039 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ceabc687-a6df-4386-88e9-6dd5197e90c3 req-06c045fe-7c77-4657-9bc4-4d1e7fb790c6 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:53.859431 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ceabc687-a6df-4386-88e9-6dd5197e90c3 req-06c045fe-7c77-4657-9bc4-4d1e7fb790c6 service nova] Creating event network-vif-deleted:16895a74-d3b9-4773-aa43-113fc2fe7bd7 for instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 on n-h2-862404-2 Oct 28 19:23:53.865211 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:23:53.865406 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ceabc687-a6df-4386-88e9-6dd5197e90c3 req-06c045fe-7c77-4657-9bc4-4d1e7fb790c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101793 Oct 28 19:23:53.865949 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4645/7621] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:23:53.875986 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-30d9ce1e-3fcd-423f-9bcd-310de7ede92b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 200 len: 1501 microversion: 2.1 time: 0.118054 Oct 28 19:23:53.876790 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2977/7622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:53 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 1501 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:23:54.905716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:54.906957 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 6a670274-c0c9-4c31-b6f4-7f1b42a7de72] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:23:54.920498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:54.920897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:54.921353 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:54.922070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:23:54.922539 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:23:54.922975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:23:54.937788 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] HTTP exception thrown: Instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 could not be found. Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Request method failure captured: Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 HTTP/1.1 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCrfJK2_86pJoFF-L-abEgPMPnTr5coqdbjFvKlNNC16w2czEKQG51gSYBJf6skaBNTAau0NKRX3EGTgJ_sovOfLU-taTPpqxL5RHjIxCR0ltRJVY78r0ZRNn1L5t_yl3ao_4JNfyLTX8miyEoVCGHbNxE5O2Bmekrpk6L0ugIltu4E Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_729fa838797f4100870d862d8aad5482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/729fa838797f4100870d862d8aad5482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2984f8cec6df45f4a5ecb582ed7e9016 Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 could not be found. Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '6a670274-c0c9-4c31-b6f4-7f1b42a7de72'} Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 could not be found. Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 could not be found. Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:23:54.939496 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 could not be found. Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Returning 404 to user: Instance 6a670274-c0c9-4c31-b6f4-7f1b42a7de72 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8767b449-5b94-423d-844b-ad96fb9bbfc6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72" status: 404 len: 111 microversion: 2.1 time: 0.042672 Oct 28 19:23:54.945237 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4646/7623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:23:54 2022] GET /compute/v2.1/servers/6a670274-c0c9-4c31-b6f4-7f1b42a7de72 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:23:58.511150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ba826ccb-52e3-4418-9bab-6d757f7f3378 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '.version_select at 0x7f78e2557af0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:23:58.517288 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba826ccb-52e3-4418-9bab-6d757f7f3378 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [db848e0d-f10a-4a4e-8dbc-0cb33444434d] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:23:59.525938 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba826ccb-52e3-4418-9bab-6d757f7f3378 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [db848e0d-f10a-4a4e-8dbc-0cb33444434d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36660. Oct 28 19:23:59.549615 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ba826ccb-52e3-4418-9bab-6d757f7f3378 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-937772490" status: 202 len: 0 microversion: 2.1 time: 1.043222 Oct 28 19:23:59.550205 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2978/7624] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 19:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-937772490 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:23:59.577904 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9adc4fe9-d415-4a5a-9d33-f2e8e9da1f03 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: .version_select at 0x7f78dc963700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-434524327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPptarlRtqqA1oTjwox861GHqT74Y5KGGmEgsMcFhbrtrB1hc8T3IP2UXOUCQ/nK0Y+d5xmV7i3hxUzqekqyNQsPFfHR+SUxGhq9TPF3445eexgN6H3Ai05jw5wlEl2vQw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:23:59.594202 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9adc4fe9-d415-4a5a-9d33-f2e8e9da1f03 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:23:59.599625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-9adc4fe9-d415-4a5a-9d33-f2e8e9da1f03 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:23:59.627591 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9adc4fe9-d415-4a5a-9d33-f2e8e9da1f03 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053651 Oct 28 19:23:59.628239 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4647/7625] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:23:59 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:05.534134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=18 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:05.539718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1170247631", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "dbfea7bb-3761-4b84-9bda-7f1347a4235d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-434524327", "security_groups": [{"name": "tempest-secgroup-smoke-2070042799"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:05.659568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] validate_networks() for [('dbfea7bb-3761-4b84-9bda-7f1347a4235d', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:24:06.159655 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:24:06.160544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:24:06.161336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:24:06.161990 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:24:06.162489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:24:06.174258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.174772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.175567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.176596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:06.177263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:06.177709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:06.198863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:24:06.205389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:24:06.226380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:24:06.230290 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:24:06.290701 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50858486-f8b0-4bec-82f0-4d126b74824c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758525 Oct 28 19:24:06.291681 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2979/7626] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:24:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:24:06.302832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:06.307988 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dfb3ba1c-5977-4598-80a6-0a8cd7d87c38 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:06.310061 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dfb3ba1c-5977-4598-80a6-0a8cd7d87c38 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:06.400599 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dfb3ba1c-5977-4598-80a6-0a8cd7d87c38 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:06.409255 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dfb3ba1c-5977-4598-80a6-0a8cd7d87c38 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1266 microversion: 2.1 time: 0.108402 Oct 28 19:24:06.410034 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4648/7627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:06 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:07.434119 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:07.435147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:07.442368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.442880 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.443337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.444098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:07.444574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:07.445019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:07.550498 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:07.560134 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ffc66391-1ff8-4861-8eb1-85b1fe0752c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1318 microversion: 2.1 time: 0.131141 Oct 28 19:24:07.560762 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2980/7628] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:07 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1318 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:08.585027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:08.585659 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:08.595185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:08.596011 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:08.596648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:08.597605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:08.598228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:08.598822 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:08.753564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:08.761837 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-610e595e-96b2-4781-80f6-259c826a2d85 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1392 microversion: 2.1 time: 0.180720 Oct 28 19:24:08.762756 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4649/7629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:08 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:09.176016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-77e94687-b542-4f6b-999e-13de7b9f9366 req-372c49bb-bc66-4d67-a778-95bde979a0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0395090d-cdaf-4827-9482-43be0c475654", "tag": "29ea136c-924c-4c3a-9f78-5f2fe4288063"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:09.188648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-77e94687-b542-4f6b-999e-13de7b9f9366 req-372c49bb-bc66-4d67-a778-95bde979a0f3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.189156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-77e94687-b542-4f6b-999e-13de7b9f9366 req-372c49bb-bc66-4d67-a778-95bde979a0f3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.189602 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-77e94687-b542-4f6b-999e-13de7b9f9366 req-372c49bb-bc66-4d67-a778-95bde979a0f3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.202941 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-77e94687-b542-4f6b-999e-13de7b9f9366 req-372c49bb-bc66-4d67-a778-95bde979a0f3 service nova] Creating event network-changed:29ea136c-924c-4c3a-9f78-5f2fe4288063 for instance 0395090d-cdaf-4827-9482-43be0c475654 on n-h1-862404-2 Oct 28 19:24:09.208330 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-77e94687-b542-4f6b-999e-13de7b9f9366 req-372c49bb-bc66-4d67-a778-95bde979a0f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036016 Oct 28 19:24:09.208946 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2981/7630] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:09.787415 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:09.787982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:09.795847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.796348 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.796791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.797500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:09.797962 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:09.798390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:09.963386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:09.971784 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dad3922e-ca9c-4f49-a989-02e086a9ac1f tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1392 microversion: 2.1 time: 0.188372 Oct 28 19:24:09.972396 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4650/7631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:09 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:10.996931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:10.997867 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:11.010017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.010525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.010986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.012481 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:11.013123 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:11.013603 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:11.160848 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:11.169694 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3cbd36e8-c1d8-4ba3-a333-76f5fa88ee29 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1392 microversion: 2.1 time: 0.178285 Oct 28 19:24:11.170290 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2982/7632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:10 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:12.192781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:12.193410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:12.200690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:12.201184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:12.201631 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:12.202339 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:12.202800 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:12.203231 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:12.339424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:12.347876 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f328a35-1ca7-4518-978b-74ae6b0d20a1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1392 microversion: 2.1 time: 0.158970 Oct 28 19:24:12.348500 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4651/7633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:12 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:13.374294 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:13.375313 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:13.383329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.383842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.384295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.385012 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:13.385475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:13.385913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:13.530632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:13.538498 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe9b97ab-0ecc-4ce4-8723-0a8c6d10009e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1392 microversion: 2.1 time: 0.168931 Oct 28 19:24:13.539083 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2983/7634] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:13 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:14.501955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6f89b570-9808-46b3-b422-96904b2762c5 req-173d9466-e702-4db7-a328-aba6d51f7941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0395090d-cdaf-4827-9482-43be0c475654", "name": "network-vif-plugged", "status": "completed", "tag": "29ea136c-924c-4c3a-9f78-5f2fe4288063"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:14.513583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6f89b570-9808-46b3-b422-96904b2762c5 req-173d9466-e702-4db7-a328-aba6d51f7941 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:14.514455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6f89b570-9808-46b3-b422-96904b2762c5 req-173d9466-e702-4db7-a328-aba6d51f7941 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:14.514751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6f89b570-9808-46b3-b422-96904b2762c5 req-173d9466-e702-4db7-a328-aba6d51f7941 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:14.526574 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6f89b570-9808-46b3-b422-96904b2762c5 req-173d9466-e702-4db7-a328-aba6d51f7941 service nova] Creating event network-vif-plugged:29ea136c-924c-4c3a-9f78-5f2fe4288063 for instance 0395090d-cdaf-4827-9482-43be0c475654 on n-h1-862404-2 Oct 28 19:24:14.532669 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6f89b570-9808-46b3-b422-96904b2762c5 req-173d9466-e702-4db7-a328-aba6d51f7941 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034918 Oct 28 19:24:14.533743 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4652/7635] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:14.562257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:14.563672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:14.570203 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:14.572179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:14.572705 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:14.573166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:14.573897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:14.574374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:14.574817 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:14.770480 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:14.778141 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed9be58d-f4b0-4258-9714-a17907d0acfc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1392 microversion: 2.1 time: 0.219910 Oct 28 19:24:14.779245 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2984/7636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:14 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1392 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:15.803510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:15.804265 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:15.810748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:15.811418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:15.813847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:15.813847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:15.813847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:15.813847 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:15.963532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:15.972576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8faa60f-c369-4290-bd2d-1396b37a67b7 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1392 microversion: 2.1 time: 0.174263 Oct 28 19:24:15.973186 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4653/7637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:15 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:16.999538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:17.000150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:17.002828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:17.004082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:17.010648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:17.011146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:17.011594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:17.012696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:17.013163 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:17.013598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:17.164340 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:17.173470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a82e0df-8bd7-41bc-a16b-b180c2e87ee9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1563 microversion: 2.1 time: 0.178292 Oct 28 19:24:17.174192 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2985/7638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:16 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:17.196352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:17.196992 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:17.200245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:17.205807 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:17.206302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:17.206755 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:17.207463 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:17.207951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:17.208386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:17.358046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:17.367054 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-64a78c97-1844-4200-a1cd-4b6f0012d8fe tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1563 microversion: 2.1 time: 0.174523 Oct 28 19:24:17.367655 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4654/7639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:17 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:19.371347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:24:19.372003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:19.381110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-848eceed-916c-45af-92cf-21e124c59e1a req-c5d6a398-bc2f-43f1-bbae-be7e224db749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0395090d-cdaf-4827-9482-43be0c475654", "tag": "29ea136c-924c-4c3a-9f78-5f2fe4288063"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:19.392577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-848eceed-916c-45af-92cf-21e124c59e1a req-c5d6a398-bc2f-43f1-bbae-be7e224db749 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:19.393066 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-848eceed-916c-45af-92cf-21e124c59e1a req-c5d6a398-bc2f-43f1-bbae-be7e224db749 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:19.393503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-848eceed-916c-45af-92cf-21e124c59e1a req-c5d6a398-bc2f-43f1-bbae-be7e224db749 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:19.399209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:19.399967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:19.400418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:19.401141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:19.401606 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:19.402357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:19.408731 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-848eceed-916c-45af-92cf-21e124c59e1a req-c5d6a398-bc2f-43f1-bbae-be7e224db749 service nova] Creating event network-changed:29ea136c-924c-4c3a-9f78-5f2fe4288063 for instance 0395090d-cdaf-4827-9482-43be0c475654 on n-h1-862404-2 Oct 28 19:24:19.414039 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-848eceed-916c-45af-92cf-21e124c59e1a req-c5d6a398-bc2f-43f1-bbae-be7e224db749 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036581 Oct 28 19:24:19.414969 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4655/7640] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:24:19.650637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:24:19.659561 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b99ced60-8c89-45f5-99c5-32100b09faaa tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1563 microversion: 2.1 time: 0.292021 Oct 28 19:24:19.660658 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2986/7641] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:24:19 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1563 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:24:52.963739 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:52.964433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=34 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:24:52.969561 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:24:52.972295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:24:52.980455 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:52.981267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:52.981973 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:52.982941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:24:52.983411 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:24:52.983874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:24:53.039208 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76d9eb1e-b8d0-4d9d-89a6-84b50ce25958 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action" status: 200 len: 24573 microversion: 2.1 time: 0.077331 Oct 28 19:24:53.040179 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4656/7642] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:24:52 2022] POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:25:23.446960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b19b4215-5800-479e-890b-b5653328dab9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:23.449234 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=5 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:23.449898 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=40 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:23.458671 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b4215-5800-479e-890b-b5653328dab9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.459180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b4215-5800-479e-890b-b5653328dab9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.459629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b19b4215-5800-479e-890b-b5653328dab9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.483352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b19b4215-5800-479e-890b-b5653328dab9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Going to try to stop instance {{(pid=120679) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Oct 28 19:25:23.526912 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b19b4215-5800-479e-890b-b5653328dab9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action" status: 202 len: 0 microversion: 2.1 time: 0.087665 Oct 28 19:25:23.527700 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2987/7643] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:23 2022] POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:23.538036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:23.539397 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:23.542325 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:23.544513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:25:23.549644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.550206 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.550830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.551606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:23.552825 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:23.553293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:23.711294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:23.720293 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-db3ba297-2e14-44fc-a694-7fbb1c5ed6ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.187098 Oct 28 19:25:23.720879 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4657/7644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:23 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:24.746841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:24.747780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:24.755548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.756076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.756523 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.757240 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:24.757709 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:24.758146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:24.902303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:24.911043 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eacbc8aa-05f9-4535-8304-d9d4b859dcd2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.168380 Oct 28 19:25:24.911639 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2988/7645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:24 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:25.935878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:25.936537 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:25.945033 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.945533 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.945981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:25.946698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:25.947172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:25.947616 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:26.089773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:26.098290 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3eeff83-842b-492c-8b18-57c0e36b63e9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.166344 Oct 28 19:25:26.098890 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4658/7646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:25 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:27.122357 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:27.122973 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:27.130646 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:27.131145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:27.131591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:27.132338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:27.132801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:27.133237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:27.268527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:27.276750 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-187542d0-21db-4472-b40a-0322b92179d2 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.158356 Oct 28 19:25:27.277353 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2989/7647] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:27 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:28.300958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:28.301564 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:28.308635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:28.309125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:28.309565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:28.310275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:28.310744 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:28.311168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:28.451626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:28.460609 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a54ba5cf-3183-4d16-b6b5-c787af3426f9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.164349 Oct 28 19:25:28.461404 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4659/7648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:28 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:29.484046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:29.484659 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:29.492372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:29.492871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:29.493329 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:29.494053 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:29.494525 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:29.494963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:29.702038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:29.712025 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-91fa3778-8ad2-4ced-ad23-48200febbb59 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.231901 Oct 28 19:25:29.712621 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2990/7649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:29 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:30.736931 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:30.737547 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:30.744028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:30.744518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:30.744956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:30.745653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:30.746107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:30.746528 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:30.889969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:30.899054 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8b7bc83-dead-4917-8116-a182b90bfb47 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.167069 Oct 28 19:25:30.899651 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4660/7650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:30 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:31.923515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:31.924179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:31.931175 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:31.931675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:31.932153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:31.932875 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:31.933348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:31.933793 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:32.080083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:32.088128 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd3197a8-83f8-45b4-94c9-1365324237b3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.168754 Oct 28 19:25:32.088730 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2991/7651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:31 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:33.112810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:33.113489 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:33.116114 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:25:33.116266 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:25:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 (ip 10.222.0.16) !!! Oct 28 19:25:33.123360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:33.123876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:33.124379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:33.125094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:33.126274 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:33.126758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:33.266781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:33.275435 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e3fc4425-3a4d-45c3-9409-12f95dc25e44 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1690 microversion: 2.1 time: 0.167141 Oct 28 19:25:33.276068 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4661/7652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:33 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:34.299672 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:34.300336 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:34.307782 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:34.308327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:34.308781 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:34.309500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:34.309969 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:34.310409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:34.456136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:34.464957 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d9f009a-056f-46f6-9e75-2cb22be4dec5 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1667 microversion: 2.1 time: 0.169740 Oct 28 19:25:34.465561 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2992/7653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:34 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:35.561853 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:35.564878 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:35.572042 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.572541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.572987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:35.573702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.574165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.574593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:35.628710 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e65857e6-0d95-4c61-a79c-ebedc53efe80 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action" status: 200 len: 36917 microversion: 2.1 time: 0.070607 Oct 28 19:25:35.629461 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4662/7654] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:35 2022] POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action => generated 36917 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:25:35.644004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f5666351-b69a-4e29-a2dc-619e0461c8ae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:25:35.651283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5666351-b69a-4e29-a2dc-619e0461c8ae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.651788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5666351-b69a-4e29-a2dc-619e0461c8ae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.652269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f5666351-b69a-4e29-a2dc-619e0461c8ae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:35.677016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f5666351-b69a-4e29-a2dc-619e0461c8ae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Going to try to start instance {{(pid=120679) start /opt/stack/nova/nova/compute/api.py:2787}} Oct 28 19:25:35.722510 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f5666351-b69a-4e29-a2dc-619e0461c8ae tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action" status: 202 len: 0 microversion: 2.1 time: 0.083193 Oct 28 19:25:35.723127 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2993/7655] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:25:35 2022] POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:25:35.732318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:35.733028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:35.741706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.742349 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.742802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:35.743610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:35.744162 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:35.744724 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:35.902158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:35.910415 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2e631cd-b22e-470b-ad36-73d5ce6aa8de tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1676 microversion: 2.1 time: 0.182436 Oct 28 19:25:35.911021 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4663/7656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:35 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:25:36.936202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:25:36.936927 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:25:36.944178 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:36.944684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:36.945143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:36.945869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:25:36.946344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:25:36.946785 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:25:37.088862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:25:37.097810 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-08a02e37-88c0-4f61-bba8-76298450ca12 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1680 microversion: 2.1 time: 0.166700 Oct 28 19:25:37.098715 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2994/7657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:25:36 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:09.331835 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:09.334070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:09.336974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=14 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:09.337636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=40 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:09.343623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:09.344137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:09.344596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:09.345286 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:09.346393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:09.347086 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:09.402867 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9567b2e4-0126-4933-91ae-8de7a82cc4e1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action" status: 200 len: 61476 microversion: 2.1 time: 0.075657 Oct 28 19:26:09.403567 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4664/7658] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:26:09 2022] POST /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654/action => generated 61476 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:26:33.301358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:33.301995 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:33.303763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9007d634-5ae4-4550-80d2-180c045b5fe0 req-3139f862-6231-457c-86d1-37de62fdbc3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0395090d-cdaf-4827-9482-43be0c475654", "tag": "29ea136c-924c-4c3a-9f78-5f2fe4288063"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:33.304837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=16 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:33.305644 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:33.307390 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 28 19:26:33.308534 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:26:33.308837 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 (ip 10.222.0.16) !!! Oct 28 19:26:33.312109 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:33.312788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:33.318056 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:33.318599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:33.319224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:33.320079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:33.320625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:33.321144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:33.321584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9007d634-5ae4-4550-80d2-180c045b5fe0 req-3139f862-6231-457c-86d1-37de62fdbc3b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:33.322290 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9007d634-5ae4-4550-80d2-180c045b5fe0 req-3139f862-6231-457c-86d1-37de62fdbc3b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:33.323372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9007d634-5ae4-4550-80d2-180c045b5fe0 req-3139f862-6231-457c-86d1-37de62fdbc3b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:33.339615 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9007d634-5ae4-4550-80d2-180c045b5fe0 req-3139f862-6231-457c-86d1-37de62fdbc3b service nova] Creating event network-changed:29ea136c-924c-4c3a-9f78-5f2fe4288063 for instance 0395090d-cdaf-4827-9482-43be0c475654 on n-h1-862404-2 Oct 28 19:26:33.345019 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9007d634-5ae4-4550-80d2-180c045b5fe0 req-3139f862-6231-457c-86d1-37de62fdbc3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046031 Oct 28 19:26:33.346681 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4665/7659] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:26:33.354494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:26:33.437843 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-99e2c120-ec7d-4610-b812-7abc06d3d326 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 204 len: 0 microversion: 2.1 time: 0.140790 Oct 28 19:26:33.438736 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2995/7660] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:26:33 2022] DELETE /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:26:33.448583 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:33.449312 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:33.456723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:33.457498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:33.458041 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:33.459405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:33.459405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:33.459645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:33.608737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:33.617959 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81225fdb-da0c-4b89-a7db-89e8a9839978 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1686 microversion: 2.1 time: 0.173706 Oct 28 19:26:33.618645 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4666/7661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:33 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:34.643089 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:34.644166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:34.651319 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:34.651977 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:34.652527 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:34.653479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:34.654017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:34.654521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:34.856117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:34.864090 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fbd95b12-a943-4347-92fe-14dd9e0d5393 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1686 microversion: 2.1 time: 0.225803 Oct 28 19:26:34.864796 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2996/7662] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:34 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1686 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:35.615220 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-47bf3b32-2cb7-419b-b2dc-69c9af971737 req-a5e74a75-0085-4a58-89b4-f9ee314b9aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0395090d-cdaf-4827-9482-43be0c475654", "name": "network-vif-deleted", "tag": "29ea136c-924c-4c3a-9f78-5f2fe4288063"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:35.629418 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-47bf3b32-2cb7-419b-b2dc-69c9af971737 req-a5e74a75-0085-4a58-89b4-f9ee314b9aa2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:35.629912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-47bf3b32-2cb7-419b-b2dc-69c9af971737 req-a5e74a75-0085-4a58-89b4-f9ee314b9aa2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:35.630408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-47bf3b32-2cb7-419b-b2dc-69c9af971737 req-a5e74a75-0085-4a58-89b4-f9ee314b9aa2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:35.641483 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-47bf3b32-2cb7-419b-b2dc-69c9af971737 req-a5e74a75-0085-4a58-89b4-f9ee314b9aa2 service nova] Creating event network-vif-deleted:29ea136c-924c-4c3a-9f78-5f2fe4288063 for instance 0395090d-cdaf-4827-9482-43be0c475654 on n-h1-862404-2 Oct 28 19:26:35.647493 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-47bf3b32-2cb7-419b-b2dc-69c9af971737 req-a5e74a75-0085-4a58-89b4-f9ee314b9aa2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092703 Oct 28 19:26:35.648384 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4667/7663] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:35.889764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:35.890407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:35.898944 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:35.899447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:35.899941 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:35.900670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:35.901136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:35.901579 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:35.938832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:35.939507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:35.940374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:35.940871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lazy-loading 'fault' on Instance uuid 0395090d-cdaf-4827-9482-43be0c475654 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:26:35.990808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:35.999093 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a5a3344-518e-4f96-a7c6-7ef693f79498 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 200 len: 1356 microversion: 2.1 time: 0.113180 Oct 28 19:26:35.999608 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2997/7664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:35 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 1356 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:37.030829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:37.031453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 0395090d-cdaf-4827-9482-43be0c475654] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:37.038483 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:37.038970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:37.039408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:37.040135 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:37.040593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:37.041024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:37.054909 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] HTTP exception thrown: Instance 0395090d-cdaf-4827-9482-43be0c475654 could not be found. Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Request method failure captured: Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 HTTP/1.1 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXCrfJK2_86pJoFF-L-abEgPMPnTr5coqdbjFvKlNNC16w2czEKQG51gSYBJf6skaBNTAau0NKRX3EGTgJ_sovOfLU-taTPpqxL5RHjIxCR0ltRJVY78r0ZRNn1L5t_yl3ao_4JNfyLTX8miyEoVCGHbNxE5O2Bmekrpk6L0ugIltu4E Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_729fa838797f4100870d862d8aad5482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/729fa838797f4100870d862d8aad5482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 2984f8cec6df45f4a5ecb582ed7e9016 Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 0395090d-cdaf-4827-9482-43be0c475654 could not be found. Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '0395090d-cdaf-4827-9482-43be0c475654'} Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0395090d-cdaf-4827-9482-43be0c475654 could not be found. Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0395090d-cdaf-4827-9482-43be0c475654 could not be found. Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:26:37.056693 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0395090d-cdaf-4827-9482-43be0c475654 could not be found. Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Returning 404 to user: Instance 0395090d-cdaf-4827-9482-43be0c475654 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc1d2e71-3d22-4b38-8ed1-0b0f6fdf6edc tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654" status: 404 len: 111 microversion: 2.1 time: 0.032739 Oct 28 19:26:37.061829 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4668/7665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:37 2022] GET /compute/v2.1/servers/0395090d-cdaf-4827-9482-43be0c475654 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:26:40.208897 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-15aabd10-9feb-47cd-a7a8-d9a66f735a4e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '.version_select at 0x7f78dd3b04c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:40.234513 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-15aabd10-9feb-47cd-a7a8-d9a66f735a4e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-434524327" status: 202 len: 0 microversion: 2.1 time: 0.029603 Oct 28 19:26:40.237452 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2998/7666] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 19:26:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-434524327 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:26:40.270376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e126417-b12b-4534-b65d-61736a5eac40 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: .version_select at 0x7f78dd555f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-926810260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL14PSF+nvK3GFAI7XB7sjNqf6CJhK0qb5LuHUZmPILGAY0kVFUCenzDonU4NsjCpYZTwrOzQH/YCZoSqkMlznFI969jXpjWYgBAv03C/dAS3+kzDIwy2km4NKwEoruRVg=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:40.290475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-8e126417-b12b-4534-b65d-61736a5eac40 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:26:40.297356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-8e126417-b12b-4534-b65d-61736a5eac40 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:26:40.326301 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e126417-b12b-4534-b65d-61736a5eac40 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.060943 Oct 28 19:26:40.327081 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4669/7667] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:26:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:46.134806 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1432096953", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "networks": [{"uuid": "614d0587-1a97-441e-88e2-fcd44577b618"}], "key_name": "tempest-TestNetworkAdvancedServerOps-926810260", "security_groups": [{"name": "tempest-secgroup-smoke-744817557"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:46.160449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:46.309885 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] validate_networks() for [('614d0587-1a97-441e-88e2-fcd44577b618', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:26:47.115013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:26:47.115666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:26:47.116486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:26:47.116915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:26:47.117490 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:26:47.126568 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.127064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.127627 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.128540 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:47.131637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:47.131637 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:47.147699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:26:47.153250 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Getting quotas for user 2984f8cec6df45f4a5ecb582ed7e9016 and project 729fa838797f4100870d862d8aad5482. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:26:47.167323 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:26:47.169721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:26:47.219417 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b85818d-26a3-4742-8dce-16d68e5b6ba0 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.088594 Oct 28 19:26:47.226899 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2999/7668] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:26:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:26:47.230046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=12 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:47.234386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95b169b9-d7d7-4715-91e7-ecfd1bd784ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:47.235114 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95b169b9-d7d7-4715-91e7-ecfd1bd784ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:47.309334 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95b169b9-d7d7-4715-91e7-ecfd1bd784ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:47.318266 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95b169b9-d7d7-4715-91e7-ecfd1bd784ff tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1266 microversion: 2.1 time: 0.089954 Oct 28 19:26:47.319683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4670/7669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:47 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:48.345022 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:48.356282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:48.364425 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:48.365172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:48.365928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:48.367840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:48.368487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:48.369283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:48.487029 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:48.499381 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-05ddf209-21dc-4acb-a26f-d6b89d090b4a tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1336 microversion: 2.1 time: 0.158413 Oct 28 19:26:48.500356 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3000/7670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:48 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1336 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:26:49.523302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:49.524105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:49.532605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:49.533661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:49.534214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:49.535215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:49.535893 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:49.536587 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:49.703280 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:49.711576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-605e67e6-802b-4937-a50a-e5537783c946 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1391 microversion: 2.1 time: 0.192679 Oct 28 19:26:49.712195 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4671/7671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:49 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:49.886462 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4f2f4551-b61c-4c10-9259-6333b1d21a1b req-df23eb86-ac54-4774-a7e8-fae1876c2985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecb44ed-c148-40be-a9b4-65636eca2a0c", "tag": "0efc4621-7d9b-48e3-af8e-1b8acf426ee4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:49.897924 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4f2f4551-b61c-4c10-9259-6333b1d21a1b req-df23eb86-ac54-4774-a7e8-fae1876c2985 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:49.898420 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4f2f4551-b61c-4c10-9259-6333b1d21a1b req-df23eb86-ac54-4774-a7e8-fae1876c2985 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:49.898862 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4f2f4551-b61c-4c10-9259-6333b1d21a1b req-df23eb86-ac54-4774-a7e8-fae1876c2985 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:49.912350 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4f2f4551-b61c-4c10-9259-6333b1d21a1b req-df23eb86-ac54-4774-a7e8-fae1876c2985 service nova] Creating event network-changed:0efc4621-7d9b-48e3-af8e-1b8acf426ee4 for instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c on n-h1-862404-2 Oct 28 19:26:49.917662 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4f2f4551-b61c-4c10-9259-6333b1d21a1b req-df23eb86-ac54-4774-a7e8-fae1876c2985 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036020 Oct 28 19:26:49.918428 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3001/7672] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:50.734608 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:50.735258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:50.743453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:50.743967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:50.744408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:50.745139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:50.745597 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:50.746024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:50.881956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:50.890048 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f9e34d1-8b69-4d2c-ba01-0607ef67b767 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1391 microversion: 2.1 time: 0.159377 Oct 28 19:26:50.900253 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4672/7673] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:50 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:51.913946 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:51.914658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:51.921843 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:51.922334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:51.922779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:51.924188 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:51.924736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:51.925172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:52.063333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:52.073007 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-64b84de5-b78f-4e01-958c-5eaef1ae8b10 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1391 microversion: 2.1 time: 0.163208 Oct 28 19:26:52.073801 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3002/7674] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:51 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:53.096391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:53.097019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:53.103920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.104422 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.104864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:53.105563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:53.106029 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:53.106461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:53.252318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:53.260089 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa5921ac-b77f-4211-8052-a43667cb0219 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1391 microversion: 2.1 time: 0.168062 Oct 28 19:26:53.260690 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4673/7675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:53 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:54.284666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:54.285207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:54.292071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:54.292592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:54.293046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:54.293762 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:54.294227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:54.294669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:54.427959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:54.435770 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7b29d623-ded9-4846-9d91-4c770d98f308 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1391 microversion: 2.1 time: 0.155798 Oct 28 19:26:54.436393 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3003/7676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:54 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:55.459264 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:55.459925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:55.466768 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:55.467257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:55.467694 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:55.468416 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:55.469085 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:55.469510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:55.614118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:55.624526 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08c0189c-a99b-48ea-97c0-39898ad1033b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1391 microversion: 2.1 time: 0.169178 Oct 28 19:26:55.625132 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4674/7677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:55 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:56.653983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:56.654658 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:56.661643 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:56.662143 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:56.662600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:56.663310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:56.663787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:56.664258 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:56.802554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:56.810252 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1a773482-9219-4cd0-b128-01f378f0b620 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1391 microversion: 2.1 time: 0.160228 Oct 28 19:26:56.810838 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3004/7678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:56 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:57.238887 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-35d1bed6-b63c-4d07-b9bc-c75cd8e6c788 req-84a037ce-73e9-41ac-bb52-5c3018ec84e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ecb44ed-c148-40be-a9b4-65636eca2a0c", "name": "network-vif-plugged", "status": "completed", "tag": "0efc4621-7d9b-48e3-af8e-1b8acf426ee4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:26:57.249159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-35d1bed6-b63c-4d07-b9bc-c75cd8e6c788 req-84a037ce-73e9-41ac-bb52-5c3018ec84e8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:57.249723 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-35d1bed6-b63c-4d07-b9bc-c75cd8e6c788 req-84a037ce-73e9-41ac-bb52-5c3018ec84e8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:57.250172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-35d1bed6-b63c-4d07-b9bc-c75cd8e6c788 req-84a037ce-73e9-41ac-bb52-5c3018ec84e8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:57.261926 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-35d1bed6-b63c-4d07-b9bc-c75cd8e6c788 req-84a037ce-73e9-41ac-bb52-5c3018ec84e8 service nova] Creating event network-vif-plugged:0efc4621-7d9b-48e3-af8e-1b8acf426ee4 for instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c on n-h1-862404-2 Oct 28 19:26:57.267378 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-35d1bed6-b63c-4d07-b9bc-c75cd8e6c788 req-84a037ce-73e9-41ac-bb52-5c3018ec84e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097187 Oct 28 19:26:57.268205 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4675/7679] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:26:57.834295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:57.834913 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:57.837914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:57.838635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:57.846100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:57.846608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:57.847061 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:57.847774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:57.848283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:57.848721 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:57.989347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:57.997584 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b76028da-2431-48e4-ab17-9eb7e971d6b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1391 microversion: 2.1 time: 0.167191 Oct 28 19:26:57.998174 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3005/7680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:57 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:59.021417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:59.022050 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:59.024027 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:26:59.030399 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.030900 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.031368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.032088 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.033313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.033990 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.178080 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:59.185891 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0973b1c5-3a0f-4245-bcb2-ec37bc34d0a6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1562 microversion: 2.1 time: 0.169107 Oct 28 19:26:59.186480 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4676/7681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:59 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:26:59.209972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:26:59.210609 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:26:59.217298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.217803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.218261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.218979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:26:59.219455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:26:59.220438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:26:59.362937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:26:59.371005 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-66b00080-d00b-421f-b162-8aedf6783ee1 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1562 microversion: 2.1 time: 0.165675 Oct 28 19:26:59.371582 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3006/7682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:26:59 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:01.016881 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:27:01.017695 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:27:01.022980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9794dde8-52c6-4ee4-b136-40c4e43bcf4d req-91499c11-f21f-4b77-a923-7d4ad4f9b13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecb44ed-c148-40be-a9b4-65636eca2a0c", "tag": "0efc4621-7d9b-48e3-af8e-1b8acf426ee4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:01.024073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:01.024833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:01.025503 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:01.026461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:01.027150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:01.027809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:01.036442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9794dde8-52c6-4ee4-b136-40c4e43bcf4d req-91499c11-f21f-4b77-a923-7d4ad4f9b13b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:01.037014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9794dde8-52c6-4ee4-b136-40c4e43bcf4d req-91499c11-f21f-4b77-a923-7d4ad4f9b13b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:01.037515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9794dde8-52c6-4ee4-b136-40c4e43bcf4d req-91499c11-f21f-4b77-a923-7d4ad4f9b13b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:01.051713 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9794dde8-52c6-4ee4-b136-40c4e43bcf4d req-91499c11-f21f-4b77-a923-7d4ad4f9b13b service nova] Creating event network-changed:0efc4621-7d9b-48e3-af8e-1b8acf426ee4 for instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c on n-h1-862404-2 Oct 28 19:27:01.058008 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9794dde8-52c6-4ee4-b136-40c4e43bcf4d req-91499c11-f21f-4b77-a923-7d4ad4f9b13b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040602 Oct 28 19:27:01.058721 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3007/7683] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:27:01.188007 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:27:01.207788 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d00f7ef4-462b-4589-8723-45e53ebb2af9 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1562 microversion: 2.1 time: 0.195038 Oct 28 19:27:01.208488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4677/7684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:27:01 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1562 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:27:34.515228 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:34.516005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=42 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:27:34.520261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:27:34.522528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:27:34.530138 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:34.530667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:34.531115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:34.531844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:27:34.532327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:27:34.532876 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:27:34.588156 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e53a4aac-4a35-42fa-b9c5-20d1944fd889 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action" status: 200 len: 24568 microversion: 2.1 time: 0.074702 Oct 28 19:27:34.588802 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3008/7685] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:27:34 2022] POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:28:05.045466 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:05.046133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=38 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:05.246974 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:05.247519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:05.253851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:05.254340 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:05.254781 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.255478 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:05.255967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:05.256403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.280064 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lazy-loading 'flavor' on Instance uuid 2ecb44ed-c148-40be-a9b4-65636eca2a0c {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:28:05.349828 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c05f165-3c0a-4b5d-8d36-34b94af416e3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.305366 Oct 28 19:28:05.350682 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4678/7686] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:05 2022] POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:28:05.360501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:05.361223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:05.363734 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:05.364953 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:05.371760 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:05.372288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:05.372745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.373459 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:05.374004 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:05.374447 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:05.515939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:05.524375 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-16bce311-e7a6-4b1e-b364-7dd0d561a66c tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1688 microversion: 2.1 time: 0.168401 Oct 28 19:28:05.524949 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3009/7687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:05 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:06.549480 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:06.550193 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:06.558808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:06.559303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:06.559749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:06.560479 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:06.560938 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:06.561368 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:06.821554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:06.829332 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad398031-a52c-4b07-9769-06535f8843db tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1688 microversion: 2.1 time: 0.284260 Oct 28 19:28:06.829913 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4679/7688] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:06 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1688 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:07.855031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:07.855661 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:07.863378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:07.863892 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:07.864359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:07.865073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:07.865541 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:07.865985 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:07.999522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:08.007947 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dff7cbea-a0ef-478f-a1c2-07799614b564 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1671 microversion: 2.1 time: 0.156581 Oct 28 19:28:08.008485 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3010/7689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:07 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:09.107257 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:09.109650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:09.116636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.118121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.118673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.119376 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.119851 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.120281 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.171749 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f2642557-bb5e-4015-9cc4-3f9ce4061d1e tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action" status: 200 len: 36065 microversion: 2.1 time: 0.068211 Oct 28 19:28:09.172506 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4680/7690] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:09 2022] POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action => generated 36065 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:28:09.185210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:09.185900 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:09.193079 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.193742 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.194196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.195094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.196002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.196451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.265473 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed748b4e-7031-494d-bb46-3828a4439e0b tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action" status: 202 len: 0 microversion: 2.1 time: 0.084045 Oct 28 19:28:09.266196 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3011/7691] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:09 2022] POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:28:09.276096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:09.276813 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:09.284239 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.284734 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.285182 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.285902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:09.286440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:09.286877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:09.435922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:09.444388 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fded9f14-a4c0-4c3b-82ab-24658e65f3b8 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1677 microversion: 2.1 time: 0.172971 Oct 28 19:28:09.444980 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4681/7692] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:09 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:10.470281 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:10.470986 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:10.477295 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:10.477789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:10.478237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:10.478939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:10.479398 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:10.479855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:10.621489 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:10.629491 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25c2ec09-37b0-440b-ae2b-5b009e6e2ecd tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1677 microversion: 2.1 time: 0.164343 Oct 28 19:28:10.630074 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3012/7693] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:10 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:11.654262 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:11.654952 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:11.661721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:11.662204 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:11.662639 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:11.663333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:11.663789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:11.664380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:11.803798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:11.812111 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e0a38eb-cac5-4ad7-9838-75dba56ef901 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1680 microversion: 2.1 time: 0.161760 Oct 28 19:28:11.812702 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4682/7694] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:11 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:11.910257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:11.912499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:11.919736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:11.920474 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:11.921149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:11.922327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:11.922947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:11.923389 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:11.969069 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7825f494-7d94-4785-8760-baf851a7f329 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action" status: 200 len: 36065 microversion: 2.1 time: 0.063327 Oct 28 19:28:11.969757 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3013/7695] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:28:11 2022] POST /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c/action => generated 36065 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 19:28:13.017464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:13.017997 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:13.020130 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-32cd280b-33e9-452e-80c8-2e81e9fb066b req-1f3dae1b-6b77-4eb6-b95b-7e5d49417c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecb44ed-c148-40be-a9b4-65636eca2a0c", "tag": "0efc4621-7d9b-48e3-af8e-1b8acf426ee4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:13.027546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.028074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.028593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.029386 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.029839 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.030563 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.036577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-32cd280b-33e9-452e-80c8-2e81e9fb066b req-1f3dae1b-6b77-4eb6-b95b-7e5d49417c6b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.037153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-32cd280b-33e9-452e-80c8-2e81e9fb066b req-1f3dae1b-6b77-4eb6-b95b-7e5d49417c6b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.038015 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-32cd280b-33e9-452e-80c8-2e81e9fb066b req-1f3dae1b-6b77-4eb6-b95b-7e5d49417c6b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.053574 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-32cd280b-33e9-452e-80c8-2e81e9fb066b req-1f3dae1b-6b77-4eb6-b95b-7e5d49417c6b service nova] Creating event network-changed:0efc4621-7d9b-48e3-af8e-1b8acf426ee4 for instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c on n-h1-862404-2 Oct 28 19:28:13.059426 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:28:13.061713 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-32cd280b-33e9-452e-80c8-2e81e9fb066b req-1f3dae1b-6b77-4eb6-b95b-7e5d49417c6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045874 Oct 28 19:28:13.062401 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3014/7696] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:13.159421 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5ffc9e05-714b-4794-9d7b-612f7d3a7aef tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 204 len: 0 microversion: 2.1 time: 0.145803 Oct 28 19:28:13.162493 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4683/7697] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:28:13 2022] DELETE /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:28:13.171220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:13.172007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:13.180676 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.181427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.181943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.182967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:13.183784 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:13.184266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:13.350791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:13.359473 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae335951-30e4-4337-ba87-b70c2e8ecaf6 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1686 microversion: 2.1 time: 0.193424 Oct 28 19:28:13.360177 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3015/7698] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:13 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:14.386741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:14.387642 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:14.394692 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:14.395183 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:14.395623 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:14.396356 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:14.396814 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:14.397237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:14.534390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:14.543087 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d2112623-f9b7-4bcb-86db-bdbf0ddb60f3 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1686 microversion: 2.1 time: 0.162097 Oct 28 19:28:14.543684 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4684/7699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:14 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:15.323605 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-48d6c8da-f28d-400d-b389-f892cbf9fdb6 req-fd364769-a0eb-4889-9022-0c4a1eb8a5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ecb44ed-c148-40be-a9b4-65636eca2a0c", "name": "network-vif-deleted", "tag": "0efc4621-7d9b-48e3-af8e-1b8acf426ee4"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:15.335172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-48d6c8da-f28d-400d-b389-f892cbf9fdb6 req-fd364769-a0eb-4889-9022-0c4a1eb8a5f8 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.336352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-48d6c8da-f28d-400d-b389-f892cbf9fdb6 req-fd364769-a0eb-4889-9022-0c4a1eb8a5f8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.336765 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-48d6c8da-f28d-400d-b389-f892cbf9fdb6 req-fd364769-a0eb-4889-9022-0c4a1eb8a5f8 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.348245 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-48d6c8da-f28d-400d-b389-f892cbf9fdb6 req-fd364769-a0eb-4889-9022-0c4a1eb8a5f8 service nova] Creating event network-vif-deleted:0efc4621-7d9b-48e3-af8e-1b8acf426ee4 for instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c on n-h1-862404-2 Oct 28 19:28:15.353281 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-48d6c8da-f28d-400d-b389-f892cbf9fdb6 req-fd364769-a0eb-4889-9022-0c4a1eb8a5f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034156 Oct 28 19:28:15.353885 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3016/7700] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:15.567218 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:15.568079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:15.575964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.576458 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.576901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.577600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.578059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.578502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.612032 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:15.612534 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:15.612985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:15.613445 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lazy-loading 'fault' on Instance uuid 2ecb44ed-c148-40be-a9b4-65636eca2a0c {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:28:15.664799 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2984f8cec6df45f4a5ecb582ed7e9016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729fa838797f4100870d862d8aad5482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:15.673001 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-963eeb30-0943-4e53-84f9-39d5a40f42c4 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 200 len: 1356 microversion: 2.1 time: 0.109699 Oct 28 19:28:15.673693 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4685/7701] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:15 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:16.700507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:16.701223 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] [instance: 2ecb44ed-c148-40be-a9b4-65636eca2a0c] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:16.707386 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:16.707916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:16.708368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:16.709070 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:16.709548 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:16.709982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:16.726233 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] HTTP exception thrown: Instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c could not be found. Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Request method failure captured: Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c HTTP/1.1 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXCrfJK2_86pJoFF-L-abEgPMPnTr5coqdbjFvKlNNC16w2czEKQG51gSYBJf6skaBNTAau0NKRX3EGTgJ_sovOfLU-taTPpqxL5RHjIxCR0ltRJVY78r0ZRNn1L5t_yl3ao_4JNfyLTX8miyEoVCGHbNxE5O2Bmekrpk6L0ugIltu4E Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/729fa838797f4100870d862d8aad5482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_729fa838797f4100870d862d8aad5482", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/729fa838797f4100870d862d8aad5482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: 729fa838797f4100870d862d8aad5482 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-244442588 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 2984f8cec6df45f4a5ecb582ed7e9016 Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestNetworkAdvancedServerOps-244442588-project Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c could not be found. Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '2ecb44ed-c148-40be-a9b4-65636eca2a0c'} Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c could not be found. Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c could not be found. Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.728102 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c could not be found. Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Returning 404 to user: Instance 2ecb44ed-c148-40be-a9b4-65636eca2a0c could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5ee1b6a6-e63e-4d38-956c-8be03fa7b22d tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c" status: 404 len: 111 microversion: 2.1 time: 0.035523 Oct 28 19:28:16.734535 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3017/7702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:16 2022] GET /compute/v2.1/servers/2ecb44ed-c148-40be-a9b4-65636eca2a0c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:28:19.924982 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-103fcaa0-6972-4ce6-a295-ca845bf71396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] Calling method '.version_select at 0x7f78dc92f1f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:19.968745 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-103fcaa0-6972-4ce6-a295-ca845bf71396 tempest-TestNetworkAdvancedServerOps-244442588 tempest-TestNetworkAdvancedServerOps-244442588-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-926810260" status: 202 len: 0 microversion: 2.1 time: 0.047671 Oct 28 19:28:19.969570 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4686/7703] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 19:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-926810260 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 19:28:31.435361 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=18 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:31.436169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:31.620585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9cd45fee-d7e6-4f5f-986f-1ae9bd722026 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Action: 'create', calling method: .version_select at 0x7f78dc2a6e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-295411503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvZuLVKdB6keAKz7EzX6UFZdm7bKYKtaEYKesO4p3SZgk96BC9jsVc2kZJ6Byvxz36hfQQyiaUfweDMmksLc2VDePCfN6lhXhP9dYKKh7H/02Icb0D4KHMy3jtXAj4QGA=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:31.640165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9cd45fee-d7e6-4f5f-986f-1ae9bd722026 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Getting quotas for project da1eae9bcf3c431980a72201c2b6ac77. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:31.646669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-9cd45fee-d7e6-4f5f-986f-1ae9bd722026 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Getting quotas for user a49effaa45a8412dae0671ad54fd60e9 and project da1eae9bcf3c431980a72201c2b6ac77. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:31.677778 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9cd45fee-d7e6-4f5f-986f-1ae9bd722026 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.243986 Oct 28 19:28:31.678830 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3018/7704] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:28:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:32.723636 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2142869428", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-295411503", "security_groups": [{"name": "tempest-secgroup-smoke-1342317795"}], "networks": [{"uuid": "d8e461fb-e7fa-4cc2-9d99-be34a705f771"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:32.734005 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:32.734645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:32.865387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] validate_networks() for [('d8e461fb-e7fa-4cc2-9d99-be34a705f771', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:28:33.460738 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:28:33.461258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:28:33.462440 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:28:33.462961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:28:33.463450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:28:33.474344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.474976 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.476474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.477983 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:33.478875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:33.479524 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:33.500266 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Getting quotas for project da1eae9bcf3c431980a72201c2b6ac77. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:28:33.505811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Getting quotas for user a49effaa45a8412dae0671ad54fd60e9 and project da1eae9bcf3c431980a72201c2b6ac77. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:28:33.519190 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:28:33.521552 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:28:33.573718 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [3d43ae7f-a104-4149-a3dc-6f2c6f45d791] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:28:34.582305 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [3d43ae7f-a104-4149-a3dc-6f2c6f45d791] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37186. Oct 28 19:28:34.588069 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-edd94110-0abb-4225-b96b-7c1932fb5fcb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.868151 Oct 28 19:28:34.589089 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4687/7705] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:28:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:28:34.602134 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e241fd6-2b11-44e5-ae71-e5c7ea940881 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:34.603666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e241fd6-2b11-44e5-ae71-e5c7ea940881 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:34.671504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2e241fd6-2b11-44e5-ae71-e5c7ea940881 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:34.678729 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e241fd6-2b11-44e5-ae71-e5c7ea940881 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1246 microversion: 2.1 time: 0.082245 Oct 28 19:28:34.679320 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3019/7706] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:34 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:35.704749 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:35.706365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:35.714805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.716238 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.716766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.717598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:35.718318 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:35.718861 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:35.792148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:35.801708 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8904957d-a0ea-4d38-b1f9-e5ee3048b041 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1298 microversion: 2.1 time: 0.101850 Oct 28 19:28:35.802161 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4688/7707] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:35 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:28:36.826352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:36.826981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:36.835436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.838613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.839254 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:36.840315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:36.841110 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:36.841556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.006352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:37.016467 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-84637533-6c51-459e-bb2d-1ff5545b5f56 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1372 microversion: 2.1 time: 0.193973 Oct 28 19:28:37.017771 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3020/7708] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:36 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:37.698289 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5805a78a-41f6-4935-afdf-29d01172618f req-d4065c14-cc73-45b2-9619-703bb792839e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:37.709482 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5805a78a-41f6-4935-afdf-29d01172618f req-d4065c14-cc73-45b2-9619-703bb792839e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:37.709959 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5805a78a-41f6-4935-afdf-29d01172618f req-d4065c14-cc73-45b2-9619-703bb792839e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:37.710413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5805a78a-41f6-4935-afdf-29d01172618f req-d4065c14-cc73-45b2-9619-703bb792839e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:37.732766 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5805a78a-41f6-4935-afdf-29d01172618f req-d4065c14-cc73-45b2-9619-703bb792839e service nova] Creating event network-changed:c143992a-cd61-4ca8-833d-e992c69b1b31 for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f on n-h2-862404-2 Oct 28 19:28:37.737845 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5805a78a-41f6-4935-afdf-29d01172618f req-d4065c14-cc73-45b2-9619-703bb792839e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043441 Oct 28 19:28:37.738833 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4689/7709] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:38.042993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:38.043794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:38.050957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.051826 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.052487 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.053217 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:38.053725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:38.054169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:38.211725 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:38.219731 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d26fab0-e68c-4a43-8aa4-ccc0ff403705 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1372 microversion: 2.1 time: 0.181814 Oct 28 19:28:38.220357 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3021/7710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:38 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:39.244509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:39.245230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:39.251510 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:39.252038 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:39.252556 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:39.253270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:39.253736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:39.254165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:39.465569 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:39.473358 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-733db5cb-bd84-43c3-8dd8-d23401685e6d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1372 microversion: 2.1 time: 0.234560 Oct 28 19:28:39.473948 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4690/7711] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:39 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1372 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:40.496845 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:40.497467 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:40.504513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:40.505006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:40.505454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:40.506155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:40.506621 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:40.507059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:40.642235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:40.650754 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a542a3af-9472-46c7-a414-fffb795b8947 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1372 microversion: 2.1 time: 0.158431 Oct 28 19:28:40.651336 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3022/7712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:40 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:41.672991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:41.673784 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:41.681576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.682000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.682545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.683322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:41.683916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:41.684406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:41.820287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:41.829333 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72c91076-92a4-4799-bdc6-8931e0b25553 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1372 microversion: 2.1 time: 0.160381 Oct 28 19:28:41.829949 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4691/7713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:41 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:42.853437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:42.854064 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:42.861006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.861502 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.861954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.862660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:42.863128 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:42.863567 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:42.997517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:43.005824 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bd2f1a22-9a22-42ac-8c5f-eeb764768987 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1372 microversion: 2.1 time: 0.156822 Oct 28 19:28:43.006522 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3023/7714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:42 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:43.673180 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3601c193-c4f2-4f4a-be42-ae9a04624e8e req-7acb513d-fb77-42da-9681-5b7ca917adcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "name": "network-vif-plugged", "status": "completed", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:43.679137 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:43.679929 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:43.686436 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3601c193-c4f2-4f4a-be42-ae9a04624e8e req-7acb513d-fb77-42da-9681-5b7ca917adcc service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:43.686956 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3601c193-c4f2-4f4a-be42-ae9a04624e8e req-7acb513d-fb77-42da-9681-5b7ca917adcc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:43.687363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3601c193-c4f2-4f4a-be42-ae9a04624e8e req-7acb513d-fb77-42da-9681-5b7ca917adcc service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:43.700318 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3601c193-c4f2-4f4a-be42-ae9a04624e8e req-7acb513d-fb77-42da-9681-5b7ca917adcc service nova] Creating event network-vif-plugged:c143992a-cd61-4ca8-833d-e992c69b1b31 for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f on n-h2-862404-2 Oct 28 19:28:43.705397 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3601c193-c4f2-4f4a-be42-ae9a04624e8e req-7acb513d-fb77-42da-9681-5b7ca917adcc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036330 Oct 28 19:28:43.706088 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4692/7715] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:28:44.031589 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:44.032168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:44.039035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.039538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.040158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.040871 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:44.041337 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:44.041773 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:44.182759 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:44.193048 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96093276-3f91-4661-bdeb-21a01b52a243 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1372 microversion: 2.1 time: 0.164288 Oct 28 19:28:44.193048 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3024/7716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:44 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:45.220387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:45.221102 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:45.228392 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.228882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.229322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.230024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.230481 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.230912 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.367119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:45.375464 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ff3f961-edd7-43c0-a85f-80985e96a101 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1556 microversion: 2.1 time: 0.160287 Oct 28 19:28:45.376196 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4693/7717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:45 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:45.400352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:28:45.401001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:28:45.403063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:28:45.409449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.410549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.410549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.411169 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:45.411632 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:45.412099 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:45.547569 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:28:45.556115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bb0a7671-737e-45bd-bbef-a717549c0ec1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1556 microversion: 2.1 time: 0.160681 Oct 28 19:28:45.556827 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3025/7718] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:28:45 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:28:47.234648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-824951a3-ddd1-4f80-8bde-2abc34f8c09a req-5a8850f8-04c1-4ad1-b1a3-f234d8f950da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:28:47.247367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-824951a3-ddd1-4f80-8bde-2abc34f8c09a req-5a8850f8-04c1-4ad1-b1a3-f234d8f950da service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:28:47.248017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-824951a3-ddd1-4f80-8bde-2abc34f8c09a req-5a8850f8-04c1-4ad1-b1a3-f234d8f950da service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:28:47.248453 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-824951a3-ddd1-4f80-8bde-2abc34f8c09a req-5a8850f8-04c1-4ad1-b1a3-f234d8f950da service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:28:47.260450 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-824951a3-ddd1-4f80-8bde-2abc34f8c09a req-5a8850f8-04c1-4ad1-b1a3-f234d8f950da service nova] Creating event network-changed:c143992a-cd61-4ca8-833d-e992c69b1b31 for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f on n-h2-862404-2 Oct 28 19:28:47.265734 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-824951a3-ddd1-4f80-8bde-2abc34f8c09a req-5a8850f8-04c1-4ad1-b1a3-f234d8f950da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035202 Oct 28 19:28:47.266343 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4694/7719] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:30:44.610337 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52f951e5-e896-445b-b633-afd01c521d0a] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:30:44.611444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:44.612276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=36 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:44.613726 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:30:44.613955 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:30:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f/action (ip 10.222.0.16) !!! Oct 28 19:30:44.616139 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:30:44.616318 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:30:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f/action (ip 10.222.0.16) !!! Oct 28 19:30:44.621031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:30:44.621577 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:44.634475 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:44.634982 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:44.635436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:44.636180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:44.636648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:44.637083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:44.665436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lazy-loading 'flavor' on Instance uuid 2f9fc2cc-c1da-4438-98ed-f9f1f712834f {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:30:45.046092 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6c4360a6-94f3-4120-a534-0119c008481d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "POST /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f/action" status: 202 len: 0 microversion: 2.1 time: 0.437352 Oct 28 19:30:45.050254 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3026/7720] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:30:44 2022] POST /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:30:45.055518 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 19:30:45.058700 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 19:30:45.059576 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:45.061009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=32 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:30:45.071167 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:45.072467 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:45.081119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:45.081613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:45.082060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:45.082773 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:45.083424 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:45.084074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:45.226199 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:45.235837 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3cec8177-9910-4634-b143-25e61353841d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.184159 Oct 28 19:30:45.236435 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4695/7721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:45 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:46.263352 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:46.264080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:46.274331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:46.274838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:46.275293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:46.276055 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:46.276524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:46.276980 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:46.282942 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [52f951e5-e896-445b-b633-afd01c521d0a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37300. Oct 28 19:30:46.434675 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:46.444817 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3c97db62-a061-48e7-aedf-51f5bf0735d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.187567 Oct 28 19:30:46.445419 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3027/7722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:46 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:30:47.474512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:47.475303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:47.484928 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:47.485428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:47.485866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:47.486584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:47.487043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:47.487472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:47.493819 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37306. Oct 28 19:30:47.497441 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37308. Oct 28 19:30:47.634052 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:47.641851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f72f79b-7641-4ca6-adc5-8ab2259310cc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.171965 Oct 28 19:30:47.642448 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4696/7723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:47 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:48.666761 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:48.667400 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:48.674403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.674909 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.675359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.676109 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:48.676656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:48.677164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:48.813586 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:48.822325 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-96983b27-6be6-4fc6-88b2-15626351d391 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.159709 Oct 28 19:30:48.822917 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3028/7724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:48 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:49.850731 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:49.851517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:49.859073 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:49.860035 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:49.860850 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:49.862139 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:49.862987 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:49.863787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:50.002425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:50.010576 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6cad28ec-66c5-4941-8158-e04b8836eef9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.167802 Oct 28 19:30:50.011276 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4697/7725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:49 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:51.034697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:51.035407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:51.043019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:51.043512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:51.043989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:51.044697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:51.045162 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:51.045596 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:51.186594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:51.194418 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a879ab15-8062-4467-a0f5-54b844edbbda tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.163686 Oct 28 19:30:51.194991 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3029/7726] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:51 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:52.217673 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:52.218278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:52.225883 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.226367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.226806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:52.227498 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:52.227981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:52.228408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:52.397375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:52.405736 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51be872b-b5a7-48d0-90d2-2a2371e5bb86 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.191983 Oct 28 19:30:52.406444 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4698/7727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:52 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:53.431226 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:53.431877 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:53.438751 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:53.439249 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:53.439701 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:53.440437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:53.440908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:53.441346 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:53.576206 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:53.584430 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-87d4affb-21cf-4574-9021-f719b1683b24 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.157972 Oct 28 19:30:53.585011 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3030/7728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:53 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:54.608413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:54.609004 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:54.616619 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:54.617101 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:54.617536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:54.618474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:54.618932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:54.619610 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:54.756170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:54.764664 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-89b3d924-8730-4ab1-91c9-75372c51c6bb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.160176 Oct 28 19:30:54.765254 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4699/7729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:54 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:55.792413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:55.793360 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:55.805017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:55.805774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:55.806484 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:55.807571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:55.808312 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:55.808978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:55.971733 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:55.981074 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e9e9dd8c-2b21-4070-b055-e77fc2362147 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1702 microversion: 2.1 time: 0.194985 Oct 28 19:30:55.983310 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3031/7730] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:55 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1702 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:57.007272 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:57.007933 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:57.014979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:57.015502 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:57.015943 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:57.016656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:57.017119 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:57.017735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:57.162646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:57.170620 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92c3b7ba-0387-4762-bd7c-08bd7ed093ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1702 microversion: 2.1 time: 0.167308 Oct 28 19:30:57.171223 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4700/7731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:57 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1702 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:58.196780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:58.198037 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:58.205812 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:58.206608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:58.207236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:58.208992 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:58.209647 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:58.210322 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:58.391010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:58.401497 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5290c478-a78a-4557-9ba0-77eaa1968f67 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.208426 Oct 28 19:30:58.402578 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3032/7732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:58 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:30:59.433273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:30:59.433895 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:30:59.444136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:59.444994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:59.445656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:59.446604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:30:59.447072 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:30:59.447509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:30:59.635961 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:30:59.646017 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-13c623f3-b5cc-4130-a099-5c5f54fd759c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.216225 Oct 28 19:30:59.666236 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4701/7733] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:30:59 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:00.329803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-18dfff4f-3924-4fa1-aaeb-5e10d4f98284 req-196eb0ac-c498-451c-8b16-feb62e4bb975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "name": "network-vif-plugged", "status": "completed", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:00.340794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-18dfff4f-3924-4fa1-aaeb-5e10d4f98284 req-196eb0ac-c498-451c-8b16-feb62e4bb975 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.341630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-18dfff4f-3924-4fa1-aaeb-5e10d4f98284 req-196eb0ac-c498-451c-8b16-feb62e4bb975 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.342345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-18dfff4f-3924-4fa1-aaeb-5e10d4f98284 req-196eb0ac-c498-451c-8b16-feb62e4bb975 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:00.357771 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-18dfff4f-3924-4fa1-aaeb-5e10d4f98284 req-196eb0ac-c498-451c-8b16-feb62e4bb975 service nova] Creating event network-vif-plugged:c143992a-cd61-4ca8-833d-e992c69b1b31 for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f on n-h2-862404-2 Oct 28 19:31:00.366072 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-18dfff4f-3924-4fa1-aaeb-5e10d4f98284 req-196eb0ac-c498-451c-8b16-feb62e4bb975 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040606 Oct 28 19:31:00.368318 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3033/7734] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:00.673104 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:00.673741 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:00.684267 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.685260 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.685963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:00.686950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:00.687906 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:00.688578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:00.905076 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:00.915264 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8928b9b3-4b2a-4e91-8089-710e6aaa41f9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.246490 Oct 28 19:31:00.932234 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4702/7735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:00 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:01.950030 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:01.950997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:01.958348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.959508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.960001 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:01.960931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:01.961468 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:01.961910 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:02.241639 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:02.252988 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b9bfb80f-3460-4b9e-b5b4-0d11ed5ff3ef tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.313248 Oct 28 19:31:02.255364 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3034/7736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:01 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:03.280846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:03.282115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:03.295021 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:03.295517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:03.296000 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:03.297070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:03.298971 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:03.299403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:03.562757 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:03.577884 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b40a90aa-cc25-4bc8-8dad-942f78b3f78f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.297857 Oct 28 19:31:03.582014 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4703/7737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:03 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:04.605309 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:04.606318 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:04.616270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:04.616809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:04.617789 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:04.618932 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:04.620018 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:04.620650 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:04.820048 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:04.833372 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5eba3d35-bd62-4887-ac6f-675bee9b5ccc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.231931 Oct 28 19:31:04.834605 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3035/7738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:04 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:05.859894 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:05.861382 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:05.875975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.876879 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.877589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:05.878565 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:05.879258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:05.881210 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:06.062313 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:06.072387 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c7c4b471-382e-40d1-a1cc-9890b7b6a4b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.216947 Oct 28 19:31:06.088794 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4704/7739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:05 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:07.098277 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:07.099125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:07.107137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.107642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.108140 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.108931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:07.109401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:07.109839 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:07.270363 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:07.282460 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-057adba1-2df8-49ea-90a1-635fd8079be2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.188398 Oct 28 19:31:07.300125 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3036/7740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:07 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:08.306159 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:08.306718 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:08.313820 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.314375 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.314819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.315593 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:08.316112 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:08.316541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:08.466126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:08.474471 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5cbc0ad0-1f89-473c-a967-a817096baa0b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1697 microversion: 2.1 time: 0.173140 Oct 28 19:31:08.487724 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4705/7741] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:08 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:09.497809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:09.498427 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:09.506239 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:09.506824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:09.507274 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:09.508011 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:09.508478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:09.508936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:09.658542 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:09.667297 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6dbf1561-f5cd-4c9e-bdf3-ee59cf21cca4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1679 microversion: 2.1 time: 0.173684 Oct 28 19:31:09.667909 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3037/7742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:09 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:10.693302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:10.694006 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:10.701646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:10.702144 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:10.702613 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:10.703333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:10.703788 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:10.704237 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:10.851791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:10.859866 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7860f693-c9c3-4071-ae7a-0fb6e5427e8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1679 microversion: 2.1 time: 0.171320 Oct 28 19:31:10.860454 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4706/7743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:10 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:11.883949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:11.884556 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:11.891367 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:11.891882 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:11.892327 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:11.893026 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:11.893486 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:11.893922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.040393 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:12.048115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-26512946-e2a4-4850-a8e3-b6a935bbfffc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1622 microversion: 2.1 time: 0.168021 Oct 28 19:31:12.048733 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3038/7744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:11 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1622 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:12.071602 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:12.072241 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:12.079043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.079529 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.079993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.080680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.081315 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.081743 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.124650 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120680) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 28 19:31:12.201847 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a67ecd20-49fe-44cf-a362-3bed57b279c2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "POST /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f/action" status: 202 len: 0 microversion: 2.1 time: 0.134120 Oct 28 19:31:12.203705 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4707/7745] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:31:12 2022] POST /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:31:12.212598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:12.213545 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:12.224635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.230025 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.231378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.234519 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.235868 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.238745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.285216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9bf9797f-a3a2-4d12-9304-ba3613ee9fb5 req-ca2c78bc-4b6a-4117-8253-c4342293b575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "name": "network-vif-unplugged", "status": "completed", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:12.300977 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9bf9797f-a3a2-4d12-9304-ba3613ee9fb5 req-ca2c78bc-4b6a-4117-8253-c4342293b575 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:12.302605 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9bf9797f-a3a2-4d12-9304-ba3613ee9fb5 req-ca2c78bc-4b6a-4117-8253-c4342293b575 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:12.303570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9bf9797f-a3a2-4d12-9304-ba3613ee9fb5 req-ca2c78bc-4b6a-4117-8253-c4342293b575 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:12.326870 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.server_external_events [req-9bf9797f-a3a2-4d12-9304-ba3613ee9fb5 req-ca2c78bc-4b6a-4117-8253-c4342293b575 service nova] Unable to find a host for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f. Dropping event network-vif-unplugged {{(pid=120680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 19:31:12.329223 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9bf9797f-a3a2-4d12-9304-ba3613ee9fb5 req-ca2c78bc-4b6a-4117-8253-c4342293b575 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050060 Oct 28 19:31:12.331417 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4708/7746] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 19:31:12.430904 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:12.440257 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-49755551-69e3-4cb0-9978-dd835f793e0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1630 microversion: 2.1 time: 0.232039 Oct 28 19:31:12.441036 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3039/7747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:12 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1630 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:13.465187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:13.465776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:13.473001 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:13.473488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:13.473925 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:13.474994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:13.475125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:13.475572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:13.630686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:13.639808 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3756bac1-9cd6-4579-b0b3-a5f0c37e029d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.178257 Oct 28 19:31:13.656428 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4709/7748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:13 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:14.471947 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-e9cfc8c5-56b9-468c-b18b-8f2ad9ff191f req-d2998e70-f6ea-4438-9ad9-37a7b1012507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:14.491003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e9cfc8c5-56b9-468c-b18b-8f2ad9ff191f req-d2998e70-f6ea-4438-9ad9-37a7b1012507 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.491629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e9cfc8c5-56b9-468c-b18b-8f2ad9ff191f req-d2998e70-f6ea-4438-9ad9-37a7b1012507 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.492293 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-e9cfc8c5-56b9-468c-b18b-8f2ad9ff191f req-d2998e70-f6ea-4438-9ad9-37a7b1012507 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:14.506725 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-e9cfc8c5-56b9-468c-b18b-8f2ad9ff191f req-d2998e70-f6ea-4438-9ad9-37a7b1012507 service nova] Creating event network-changed:c143992a-cd61-4ca8-833d-e992c69b1b31 for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f on n-h1-862404-2 Oct 28 19:31:14.512278 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-e9cfc8c5-56b9-468c-b18b-8f2ad9ff191f req-d2998e70-f6ea-4438-9ad9-37a7b1012507 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050442 Oct 28 19:31:14.512914 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3040/7749] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:14.665516 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:14.666127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:14.673742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.674714 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.675643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:14.677003 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:14.677486 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:14.677920 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:14.830685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:14.838955 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32e037f5-fbf0-40bc-a69d-07ebbde8bc32 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.177385 Oct 28 19:31:14.840167 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4710/7750] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:14 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:15.864934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:15.866155 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:15.868615 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=31 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:15.880266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:15.880774 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:15.881617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:15.882549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:15.883287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:15.883922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:15.909261 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:16.603338 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:16.611761 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-21158862-621f-4aef-ade0-928ef70c4840 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.752481 Oct 28 19:31:16.612398 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3041/7751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:15 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:17.643471 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:17.645830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:17.652801 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:17.654776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:17.655513 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:17.656278 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:17.657269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:17.657969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:17.658656 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:17.665298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:31:17.861703 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:17.871029 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72a41686-fb06-43cf-bdeb-ac4d7018dd1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.231902 Oct 28 19:31:17.872893 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4711/7752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:17 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:18.898284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:18.898911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:18.912517 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:18.913035 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:18.913513 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:18.914235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:18.914708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:18.915150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:19.162635 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:19.170985 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d18b1d90-7953-439c-9ef7-24c79fd4d9a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.277773 Oct 28 19:31:19.187847 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3042/7753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:18 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:20.195374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:20.196429 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:20.212363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:20.214777 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:20.215305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:20.216707 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:20.217699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:20.218474 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:20.444462 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:20.452508 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-94f1c693-e4a2-49eb-90be-bb99a32ef5ac tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.261745 Oct 28 19:31:20.453094 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4712/7754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:20 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:21.482219 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:21.482960 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:21.490865 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:21.491448 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:21.492024 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:21.492815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:21.493356 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:21.493905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:21.712720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:21.721043 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e6ec7dd7-ef93-49c7-a203-a2976507569f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.242986 Oct 28 19:31:21.721914 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3043/7755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:21 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:22.745832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:22.746689 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:22.753626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:22.754654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:22.755294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:22.756124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:22.756581 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:22.757055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:22.917245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:22.925106 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0275e414-d7a7-4273-8410-93e08fa33300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.183585 Oct 28 19:31:22.925685 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4713/7756] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:22 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:31:23.948823 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:23.949560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:23.956444 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:23.956940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:23.957429 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:23.958218 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:23.958683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:23.959121 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:24.095194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:24.104631 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cae17b39-61f5-4e0b-8f2f-3b6def862f1f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.159661 Oct 28 19:31:24.105229 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3044/7757] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:23 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:25.129333 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:25.130121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:25.136917 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.137404 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.137846 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.138549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:25.139009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:25.139446 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:25.290955 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:25.305670 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-88a6cf33-32e5-4cb4-a4db-8313cf3360b5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.179138 Oct 28 19:31:25.307843 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4714/7758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:25 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:26.332007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:26.333185 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:26.340216 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:26.340724 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:26.341176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:26.341901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:26.342372 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:26.342818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:26.480908 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:26.488691 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eb93546e-1ec1-45b9-b373-1af6a3dc649f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.160797 Oct 28 19:31:26.489276 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3045/7759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:26 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:27.513121 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:27.513737 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:27.520901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:27.521390 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:27.521829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:27.522525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:27.522981 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:27.523407 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:27.656492 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:27.665475 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4bcd8e3-1035-4b18-846a-c6b07470ee40 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.156301 Oct 28 19:31:27.666070 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4715/7760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:27 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:28.689560 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:28.690187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:28.697736 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:28.698413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:28.698846 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:28.699640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:28.700135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:28.700575 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:28.839630 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:28.847520 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7cc04017-0e0d-4a63-8b8a-4c457a3b7cff tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.161906 Oct 28 19:31:28.848586 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3046/7761] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:28 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:29.872396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:29.873148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:29.880020 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:29.880519 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:29.880963 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:29.881672 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:29.882133 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:29.882566 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:30.025837 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:30.033758 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eb7cd4d4-a432-4075-840b-8c5c77493b8e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.165653 Oct 28 19:31:30.034346 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4716/7762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:29 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:31.056510 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:31.057180 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:31.065591 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:31.065933 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:31.066436 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:31.067148 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:31.067614 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:31.068074 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:31.203511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:31.211946 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20d0457f-cda5-4d4b-a8c1-38c5bfabbef8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.159472 Oct 28 19:31:31.212517 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3047/7763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:31 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:32.236674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:32.237372 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:32.244469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.245225 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.245671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.246766 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.246919 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.247252 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.398079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:32.403574 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-59f7ad26-9294-4a1b-9cc2-493530b33e68 req-d48a4bbb-e632-4756-9233-7da4208dc4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "name": "network-vif-plugged", "status": "completed", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:31:32.409228 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a600621-53e9-4907-8110-473d44e1a246 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.176363 Oct 28 19:31:32.411864 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4717/7764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:32 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:32.433779 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-59f7ad26-9294-4a1b-9cc2-493530b33e68 req-d48a4bbb-e632-4756-9233-7da4208dc4e0 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:32.434284 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-59f7ad26-9294-4a1b-9cc2-493530b33e68 req-d48a4bbb-e632-4756-9233-7da4208dc4e0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:32.434732 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-59f7ad26-9294-4a1b-9cc2-493530b33e68 req-d48a4bbb-e632-4756-9233-7da4208dc4e0 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:32.447312 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-59f7ad26-9294-4a1b-9cc2-493530b33e68 req-d48a4bbb-e632-4756-9233-7da4208dc4e0 service nova] Creating event network-vif-plugged:c143992a-cd61-4ca8-833d-e992c69b1b31 for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f on n-h1-862404-2 Oct 28 19:31:32.453031 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-59f7ad26-9294-4a1b-9cc2-493530b33e68 req-d48a4bbb-e632-4756-9233-7da4208dc4e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059087 Oct 28 19:31:32.453904 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3048/7765] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:31:33.437864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:33.438485 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:33.446450 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:33.446944 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:33.447387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:33.448130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:33.448591 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:33.449055 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:33.585830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:33.593662 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5a3014c3-5020-4d7b-b79c-44d95fea0b4a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1688 microversion: 2.1 time: 0.159766 Oct 28 19:31:33.594254 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4718/7766] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:33 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:31:34.618962 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:31:34.619978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:31:34.626177 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.626678 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.627129 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.627858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:31:34.628334 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:31:34.629269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:31:34.765251 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:31:34.773946 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e521939e-7f50-4d9e-a66f-ea19a2212b1c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1675 microversion: 2.1 time: 0.160107 Oct 28 19:31:34.774543 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3049/7767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:31:34 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:20.984880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=15 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:20.986242 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=47 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:20.987317 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:33:20.987485 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f (ip 10.222.0.16) !!! Oct 28 19:33:20.990167 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:33:20.990366 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f (ip 10.222.0.16) !!! Oct 28 19:33:20.998972 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:33:20.999700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=17 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:21.000512 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:21.001009 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=49 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:21.001214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:21.002938 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:33:21.003199 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 19:33:21.012391 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:21.012891 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:21.013363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:21.014047 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:21.014497 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:21.015036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:21.048330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:33:21.120233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-43c5f0c6-e2a1-4e57-9e39-348774cd49f6 req-c88e31fc-b677-4776-be24-364e9356a85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:21.131031 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-43c5f0c6-e2a1-4e57-9e39-348774cd49f6 req-c88e31fc-b677-4776-be24-364e9356a85c service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:21.131657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-43c5f0c6-e2a1-4e57-9e39-348774cd49f6 req-c88e31fc-b677-4776-be24-364e9356a85c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:21.132190 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-43c5f0c6-e2a1-4e57-9e39-348774cd49f6 req-c88e31fc-b677-4776-be24-364e9356a85c service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:21.145921 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-43c5f0c6-e2a1-4e57-9e39-348774cd49f6 req-c88e31fc-b677-4776-be24-364e9356a85c service nova] Creating event network-changed:c143992a-cd61-4ca8-833d-e992c69b1b31 for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f on n-h1-862404-2 Oct 28 19:33:21.151170 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02db0ca6-4c49-4c95-8291-ba144151399c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 204 len: 0 microversion: 2.1 time: 0.167954 Oct 28 19:33:21.152228 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4719/7768] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:33:20 2022] DELETE /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:33:21.153372 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-43c5f0c6-e2a1-4e57-9e39-348774cd49f6 req-c88e31fc-b677-4776-be24-364e9356a85c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161942 Oct 28 19:33:21.154166 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3050/7769] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:21.162082 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:21.162864 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:21.170570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:21.171074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:21.171518 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:21.172275 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:21.172876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:21.173314 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:21.383475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:21.392417 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-54d474a8-3eb5-463d-bb81-90a2ff189614 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.235284 Oct 28 19:33:21.393568 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4720/7770] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:21 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:22.417173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:22.417869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:22.426652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:22.427158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:22.427617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:22.428365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:22.428832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:22.429269 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:22.435795 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37594. Oct 28 19:33:22.618886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:22.628073 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df21a93c-4d69-4739-b5c0-bf31c173b0bf tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1681 microversion: 2.1 time: 0.215059 Oct 28 19:33:22.628671 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3051/7771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:22 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:23.301635 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-2689d5f7-6548-4af3-a800-264f8cb6820e req-a60933fd-2825-4641-ad74-09f388f59f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9fc2cc-c1da-4438-98ed-f9f1f712834f", "name": "network-vif-deleted", "tag": "c143992a-cd61-4ca8-833d-e992c69b1b31"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:23.316305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2689d5f7-6548-4af3-a800-264f8cb6820e req-a60933fd-2825-4641-ad74-09f388f59f5b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:23.316791 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2689d5f7-6548-4af3-a800-264f8cb6820e req-a60933fd-2825-4641-ad74-09f388f59f5b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:23.317758 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-2689d5f7-6548-4af3-a800-264f8cb6820e req-a60933fd-2825-4641-ad74-09f388f59f5b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:23.331519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-2689d5f7-6548-4af3-a800-264f8cb6820e req-a60933fd-2825-4641-ad74-09f388f59f5b service nova] Creating event network-vif-deleted:c143992a-cd61-4ca8-833d-e992c69b1b31 for instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f on n-h1-862404-2 Oct 28 19:33:23.338245 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-2689d5f7-6548-4af3-a800-264f8cb6820e req-a60933fd-2825-4641-ad74-09f388f59f5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042319 Oct 28 19:33:23.338886 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4721/7772] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:33:23.653472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:23.654113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:23.662570 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:23.663083 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:23.663553 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:23.664380 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:23.664854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:23.665302 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:23.713850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:23.714454 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:23.714993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:23.715645 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lazy-loading 'fault' on Instance uuid 2f9fc2cc-c1da-4438-98ed-f9f1f712834f {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:33:23.766262 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:23.774304 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5c567dd7-3139-4c9e-a1c7-e8bca341a493 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 200 len: 1336 microversion: 2.1 time: 0.124809 Oct 28 19:33:23.774908 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3052/7773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:23 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:24.801549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:24.802381 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 2f9fc2cc-c1da-4438-98ed-f9f1f712834f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:24.810295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:24.810790 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:24.811227 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:24.812344 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:24.813063 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:24.814189 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:24.828982 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] HTTP exception thrown: Instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f could not be found. Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Request method failure captured: Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f HTTP/1.1 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXC1a0RRfce3ZXU93Ffq6K9yB-EO96Hxy74VPkZLuCzm8xBpzSHFJhfWlRTUEIKXYGSH4_X0Zph_hgzlbr8-MLIgbolOAnsM9fs0vVpkcMZ4HiW7yVYV4QhHMI4tL2f4J-fyBSGDgJtzotKYqkkEjd7Q866x8Eo7yqVlS2k0sFjBQfaI Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: da1eae9bcf3c431980a72201c2b6ac77 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestShelveInstance-1855477678 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da1eae9bcf3c431980a72201c2b6ac77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da1eae9bcf3c431980a72201c2b6ac77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da1eae9bcf3c431980a72201c2b6ac77", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da1eae9bcf3c431980a72201c2b6ac77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestShelveInstance-1855477678 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: da1eae9bcf3c431980a72201c2b6ac77 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestShelveInstance-1855477678 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestShelveInstance-1855477678-project Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: a49effaa45a8412dae0671ad54fd60e9 Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestShelveInstance-1855477678-project Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f could not be found. Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '2f9fc2cc-c1da-4438-98ed-f9f1f712834f'} Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f could not be found. Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f could not be found. Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:33:24.830684 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f could not be found. Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Returning 404 to user: Instance 2f9fc2cc-c1da-4438-98ed-f9f1f712834f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c078c7f-aff9-4601-8646-14425687eea2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f" status: 404 len: 111 microversion: 2.1 time: 0.037216 Oct 28 19:33:24.836215 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4722/7774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:24 2022] GET /compute/v2.1/servers/2f9fc2cc-c1da-4438-98ed-f9f1f712834f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:33:25.012814 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-188de58c-34ba-4185-a5fe-e53eff7cdef1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '.version_select at 0x7f78e23e8790>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:25.042593 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-188de58c-34ba-4185-a5fe-e53eff7cdef1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-295411503" status: 202 len: 0 microversion: 2.1 time: 0.033612 Oct 28 19:33:25.043553 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3053/7775] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 19:33:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-295411503 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:33:25.062171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b94e12d-f7d9-433a-85ba-288bb41a82b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Action: 'create', calling method: .version_select at 0x7f78dcaf2700>, body: {"keypair": {"name": "tempest-TestShelveInstance-148839729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIycF1f0Qu7ctzpFUErpfWYUhAl+FQZX93oPxTHizBSU9OpNz4hkIDHkYuWBSY8pEW7C6Gc5ReHmXqw/kG2I6FnJ3vSZJ5ar1mMrISx2zZQQn4Bw4vHHLVuIi1WLPZMvA=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:25.078796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3b94e12d-f7d9-433a-85ba-288bb41a82b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Getting quotas for project da1eae9bcf3c431980a72201c2b6ac77. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:33:25.084752 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-3b94e12d-f7d9-433a-85ba-288bb41a82b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Getting quotas for user a49effaa45a8412dae0671ad54fd60e9 and project da1eae9bcf3c431980a72201c2b6ac77. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:33:25.115982 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b94e12d-f7d9-433a-85ba-288bb41a82b6 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.057915 Oct 28 19:33:25.116611 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4723/7776] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:33:25 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:33:41.542745 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=16 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:41.543514 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:41.548237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1398613016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-148839729", "security_groups": [{"name": "tempest-secgroup-smoke-561895463"}], "networks": [{"uuid": "d8e461fb-e7fa-4cc2-9d99-be34a705f771"}], "block_device_mapping_v2": [{"uuid": "cd132da8-2c05-4806-96ae-62449d3f1ed8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:41.680931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] validate_networks() for [('d8e461fb-e7fa-4cc2-9d99-be34a705f771', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:33:42.167344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:33:42.168263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:33:42.169166 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:33:42.169710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:33:42.170135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:33:42.180050 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:42.180563 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:42.181013 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:42.181764 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:42.182263 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:42.182697 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:42.202071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Getting quotas for project da1eae9bcf3c431980a72201c2b6ac77. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:33:42.208507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Getting quotas for user a49effaa45a8412dae0671ad54fd60e9 and project da1eae9bcf3c431980a72201c2b6ac77. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:33:42.275080 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:33:42.277315 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd132da8-2c05-4806-96ae-62449d3f1ed8',volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:33:42.417366 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aaa354e4-d0ee-44b9-a3e9-dd346cf947b2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.876250 Oct 28 19:33:42.418346 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3054/7777] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:33:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:33:42.427934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:42.428698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:42.429350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:42.433380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a1b49391-0455-4328-b946-b67f46cd6695 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:42.434276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a1b49391-0455-4328-b946-b67f46cd6695 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:42.495589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a1b49391-0455-4328-b946-b67f46cd6695 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:42.503800 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a1b49391-0455-4328-b946-b67f46cd6695 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1088 microversion: 2.1 time: 0.077673 Oct 28 19:33:42.504439 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4724/7778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:42 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:43.526863 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:43.527524 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:43.535232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:43.536141 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:43.536821 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:43.537790 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:43.538906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:43.538906 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:43.611989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:43.620550 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4bd31e61-3e07-4448-8847-b80b07fe3c7a tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1194 microversion: 2.1 time: 0.097831 Oct 28 19:33:43.621640 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3055/7779] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:43 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:44.645685 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:44.646311 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:44.653923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:44.654338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:44.654969 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:44.655892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:44.656351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:44.656978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:44.803057 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:44.811519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e8d04387-6203-4d71-90cb-43c0251177d0 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1271 microversion: 2.1 time: 0.170554 Oct 28 19:33:44.813040 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4725/7780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:44 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:45.092298 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6a6884a1-be94-44d9-bfab-621c8bb97240 req-d6f878f3-9f13-4c45-aeb1-952ccf44640b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08af7121-970c-42f0-b407-9b689c8f6393", "tag": "15cc388c-b666-4e0f-b528-8b23bf93ee59"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:33:45.106684 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a6884a1-be94-44d9-bfab-621c8bb97240 req-d6f878f3-9f13-4c45-aeb1-952ccf44640b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:45.107192 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a6884a1-be94-44d9-bfab-621c8bb97240 req-d6f878f3-9f13-4c45-aeb1-952ccf44640b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:45.107888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6a6884a1-be94-44d9-bfab-621c8bb97240 req-d6f878f3-9f13-4c45-aeb1-952ccf44640b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:45.122433 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6a6884a1-be94-44d9-bfab-621c8bb97240 req-d6f878f3-9f13-4c45-aeb1-952ccf44640b service nova] Creating event network-changed:15cc388c-b666-4e0f-b528-8b23bf93ee59 for instance 08af7121-970c-42f0-b407-9b689c8f6393 on n-h1-862404-2 Oct 28 19:33:45.129728 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6a6884a1-be94-44d9-bfab-621c8bb97240 req-d6f878f3-9f13-4c45-aeb1-952ccf44640b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040195 Oct 28 19:33:45.130358 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3056/7781] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:33:45.836772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:45.838106 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:45.845716 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:45.847398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:45.848015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:45.848866 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:45.849394 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:45.849889 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:46.000464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:46.009902 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01ebbf4f-06a9-4f6c-8952-7fee03d189b1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1271 microversion: 2.1 time: 0.176923 Oct 28 19:33:46.010787 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4726/7782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:45 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:47.035413 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:47.036170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:47.043622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:47.044156 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:47.044613 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:47.045339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:47.045815 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:47.046260 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:47.183780 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:47.192482 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cf2a61d4-af48-4c5d-8d0d-6541210dca44 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1271 microversion: 2.1 time: 0.162067 Oct 28 19:33:47.193066 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3057/7783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:47 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:48.216797 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:48.217377 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:48.223393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:48.223916 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:48.224350 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:48.225051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:48.225509 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:48.225940 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:48.361848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:48.370792 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8876b1df-770c-47ea-95ef-476d5ea8a327 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1271 microversion: 2.1 time: 0.158356 Oct 28 19:33:48.371660 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4727/7784] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:48 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:49.396555 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:49.397168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:49.404167 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:49.404670 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:49.405114 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:49.405827 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:49.406289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:49.406718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:49.557476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:49.566795 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff49950b-8a99-4c6c-95cf-d4b634d0c027 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.175454 Oct 28 19:33:49.567727 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3058/7785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:49 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:50.592626 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:50.593645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:50.604009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:50.604009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:50.604009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:50.604009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:50.604009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:50.604009 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:50.745410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:50.754486 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-19d1c6e0-a201-4f8c-952b-124992e74efd tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.165730 Oct 28 19:33:50.755289 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4728/7786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:50 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:51.777000 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:51.777656 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:51.785533 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:51.786039 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:51.786488 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:51.787209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:51.787674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:51.788139 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:52.189727 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:52.215920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:52.266748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:52.275938 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-802cfc1a-21c0-4652-8df7-9619ddaa1003 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.502899 Oct 28 19:33:52.276539 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3059/7787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:51 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:53.300259 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:53.301532 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:53.304246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:33:53.309890 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:53.310387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:53.310832 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:53.311549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:53.312036 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:53.312469 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:53.460217 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:53.473371 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-411ed9d1-3a5b-4dc9-92d2-00cf44e38348 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.176856 Oct 28 19:33:53.474313 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4729/7788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:53 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:54.497648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:54.498280 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:54.505529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:54.506028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:54.506476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:54.507209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:54.507674 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:54.508146 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:54.657808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:54.667263 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28e085b7-0549-45d6-abe2-791fe589823e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.173999 Oct 28 19:33:54.668224 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3060/7789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:54 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:55.692793 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:55.693417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:55.700658 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:55.701157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:55.701596 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:55.702328 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:55.702786 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:55.703216 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:55.842358 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:55.850449 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32973b49-4ba8-4d56-ab80-fa1138b2f2f7 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.162390 Oct 28 19:33:55.851075 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4730/7790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:55 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:33:56.875374 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:56.876471 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:56.885997 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:56.886499 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:56.887286 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:56.887688 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:56.888191 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:56.888735 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:57.053229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:57.061455 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2c1466df-553c-4166-bdfa-dff10c1bf5e2 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.192219 Oct 28 19:33:57.062053 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3061/7791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:56 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:58.085205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:58.085828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:58.092902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:58.093413 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:58.093848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:58.094553 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:58.095028 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:58.095434 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:58.239796 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:58.248339 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-659c776d-4d85-4294-9609-a3b4f0dfa934 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.167735 Oct 28 19:33:58.248943 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4731/7792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:58 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:33:59.270657 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:33:59.271604 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:33:59.278754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:59.279257 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:59.279714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:59.280455 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:33:59.280931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:33:59.281376 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:33:59.417378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:33:59.425590 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4128e1a1-b05f-4ede-93b2-e77c1392f9e9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.158817 Oct 28 19:33:59.426185 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3062/7793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:33:59 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:00.449074 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:00.449760 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:34:00.456950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:00.457442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:00.457898 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:00.458653 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:00.459120 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:00.459549 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:00.603308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:00.611270 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8e2b398-38ba-4842-b278-85306a53913f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.166141 Oct 28 19:34:00.611894 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4732/7794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:00 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:01.123958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5d462107-5597-4319-9bad-fe015eeeb5f0 req-71990a27-916c-43b5-8383-661fb7a3e46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08af7121-970c-42f0-b407-9b689c8f6393", "name": "network-vif-plugged", "status": "completed", "tag": "15cc388c-b666-4e0f-b528-8b23bf93ee59"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:01.135515 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d462107-5597-4319-9bad-fe015eeeb5f0 req-71990a27-916c-43b5-8383-661fb7a3e46d service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:01.136153 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d462107-5597-4319-9bad-fe015eeeb5f0 req-71990a27-916c-43b5-8383-661fb7a3e46d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:01.136620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5d462107-5597-4319-9bad-fe015eeeb5f0 req-71990a27-916c-43b5-8383-661fb7a3e46d service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:01.150035 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5d462107-5597-4319-9bad-fe015eeeb5f0 req-71990a27-916c-43b5-8383-661fb7a3e46d service nova] Creating event network-vif-plugged:15cc388c-b666-4e0f-b528-8b23bf93ee59 for instance 08af7121-970c-42f0-b407-9b689c8f6393 on n-h1-862404-2 Oct 28 19:34:01.155296 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5d462107-5597-4319-9bad-fe015eeeb5f0 req-71990a27-916c-43b5-8383-661fb7a3e46d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101808 Oct 28 19:34:01.155926 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3063/7795] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:34:01.635196 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:01.635809 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:34:01.642654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:01.643138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:01.643573 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:01.644295 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:01.644751 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:01.645174 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:01.789015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:01.796786 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8fdb1695-ba55-4ba6-a30a-9ffe8d604116 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1259 microversion: 2.1 time: 0.165697 Oct 28 19:34:01.797369 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4733/7796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:01 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:02.822002 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:02.822618 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:34:02.829914 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:02.830419 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:02.830905 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:02.831617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:02.832117 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:02.832561 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:02.979176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:02.987316 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-23bcd8d7-880e-46db-a055-089d754f5055 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1442 microversion: 2.1 time: 0.170609 Oct 28 19:34:02.987914 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3064/7797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:02 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1442 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:03.010648 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:34:03.011270 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:34:03.018096 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:03.018579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:03.019017 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:03.019709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:03.020271 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:03.020746 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:03.165680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:34:03.173573 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9b0e3ab9-d4f9-464c-87e5-1a23244261d9 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1442 microversion: 2.1 time: 0.166880 Oct 28 19:34:03.174166 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4734/7798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:34:03 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1442 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:34:04.949687 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a4deb0cd-c583-4a7d-a0ec-f38fc6735674 req-eba733c1-3dee-4de7-bc67-500179b2e0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08af7121-970c-42f0-b407-9b689c8f6393", "tag": "15cc388c-b666-4e0f-b528-8b23bf93ee59"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:34:04.959271 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a4deb0cd-c583-4a7d-a0ec-f38fc6735674 req-eba733c1-3dee-4de7-bc67-500179b2e0f1 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:34:04.959772 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a4deb0cd-c583-4a7d-a0ec-f38fc6735674 req-eba733c1-3dee-4de7-bc67-500179b2e0f1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:34:04.960242 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a4deb0cd-c583-4a7d-a0ec-f38fc6735674 req-eba733c1-3dee-4de7-bc67-500179b2e0f1 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:34:04.971916 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a4deb0cd-c583-4a7d-a0ec-f38fc6735674 req-eba733c1-3dee-4de7-bc67-500179b2e0f1 service nova] Creating event network-changed:15cc388c-b666-4e0f-b528-8b23bf93ee59 for instance 08af7121-970c-42f0-b407-9b689c8f6393 on n-h1-862404-2 Oct 28 19:34:04.977875 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a4deb0cd-c583-4a7d-a0ec-f38fc6735674 req-eba733c1-3dee-4de7-bc67-500179b2e0f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087298 Oct 28 19:34:04.978525 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3065/7799] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:00.141195 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:36:00.142110 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:36:00.142693 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=24 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:00.143442 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=60 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:00.144260 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:36:00.144421 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:36:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393/action (ip 10.222.0.16) !!! Oct 28 19:36:00.150702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:00.151256 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:00.159652 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:00.160185 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:00.160632 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:00.161342 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:00.161806 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:00.162254 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:00.190902 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lazy-loading 'flavor' on Instance uuid 08af7121-970c-42f0-b407-9b689c8f6393 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:36:00.272189 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c3ca8a3-2421-4df8-84a2-8f1cf1d118ba tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "POST /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393/action" status: 202 len: 0 microversion: 2.1 time: 0.132893 Oct 28 19:36:00.272826 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4735/7800] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:36:00 2022] POST /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:36:00.280567 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 19:36:00.281448 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52f951e5-e896-445b-b633-afd01c521d0a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:36:00.282085 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:00.282854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=56 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:00.284096 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:36:00.284605 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:36:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 (ip 10.222.0.16) !!! Oct 28 19:36:00.291625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:00.292451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:00.303189 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:00.303699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:00.304187 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:00.305479 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:00.306662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:00.306662 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:00.524107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:00.532167 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f96e7db-a3c2-4d1c-95de-5275b85903f4 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.254457 Oct 28 19:36:00.532758 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3066/7801] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:00 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:01.558763 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:01.559488 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:01.568666 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:01.569156 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:01.569598 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:01.571012 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:01.571748 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:01.572273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:01.576534 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37874. Oct 28 19:36:01.577245 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37876. Oct 28 19:36:01.729158 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:01.737216 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac7e7d6d-8e4e-4b35-9eaf-1e650b1bede8 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.184779 Oct 28 19:36:01.737815 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4736/7802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:01 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:02.761136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:02.761769 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:02.777594 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [52f951e5-e896-445b-b633-afd01c521d0a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37884. Oct 28 19:36:02.780431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:02.780940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:02.781396 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:02.782126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:02.782597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:02.783042 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:02.790531 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37882. Oct 28 19:36:02.938067 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:02.946834 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e7430fe-2214-4470-83fd-d3ad5b8f6bd5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.189890 Oct 28 19:36:02.947437 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3067/7803] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:02 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:03.971219 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:03.971892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:03.979595 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:03.980123 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:03.980560 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:03.981263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:03.981722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:03.982170 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:04.147546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:04.156294 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2381c3fe-a030-49ee-aa2c-d438a7cc321f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.189055 Oct 28 19:36:04.156889 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4737/7804] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:03 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:05.182164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:05.182919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:05.190432 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:05.190948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:05.191405 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:05.192168 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:05.192648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:05.193094 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:05.349551 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:05.358470 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cbddecdb-dbd8-4062-984b-ed36d611df4e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.181862 Oct 28 19:36:05.359064 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3068/7805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:05 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:06.383393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:06.384059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:06.391151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:06.391640 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:06.392117 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.392823 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:06.393277 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:06.393699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:06.535046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:06.543168 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f60d04ed-b31f-429f-b1f8-02edb5be4918 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.164310 Oct 28 19:36:06.543765 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4738/7806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:06 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:07.567150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:07.567778 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:07.575549 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:07.576107 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:07.576559 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:07.577285 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:07.577754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:07.578195 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:07.718081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:07.727074 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e9ec4d2-76df-445c-8bac-77bb27a3e04b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.163414 Oct 28 19:36:07.727766 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3069/7807] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:07 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:08.751468 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:08.752118 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:08.759475 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:08.760015 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:08.760460 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:08.761188 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:08.761644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:08.762071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:08.905729 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:08.913975 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a966ab1-182c-4bb4-b154-c9175701c817 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.166636 Oct 28 19:36:08.914581 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4739/7808] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:08 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:09.939450 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:09.940359 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:09.948430 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:09.948937 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:09.949397 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:09.950173 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:09.950648 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:09.951093 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:10.097028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:10.109182 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62a66ab0-e691-4694-8a56-913566001921 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.174524 Oct 28 19:36:10.109791 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3070/7809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:09 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:11.133725 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:11.134351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:11.141633 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:11.142131 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:11.142578 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:11.143297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:11.143761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:11.144335 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:11.292996 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:11.301181 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4192a195-179f-43d0-942b-f5fd8a724312 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.171416 Oct 28 19:36:11.301823 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4740/7810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:11 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:12.327369 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:12.327989 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:12.335125 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:12.335700 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:12.336197 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:12.336929 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:12.337404 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:12.337854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:12.537669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:12.546832 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-deedef4a-c7fc-4f9b-b166-066faf2aba04 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.223752 Oct 28 19:36:12.560516 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3071/7811] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:12 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:13.571698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:13.572435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:13.579360 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:13.580048 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:13.580393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:13.581113 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:13.581584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:13.582025 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:13.734165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:13.742776 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-197ef5bd-e8d0-43ea-9d79-b05fc7fd536b tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.175892 Oct 28 19:36:13.743381 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4741/7812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:13 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:14.767948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:14.768810 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:14.776120 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:14.776651 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:14.777104 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:14.777854 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:14.778328 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:14.778763 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:14.926236 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:14.934229 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb8d6abb-90cb-474b-95b2-e4f2cb199e87 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1508 microversion: 2.1 time: 0.171052 Oct 28 19:36:14.934839 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3072/7813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:14 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:14.957500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:14.958141 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:14.965812 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:14.966302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:14.966736 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:14.967441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:14.967924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:14.968352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:14.998848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120680) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 28 19:36:15.068535 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0bd43e06-0fb5-45b3-af84-24c2e256e300 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "POST /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393/action" status: 202 len: 0 microversion: 2.1 time: 0.115212 Oct 28 19:36:15.069503 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4742/7814] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:36:14 2022] POST /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:36:15.078202 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:15.078874 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:15.086633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:15.086633 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:15.086988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:15.087723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:15.088158 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:15.088599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:15.259907 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:15.268637 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dba6013f-aa7e-455d-82b4-3db776e805d1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1516 microversion: 2.1 time: 0.194192 Oct 28 19:36:15.269384 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3073/7815] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:15 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:15.587804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-361c1ac9-cdc0-4de5-9ab2-b0743874de32 req-9c8b6902-541e-4591-9dd1-621d67d291c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08af7121-970c-42f0-b407-9b689c8f6393", "name": "network-vif-unplugged", "status": "completed", "tag": "15cc388c-b666-4e0f-b528-8b23bf93ee59"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:15.598527 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-361c1ac9-cdc0-4de5-9ab2-b0743874de32 req-9c8b6902-541e-4591-9dd1-621d67d291c2 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:15.599094 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-361c1ac9-cdc0-4de5-9ab2-b0743874de32 req-9c8b6902-541e-4591-9dd1-621d67d291c2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:15.599494 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-361c1ac9-cdc0-4de5-9ab2-b0743874de32 req-9c8b6902-541e-4591-9dd1-621d67d291c2 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:15.615584 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.compute.server_external_events [req-361c1ac9-cdc0-4de5-9ab2-b0743874de32 req-9c8b6902-541e-4591-9dd1-621d67d291c2 service nova] Unable to find a host for instance 08af7121-970c-42f0-b407-9b689c8f6393. Dropping event network-vif-unplugged {{(pid=120680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 19:36:15.616552 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-361c1ac9-cdc0-4de5-9ab2-b0743874de32 req-9c8b6902-541e-4591-9dd1-621d67d291c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033481 Oct 28 19:36:15.618326 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4743/7816] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 19:36:16.293714 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:16.294154 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:16.301348 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:16.301850 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:16.302330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:16.303045 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:16.303508 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:16.303981 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:16.448157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:16.456287 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6df04a2d-a47d-4e42-8a37-71b4a82e15e5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1518 microversion: 2.1 time: 0.167404 Oct 28 19:36:16.472085 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3074/7817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:16 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:17.481754 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:17.482570 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:17.489892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:17.490384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:17.490826 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:17.491545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:17.492627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:17.493058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:17.647706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:17.657180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f4a0556d-7234-4060-954c-ea0b2e23dc72 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1518 microversion: 2.1 time: 0.179270 Oct 28 19:36:17.657810 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4744/7818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:17 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:36:18.684137 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:18.684792 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:18.692244 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.692746 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.693199 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.693923 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:18.694391 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:18.695032 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:18.839159 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:18.847505 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a510bf5e-03d7-41a3-89a3-4c0841e0ab5d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1518 microversion: 2.1 time: 0.168680 Oct 28 19:36:18.848136 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3075/7819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:18 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:19.872871 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:19.873499 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:19.880993 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:19.881514 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:19.882148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:19.883643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:19.884321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:19.884761 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:20.058572 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:20.068829 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-79bdd220-7ec2-4061-8216-403e49b6f36d tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1518 microversion: 2.1 time: 0.200251 Oct 28 19:36:20.079488 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4745/7820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:19 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1518 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:21.093227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:21.093857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:21.100895 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:21.101808 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:21.102265 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:21.102998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:21.103466 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:21.103931 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:21.268888 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:21.277692 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f06d9446-9286-4a7b-8822-c6ae711739db tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1518 microversion: 2.1 time: 0.188276 Oct 28 19:36:21.278293 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3076/7821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:21 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:22.301207 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:22.301811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:22.309194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:22.309687 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:22.310130 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:22.310845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:22.311299 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:22.311727 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:22.565322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:22.574806 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eee328b8-16cb-4943-9214-1df22720981e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.277499 Oct 28 19:36:22.575415 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4746/7822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:22 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:22.758852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-040bb4b9-9d78-404a-93e9-1b532c18676f req-40bc67c0-f335-4758-aa53-580285ee651b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08af7121-970c-42f0-b407-9b689c8f6393", "tag": "15cc388c-b666-4e0f-b528-8b23bf93ee59"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:22.769347 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-040bb4b9-9d78-404a-93e9-1b532c18676f req-40bc67c0-f335-4758-aa53-580285ee651b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:22.769838 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-040bb4b9-9d78-404a-93e9-1b532c18676f req-40bc67c0-f335-4758-aa53-580285ee651b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:22.770278 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-040bb4b9-9d78-404a-93e9-1b532c18676f req-40bc67c0-f335-4758-aa53-580285ee651b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:22.782604 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-040bb4b9-9d78-404a-93e9-1b532c18676f req-40bc67c0-f335-4758-aa53-580285ee651b service nova] Creating event network-changed:15cc388c-b666-4e0f-b528-8b23bf93ee59 for instance 08af7121-970c-42f0-b407-9b689c8f6393 on n-h2-862404-2 Oct 28 19:36:22.787860 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-040bb4b9-9d78-404a-93e9-1b532c18676f req-40bc67c0-f335-4758-aa53-580285ee651b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035089 Oct 28 19:36:22.788518 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3077/7823] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:23.598855 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:23.599618 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:23.607365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:23.607874 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:23.608316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:23.609023 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:23.609476 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:23.609901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:23.757472 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:23.765628 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a677c60b-345f-433d-97ea-7d4531ad4e39 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.170803 Oct 28 19:36:23.766320 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4747/7824] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:23 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:24.792270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:24.792988 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:24.799472 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:24.800005 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:24.800451 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:24.801161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:24.801626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:24.802059 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:24.962824 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:24.970789 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-76b4e2e7-0001-45c4-958a-a13dced4900f tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.184787 Oct 28 19:36:24.971372 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3078/7825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:24 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:25.995828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:25.996451 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:26.004079 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:26.004606 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:26.005043 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:26.005742 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:26.006332 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:26.006787 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:26.153600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:26.161757 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-93612b62-74cd-4628-9eee-6920716ee355 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.170939 Oct 28 19:36:26.162359 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4748/7826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:25 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:27.186248 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:27.186869 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:27.193886 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:27.194387 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:27.195342 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:27.196142 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:27.196608 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:27.197069 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:27.338963 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:27.346976 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-503bf23b-7e66-4c99-8a68-4a1f76cf3372 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.164625 Oct 28 19:36:27.347565 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3079/7827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:27 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:28.371525 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:28.372187 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:28.379711 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:28.380246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:28.380686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:28.381395 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:28.381856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:28.382506 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:28.387014 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:28.545877 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:28.559930 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2599ece0-0014-4bbd-82fc-23ed61fdc212 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.192703 Oct 28 19:36:28.561035 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4749/7828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:28 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:29.583622 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:29.584594 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:29.591852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:29.592507 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:29.592954 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:29.593791 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:29.594501 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:29.594972 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:29.747748 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:29.758237 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e9d70bd-d64b-4777-9f1e-91ec041c8a0c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.177891 Oct 28 19:36:29.758947 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3080/7829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:29 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:30.782058 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:30.782637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:30.785384 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:30.790899 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:30.791398 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:30.791857 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:30.792571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:30.793103 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:30.793465 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:30.939024 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:30.947985 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-baab333a-0295-400a-b342-d648f7d2224c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.169673 Oct 28 19:36:30.948674 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4750/7830] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:30 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:31.983928 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:31.984710 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:31.989401 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=31 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:31.994704 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:31.995388 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:31.996019 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:31.996915 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:31.997728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:31.998227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:32.003600 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=87 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:36:32.169681 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:32.179452 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bd5ae3aa-ece8-4582-aafb-91f7ffae8eeb tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.200228 Oct 28 19:36:32.180450 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3081/7831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:31 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:33.204338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:33.205138 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:33.212168 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:33.212660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:33.213095 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:33.213798 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:33.214250 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:33.214674 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:33.354136 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:33.362851 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2674c063-2934-4d3a-958e-8d75c2607162 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.162634 Oct 28 19:36:33.363430 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4751/7832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:33 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:33.909902 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3bd04ca9-5eb7-40c4-bca9-ff8211289d01 req-76494670-9f5d-4e78-9276-751da24ecbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08af7121-970c-42f0-b407-9b689c8f6393", "name": "network-vif-plugged", "status": "completed", "tag": "15cc388c-b666-4e0f-b528-8b23bf93ee59"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:36:33.927287 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3bd04ca9-5eb7-40c4-bca9-ff8211289d01 req-76494670-9f5d-4e78-9276-751da24ecbf9 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:33.927920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3bd04ca9-5eb7-40c4-bca9-ff8211289d01 req-76494670-9f5d-4e78-9276-751da24ecbf9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:33.928296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3bd04ca9-5eb7-40c4-bca9-ff8211289d01 req-76494670-9f5d-4e78-9276-751da24ecbf9 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:33.940901 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3bd04ca9-5eb7-40c4-bca9-ff8211289d01 req-76494670-9f5d-4e78-9276-751da24ecbf9 service nova] Creating event network-vif-plugged:15cc388c-b666-4e0f-b528-8b23bf93ee59 for instance 08af7121-970c-42f0-b407-9b689c8f6393 on n-h2-862404-2 Oct 28 19:36:33.946995 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3bd04ca9-5eb7-40c4-bca9-ff8211289d01 req-76494670-9f5d-4e78-9276-751da24ecbf9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041879 Oct 28 19:36:33.947645 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3082/7833] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:36:34.386818 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:34.387545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:34.394500 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:34.394994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:34.395435 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:34.396184 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:34.396646 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:34.397075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:34.537546 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:34.546300 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c0a5655-8769-40c9-8b58-8aef243be073 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1574 microversion: 2.1 time: 0.163504 Oct 28 19:36:34.546894 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4752/7834] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:34 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:36:35.571984 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:36:35.572718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:36:35.580075 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:35.580581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:35.581038 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:35.581758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:36:35.582233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:36:35.582673 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:36:35.721749 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:36:35.729961 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e000a945-f195-4679-9a4d-49bbdf542eea tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1561 microversion: 2.1 time: 0.163237 Oct 28 19:36:35.730590 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3083/7835] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:36:35 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:53.094897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=5 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:53.095661 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=22 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:53.100550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=5 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:53.101330 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=13 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:37:53.102130 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:37:53.102371 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 (ip 10.222.0.16) !!! Oct 28 19:37:53.104994 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:37:53.106313 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 19:37:53.112439 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:53.112946 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:37:53.118554 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f90a6ce6-bdc2-4b61-9b15-694d795e9877 req-2fc40c85-441f-4351-bc0a-17f170738e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08af7121-970c-42f0-b407-9b689c8f6393", "tag": "15cc388c-b666-4e0f-b528-8b23bf93ee59"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:53.130178 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:53.131660 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:53.132441 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:53.132819 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f90a6ce6-bdc2-4b61-9b15-694d795e9877 req-2fc40c85-441f-4351-bc0a-17f170738e5e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:53.133303 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:53.133495 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f90a6ce6-bdc2-4b61-9b15-694d795e9877 req-2fc40c85-441f-4351-bc0a-17f170738e5e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:53.133901 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:53.134401 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:53.134592 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f90a6ce6-bdc2-4b61-9b15-694d795e9877 req-2fc40c85-441f-4351-bc0a-17f170738e5e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:53.149826 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f90a6ce6-bdc2-4b61-9b15-694d795e9877 req-2fc40c85-441f-4351-bc0a-17f170738e5e service nova] Creating event network-changed:15cc388c-b666-4e0f-b528-8b23bf93ee59 for instance 08af7121-970c-42f0-b407-9b689c8f6393 on n-h2-862404-2 Oct 28 19:37:53.156607 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f90a6ce6-bdc2-4b61-9b15-694d795e9877 req-2fc40c85-441f-4351-bc0a-17f170738e5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058407 Oct 28 19:37:53.157924 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3084/7836] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:53.164841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:37:53.266626 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ccfe79a-eb32-49a2-8dfc-0095ea4f9ae1 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "DELETE /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 204 len: 0 microversion: 2.1 time: 0.173257 Oct 28 19:37:53.271898 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4753/7837] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:37:53 2022] DELETE /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:37:53.280210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:53.280940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:37:53.291795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:53.292599 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:53.293122 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:53.293936 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:53.294476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:53.295010 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:53.454752 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:53.464002 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-704f073d-142b-495d-8313-3062a9480745 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.190208 Oct 28 19:37:53.464623 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3085/7838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:53 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:37:54.487892 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:54.488607 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:37:54.496843 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:54.497363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:54.497805 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:54.498776 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:54.499228 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:54.499657 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:54.722380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:54.736180 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7bd80276-6fe2-4fd3-bea1-b49120dc615e tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1567 microversion: 2.1 time: 0.252194 Oct 28 19:37:54.737120 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4754/7839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:54 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:55.568818 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d2834180-6d5a-4586-866e-b2f69cf8b6aa req-ea0bcdd8-010f-48f6-af35-0ac1736d6c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08af7121-970c-42f0-b407-9b689c8f6393", "name": "network-vif-deleted", "tag": "15cc388c-b666-4e0f-b528-8b23bf93ee59"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:37:55.582585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d2834180-6d5a-4586-866e-b2f69cf8b6aa req-ea0bcdd8-010f-48f6-af35-0ac1736d6c3b service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:55.584296 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d2834180-6d5a-4586-866e-b2f69cf8b6aa req-ea0bcdd8-010f-48f6-af35-0ac1736d6c3b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:55.586144 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d2834180-6d5a-4586-866e-b2f69cf8b6aa req-ea0bcdd8-010f-48f6-af35-0ac1736d6c3b service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:55.598180 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d2834180-6d5a-4586-866e-b2f69cf8b6aa req-ea0bcdd8-010f-48f6-af35-0ac1736d6c3b service nova] Creating event network-vif-deleted:15cc388c-b666-4e0f-b528-8b23bf93ee59 for instance 08af7121-970c-42f0-b407-9b689c8f6393 on n-h2-862404-2 Oct 28 19:37:55.605447 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d2834180-6d5a-4586-866e-b2f69cf8b6aa req-ea0bcdd8-010f-48f6-af35-0ac1736d6c3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041612 Oct 28 19:37:55.606269 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3086/7840] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:37:55.762545 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:55.763110 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:37:55.771577 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:55.772148 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:55.772821 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:55.773554 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:55.774019 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:55.774447 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:55.852105 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:55.863330 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2a489a7d-1d0a-4044-809c-afbc6165bd76 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1219 microversion: 2.1 time: 0.104901 Oct 28 19:37:55.875855 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4755/7841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:55 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:56.892052 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:56.892832 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:37:56.899794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:56.900333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:56.900788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:56.901509 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:56.901978 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:56.902418 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:56.977853 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:56.986368 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20198561-0ed6-4dce-8a2d-e3041eb9effc tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1219 microversion: 2.1 time: 0.099399 Oct 28 19:37:56.986962 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3087/7842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:56 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:58.011362 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:58.012192 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:37:58.019589 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:58.020116 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:58.020555 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:58.021330 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:58.021882 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:58.022322 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:58.092735 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:58.101170 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0479baaa-813e-4f71-b5e6-b7289a5a46a5 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1219 microversion: 2.1 time: 0.093703 Oct 28 19:37:58.107996 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4756/7843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:58 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:37:59.125720 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:37:59.126394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:37:59.134345 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:59.134828 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:59.135276 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:59.136051 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:37:59.136503 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:37:59.136940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:37:59.206689 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:37:59.215082 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3e72327d-c57a-4bc7-a476-5b07141f9306 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1219 microversion: 2.1 time: 0.093632 Oct 28 19:37:59.215665 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3088/7844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:37:59 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:00.240663 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:00.241379 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:00.249521 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:00.250016 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:00.250457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:00.251166 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:00.251622 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:00.252071 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:00.289958 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:00.290449 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:00.290888 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:00.291708 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lazy-loading 'fault' on Instance uuid 08af7121-970c-42f0-b407-9b689c8f6393 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:38:00.336627 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49effaa45a8412dae0671ad54fd60e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1eae9bcf3c431980a72201c2b6ac77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:00.356747 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95a7915d-8625-4d9c-9429-0aaf10280a52 tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 200 len: 1224 microversion: 2.1 time: 0.121328 Oct 28 19:38:00.357830 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4757/7845] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:00 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:01.390482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:01.391170 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] [instance: 08af7121-970c-42f0-b407-9b689c8f6393] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:01.399581 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:01.400145 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:01.400716 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:01.401365 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:01.401957 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:01.402544 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:01.418599 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] HTTP exception thrown: Instance 08af7121-970c-42f0-b407-9b689c8f6393 could not be found. Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Request method failure captured: Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 HTTP/1.1 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXC1a0RRfce3ZXU93Ffq6K9yB-EO96Hxy74VPkZLuCzm8xBpzSHFJhfWlRTUEIKXYGSH4_X0Zph_hgzlbr8-MLIgbolOAnsM9fs0vVpkcMZ4HiW7yVYV4QhHMI4tL2f4J-fyBSGDgJtzotKYqkkEjd7Q866x8Eo7yqVlS2k0sFjBQfaI Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: da1eae9bcf3c431980a72201c2b6ac77 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestShelveInstance-1855477678 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da1eae9bcf3c431980a72201c2b6ac77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/da1eae9bcf3c431980a72201c2b6ac77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_da1eae9bcf3c431980a72201c2b6ac77", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/da1eae9bcf3c431980a72201c2b6ac77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestShelveInstance-1855477678 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: da1eae9bcf3c431980a72201c2b6ac77 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestShelveInstance-1855477678 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestShelveInstance-1855477678-project Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: a49effaa45a8412dae0671ad54fd60e9 Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestShelveInstance-1855477678-project Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance 08af7121-970c-42f0-b407-9b689c8f6393 could not be found. Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': '08af7121-970c-42f0-b407-9b689c8f6393'} Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08af7121-970c-42f0-b407-9b689c8f6393 could not be found. Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08af7121-970c-42f0-b407-9b689c8f6393 could not be found. Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:38:01.420654 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08af7121-970c-42f0-b407-9b689c8f6393 could not be found. Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Returning 404 to user: Instance 08af7121-970c-42f0-b407-9b689c8f6393 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3858775b-17f9-4771-87c4-16f1a06999ee tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393" status: 404 len: 111 microversion: 2.1 time: 0.035757 Oct 28 19:38:01.432176 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3089/7846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:01 2022] GET /compute/v2.1/servers/08af7121-970c-42f0-b407-9b689c8f6393 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:38:01.614644 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70c57472-adc8-463e-adc0-117d9d7ed70c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] Calling method '.version_select at 0x7f78dc9ca430>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:01.646874 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-70c57472-adc8-463e-adc0-117d9d7ed70c tempest-TestShelveInstance-1855477678 tempest-TestShelveInstance-1855477678-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-148839729" status: 202 len: 0 microversion: 2.1 time: 0.035839 Oct 28 19:38:01.647392 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4758/7847] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 19:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-148839729 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:38:20.999738 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=12 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:21.000958 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=24 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:21.246354 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72594aab-c06f-4af7-b226-94e223c06b25 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Action: 'create', calling method: .version_select at 0x7f78dd401310>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-642563786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEpI4LAwObiRuaZDMbgmzUgBu8F/nKxAYajW5QMgZrrILa+0whYHQUM9cVIZasYcIi6LBJMjHagdT1ZjkC7lbtmRyKNHvI2v7DY58Dwnd6fp2bdzKMXRTe3SJJQVKVZBQ=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:21.263857 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-72594aab-c06f-4af7-b226-94e223c06b25 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Getting quotas for project dd8dcb2d05fc4e9d98383beac533b503. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:38:21.269693 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-72594aab-c06f-4af7-b226-94e223c06b25 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Getting quotas for user 26ebd4a5c50946a8b569ed9a85c5e9f1 and project dd8dcb2d05fc4e9d98383beac533b503. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:38:21.311227 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72594aab-c06f-4af7-b226-94e223c06b25 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.316688 Oct 28 19:38:21.311943 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3090/7848] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 19:38:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:38:22.514374 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:22.515134 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:22.519897 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-902477394", "imageRef": "f17ba65f-a473-4179-8631-ca52e11cfd46", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-642563786", "security_groups": [{"name": "tempest-secgroup-smoke-915022956"}], "networks": [{"uuid": "d971e3c0-a96f-48ad-b43b-98f6294254fc"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:22.774559 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] validate_networks() for [('d971e3c0-a96f-48ad-b43b-98f6294254fc', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:38:23.326428 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:38:23.327236 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:38:23.328165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:38:23.328991 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:38:23.329769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:38:23.343579 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:23.344296 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:23.344867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:23.345698 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:23.346245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:23.346686 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:23.366308 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Getting quotas for project dd8dcb2d05fc4e9d98383beac533b503. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:38:23.373721 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.quota [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Getting quotas for user 26ebd4a5c50946a8b569ed9a85c5e9f1 and project dd8dcb2d05fc4e9d98383beac533b503. Resources: {'cores', 'instances', 'ram'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:38:23.388848 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:38:23.391305 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f17ba65f-a473-4179-8631-ca52e11cfd46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:38:23.444486 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd587f25-226e-40ce-b8ca-df7dbcbe261b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.931901 Oct 28 19:38:23.452845 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4759/7849] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:38:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:38:23.460757 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74315f87-624b-4371-a6b7-9fcf8eaf2207 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:23.461421 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74315f87-624b-4371-a6b7-9fcf8eaf2207 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:23.529108 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-74315f87-624b-4371-a6b7-9fcf8eaf2207 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:23.544724 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74315f87-624b-4371-a6b7-9fcf8eaf2207 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1247 microversion: 2.1 time: 0.089025 Oct 28 19:38:23.545428 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3091/7850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:23 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:24.572772 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:24.574077 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:24.581960 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:24.582634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:24.583709 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:24.584601 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:24.585298 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:24.585999 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:24.659124 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:24.668352 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56bf53c1-f246-4ba6-b65b-b6ab0e915de8 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1299 microversion: 2.1 time: 0.099944 Oct 28 19:38:24.683838 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4760/7851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:24 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:25.702384 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:25.703161 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:25.716620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:25.717003 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:25.717677 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:25.718598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:25.719270 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:25.719916 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:25.975229 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:25.983720 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22dd7ec2-c3a2-48fb-bd52-061f501a5d1d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1372 microversion: 2.1 time: 0.285216 Oct 28 19:38:25.984351 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3092/7852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:25 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:38:26.516389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a08a4aec-760a-44ab-bf3e-c0f6366e8d5b req-d2917e56-b99b-45e4-bed6-d996cec65c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae91110a-250d-4db4-aa12-d68beedd6b90", "tag": "4648ce22-de75-4350-b68f-8aabd97f09f6"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:26.528287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a08a4aec-760a-44ab-bf3e-c0f6366e8d5b req-d2917e56-b99b-45e4-bed6-d996cec65c5e service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:26.528869 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a08a4aec-760a-44ab-bf3e-c0f6366e8d5b req-d2917e56-b99b-45e4-bed6-d996cec65c5e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:26.529366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a08a4aec-760a-44ab-bf3e-c0f6366e8d5b req-d2917e56-b99b-45e4-bed6-d996cec65c5e service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:26.544770 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a08a4aec-760a-44ab-bf3e-c0f6366e8d5b req-d2917e56-b99b-45e4-bed6-d996cec65c5e service nova] Creating event network-changed:4648ce22-de75-4350-b68f-8aabd97f09f6 for instance ae91110a-250d-4db4-aa12-d68beedd6b90 on n-h1-862404-2 Oct 28 19:38:26.550453 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a08a4aec-760a-44ab-bf3e-c0f6366e8d5b req-d2917e56-b99b-45e4-bed6-d996cec65c5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101485 Oct 28 19:38:26.551171 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4761/7853] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:38:27.007482 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:27.008151 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:27.015193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:27.015699 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:27.016179 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:27.016901 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:27.017378 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:27.017822 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:27.155550 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:27.164895 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d42fda05-33da-4b00-b6fb-87e5f1b11a32 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1372 microversion: 2.1 time: 0.161825 Oct 28 19:38:27.165523 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3093/7854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:27 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:28.188789 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:28.189541 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:28.197294 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:28.197810 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:28.198246 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:28.198941 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:28.199396 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:28.199867 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:28.336505 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:28.344147 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-28391609-cd9a-4929-8fa5-22f262aa289d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1372 microversion: 2.1 time: 0.159660 Oct 28 19:38:28.344735 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4762/7855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:28 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:29.366881 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:29.367626 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:29.375090 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:29.375654 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:29.376136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:29.376844 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:29.377310 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:29.377787 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:29.517998 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:29.525812 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-82ad0bd3-cab1-4f23-923d-c14b19132be5 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1372 microversion: 2.1 time: 0.163115 Oct 28 19:38:29.526385 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3094/7856] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:29 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:30.548253 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:30.548819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:30.555702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:30.556230 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:30.556680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:30.557383 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:30.557845 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:30.558276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:30.694517 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:30.702694 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77db6179-9e1d-4b42-a226-283e783f47d7 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1372 microversion: 2.1 time: 0.158532 Oct 28 19:38:30.703534 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4763/7857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:30 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:31.726801 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:31.727438 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:31.735028 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:31.735685 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:31.736171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:31.736899 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:31.737409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:31.737858 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:31.875194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:31.883454 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-778b9266-0b4d-402b-88dc-9151268e3ec6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1372 microversion: 2.1 time: 0.161278 Oct 28 19:38:31.884075 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3095/7858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:31 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:32.136979 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c09d64b9-8143-4a36-9463-ae074e557bfe req-e9de1a8e-1b76-47e9-b569-c28ea031aff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae91110a-250d-4db4-aa12-d68beedd6b90", "name": "network-vif-plugged", "status": "completed", "tag": "4648ce22-de75-4350-b68f-8aabd97f09f6"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:32.148924 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c09d64b9-8143-4a36-9463-ae074e557bfe req-e9de1a8e-1b76-47e9-b569-c28ea031aff3 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:32.149444 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c09d64b9-8143-4a36-9463-ae074e557bfe req-e9de1a8e-1b76-47e9-b569-c28ea031aff3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:32.149875 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c09d64b9-8143-4a36-9463-ae074e557bfe req-e9de1a8e-1b76-47e9-b569-c28ea031aff3 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:32.162631 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c09d64b9-8143-4a36-9463-ae074e557bfe req-e9de1a8e-1b76-47e9-b569-c28ea031aff3 service nova] Creating event network-vif-plugged:4648ce22-de75-4350-b68f-8aabd97f09f6 for instance ae91110a-250d-4db4-aa12-d68beedd6b90 on n-h1-862404-2 Oct 28 19:38:32.170174 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c09d64b9-8143-4a36-9463-ae074e557bfe req-e9de1a8e-1b76-47e9-b569-c28ea031aff3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036799 Oct 28 19:38:32.171009 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4764/7859] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:38:32.907326 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:32.907993 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:32.915111 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:32.915620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:32.916113 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:32.916835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:32.917311 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:32.917758 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:33.055164 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:33.063183 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-69a6ff8b-c51a-4e45-a5d3-ace2ba9e5efb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1372 microversion: 2.1 time: 0.159736 Oct 28 19:38:33.069644 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3096/7860] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:32 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:34.087935 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:34.088643 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:34.091393 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:34.092092 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:34.099347 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:34.099804 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:34.100269 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:34.100964 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:34.101417 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:34.101840 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:34.236645 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:34.245217 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4fb6685-842c-4747-bc22-74e556f5978b tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1557 microversion: 2.1 time: 0.162390 Oct 28 19:38:34.245808 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4765/7861] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:34 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:34.267437 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:38:34.268127 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:38:34.270512 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:38:34.276728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:34.277220 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:34.277667 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:34.278373 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:34.278835 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:34.279266 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:34.416809 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:38:34.425115 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cf06b661-9094-4aba-9166-d724da7298bb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1557 microversion: 2.1 time: 0.161497 Oct 28 19:38:34.425725 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3097/7862] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:38:34 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:38:36.471357 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-004206ff-7ef6-4507-8702-cb025f0a7536 req-7224f754-e96b-4b3d-9455-f116c27b60ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae91110a-250d-4db4-aa12-d68beedd6b90", "tag": "4648ce22-de75-4350-b68f-8aabd97f09f6"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:38:36.482802 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-004206ff-7ef6-4507-8702-cb025f0a7536 req-7224f754-e96b-4b3d-9455-f116c27b60ea service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:38:36.483293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-004206ff-7ef6-4507-8702-cb025f0a7536 req-7224f754-e96b-4b3d-9455-f116c27b60ea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:38:36.483733 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-004206ff-7ef6-4507-8702-cb025f0a7536 req-7224f754-e96b-4b3d-9455-f116c27b60ea service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:38:36.499144 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-004206ff-7ef6-4507-8702-cb025f0a7536 req-7224f754-e96b-4b3d-9455-f116c27b60ea service nova] Creating event network-changed:4648ce22-de75-4350-b68f-8aabd97f09f6 for instance ae91110a-250d-4db4-aa12-d68beedd6b90 on n-h1-862404-2 Oct 28 19:38:36.504869 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-004206ff-7ef6-4507-8702-cb025f0a7536 req-7224f754-e96b-4b3d-9455-f116c27b60ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037829 Oct 28 19:38:36.505502 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4766/7863] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:02.383115 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52f951e5-e896-445b-b633-afd01c521d0a] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:41:02.384426 n-d-862404-2 devstack@n-api.service[120679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:41:02.385196 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:02.386147 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=36 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:02.387491 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:41:02.387722 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:41:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90/action (ip 10.222.0.16) !!! Oct 28 19:41:02.390440 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:41:02.390684 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:41:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90/action (ip 10.222.0.16) !!! Oct 28 19:41:02.392928 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:41:02.393132 n-d-862404-2 devstack@n-api.service[120679]: Fri Oct 28 19:41:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90/action (ip 10.222.0.16) !!! Oct 28 19:41:02.399403 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1382375489"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:02.401919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:02.416289 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:02.416788 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:02.417235 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:02.417949 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:02.418415 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:02.418852 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:02.702197 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-36f0a24e-4a62-4a71-9a5b-e66bf65206d6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "POST /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90/action" status: 202 len: 0 microversion: 2.1 time: 0.321995 Oct 28 19:41:02.702846 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3098/7864] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:41:02 2022] POST /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:41:08.710303 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:41:08.711236 n-d-862404-2 devstack@n-api.service[120680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:41:08.711985 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:08.713419 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=32 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:08.714067 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:41:08.714230 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:41:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 19:41:08.715942 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:41:08.716214 n-d-862404-2 devstack@n-api.service[120680]: Fri Oct 28 19:41:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 19:41:08.795699 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f61088c9-a04e-42a4-8270-5fb504e6b55b req-d1a789f6-1689-4441-9539-ecabfc7cd685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae91110a-250d-4db4-aa12-d68beedd6b90", "name": "network-vif-plugged", "status": "completed", "tag": "4648ce22-de75-4350-b68f-8aabd97f09f6"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:08.809316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f61088c9-a04e-42a4-8270-5fb504e6b55b req-d1a789f6-1689-4441-9539-ecabfc7cd685 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:08.809830 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f61088c9-a04e-42a4-8270-5fb504e6b55b req-d1a789f6-1689-4441-9539-ecabfc7cd685 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:08.810406 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f61088c9-a04e-42a4-8270-5fb504e6b55b req-d1a789f6-1689-4441-9539-ecabfc7cd685 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:08.823212 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f61088c9-a04e-42a4-8270-5fb504e6b55b req-d1a789f6-1689-4441-9539-ecabfc7cd685 service nova] Creating event network-vif-plugged:4648ce22-de75-4350-b68f-8aabd97f09f6 for instance ae91110a-250d-4db4-aa12-d68beedd6b90 on n-h1-862404-2 Oct 28 19:41:08.829523 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f61088c9-a04e-42a4-8270-5fb504e6b55b req-d1a789f6-1689-4441-9539-ecabfc7cd685 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121688 Oct 28 19:41:08.830252 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4767/7865] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:21.453878 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:21.454726 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:21.459207 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1707494768", "imageRef": "fad26f30-0de9-4ab0-b190-8a79db398feb", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-642563786", "security_groups": [{"name": "tempest-secgroup-smoke-915022956"}], "networks": [{"uuid": "d971e3c0-a96f-48ad-b43b-98f6294254fc"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:21.485329 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [52f951e5-e896-445b-b633-afd01c521d0a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38436. Oct 28 19:41:21.486343 n-d-862404-2 devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] [16e195db-c99a-4528-a91c-4b6e098442e5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38438. Oct 28 19:41:21.579082 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] validate_networks() for [('d971e3c0-a96f-48ad-b43b-98f6294254fc', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:41:22.011696 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:41:22.012157 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:41:22.012642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:41:22.013062 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:41:22.013491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:41:22.022233 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:22.022728 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:22.023172 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:22.023943 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:22.024409 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:22.024847 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:22.041272 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Getting quotas for project dd8dcb2d05fc4e9d98383beac533b503. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:41:22.046407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.quota [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Getting quotas for user 26ebd4a5c50946a8b569ed9a85c5e9f1 and project dd8dcb2d05fc4e9d98383beac533b503. Resources: {'cores', 'instances', 'ram'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:41:22.059136 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:41:22.061669 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fad26f30-0de9-4ab0-b190-8a79db398feb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:41:22.110722 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e5ba40c9-2b6a-432a-8859-ff506e9f2c68 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.659088 Oct 28 19:41:22.111413 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3099/7866] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 19:41:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:41:22.122706 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:22.123540 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:22.128051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d504f89a-99db-4ae6-9e35-54353042f8f6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:22.128829 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d504f89a-99db-4ae6-9e35-54353042f8f6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:22.143391 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [838da90b-009f-486b-96d4-49ecfb89b483] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38452. Oct 28 19:41:22.144086 n-d-862404-2 devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] [cbb0c4cf-a416-4c32-b724-f7634e302399] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38454. Oct 28 19:41:22.195457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-d504f89a-99db-4ae6-9e35-54353042f8f6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:22.203078 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d504f89a-99db-4ae6-9e35-54353042f8f6 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1248 microversion: 2.1 time: 0.082696 Oct 28 19:41:22.203653 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4768/7867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:22 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:23.228431 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:23.229100 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:23.235539 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:23.236073 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:23.236521 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:23.237232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:23.237695 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:23.238193 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:23.321940 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:23.330309 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d27a3a48-283d-464a-824d-c1ed23d9428a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1300 microversion: 2.1 time: 0.106993 Oct 28 19:41:23.331500 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3100/7868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:23 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:24.357834 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:24.362337 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:24.388157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:24.391671 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:24.393173 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:24.394316 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:24.398152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:24.399126 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:24.627380 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:24.637314 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26016ab1-422b-4570-8f41-3748196a6fca tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.287142 Oct 28 19:41:24.655023 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4769/7869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:24 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:24.840642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a773512a-f504-4ea3-8ddf-ffa090920c70 req-39b490b3-2b06-49a2-bc70-ce043d13588a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae91110a-250d-4db4-aa12-d68beedd6b90", "name": "network-vif-unplugged", "status": "completed", "tag": "4648ce22-de75-4350-b68f-8aabd97f09f6"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:24.866754 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a773512a-f504-4ea3-8ddf-ffa090920c70 req-39b490b3-2b06-49a2-bc70-ce043d13588a service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:24.868408 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a773512a-f504-4ea3-8ddf-ffa090920c70 req-39b490b3-2b06-49a2-bc70-ce043d13588a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:24.869723 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a773512a-f504-4ea3-8ddf-ffa090920c70 req-39b490b3-2b06-49a2-bc70-ce043d13588a service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:24.896475 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a773512a-f504-4ea3-8ddf-ffa090920c70 req-39b490b3-2b06-49a2-bc70-ce043d13588a service nova] Creating event network-vif-unplugged:4648ce22-de75-4350-b68f-8aabd97f09f6 for instance ae91110a-250d-4db4-aa12-d68beedd6b90 on n-h1-862404-2 Oct 28 19:41:24.906113 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a773512a-f504-4ea3-8ddf-ffa090920c70 req-39b490b3-2b06-49a2-bc70-ce043d13588a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077191 Oct 28 19:41:24.907392 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3101/7870] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:25.662194 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:25.663433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:25.670484 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:25.670975 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:25.671410 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:25.672150 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:25.672611 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:25.673046 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:25.832195 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:25.843031 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f1ac2a1-16ce-4beb-a078-a4ca250f1f0f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.184365 Oct 28 19:41:25.843770 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4770/7871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:25 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:26.870366 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:26.871979 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:26.880620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:26.881860 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:26.882642 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:26.883708 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:26.884983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:26.885851 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:27.070629 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:27.080368 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0f43432-c272-480f-931d-d8092ccec328 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.216427 Oct 28 19:41:27.081024 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3102/7872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:26 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:28.105934 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:28.107258 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:28.121717 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:28.122849 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:28.124276 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:28.126705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:28.127654 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:28.128491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:28.303214 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:28.311124 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e764dfa-1571-4e31-bf63-4fd889861754 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.209578 Oct 28 19:41:28.311707 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4771/7873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:28 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:29.338597 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:29.339417 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:29.349209 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:29.350529 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:29.351224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:29.352320 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:29.353017 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:29.353666 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:29.530538 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:29.546712 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-13206bd9-1e31-4276-a5e9-f146d9f6d877 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.213313 Oct 28 19:41:29.549067 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3103/7874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:29 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:30.571140 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:30.571833 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:30.578967 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:30.579456 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:30.579930 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:30.580634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:30.581172 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:30.581600 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:30.749571 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:30.760159 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3b98a5d-6499-4da8-b3af-4d027e8f7c5d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.193066 Oct 28 19:41:30.761447 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4772/7875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:30 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:31.794135 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:31.795063 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:31.814934 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:31.815652 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:31.816303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:31.817224 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:31.817883 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:31.818506 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:32.031585 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:32.054023 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:32.079049 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:32.087582 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94f7f36b-3236-47f9-927c-2159cae58733 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.299257 Oct 28 19:41:32.088602 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3104/7876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:31 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:33.111273 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:33.111932 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:33.114625 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:41:33.120367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:33.120860 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:33.121297 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:33.121998 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:33.122457 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:33.122880 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:33.266970 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:33.278380 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24d318fd-8142-48e2-b2c0-90c4eb111851 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.170843 Oct 28 19:41:33.279034 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4773/7877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:33 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:34.306412 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:34.307044 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:34.314660 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:34.315171 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:34.315803 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:34.317007 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:34.317494 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:34.317964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:34.479720 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-40c5d81c-64ac-42d4-9ce9-8c5e1df46687 req-d4512ade-d512-4899-85fd-88e0cd84e338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a7ad38-3bba-4433-b738-4d5b170b08a3", "tag": "a0348b10-86ff-4499-8ae7-d11183659cec"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:34.495769 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40c5d81c-64ac-42d4-9ce9-8c5e1df46687 req-d4512ade-d512-4899-85fd-88e0cd84e338 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:34.496491 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40c5d81c-64ac-42d4-9ce9-8c5e1df46687 req-d4512ade-d512-4899-85fd-88e0cd84e338 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:34.496923 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-40c5d81c-64ac-42d4-9ce9-8c5e1df46687 req-d4512ade-d512-4899-85fd-88e0cd84e338 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:34.511646 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-40c5d81c-64ac-42d4-9ce9-8c5e1df46687 req-d4512ade-d512-4899-85fd-88e0cd84e338 service nova] Creating event network-changed:a0348b10-86ff-4499-8ae7-d11183659cec for instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 on n-h2-862404-2 Oct 28 19:41:34.518093 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-40c5d81c-64ac-42d4-9ce9-8c5e1df46687 req-d4512ade-d512-4899-85fd-88e0cd84e338 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041512 Oct 28 19:41:34.518748 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4774/7878] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:41:34.581939 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:34.589997 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1de2bfde-fd94-4651-8bb7-640f9cd5322a tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.289119 Oct 28 19:41:34.590703 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3105/7879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:34 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:35.614464 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:35.615321 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:35.622634 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:35.623129 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:35.623575 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:35.624319 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:35.625078 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:35.625520 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:35.780637 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:35.788686 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2d233718-bd69-4210-9394-91b146f87858 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.178529 Oct 28 19:41:35.789297 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4775/7880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:35 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:36.812975 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:36.813534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:36.821333 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:36.821840 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:36.822297 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:36.823021 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:36.823491 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:36.823971 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:36.962492 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:36.970357 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e671d0f3-269d-4008-a7e8-1c9a723b8788 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.161384 Oct 28 19:41:36.970951 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3106/7881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:36 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:37.994389 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:37.994978 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:38.002235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:38.002722 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:38.003157 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:38.003876 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:38.004338 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:38.004765 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:38.147235 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:38.155184 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6048f045-759b-4621-ad60-8ca18fa6a0a0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.165279 Oct 28 19:41:38.155799 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4776/7882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:37 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:39.179473 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:39.180126 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:39.186948 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:39.187442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:39.187920 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:39.188634 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:39.189098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:39.189580 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:39.328030 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a8c485fd-2fce-4006-ba3c-99f3446d60f8 req-744985a5-9dde-404e-8e97-4d90e2308a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a7ad38-3bba-4433-b738-4d5b170b08a3", "name": "network-vif-plugged", "status": "completed", "tag": "a0348b10-86ff-4499-8ae7-d11183659cec"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:39.335106 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:39.341702 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a8c485fd-2fce-4006-ba3c-99f3446d60f8 req-744985a5-9dde-404e-8e97-4d90e2308a55 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:39.342408 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a8c485fd-2fce-4006-ba3c-99f3446d60f8 req-744985a5-9dde-404e-8e97-4d90e2308a55 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:39.343245 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a8c485fd-2fce-4006-ba3c-99f3446d60f8 req-744985a5-9dde-404e-8e97-4d90e2308a55 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:39.345124 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c1ac69cf-f03c-4746-9b49-3d130872e17f tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.170346 Oct 28 19:41:39.345731 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3107/7883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:39 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:39.357519 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a8c485fd-2fce-4006-ba3c-99f3446d60f8 req-744985a5-9dde-404e-8e97-4d90e2308a55 service nova] Creating event network-vif-plugged:a0348b10-86ff-4499-8ae7-d11183659cec for instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 on n-h2-862404-2 Oct 28 19:41:39.362626 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a8c485fd-2fce-4006-ba3c-99f3446d60f8 req-744985a5-9dde-404e-8e97-4d90e2308a55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038539 Oct 28 19:41:39.363250 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4777/7884] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:41:40.370325 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:40.371014 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:40.378210 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:40.378703 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:40.379150 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:40.379890 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:40.380358 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:40.380795 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:40.523227 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:40.532181 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7f42f201-5d3d-4a08-9baf-2d0f6ded7050 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1373 microversion: 2.1 time: 0.165685 Oct 28 19:41:40.532795 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3108/7885] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:40 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:41.556070 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:41.556774 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:41.563152 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:41.563641 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:41.564107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:41.564808 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:41.565263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:41.565690 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:41.704568 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:41.713087 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f42ab6b7-97a0-43bd-bf8b-40f2705fc1f0 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1557 microversion: 2.1 time: 0.162314 Oct 28 19:41:41.713683 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4778/7886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:41 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:41.735571 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:41:41.736232 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:41:41.743625 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:41.744149 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:41.744620 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:41.745324 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:41.745794 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:41.746237 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:41.894528 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:41:41.903349 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c270d9da-8477-4999-aff3-201eb9de1848 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1557 microversion: 2.1 time: 0.171630 Oct 28 19:41:41.903968 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3109/7887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:41:41 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:41:43.587366 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-33d8df30-5c88-4531-9f56-2f6a7dceee4c req-cc93b1bd-f701-4e0b-926e-ab13ec1a4453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a7ad38-3bba-4433-b738-4d5b170b08a3", "tag": "a0348b10-86ff-4499-8ae7-d11183659cec"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:41:43.597675 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-33d8df30-5c88-4531-9f56-2f6a7dceee4c req-cc93b1bd-f701-4e0b-926e-ab13ec1a4453 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:41:43.598165 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-33d8df30-5c88-4531-9f56-2f6a7dceee4c req-cc93b1bd-f701-4e0b-926e-ab13ec1a4453 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:41:43.598604 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-33d8df30-5c88-4531-9f56-2f6a7dceee4c req-cc93b1bd-f701-4e0b-926e-ab13ec1a4453 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:41:43.610489 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-33d8df30-5c88-4531-9f56-2f6a7dceee4c req-cc93b1bd-f701-4e0b-926e-ab13ec1a4453 service nova] Creating event network-changed:a0348b10-86ff-4499-8ae7-d11183659cec for instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 on n-h2-862404-2 Oct 28 19:41:43.615613 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-33d8df30-5c88-4531-9f56-2f6a7dceee4c req-cc93b1bd-f701-4e0b-926e-ab13ec1a4453 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032063 Oct 28 19:41:43.616836 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4779/7888] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:43:11.922959 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:11.923717 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=58 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:11.928698 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-125873998"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:11.931712 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:11.939406 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:11.939922 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:11.940368 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:11.941071 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:11.941534 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:11.941967 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:12.147101 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6957f01f-9472-4a7b-872c-4c4561fb3b55 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "POST /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3/action" status: 202 len: 0 microversion: 2.1 time: 0.225892 Oct 28 19:43:12.147759 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3110/7889] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 19:43:11 2022] POST /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:43:17.861387 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=26 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:17.863292 n-d-862404-2 devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=54 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:17.873151 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8df85912-d5a1-48dc-bdd8-b1a6ef00ef3e req-1c20ea5c-ab5f-4063-8a17-5a0384d083e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a7ad38-3bba-4433-b738-4d5b170b08a3", "name": "network-vif-plugged", "status": "completed", "tag": "a0348b10-86ff-4499-8ae7-d11183659cec"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:17.885302 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8df85912-d5a1-48dc-bdd8-b1a6ef00ef3e req-1c20ea5c-ab5f-4063-8a17-5a0384d083e7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:17.885856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8df85912-d5a1-48dc-bdd8-b1a6ef00ef3e req-1c20ea5c-ab5f-4063-8a17-5a0384d083e7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:17.886287 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8df85912-d5a1-48dc-bdd8-b1a6ef00ef3e req-1c20ea5c-ab5f-4063-8a17-5a0384d083e7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:17.898875 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8df85912-d5a1-48dc-bdd8-b1a6ef00ef3e req-1c20ea5c-ab5f-4063-8a17-5a0384d083e7 service nova] Creating event network-vif-plugged:a0348b10-86ff-4499-8ae7-d11183659cec for instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 on n-h2-862404-2 Oct 28 19:43:17.904846 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8df85912-d5a1-48dc-bdd8-b1a6ef00ef3e req-1c20ea5c-ab5f-4063-8a17-5a0384d083e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046122 Oct 28 19:43:17.906086 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4780/7890] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:43:26.890718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:26.891504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:26.896449 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:26.897098 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:26.906842 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:26.907598 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:26.908282 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:26.909006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:26.909478 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:26.910115 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:26.938855 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:43:26.955352 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-70fb8f03-0a06-4698-a651-16982ea825e2 req-0da090da-6698-4a85-b481-d1d6006c3a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a7ad38-3bba-4433-b738-4d5b170b08a3", "tag": "a0348b10-86ff-4499-8ae7-d11183659cec"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:26.966051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-70fb8f03-0a06-4698-a651-16982ea825e2 req-0da090da-6698-4a85-b481-d1d6006c3a78 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:26.966680 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-70fb8f03-0a06-4698-a651-16982ea825e2 req-0da090da-6698-4a85-b481-d1d6006c3a78 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:26.967351 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-70fb8f03-0a06-4698-a651-16982ea825e2 req-0da090da-6698-4a85-b481-d1d6006c3a78 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:26.981273 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-70fb8f03-0a06-4698-a651-16982ea825e2 req-0da090da-6698-4a85-b481-d1d6006c3a78 service nova] Creating event network-changed:a0348b10-86ff-4499-8ae7-d11183659cec for instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 on n-h2-862404-2 Oct 28 19:43:26.986892 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-70fb8f03-0a06-4698-a651-16982ea825e2 req-0da090da-6698-4a85-b481-d1d6006c3a78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095199 Oct 28 19:43:26.987793 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4781/7891] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:43:27.039867 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9cff155d-2c1c-4d44-9946-d4945e54d434 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 204 len: 0 microversion: 2.1 time: 0.150342 Oct 28 19:43:27.040630 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3111/7892] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:43:26 2022] DELETE /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:27.049705 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:27.050425 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:27.057433 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:27.058585 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:27.059244 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:27.060191 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:27.060819 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:27.061403 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:27.259293 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:27.267158 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad7c90be-db36-47b0-8445-5db9c939cb33 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1682 microversion: 2.1 time: 0.222026 Oct 28 19:43:27.267844 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4782/7893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:27 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:28.297783 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:28.298504 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:28.305686 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:28.306186 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:28.306640 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:28.307344 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:28.307837 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:28.308283 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:28.444046 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:28.452213 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3cf931e-dad0-4952-a946-6f1e95bf76eb tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1682 microversion: 2.1 time: 0.158737 Oct 28 19:43:28.452785 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3112/7894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:28 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:29.364051 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-92ea3888-f90e-4e4b-b34f-94bdebdaaf4a req-9a3ae34a-02bd-499e-9b94-be5c742a3bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a7ad38-3bba-4433-b738-4d5b170b08a3", "name": "network-vif-deleted", "tag": "a0348b10-86ff-4499-8ae7-d11183659cec"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:29.374171 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-92ea3888-f90e-4e4b-b34f-94bdebdaaf4a req-9a3ae34a-02bd-499e-9b94-be5c742a3bfd service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:29.374647 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-92ea3888-f90e-4e4b-b34f-94bdebdaaf4a req-9a3ae34a-02bd-499e-9b94-be5c742a3bfd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:29.375075 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-92ea3888-f90e-4e4b-b34f-94bdebdaaf4a req-9a3ae34a-02bd-499e-9b94-be5c742a3bfd service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:29.387276 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-92ea3888-f90e-4e4b-b34f-94bdebdaaf4a req-9a3ae34a-02bd-499e-9b94-be5c742a3bfd service nova] Creating event network-vif-deleted:a0348b10-86ff-4499-8ae7-d11183659cec for instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 on n-h2-862404-2 Oct 28 19:43:29.391929 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-92ea3888-f90e-4e4b-b34f-94bdebdaaf4a req-9a3ae34a-02bd-499e-9b94-be5c742a3bfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085958 Oct 28 19:43:29.392542 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4783/7895] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:43:29.475968 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:29.477303 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:29.484683 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:29.485194 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:29.485718 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:29.486442 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:29.486919 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:29.487375 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:29.522394 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:29.522805 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:29.524006 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:29.524476 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lazy-loading 'fault' on Instance uuid 23a7ad38-3bba-4433-b738-4d5b170b08a3 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:43:29.566557 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:29.574500 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-63d2f5e3-206a-4dc8-a831-cf1b4e399cbc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 200 len: 1338 microversion: 2.1 time: 0.103202 Oct 28 19:43:29.575076 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3113/7896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:29 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:30.600127 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:30.600841 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: 23a7ad38-3bba-4433-b738-4d5b170b08a3] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:30.607405 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:30.607922 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:30.608365 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:30.609059 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:30.609523 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:30.609951 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:30.623368 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] HTTP exception thrown: Instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 could not be found. Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Request method failure captured: Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 HTTP/1.1 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: Accept: application/json Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: Accept-Encoding: identity Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: Connection: close Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: Content-Length: 0 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: Content-Type: application/json Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: Host: 10.222.0.16 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: Openstack-System-Scope: None Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjXC-n88a6y_TBnpl83ahMpVpv_twpP1epOxuKbdPHs-MLG-58BhGOMBIhBVQUbJyApdfmH9uJp_IXGJMR4N2lYkEDzAPXic6Cm7BVpMtwpyNBOvZKtRDCao6uw-3Y5zstH9ss9P7VU9R-GjxOq1SY10O0ryGtQX5eT3clCyf8440ZXTg Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Id: None Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Domain-Name: None Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Identity-Status: Confirmed Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Is-Admin-Project: True Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Id: default Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Domain-Name: Default Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Id: dd8dcb2d05fc4e9d98383beac533b503 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Project-Name: tempest-TestSnapshotPattern-1472365178 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Role: member,reader Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Roles: member,reader Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd8dcb2d05fc4e9d98383beac533b503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd8dcb2d05fc4e9d98383beac533b503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd8dcb2d05fc4e9d98383beac533b503", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd8dcb2d05fc4e9d98383beac533b503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant: tempest-TestSnapshotPattern-1472365178 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Id: dd8dcb2d05fc4e9d98383beac533b503 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestSnapshotPattern-1472365178 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-User: tempest-TestSnapshotPattern-1472365178-project Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Id: default Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-User-Domain-Name: Default Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-User-Id: 26ebd4a5c50946a8b569ed9a85c5e9f1 Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: X-User-Name: tempest-TestSnapshotPattern-1472365178-project Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: method: > Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: exception: Instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 could not be found. Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: action_args: {'id': '23a7ad38-3bba-4433-b738-4d5b170b08a3'} Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 could not be found. Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 could not be found. Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:43:30.624994 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 could not be found. Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Returning 404 to user: Instance 23a7ad38-3bba-4433-b738-4d5b170b08a3 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-feff229e-8424-4e7f-9cfb-0f77620883bc tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3" status: 404 len: 111 microversion: 2.1 time: 0.031854 Oct 28 19:43:30.630501 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4784/7897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:30 2022] GET /compute/v2.1/servers/23a7ad38-3bba-4433-b738-4d5b170b08a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:43:31.966268 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:31.966911 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:31.969060 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8c2da551-c213-451e-b05a-8a7eb838200d req-933a36d3-3be8-4f6a-8d28-b6287b4e4bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae91110a-250d-4db4-aa12-d68beedd6b90", "tag": "4648ce22-de75-4350-b68f-8aabd97f09f6"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:31.973930 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:31.975081 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:31.975617 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:31.976799 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:31.977288 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:31.977950 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:31.988972 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8c2da551-c213-451e-b05a-8a7eb838200d req-933a36d3-3be8-4f6a-8d28-b6287b4e4bb7 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:31.989811 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8c2da551-c213-451e-b05a-8a7eb838200d req-933a36d3-3be8-4f6a-8d28-b6287b4e4bb7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:31.990459 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8c2da551-c213-451e-b05a-8a7eb838200d req-933a36d3-3be8-4f6a-8d28-b6287b4e4bb7 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:32.005929 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8c2da551-c213-451e-b05a-8a7eb838200d req-933a36d3-3be8-4f6a-8d28-b6287b4e4bb7 service nova] Creating event network-changed:4648ce22-de75-4350-b68f-8aabd97f09f6 for instance ae91110a-250d-4db4-aa12-d68beedd6b90 on n-h1-862404-2 Oct 28 19:43:32.006152 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2721}} Oct 28 19:43:32.014949 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8c2da551-c213-451e-b05a-8a7eb838200d req-933a36d3-3be8-4f6a-8d28-b6287b4e4bb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050002 Oct 28 19:43:32.016532 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4785/7898] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:43:32.113438 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e2207852-d34e-4fef-87dc-2fd7e64758a4 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 204 len: 0 microversion: 2.1 time: 0.151462 Oct 28 19:43:32.114046 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3114/7899] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 19:43:31 2022] DELETE /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:32.125125 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:32.126115 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:32.133950 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:32.135081 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:32.135536 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:32.136363 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:32.136828 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:32.137461 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:32.295155 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.policy [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:32.302677 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a5c0bf3e-3539-4f1f-bdc4-577ee4f5de49 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1681 microversion: 2.1 time: 0.181952 Oct 28 19:43:32.303270 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4786/7900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:32 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:33.328522 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:33.329243 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:33.337894 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:33.338407 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:33.338861 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:33.339588 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:33.340076 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:33.340511 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:33.481016 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.policy [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ebd4a5c50946a8b569ed9a85c5e9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8dcb2d05fc4e9d98383beac533b503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:43:33.489041 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-266d23e4-4aaa-4216-918f-fa57621a1f8d tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 200 len: 1563 microversion: 2.1 time: 0.165146 Oct 28 19:43:33.489632 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3115/7901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:33 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:33.666107 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-dc8d7a40-87aa-4255-b928-4ff67edef256 req-3848a66c-f170-438d-8d80-b9230bc683a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae91110a-250d-4db4-aa12-d68beedd6b90", "name": "network-vif-deleted", "tag": "4648ce22-de75-4350-b68f-8aabd97f09f6"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:43:33.679205 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dc8d7a40-87aa-4255-b928-4ff67edef256 req-3848a66c-f170-438d-8d80-b9230bc683a4 service nova] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:33.679856 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dc8d7a40-87aa-4255-b928-4ff67edef256 req-3848a66c-f170-438d-8d80-b9230bc683a4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:33.680263 n-d-862404-2 devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-dc8d7a40-87aa-4255-b928-4ff67edef256 req-3848a66c-f170-438d-8d80-b9230bc683a4 service nova] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:33.692153 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-dc8d7a40-87aa-4255-b928-4ff67edef256 req-3848a66c-f170-438d-8d80-b9230bc683a4 service nova] Creating event network-vif-deleted:4648ce22-de75-4350-b68f-8aabd97f09f6 for instance ae91110a-250d-4db4-aa12-d68beedd6b90 on n-h1-862404-2 Oct 28 19:43:33.697815 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-dc8d7a40-87aa-4255-b928-4ff67edef256 req-3848a66c-f170-438d-8d80-b9230bc683a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Oct 28 19:43:33.698542 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4787/7902] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 19:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:43:34.514304 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:34.514964 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] [instance: ae91110a-250d-4db4-aa12-d68beedd6b90] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2977}} Oct 28 19:43:34.521841 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:34.522339 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:34.523500 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:34.524247 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Acquiring lock "43f74929-bc21-41df-9120-e6be09c18015" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:43:34.524722 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:43:34.525165 n-d-862404-2 devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Lock "43f74929-bc21-41df-9120-e6be09c18015" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:43:34.538584 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] HTTP exception thrown: Instance ae91110a-250d-4db4-aa12-d68beedd6b90 could not be found. Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Request method failure captured: Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 HTTP/1.1 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: Accept: application/json Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: Accept-Encoding: identity Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: Connection: close Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: Content-Length: 0 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: Content-Type: application/json Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: Host: 10.222.0.16 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: Openstack-System-Scope: None Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjXC-n88a6y_TBnpl83ahMpVpv_twpP1epOxuKbdPHs-MLG-58BhGOMBIhBVQUbJyApdfmH9uJp_IXGJMR4N2lYkEDzAPXic6Cm7BVpMtwpyNBOvZKtRDCao6uw-3Y5zstH9ss9P7VU9R-GjxOq1SY10O0ryGtQX5eT3clCyf8440ZXTg Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Id: None Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Domain-Name: None Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Identity-Status: Confirmed Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Is-Admin-Project: True Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Id: default Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Domain-Name: Default Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Id: dd8dcb2d05fc4e9d98383beac533b503 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Project-Name: tempest-TestSnapshotPattern-1472365178 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Role: member,reader Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Roles: member,reader Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd8dcb2d05fc4e9d98383beac533b503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd8dcb2d05fc4e9d98383beac533b503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd8dcb2d05fc4e9d98383beac533b503", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd8dcb2d05fc4e9d98383beac533b503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}] Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant: tempest-TestSnapshotPattern-1472365178 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Id: dd8dcb2d05fc4e9d98383beac533b503 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestSnapshotPattern-1472365178 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-User: tempest-TestSnapshotPattern-1472365178-project Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Id: default Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-User-Domain-Name: Default Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-User-Id: 26ebd4a5c50946a8b569ed9a85c5e9f1 Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: X-User-Name: tempest-TestSnapshotPattern-1472365178-project Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: method: > Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: exception: Instance ae91110a-250d-4db4-aa12-d68beedd6b90 could not be found. Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: action_args: {'id': 'ae91110a-250d-4db4-aa12-d68beedd6b90'} Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae91110a-250d-4db4-aa12-d68beedd6b90 could not be found. Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae91110a-250d-4db4-aa12-d68beedd6b90 could not be found. Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:43:34.540331 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae91110a-250d-4db4-aa12-d68beedd6b90 could not be found. Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Returning 404 to user: Instance ae91110a-250d-4db4-aa12-d68beedd6b90 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-93a4ac3c-48d4-45dd-b42c-c2c33a23f524 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90" status: 404 len: 111 microversion: 2.1 time: 0.031412 Oct 28 19:43:34.545983 n-d-862404-2 devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3116/7903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 19:43:34 2022] GET /compute/v2.1/servers/ae91110a-250d-4db4-aa12-d68beedd6b90 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:43:34.707367 n-d-862404-2 devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7a081573-db92-46f0-b70e-e7a5ddc03f39 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] Calling method '.version_select at 0x7f78dc5de700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:43:34.731548 n-d-862404-2 devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7a081573-db92-46f0-b70e-e7a5ddc03f39 tempest-TestSnapshotPattern-1472365178 tempest-TestSnapshotPattern-1472365178-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-642563786" status: 202 len: 0 microversion: 2.1 time: 0.029393 Oct 28 19:43:34.732388 n-d-862404-2 devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4788/7904] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 19:43:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-642563786 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)